How do I close a PO that still has a balance?

Send an email to the Purchasing Specialist who handled your order and request a change order to close your PO.

Read more:

Purchasing Manual: Introduction to Procurement Processes, Chapter 2: Purchasing Processes > Making Changes to a Purchase Order.