Interacting selectively and non-covalently with a polo box domain of a protein. The polo box domain is involved in binding substrates of polo kinases.