Interacting selectively and non-covalently with a CD4, a receptor found on the surface of T cells, monocytes and macrophages.