Interacting selectively and non-covalently with the aldohexose galactose (galacto-hexose), a common constituent of many oligo- and polysaccharides.