Interacting selectively and non-covalently with any part of a mitochondrial ribosome, a ribosome found in the mitochondrion of a eukaryotic cell.