The process in which a relatively unspecialized epithelial cell becomes a more specialized epithelial cell of the mammary gland.