The process in which a relatively unspecialized cell acquires specialized features of an auditory hair cell.