The process in which a relatively unspecialized cell acquires specialized features of a glial cell in a lateral line nerve.