The process in which a relatively unspecialized precursor cell acquires the specialized features of a follicular dendritic cell.