Any process resulting in the physical partitioning and separation of an epidermal cell, any of the cells making up the epidermis, into daughter cells.
