Any process involved in the maintenance of an internal steady state of divalent cations at the level of a cell.