Any process that modulates the frequency, rate or extent of removal of phosphate groups from a protein.