Any process that modulates the frequency, rate or extent of cellular respiration, the enzymatic release of energy from organic compounds.