Any process that modulates the rate, frequency, or extent of cell proliferation involved in embryonic placenta development.