Any process that modulates the frequency, rate or extent of thyroid gland epithelial cell proliferation.