Any process that modulates the frequency, rate or extent of epithelial cell differentiation involved in kidney development.