Any process that modulates the frequency, rate or extent of epithelial cell-cell adhesion involved in epithelium migration.