Any process that modulates the frequency, rate or extent of protein localization to cell-cell junction