Any process that modulates the frequency, rate or extent of attachment of a cell to the extracellular matrix.