Any process that modulates the frequency, rate, or extent of an immunoglobulin mediated immune response.