Any process that modulates the frequency, rate, or extent of cytokine production that contributes to an immune response.