Any host process that modulates the frequency, rate, or extent of the antiviral response of a host cell or organism.
