Any process that modulates the frequency, rate or extent of the formation of a bipolar filament composed of myosin II molecules.