Any process that modulates the frequency, rate or extent of actin filament annealing, i.e. the end-to-end joining of existing actin filaments.