Any process that modulates the frequency, rate or extent of multiplication or reproduction of fibroblast cells.