Any process that modulates the frequency, rate or extent of the regulated release of a prostaglandin from a cell.