Any process that modulates the frequency, rate or extent of the deposition or modulates the distribution of coloring matter in an organism.