Any process that modulates the frequency, rate or extent of modification of postsynaptic actin cytoskeleton.