Any process that modulates the frequency, rate or extent of cyclin-dependent protein kinase activity.