Any process that modulates the frequency, rate or extent of the activity of the nerve growth factor (NGF) receptor.