Any process that modulates the frequency, rate or extent of transcription of a non-protein coding gene from a DNA-template.