Catalysis of the reaction: a 5,6-dihydrouracil20 in tRNA + NAD(P) <=> H+ + a uracil20 in tRNA + NAD(P)H