The process of restoring the photoreceptor cell to its unexcited state after termination of the stimulus (photon).