Any process that stops, prevents, or reduces the frequency, rate or extent of neurogenesis, the origin and formation of neurons.