The directed movement of L-ornithine from one side of a membrane to the other into, out of or within a mitochondrion.