The chemical reactions and pathways involving pentitols, any alditol with a chain of five carbon atoms in the molecule.