The chemical reactions and pathways resulting in the breakdown of glycerolipids, any lipid with a glycerol backbone.