The controlled breakdown of the membranes of cargo-carrying vesicles formed during peroxisome degradation.