A process of peroxisome organization in which assembly or arrangement of constituent parts takes place in the endoplasmic reticulum.