Formation of a cup-shaped invagination at the posterior end of the embryo, bringing the posterior midgut and hindgut primordia into the interior.