The inner, i.e. lumen-facing, lipid bilayer of the cyanelle envelope; also faces the cyanelle stroma.