The multiplication or reproduction of spongiotrophoblast cells, resulting in the expansion of the population in the spongiotrophoblast layer.