The multiplication or reproduction of skeletal muscle cells, resulting in the expansion of a cell population.