Any process that activates or increases the rate or extent of oligodendrocyte progenitor proliferation.