Enables the transfer of acidic amino acids from one side of a membrane to the other. Acidic amino acids have a pH below 7.