The set of processes involved in identifying and degrading defective or aberrant mRNAs within the nucleus.