Any process that stops, prevents or reduces the frequency, rate or extent of activation of JAK (Janus Activated Kinase) kinase activity.