Catalysis of the reaction: [isocitrate dehydrogenase] phosphate + H2O = [isocitrate dehydrogenase] + phosphate.