Okay so. The group we saw in the 50th was the gallifreyan High Command. The High Council was busy elsewhere……with the Master, actually.

So sometime between the War Doctor taking the Moment and the Tardis’s to the rescue the events of the “End of Time” took place.

And ten says ‘I don’t want to go’ at the end, because he’s going towards the Oods, and also toward the “End of Time.” Which is also why ten doesn’t have a companion.

We can totally get the Master back now…