The Doctor would argue that referencing it isn't the same as 'talking about it'. And in this case, he sort of has to, because it applies.

"Of course. Does anyone else talk like me?"

And now he's North. Way North. An entirely different country north. He's Scottish.

"The only way I can keep track of time here is this..."

He pointedly look at his clapping hand.

"...So, you know, take a wild stab in the dark."