It is referring to English colonisation of Australia a few hundred years ago. The English did not learn the indigenous languages there, and they brought English law with them. It also refers to the fact that a lot of convicts were sent to Australia.
Joke: An Englishman gets off the plane, and immigration asks him if he has any criminal convictions. He replies “I didn’t know you still needed one”.
"There's nothing I would rather be
Than to be an Aborigine
And watch you take my precious land away.
For nothing gives me greater joy
Than to watch you fill each girl and boy
With superficial, existential shit.
Now you may think I'm cheeky
But I'd be satisfied
To rebuild your convict ships
And sail them on the tide.
I love the way you give me God
And of course the mining board,
For this of course I thank the Lord each day.
I'm glad you say that land rights wrong.
Then you should go where you belong
And leave me to just keep on keeping on."
Joke: An Englishman gets off the plane, and immigration asks him if he has any criminal convictions. He replies “I didn’t know you still needed one”.