I assumed "pumping energy into the oceans" to be a shorthand for "energy produced on Earth is not radiated into space".
Nope, it was literal. Because for anything else, we get into loss to space, which can be substantial.
...in which case energy from non-renewable sources eventually ends up in the environment as heat.
Well, mostly.
There may be a lag between when energy gets produced and when it eventually ends up in as waste heat, but even if the lag is of the order of decades or even hundred years, it doesn't significantly change the picture.
Picayune aside: Some chemicals we produce, and changes we make, effectively store energy for much longer than a hundred years. Some plastics, for example, don't oxidize on the decade-to-century timescale.
Heck, my suburban house is already over a century old.







