Really, just hiking anywhere does it for me, but hiking in a new place really does it!
I recently spent some time on the east coast of Newfoundland, and hoo boy! It's basically endless rocky, jagged coasts dominated by cliffs, and in some of those cliffs are caves!