There are a number of spells that affect earth or stone, but specifically exempt "worked stone".
Obviously, stone blocks qualify.
Wall of Stone creates "rough stone", but it can be shaped. Is it "worked stone", for purposes of spells like Transmute Rock to Mud or "Soften Earth and Stone
What about rubble-stone walls? That is, walls built by stacking and/or mortaring field stone? (Think of the stone fences of Ireland or New England, assembled from whatever the farmer found in his field, without any attempt to reshape the individual stones.)