Jimmy Woo use to work for SHIELD, he’s got contacts - so when he came across a disappeared town, he calls his contacts and they contact SWORD due to potential interest.
I still think Wanda is the cause and her not knowing it just points to her trauma. There may be others who got involved (eg Agnes and Hetb) and she may have even opened her world up to the multiverse
The lavender scene in particular points to Agnes attempting to protect the towns folk from ‘evil’ spirits (from the multiverse?).
Of course we still dont know who ‘husband Ralph’ is - that reveal might be critical (or not)