Yes and no.
You could instead take Brutal Defense at level 1, which grants proficiency in Light Armor and lets you use your Strength mod instead of your Dex mod when wearing light armor, allowing you to use magic armor and the like.
Of course, you could simply gain Medium or even Heavy armor proficiency and avoid the Adept options that require light or no armor.
But if you choose the Agile Defense option, then just like a 5e monk your only choice is to up your attributes and find magic items. Unless you wish to take armor proficiency feats (or multiclass) and wear armor. Again, avoiding options that require light or no armor.