Hygiene would be an issue, but you can clean yourself with a cantrip.
The major issue is comfort, but if you're on an adventure in a high danger environment, wearing a headband 24/7 is a small price to pay for more firepower.
Alternatively, you just need to put it on before you prepare spells. You get bonus spell slots (a cleric or druid would have to wear their stat booster for 24 hours, but a wizard wouldn't; must have been thinking of the wrong class earlier) and can load them on the spot.
This is the interpretation I favor.