Are you desperate to gt away of construction completely, or just off site.
'Cause it sounds like something in architectural design/draughting would suit you. I don't mean becoming a full blown architect (that'd take years), but doing the 'bog extensions' -little domestic jobs that wouldn't warrant an architects fees. You could meet clients and do surveys in the evenings when people are home from work, and then draw them up at home during the day.
I don't know if there is a market for that sort of thing in the US (or even if it's legal), but I know quite a few people who supplement there income that way over here.
The tricky bit is getting the work, but I assume you have had dealing with builders and architects in the past. Have a word with a big architectural practice and get them to direct any jobs that are too small your way. Alternatively, ask around and see if you can find someone else with the same plan with more jobs on than they can do.
glass.