Nope, dem's da rules. You haven't missed or misread anything. If you don't like the rules, you or your DM can house rule it differently. There is a feat that does what you ask, "Weapon Finesse." A touch attack is considered a "light weapon." Welcome to D&D.