We're currently in dungeon where there are several humans and only one light cantrip. So we use torches. It's added some complexity when the DM says, "Aren't you holding a torch?"
You can drop your torch on the ground for free, and draw one weapon as a free action. No problem. But then you want to move. "Do you leave the torch there?" The other option is to use a free action to sheathe your sword and...a full action to pick it up? It gets left.
Since we're playing on a VTT, the DM then removes the light source from the character and makes it stationary. Then (because our DM is evil) the goblins move the fight around a corner...into darkness.
Now, you could ignore ALL of this and still have fun playing. But having to think about what you are holding, and what else you need your hands for, definitely adds complexity. I don't really track who says what on the forum (unless I don't have a choice because they say it 10,000 times) but if the people saying they ignore drawing/holding/picking up, spell components, encumbrance, etc. are the same ones who complain that 5e doesn't have tactics....well....
See, we are talking about different things now.
Spellcasting focuses only take a single hand, or a shield.
Paladin or Cleric? Sure, focus is on their shield, they might have trouble juggling a shield, torch and weapon, if they are in the dark and don't have darkvision. Of course, cleric's can just cast light on their shield, solving that issue.
Warlock, Sorcerer, Wizard, Bard, Druid, Ranger? Most of them don't have or don't use shields. In fact, for most wizards, sorcerers, bards and warlocks? The have a focus in one hand and nothing in their other, so they can easily carry a torch and cast.
And by 4th level, if you are a caster who has this problem, you usually take warcaster which allows you to cast while your hands are full.
So, we have to get fairly specific and in the weeds for this to ever come up needing
1) Multiple people without Darkvision
2) Using a hand-held light source to see in the dark instead of the variety of cantrips that do so
3) They must be wielding a shield, or commonly have a weapon other than a staff (which is an arcane focus) that they wish to hold while casting
4) Not have a feat, ability, or common magical item to counteract that handedness issue
Yes.
The component was right here. I went ahead and bolded it for a second time, since apparently you missed the bold the first time.
"The biggest I can remember doing is hold Person, and again, "This guy gestures, etheral chains explode around you, roll a wisdom save" is generally what happens."
I don't care if you care about the rules. If the casters are gesturing, they are using somatic components. How you got there doesn't matter.
Well, thank you for informing me, I guess I didn't know my own table
But, doesn't hold person have three components? Somatic (gestures), Verbal (specific words of specific intonation and pitch) and Material (holy symbol or length of iron)
Can we really say that I am using components when I'm only using 1/3 of what is required by the rules? You want to say I'm following a set of standards that I am not following, but I don't understand what you think this will accomplish.
You. Our side is just saying no V, S, M.
Wouldn't that, by default, make them hidden?
Unless you are saying that a psionicist should stand there perfectly still and silent, then light up like a christmas tree
The argument from our side is that they don't use V, S, and M. That's it. If some outlier is saying that there shouldn't be any side effects, that's not a strong sentiment from this side of things.
Not from our side, no. That's not what we are asking for. :

:
Ah, so you are willing to die on a hill to split a hair. Carry on I guess.
Edit: Though this still doesn't fix what is an actual balance problem, that is without the limits of speaking or gesturing, you can't shut down a psion like you can every other caster in the game. And that is a legitimate problem, you need a way to stop them from using 90% of their abilities, just like every other caster.
Sincerely very heartening to see others who see VSM on psionics is wrong. And yes, I don't care whether psionics share spell effects, use spell slots, have other components (like for example, PF1's Thought and Emotion, and/or burning ozone smells and glowing skin veins) that can be exploited to detect and/or hinder "casting". Just no reliance on a biophysical vocalization organ + appendage combination.
Even the much referenced Jedi (or any force user in general) theoretically don't "need" vocal chords nor a protein hand (just look at Darth Vader, he's a cyborg during the entire Original Trilogy) to use telekinesis.
You don't need a protein hand in 5e for arcane casting either.
Also, just look at War Caster or Ruby of the War Mage. Both of these allow casting without your hand being free.
Edit Tangent: With the Edit I just made to the response to MaxPerson, I had a thought. Do people allow casters with War Caster to cast spells while bound? I've never encountered it, so I'm not sure what the accepted ruling on that is.