IMO,
Simply holding/ weilding two weapons out does not incur the TWF penalties.
However, if you choose to take an additional attack in that round, you must incur the normal penalties that apply to all those attacks.
If you soleley hold/ weild two weapons, but only chose to take the number...