Yes, actually, you could use the greatsword for your regular attack, switch to a scimitar for Extra Attack (+Light/Nick attack), then back to greatsword for your DW bonus action attack.
Dual Wielder specifies it doesn't. Sorry, should have included that. TWF also only affects the attack you get...