You cannot use the wand without a magic action, it is an item that requires you to use a magic action.
The only difference is that the scroll disintegrates after use, while the wand does not. Fast Hands makes no mention of the magic item needing to disintegrate.
If you use a spell scroll to...