I don't understand why everyone seems confident that you cannot use feats while polymorphed... does the polymorph spells specifically mentions this? Otherwise, I would expect it depends on the feat.
The target’s game statistics, including mental ability scores, are replaced by the statistics of the chosen beast.
Feats are game statistics, so unless the statistic block of the chosen beast has them, you lose them.