On the hand, this is technically a fair complaint.
On the other, Secret Invasion was apparently so naughty word horrible, that pretending it's not canon or happened in a different universe would be extremely beneficial; so it may not be fair to hold against the film.