If all ships are roughly the same size (+-1 Class) it should be ok; X-Wing vs big Ship(s) will definitely need adjusted rules.
You won't get hit very often, but one hit would be one too much.
My party runs a class 4 ship; fighters would get auto damage (automatic defence) if they get too close, additionaly it has 4 Attacks