Not necessarily. You can choose to defend yourself and maintain a strong defensive ability while not being aggressive. As Teddy Roosevelt, one of america's second-best presidents said ''Speak softly and carry a big stick, you will go far. ''And then the person who decides not to follow that statement kills you and takes all your stuff. (Star Trek itself did a bit with this where the Mirror Universe Terrans get inspired by Mirror Spock to be less violent and then get conquered by someone else.)
Refusing to engage in war effectively works as a multi-person prisoner's dilemma with large rewards to the first one to break the rules. Even our modern standards, imperfect as they are, are backed by the military and financial power of a large international hegemon which, of course, has its interests come first.
I'm not advocating breaking into the house next door and taking their stuff, but 'might makes right' is the norm historically, and even more so pre-historically, and before that in the animal kingdom. Before that bacteria would secrete toxins to kill other bacteria.
(Perhaps this is the reason stories of paladins and the like are so attractive...we'd like to believe that the people with the power are morally just, because IRL it just isn't so most of the time. There's a well-known franchise where the bad guys win...it's called real life.)
Just because you choose to be generally non aggressive militarily doesn't mean you can't defend yourself and hit an aggressor back hard. That's why America had the nuclear triade strategy for dealing with the mutural assured destruction situation, we had numerous missile bases, both in and out of America , bombers which could stay airborne for several days with refueling and the boomers, our missile subs. It was pretty hard to imagine any plausible scenario that would allow any enemy to take out enough of our deterrent forces to protect him from utter destruction if he attacked.
Frankly I'm neither a Hawk nor a dove, I'm a Raven. I believe in maintaining a strong ready defense but not in bombing anyone who looks at us cross-eyed or refuses our generous offers to run their economy for them.