I agree. I think, if the spell would create objects that affect creatures physically, it would just be too powerful and have big intersections with other spells.
So, I believe the best way to consider, whether a specific object created with Phantasmal Force would be viable or not, is to apply...