Point buy/Standard Array is what the game is balanced around. All of the classes, all of the monsters, spell effects, everything, is all balanced on the assumption of that method of building your character and it makes a huge difference if you deviate from that, for the worse.
Rolling for stats...