If the goblins are in a castle, with lots of arrows, cauldrons of boiling oil, etc, then they might pose a serious threat, but CR does not take tactical situations into account any more than it does player skill.
Or the goblins in a field might run away and alert the goblin army.
Or maybe the...