In this case, not being able to cast the lower level slots at higher level unnecessarily limits your choices. It feels bad to only use a low level spell instead of a high level spell.
If level 3 spells are fair game, why shouldn't ylu be able to use level 1 spells cast at 3rd level, when those...