I believe it's not necessarily how challenging a single encounter is, but how often encounters occur before rest/healing.
IIRC, the DMG CR 'system' is designed for 4 characters having 4 encounters before resting. It's a bit weak, IMO.
Back before CRs were created, I routinely had encounters where the monster's HD were equal to 1 to 1 1/2 the party's total level (a formula I still roughly use today). My encounters were considered challenging (a fact the players appreciated). In fact, I've recently ran some generic numbers and found a normal encounter this way in 3.5 is considered "very difficult". As such, my players have been very good about resting before continuing.
So while a single encounter can be challenging, forcing several on the players before they can rest can be devastating*. Having a lot of weaker challenges just sets the players up for underestimating more challenging ones. I like what you have.
*Back in a modified 1e/2e world, we had a DM who when the die indicated we would get a random encounter would roll a d6 to see how many encounters we had. This meant by the time we got to the dungeon we would have to run home. It took us three tries before we ever reached the dungeon (walked in, fought an encounter and ran home).