I think you still want to build in a safeguard for people dipping Class X at level 1, then never taking it again.
Perhaps your class at the first level is your primary class. Your primary class must be your highest level class until you reach level X in your primary class. A simpler rule that...