Blue
Ravenous Bugblatter Beast of Traal
In my experience, Ritual Casting helps deal with the issue that otherwise, combat resources and non-combat resources would come out of the same pool, for the characters who rely on spells as their primary combat ability.
No other type of class use the same resource pool for their primary combat ability and for the other pillars. The Warlock is a full caster without Ritual casting - but their spell slots recharge on a short rest so they can get them back and use them both ways. They also have a number of at-will invocations that do more than cantrip-level spells.
If you distill the question you are asking through that lens, it can be restated as "for my table, are the casters able to take too large an advantage of out-of-combat casting"? If they are casting too many spells that they are overshadowing the other characters out-of-combat, then by all means increase the ritual time. If on the other hand it feels that they make an equal (but different) contribution out-of-combat as other classes that have other non-combat features, increased skill lists, etc. - well in that case everyone is getting equal chance at spotlight and I'd say leave it.
No other type of class use the same resource pool for their primary combat ability and for the other pillars. The Warlock is a full caster without Ritual casting - but their spell slots recharge on a short rest so they can get them back and use them both ways. They also have a number of at-will invocations that do more than cantrip-level spells.
If you distill the question you are asking through that lens, it can be restated as "for my table, are the casters able to take too large an advantage of out-of-combat casting"? If they are casting too many spells that they are overshadowing the other characters out-of-combat, then by all means increase the ritual time. If on the other hand it feels that they make an equal (but different) contribution out-of-combat as other classes that have other non-combat features, increased skill lists, etc. - well in that case everyone is getting equal chance at spotlight and I'd say leave it.