Sure enough, but you have to be a Conjurer to do that (at least for a 1-level dip). You can stay full Scout (or Swift Hunter or whatever), not delay your skirmish progression, and just take the Travel Devotion feat to do the same.
Also, Skirmish is just a few d6s extra damage. Guess what the Lion Totem Barbarian or the multi-shadowpouncing, sneak-attacking Shadowlord can do? More damage, and just as reliable - or better in the Barbarian's case, since he doesn't have to worry about concealment and crit-immunes.