Exactly. One of my favourite Lovecraft quotes covers this quite nicely.
There are not many persons who know what wonders are opened to them in
the stories and visions of their youth; for when as children we listen
and dream, we think but half-formed thoughts, and when as men we try
to remember...