I'm A Banana
Potassium-Rich
Granted, stuff like Miyazaki is big--like the opening of a new Disney animated feature here. But otherwise guys who sit around watching a lot of anime are considered just as dorky in Japan as they are here.
From my experience talking with people who have lived there and actual Japanese people:
No more than Americans sitting around watching Lord of the Rings movies and X-Men movies and Spiderman movies.
In other words, people like good entertainment. There's a slight cultural bias in the US against animation as a universal storytelling vehicle, as opposed to something that's "just for kids," but it's definately nothing major, especially recently (and with the greater use of computer animation).
But people who really love, say, Dragonball Z to the point of obsession are just as dorky in JApan as the guys who really love DBZ here, and people who have an encyclopedic knowledge of Doctor Doom over here are just as nerdy either of 'em.
Dorkiness is evidenced by obsessive fandom in a casual pusuit, right?