Well, it would be hard to deny the existence of gods in a world where clerics are granted powers.
BUT... the "atheist" PC could see gods as just incredibly powerful badasses that are not necessarily worthy of sucking up to and can be killed. Or, maybe he or she just despises temples.