I honestly don't think I'd notice if there were no religious references unless someone else pointed it out! You might want to think about how their cultures would have developed in the absence of religion, though--what kind of art, myth and stories would they have?