Not absurd. It explains the difference in behavior between believers and non-believers. Believers place high value/importance on morality while non-believers generally do not. Ask an atheist and a Christian the same question about sex, honesty, family, marriage, etc., and you usually get very different answers. The typical non-believing young couple shacks up while the Christian couple waits until marriage for sex. Views on abortion, charity, etc. THere is a big difference. Believers have even been found to have less stress than non-believers.
This is what you believe because you look at believers through rose colored glasses. The fact that we have to deal with is that acknowledged atheists are, on average, better people than we are. They are more honest and less hypocritical. They value humans beings regardless of their belief system.
If you want to see truly caring and moral people take a good hard look at the Buddhists. They do more to help people than any other religion.