Religion is by no means always connected with goodness. In the Greco-Roman world, the two were often entirely separate…the danger was therefore very great that Christianity might be treated in the same way. The early Christians needed to be admonished ever and again that their God was a God of righteousness, that no unclean thing could stand in his presence.
J. Gresham Machen, The New Testament, p. 262.