Several churches have stood where Westminster stands now, the first Christian church was erected there in the seventh century. It is reputed that one of the Roman structures that preceded it was dedicated to Apollo. There was even evidence of a stone circle having existed underneath where the Abbey now stands. Most of this info came from Paul Devereux's "Secrets of Ancient and Sacred Places" which has a detailed section on Westminster Abbey and its pagan origins-check it out!