There was just one being - Castiel said he was probably a spirit possessing some kind of doll - who could teleport people in and out of a single place. They could be anywhere, and they could go anywhere, but it had to be through that place. I never had any idea how he did it.