The Church of the Nativity in the biblical city of Bethlehem was closed indefinitely Thursday amid suspicions that four Palestinians had caught the coronavirus.