It’s a point raised in the movie. There were no people in the buildings because the bombings were done at night and the only people that would be in the buildings were a part of the group and knew to be out of them.