This probably plays into their desire to remain isolated. If every time some wanderer landed on their island a lot of their people died then it makes sense that they would not welcome anyone from outside.