The Jews were afraid of the people in the land possibly attacking them.

Source: Ezra 3:3