There's a difference between the people and the land. His land is the Holy land, but there have been many inhabitants, both His people and not His people, i.e. Joshua and Jericho. His people are any that believe in Jesus as their Lord and Savior.

Galatians 3:16

Now the promises were made to Abraham and to his offspring. It does not say, “And to offsprings,” referring to many, but referring to one, “And to your offspring,” who is Christ.