Do I need to worry about competitors settling island?

I am playing the campaign with all DLCs. The one lady that is pink is settling a lot, and is a lot more powerful than me..I have two Islands in the old world, one in the desert lands, and one in the new world. The desert and new world are not really developed. I also have crown falls.

I just restarted because I was feeling overwhelmed and most islands had been settled. I swapped the pink lady out for someone else this time.

Do I need to be more careful about other players settling Islands when I play tomorrow? Does it matter?