According to Ottoman census data, Gaza was majority Jewish in the 1800s. There was also a significant Christian Arab population, with only a few Muslim families. Israel forced out Jews in 2005, thinking it would lead to peace. Gaza became Judenrein. They were rewarded with 10,000 rocket attacks, all the donated greenhouses by left wing Jews, destroyed. So the settler argument is a simple one, if the absence of Jews leads to constant war, then Jews having a say in Gaza and living there again- like they did for thousands of years- would lead to less conflict.
It isn't a sentiment I share, I don't believe you could have real security among such a hostile population. In any case, the majority of the world now recognise HAMAS cannot be part of Gaza's future. But that doesn't mean Israel will automatically be part of it either.