Compared to having to choose between being murdered, enslaving or moving to Oklahoma (slightly different periods I know..) that's not necessarily that awful.
e.g there were thousands and thousands of Native American refugees fleeing to Spanish Florida from the Carolinas after the British got there. When Florida was captured some were lucky enough to be evacuated to Cuba and other Spanish colonies (in the few ships they were willing and able to send). The rest? Well...