If the person you are talking to is obsessed with calling white people racists then they will say that that sentence is offensive. I do not consider that sentence to be offensive. I assume "spooked the natives" means that someone did something in the past that scared some group of people by accident or on purpose