If the person you are talking to is obsessed with calling white people racists then they will say that that sentence is offensive. I do not consider that sentence to be offensive. I assume "spooked the natives" means that someone did something in the past that scared some group of people by accident or on purpose
@shortstories Thanks. Yeah, seems like best avoided, but the meaning is "not wanting to make people scared by accident"