You have to describe each situation more specifically, as I have no idea. My point is the situation itself puts the two groups into conflict, neither side is responsible for the conflict in the case I just mentioned. As far as the farmer knows the land he wants to build a farmstead out of is unoccupied, he has no evidence to point out to him otherwise until the hunting party of Indians show up.
From the Indians' point of view, they always hunted here, and when the game got scarce, they moved on to some other hunting ground, allowing time for the game to replenish itself, and when the game at the other hunting ground becomes scarce, they move back here. There are not used to farmers or animal domestication, so when they return to this hunting ground, they find a farming family living here, having chopped down the trees, clearing the land for pastures and building fences and they don't like it! Some of the Indians might decide that some of the farm animals look good to eat and might hunt them in their pens, this gets the farmer mad, and he might want to call on some of his neighbors to gather a posse and hunt down those Indians that stole their cattle. This is how conflicts develop. It is very hard for one group to hunt and fish on the same land where another is trying to farm.