The speaker does not consider the wall as a necessity, as both apple and pine plantations are naturally separated, but they can see their neighbour prefers to hold the wall up to compensate for his lack of trust towards outsiders.
The speaker remains indiferent regarding the existence of the wall; they would rather not have it, but they are acceptant about it either way.