“There is a bigger and bigger fury growing about this. We’re not just going away,” warned Janis Donnaud, a Sag Harbor resident, referring to mounting tensions within the community over the district’s plan to buy five residential lots along Marsden Street and turn them into athletic fields.