Sag Harbor Village officials and their counterparts on the Southampton Town Board appear in agreement on a wish to see a portion of the Sag Harbor waterfront revert to public ownership. A developer has been working on a plan for townhouse-style units there and has filed application paperwork with the village. In effect, the structures would wall off that side of Sag Harbor from the water.