After months of tinkering with a very challenging project, the Sag Harbor Village Board voted unanimously Tuesday night to set a public hearing on proposed changes to the village code that will allow for affordable housing development in the village.