Adam Potter has tabled controversial plans for a 79-unit downtown affordable apartment building with 34,000 square feet of retail space, and said he will instead submit plans to Sag Harbor Village for a building with 39 residential units and a third of the retail space originally proposed.