Sand Highway L.L.C., a 14.49-acre sand and gravel mine on Middle Highway in East Hampton, is challenging a 2022 determination by the town’s principal building inspector that its mining activities have surpassed what the town allows. The matter was in front of the town’s zoning board of appeals on May 16. There is a lot of history.