The Sag Harbor Village Zoning Board of Appeals listened with apparent empathy on Feb. 19 to neighbors who voiced opposition to plans for a historic house on Garden Street that they said would change the character of the neighborhood and exacerbate flooding, as well as to Dennis Downes, the attorney for the applicant, William Egan. “The neighbors have had a good time stalling this for five years,” Mr. Downes said.