“My Fair Lady,” the iconic Lerner and Loewe musical based on George Bernard Shaw’s “Pygmalion,” will open a three-and-a-half-week run at the Bay Street Theater in Sag Harbor on Tuesday. The production is directed by Michael Arlen, a Tony Award nominee and Outer Critics Circle Award-winner for Best Director of a Musical for the Broadway revival of “Spring Awakening.”