Inn by the Bandstand lies in the center of town in a gleaming 1809 Federal-style house with nine guest rooms and 10 working fireplaces.