You can see that you don't even have to arrive a cyclist, they will loan you a touring bike at the Visitor's Center.
Once out on your loaner bike you can visit the Crazy Russian Girls Bakery. The coffee's free if you arrive on a bike!
The Bennington Arts Guild was even featuring bicycle parts re-made as art in its windows.
I don't know when I'll be back, but I'd love to cycle there again (and at a time that the bakery is open!)