Loved Ausable Chasm. We did it a few times, and with very young children. Baby in a carrier. But it was scary. Kids were good walkers. As long as baby fit in life jacket they let us do the raft trick back.
One year did a ferry to Vermont - was relaxing break from trip. Did it walking round trip. Had time to just walk around a bit and then take it back.