So it took a whole bunch of weeks of us using our new Dr. Brown baby bottle brush with the handy-dandy sponge at the end to realize that it's a real problem for Shabbos! I know Munchkin also has a bunch of bottle brushes with a big sponge at the end. Lots of the bottle brushes sold in the frum supermarkets have that sponge...
Beware!