If you have to wash it by hand, dish soap and water will do the trick most of the time. Drip a little soap into the bottle or mug, add some warm water and scrub away.
You can use a sponge if it fits all the way into the vessel, but we’ve found that most mugs and bottles are too narrow to allow your hand in far enough to reach the bottom, so we recommend bottle brushes.