To replace straws, remove the straw by pulling the base of the straw to the side with your thumb and pulling it down to release. The cleaning brush is designed to clean inside the straw.