Yes, the water bottle mount is attached to one of the two quick-release aerobars. 


That means that when you remove the aerobars, the water bottle mount also comes off and stays attached to the aerobar.