Gymnastics or Swimming or both

I recently enrolled my almost 4 year old son in Preschool Gymnastics and he loves going there. I want to enroll him in swimming too for the summer. But the problem is that the only available slots make these lessons back to back. I really hate to take him off gymnastics since he loves it so much but I have no idea if he will enjoy swimming. Also swimming is an essential skill and I hate to wait since many of our friends have swimming pools at home and I want him to learn for his own safety. Do you think it is too much and too exhausting for him? What would you suggest I do? Parents some advice please!