Good Night, if you are look for a charter, The BVI is fantastic! Time of year is more important than location within The BVI if you are trying to avoid the crowds. You'll find the boat you are looking for there. Lots of charter boat companies to choose from. Voyage, BVI Yacht Charters, TMM, The Moorings/Sunsail, Waypoints, Horizon Yacht Charters. Our two favorites are BVIYC and Voyage. If you need a little more handholding in planning your vacation, work with a boat broker. Each company or broker will have a different price point for your charter.
There are lots of resources for planning what to do. To avoid the crowds, it does slow down in May, but the summer is slower overall compared to Christmas and Spring Break. Top spots to hit are The Baths and The Indians for Snorkeling. I did like snorkeling The Baths, but many people also like to just explore the boulders. If you really want to avoid the crowds from The Baths, go to Old Jerusalem Island instead. few people go there, but has similar boulders. Great snorkeling and amazing boating.
You can stop off at Cooper Island or Norman if you don't want to cook that night. Jost Van Dyke has THE MOST AMAZING white sand beach. Anchor in White Bay and swim to shore. Grab a Painkiller at The Soggy Dollar and spend a day on the beach.
The one thing that I would advise is if you fly into St. Thomas, use a water taxi to get to your charter, if you can swing it. With that many kids...its a little chaotic waiting at the ferry terminal. We've used several different companies, but our favorite is SeaHorse Water Taxi for BVI service. It made it super easy. They had a van waiting at the airport that took us to the marina where a boat was waiting. They checked us into customs in The BVI and dropped us off at our charter boat company. It was so easy! On the way out, they took care of customs and got us to our flight on time. Amy was great! She knows the islands and had great suggestions like hitting The French Bakery before casting off.