But if you get the basics of a family holiday right, you'll come back with fond memories rather than needing another break to recover.
Follow our tips below to make sure your family holiday goes as smoothly as possible.
It all starts in the planning
• Make a list of the things each member of your family might want from the trip - such as a sandy beach or watersports lessons - and decide whether you all need a rest or are looking for something physically or mentally challenging. Then sort your list into “must haves” and “nice to haves” to help you make a decision.
• Decide on how long you want to be away for.
• Think about the length of the journey your family can cope with. This will vary by the age of your children and how long you, realistically, think they will handle being confined in a plane.
You should now be starting to filter out some destinations. To help you further:
• Think about the time of year you are travelling and do some research on the weather in your potential destinations.
• Find out whether you will need any injections or medication, such as malaria tablets, for any of your short list of destinations and address any health concerns.
• For inspiration, take a look at our article 'The top 10 family destinations in 2013' When you have a short list, it's a good idea to talk through the options with your family so everyone feels involved in the decision. That way, you'll have a better chance of starting off on a good footing.
Doing your research will pay dividends
Time spent researching your trip will really pay off when you are there - you don't want any nasty surprises when you arrive.
Start by looking online and browsing a good cross-section of websites - for example, travel companies and the Foreign and Commonwealth Office - for help and advice on destinations and resorts that are suitable for children and families.
If you still have questions, speak to your local travel agent who should be able to recommend companies and accommodation to suit your needs. You could also pick up brochures for inspiration.
Talk to friends and family to get holiday ideas, and ask your connections on social media platforms for advice and inspiration.
Getting closer? Now refer back to your original list
When you have received recommendations and done your research, it can be all too easy to get carried away and forget your original objective so, before you book, refer back to your “must-haves” list and ask yourself:
1. Will there be enough to keep the kids entertained and will there be other children around for them to play with?
2. Is there a safe beach or pool near your accommodation that the kids can cool off and have fun in?
3. Can you find food nearby (or in your accommodation) for all the family?
4. Does your chosen holiday have all of the facilities and equipment you will need - kids' clubs, cots, high chairs etc.
5. Have you chosen the right accommodation type for all of your family's needs? For example, all-inclusive accommodation could be perfect if you don't want to worry about extra costs while you are in your hotel, but self-catering may be more for you if you like to have more control over what you all eat and drink and when.
How to book
Once you have settled on your holiday choice, it's time to find the best deal. Follow our tips below to secure the best price.
• Compare the price of booking a package holiday with that of buying your flight and hotel separately so you know which the cheapest option is.
• Use a price-comparison site such as TravelSupermarket so you know that the deal you have found is the most competitive around.
• Look out for deals on both deposits and balance payments. And, remember our three golden rules when booking your holiday:
• If you can, book an ATOL or ATOL Flight-Plus protected holiday. If you are unsure whether your holiday is covered, ask before you book.
• Pay by credit card to receive protection under the Consumer Credit Act for transactions of more than £100 (and up to £30,000), or by VISA or MasterCard debit card for charge back protection.
• If you don't book a holiday with ATOL protection, take out a travel insurance policy with end supplier failure as soon as you book. This will protect you from day one should any part of your holiday fail.
Once you are booked, stick a picture of your destination to the fridge so all of the family have something to look forward to and start saving a little straight away so you can all have fun without worrying about the bills you will come back to.