When you buy a house, condo or townhouse, you know that you are joining an HOA and agree to the rules. It's no different than the airport or tracks - they were there before you were and if you don't like living by community rules, don't live in that community.
I live in a townhouse in an HOA and have fought with the association at times and have been president at times. But we moved in here with open eyes and recognize that we agree that the community rules and we can always move or run for the board if we don't like things.
While president or just a board member, my attitude was always "how can we accommodate the request if possible" rather then just saying "no".
When the association voted to oppose a rezone to allow a "moderate income" development nearby, I totally disagreed with them as they would not be that close (about 1/4 mile from our closest edge to their closest edge and over the hill) but I was outvoted. That's what I gave up by allowing the majority of owners to decide even if they were bigoted. We don't always get what we want.