Who's stopping you? The scouts are a non profit and gyms are businesses. But you don't need a gym to work out and you don't need a clubhouse to do things like the scouts.

Keep it private and you can have all the male only spaces you want. No one will stop you, much less even know, most likely.