Anarchy also says you have the right of free association, so yes that is allowed. The point is that you shouldn’t force people to be part of it, that they can leave at any time and that your freedom to live how you want shouldn’t come at the cost of the freedom of others.