A decision may become easier once you stop trying to find the option that keeps everybody equally happy. There may not be one. Focus on what is fair, realistic, and sustainable for you rather than what creates the least immediate discomfort for someone else.
Communication can improve today if you remove the extra explanation. Say what you mean in fewer words and give the other person room to respond. You do not need to soften every boundary until it becomes unclear. A respectful no, a clear yes, or a simple request may do more for a relationship than another round of guessing and accommodating.