The compiler of this book (may Allah سبحانه وتعالى have mercy on him) commented: The meaning of his statement, "As for avoiding women, no," is that he عليه السلام did not prohibit women from serving him or sitting with him. However, he refrained from intimacy with them, as is evident from the meaning of "he folded up his bedding," which implies abstaining from conjugal relations.
Commentary #1