He's a little bit disappointed every time he leaves her. It's not because he has to be away from her. Everyone knows he carries a piece of her with him wherever he goes. No, it isn't because she smiles softly at him, making sure he knows that she'd be right there waiting for him when he comes back home. He's not disappointed in that he won't be able to make her bend and squirm in pleasure when he's out of Konoha. He'll have that part of her engraved in his memory forever. His disappointment doesn't lie completely in that he won't have her touch, her scent or her laughter to surround him.
Mostly his disappointment starts and ends at the same thought- mostly because he knows that every time he walks away from his bubblegum-pink haired wife, he leaves a piece of himself with her and he knows that without her, he will never be whole again. He's only disappointed that he can't leave all of himself in her possession because, really, he belongs to her.