Rebirth was not the process others would have you believe. Infants, for many years, simply don't retain long term memories the way adults do. My first memory in this life wasn't the interior of my mother's womb, or the grasp of a midwife. It was watching my elder brother practice kenjutsu one last time before leaving for the academy. Specifically, it was the Ninja Academy of the Village Hidden in the Mists. I could only assume that I would be under some sort of social obligation to attend as well.
It took a while before anyone attended the crying toddler.