The first time Shinji Mimura heard the words 'go to hell' was when he was ten. He had taken it upon himself to announce his profound inner feelings of love to the particularly rough looking teenage girl that just happened to pass by his house. He got to hear a lot of other phrases too that were beyond his understanding back then. Those words were much too crude for his liking.
But at age sixteen, Shinji decided he liked this phrase, simply because he managed to clout Toshinori Oda multiple times over the head before he was forced to hear it.