Yugi didn't know how Yami did it. He lit up every room he walked into as if by magic. Maybe it was because he was attractive or maybe it was his voice, but people always gravitated toward him. Yami was always the center of attention.
If Yugi didn't share a body with Yami, he'd be drawn to him as well.