He didn't think about the silence until much later. It always seemed silent in a fight when he was in the middle of it. The extreme focus, blocking out everything except your goal. He had taken out his sword, and that was the last thing he remembered.
Only later did he think about the roaring of the wind that suddenly stopped. He hadn't thought anyone else might be around. Who else would have gone out in that storm?
No point in dwelling now. It wasn't quite silent in here. He could hear the waves outside. He was leaving Elba, finally.