I honestly wasn't surprised Byakuya wouldn't even deign to look at Zommari after beating him; it just screams his usual icy pride, like how he always carries himself. For me, that silence and turning away was way more dramatic and crushing than any final insult could have been, really highlighting just how little Zommari truly meant to him.