Multi-Bin Batching for Increasing LLM Inference Throughput

Accepted to ACM Transactions on Modeling and Performance Evaluation of Computing Systems (TOMPECS).