Multi-Bin Batching for Increasing LLM Inference Throughput
Preprint; under review
Under review.
Ozgur Guldogan
Ph.D. Candidate in Electrical and Computer Engineering at University of California, Santa Barbara
- Santa Barbara, CA
- UC Santa Barbara
- Google Scholar
- GitHub