On-Device LLM
- 44 papers
- On-Device Language Models: A Comprehensive Review
- MELTing point: Mobile Evaluation of Language Transformers
- Understanding Large Language Models in Your Pockets: Performance Study on COTS Mobile Devices
- LLM Inference at the Edge: Mobile, NPU, and GPU Performance Efficiency Trade-offs Under Sustained Load
Measuring LLM throughput, energy, and thermals on Android phones — what the first mobile harnesses established, and what peak tok/s hides under sustained load.