top of page
From Words to Watts: Benchmarking the Energy Costs of Large Language Model Inference
Reference Type:
Conference Paper
Samsi, Siddharth, Dan Zhao, Joseph McDonald, Baolin Li, Adam Michaleas, Michael Jones, William Bergeron, Jeremy Kepner, Devesh Tiwari, and Vijay Gadepally. 2023. “From Words to Watts: Benchmarking the Energy Costs of Large Language Model Inference.” In 2023 IEEE High Performance Extreme Computing Conference (HPEC), 1–9. Boston, MA, USA: IEEE. https://doi.org/10.1109/HPEC58863.2023.10363447
Download Reference:
Search for the Publication In:
Formatted Reference:
bottom of page