top of page

From Words to Watts: Benchmarking the Energy Costs of Large Language Model Inference

Reference Type: 

Conference Paper

Samsi, Siddharth, Dan Zhao, Joseph McDonald, Baolin Li, Adam Michaleas, Michael Jones, William Bergeron, Jeremy Kepner, Devesh Tiwari, and Vijay Gadepally. 2023. “From Words to Watts: Benchmarking the Energy Costs of Large Language Model Inference.” In 2023 IEEE High Performance Extreme Computing Conference (HPEC), 1–9. Boston, MA, USA: IEEE. https://doi.org/10.1109/HPEC58863.2023.10363447

Download Reference:

Search for the Publication In:

Formatted Reference:

bottom of page