Timing Trick Cuts Energy Used in LLM Training by Up to 14 Percent

Summary

OpenAI’s fourth large language model (LLM), GPT-4, took an estimated 50 gigawatt-hours to train, or the equivalent of 5,000 American homes’ yearly power consumption. That was in 2023. Since then, the computational resources used to train frontier LLMs have only increased, though direct power usage numbers are hard to come by.Now, a research group at the University of Twente in the Netherlands has shown that you can save up to 14 percent of the energy used in LLM training without sacrificing spee

SpinGraph analysis pending — check back after processing.

• AI’s Volatile Power Use Quietly Tests Grid Limits
• Nvidia’s AI Hardware Comes to Windows in RTX Spark PCs
• AI Can Help Track the World’s Shrinking Glaciers
• How a Google DeepMind Spin-off Hunts Hidden Drug Targets
• Visual Language Models Train Robots to Read Human Emotions
• General Motors Is Cutting Its Development Cycles in Half