Skip to main content

Utility

  • Current Students
  • Faculty & Staff
  • Alumni
  • Office Directory

Actions Menu

  • Visit
  • Give

Main navigation

  • About

    • About Carnegie Mellon
    • Leadership
    • Vision, Mission & Values
    • History
    • Traditions
    • Rankings & Awards
    • Pittsburgh
    • Global Locations
    Students walking up outdoor stairs with backpacks
    Our Strategic Framework

    The Persistent Pursuit of Excellence

    As we celebrate our 125th year, we do so with a renewed sense of purpose. Guided by our strategic vision and driven by our shared values, we are confident that we will rise to meet this moment and continue to lead with distinction in the decades to come.

  • Academics

    • Academics at CMU
    • Majors & Programs
    • Graduate Programs
    • Interdisciplinary Programs
    • Online Education
    • Continuing Education
    • Academic Calendar
    • Pre-College Programs
    • Learning for a Lifetime
    Edda Fields-Black speaking at a podium
    2025 Pulitzer Prize

    CMU professor Edda Fields-Black has won the 2025 Pulitzer Prize in History for her book COMBEE: Harriet Tubman, the Combahee River Raid and Black Freedom during the Civil War, which recounts Tubman's leadership in liberating over 700 enslaved people in 1863.

  • Admission

    • Admissions at CMU
    • Undergraduate Admission
    • Graduate Admission
    • Access & Affordability
    Outdoor clock on campus
    138 Fulbright Students

    Carnegie Mellon has seen 138 Tartans become Fulbright U.S. Student grantees.

  • Campus Life

    • Campus Life at CMU
    • Student Activities
    • Living In Pittsburgh
    • Student Affairs
    • Housing
    • Athletics
    CMU125 The Power of Possibilities decorative graphic
    CMU125

    This 125th anniversary year is a celebration of the milestone moments of the university’s history to date, as well as what CMU will make possible in its next 125 years.

  • Impact

    • Research & Creativity at CMU
    • AI Research at CMU
    • Tony Awards
    • Undergraduate Research
    • Centers & Institutes
    • Libraries
    • Scholars
    Student wearing a machine on her head in the neuroscience lab
    Work That Matters

    From improving health outcomes and enhancing education, to strengthening national security and advancing trustworthy artificial intelligence, our work makes life better for people everywhere. We ask bold questions, solve complex problems and make real change.

Utility

  • Current Students
  • Faculty & Staff
  • Alumni
  • Office Directory

Actions Menu

  • Visit
  • Give

What can we help you find?

Popular Searches

  • Undergraduate Admissions
  • Career Center
  • Majors and Programs
  • Work That Matters
  • Cancer Research
  • Pulitzer Prize

AI and Its Growing Energy Demand

Home / Work That Matters / Energy & Innovation / AI and Its Growing Energy Demand

By: Zico Kolter

AI models, especially the large models powering systems like ChatGPT, have exploded in capabilities and usage over the past years. In response, there have been many commitments from large companies to spend tens or hundreds of billions of dollars to build data centers that can power these AI models.

Why it matters: These data centers, in turn, need to be powered by large amounts of electricity: it’s not uncommon for newly proposed data centers to consume over 1 Gigawatt (GW) of electrical power. By comparison, the entire Pittsburgh area uses an average of between 1-2 GW of electrical power over the course of a day.

The big questions: But why do AI models use this much electricity? What is driving this rapid increase in demand? And perhaps most subjectively, will the resulting increases in AI capabilities and availability be “worth” the cost in power?

Catch up quick: Doing any kind of computation on a computer requires power: to use your laptop, you need to plug it into an outlet, and if you’re doing a particularly intensive task, you’ll likely even notice it heating up from that power consumption. AI models work the same way but on a much larger scale.

The AI models that power systems like ChatGPT work by first transforming the text you type into numbers, then multiplying and adding these numbers many trillions of times, very quickly, to eventually produce a written response, an image, or a video. The costs associated with data centers correspond to: 1) the cost of the building/facilities themselves; 2) the cost of the computer chips that run the computation; and finally 3) the electrical power used to run the chips and run the cooling systems to prevent them from overheating.

The details: AI’s energy demands have grown rapidly for two main reasons. 

  • First, because of a phenomenon called the “scaling laws” of AI models. For several years, researchers have recognized that if you increase the number of computations used by the AI models: say going from 100 billion to 1 trillion to 10 trillion operations to produce an output, then the performance of the resulting model will improve by corresponding amount. Due to the desire to create ever-more-capable models, companies want to create models that use more and more computations, and hence more and more energy.
  • The second reason is due to our increasing use of AI. In the past 2.5 years, AI has grown from a set of niche use cases, to a tool that many of us use every day. Thus, the net effect of larger models and massive growth is a rapidly increasing demand for electrical power, even in light of other improvements of efficiency.

Worth noting: We don’t always need more electrical power to run the AI models: the efficiency of computer chips are also improving exponentially as are the efficiency of the underlying algorithmic approaches themselves, which can offset much of the increase in power.

The big picture: All of this finally leads to the natural question: is this increasing demand for power “worth” its cost? The answer, naturally, depends on our individual perception of the value of AI systems. If you are inherently skeptical about the value provided by AI systems, then you may feel that the benefits do not outweigh the energy costs. But if (and I now have to acknowledge that I place myself in this camp) you believe that AI has the potential to substantially transform our world for the better, then the energy cost may seem to be well worth it.

AI technology, if deployed responsibly, has the potential to drastically increase productivity, to enable us to create software in a faster and more robust manner, to advance science, and to ultimately benefit the human condition. Most revolutions that ultimately have increased the quality of life for the majority of humanity — the industrial revolution, modern transportation, and the introduction of computers — all came with associated increases in energy cost, and AI will likely be no different.

What's next: As work across Carnegie Mellon shows, AI has the potential to drastically improve our energy consumption as well, assisting in developing more efficient techniques for grid operation, building better materials for batteries, and potentially even truly revolutionizing energy through accelerating the development of technologies like nuclear fusion. These are all big bets, to be clear, and advancing science is never a sure thing, but AI at its best can be a unique enabler of so many beneficial downstream technologies.

As we move AI technology forward, and build the needed infrastructure to power this revolution, it is incumbent upon all of us to ensure that the positive impacts of AI are worth the substantial energy cost. Owning to work at Carnegie Mellon and elsewhere, we are well-positioned to meet this challenge.

More on Meeting AI Energy Demand

Building American Strength and Resiliency in Critical Minerals for Energy Storage

How AI Can Unlock Fusion Energy

5000 Forbes Avenue 
Pittsburgh, PA 15213  
(412) 268-2000

About CMU

  • Athletics
  • Events Calendar
  • Careers at CMU
  • Maps, Parking & Transportation
  • Health & Safety
  • News

Academics

  • Majors
  • Graduate
  • Undergrad Admissions
  • Graduate Admissions
  • International Students
  • Scholarship & Financial Aid

Our Impact

  • Centers & Institutes
  • Business Engagement
  • Global Locations
  • Work That Matters
  • Regional Impact
  • Libraries

Top Tools

  • Office Directory
  • Academic Calendar
  • Bookstore
  • Canvas
  • The Hub
  • Workday

Copyright © 2025 Carnegie Mellon University

  • Title IX
  • Privacy
  • Legal