Search our projects, research and resources
What really powers AI? Data Centres, Energy Use, and the Environmental Cost of Intelligence…
Artificial Intelligence (AI) has seamlessly integrated into our daily lives, powering everything from virtual assistants and AI Agents to personalised recommendations.
However, the convenience and efficiency that AI offers us also comes with significant environmental costs that are often overlooked.
We look at the hidden infrastructure behind AI, exploring how it’s hosted, the workings of data centres, and the environmental implications of this rapidly advancing technology.

1. Where and How Is AI Hosted?
AI models, especially large-scale ones like ChatGPT, don’t reside on personal devices. Instead, they operate on powerful servers housed in data centres worldwide.
These centres are maintained by tech giants such as Amazon Web Services (AWS), Google Cloud, and Microsoft Azure.
In South Africa, AWS launched its first data centre region in Cape Town in 2020, marking a significant step in bringing cloud services closer to African businesses and users.
These data centres provide the computational power necessary for AI operations, from training complex models to handling real-time user queries.
However, this infrastructure demands substantial energy, contributing to the overall carbon footprint of AI technologies.
Reference: Wikipedia

2. What Is a Data Centre and How Does It Work?
A data centre is a facility that houses a network of computing and storage resources, enabling the delivery of shared applications and data.
These centres consist of servers, storage systems, networking equipment, and the necessary infrastructure for power distribution and cooling.
To ensure optimal performance, data centres require:
Reference: Reuters
In South Africa, companies like Teraco operate large-scale data centres, providing infrastructure for various digital services.
These facilities are integral to the functioning of AI applications but also pose environmental challenges due to their energy consumption.
Reference: arXiv

3. How Much Energy Does AI Really Use?
The energy demands of AI are substantial. Training large language models (LLMs) like GPT-3 can consume significant amounts of electricity.
For instance, training GPT-3 is estimated to have consumed 552 metric tons of CO₂, equivalent to the annual emissions of 123 gasoline-powered cars.
Moreover, the operational phase of AI models also requires considerable energy.
A single query to ChatGPT can consume nearly ten times the energy of a typical Google search!
As AI becomes more integrated into various applications, the cumulative energy consumption is poised to increase, raising concerns about sustainability.
Reference: Teen Vogue

4. Cooling, Water Use & Environmental Impact
Beyond electricity, data centres consume vast amounts of water for cooling purposes.
It’s estimated that by 2027, AI could use up to 6.6 billion cubic meters of water annually.
For example, Microsoft’s data centre in Iowa was responsible for 6% of the freshwater use in a local town.
In regions facing water scarcity, such as parts of South Africa, the water usage of data centres can exacerbate existing challenges.
Efforts are being made to develop more water-efficient cooling technologies, but widespread adoption is still in progress.

5. The Race to Green AI: What’s Being Done?
As awareness of AI’s environmental footprint grows, leading tech companies are actively pursuing strategies to mitigate these impacts:
Despite these initiatives, challenges persist.
For instance, the U.S. Department of Energy has identified sites for nuclear-powered data centres to meet AI’s growing energy demands, but the feasibility of such projects within tight timelines remains uncertain.

6. The Human Cost: Ethics and Awareness
Beyond environmental concerns, AI’s expansion raises ethical questions, particularly regarding its societal impacts:
Reference: arXiv
These discussions underscore the necessity of a holistic approach to AI development – one that balances technological advancement with ethical responsibility and environmental knowledge and protection.

So, What Can We Do About It?
As AI continues to evolve, it’s crucial to address the environmental implications proactively.
This involves:
By understanding the environmental challenges posed by AI, and making the necessary changes to the way you use AI tools like ChatGPT.
We can work towards a future where technological innovation and ecological control go hand in hand.
PLEASE SHARE THIS ARTICLE WITH ALL YOUR CONTACTS TO EDUCATE THEM.