Can Large Language Models ever be ethical?

Large Language Models (LLMs) have revolutionised the way we interact with technology, but their rapid rise has also sparked deep ethical concerns. From issues surrounding data privacy and copyright infringement to the environmental toll of AI development, many wonder whether these systems can ever truly be ethical. While LLMs offer immense potential across various industries, the growing debate touches on the legality of data scraping, the reinforcement of biases, and the sustainability of these energy-intensive models. This article explores the complexities of AI ethics, offering a balanced perspective on both the challenges and potential solutions.

Introduction

Can Large Language Models ever be ethical? It's a question causing a hot debate in the AI industry lately - data scraping, copyright breaches and environmental costs are all at the pinnacle of the concerns.

While LLMs have transformed the world and revolutionized industries, they are still met with a lot of criticism. Let’s dive into both sides of this question.

Framing the Ethical Concerns

Firmly on the ‘no’ side of the argument, there are key ethical breaches to explore.

AI systems are trained on vast amounts of data scraped from the internet—often without explicit consent from content creators or any regard for copyright laws. This practice has sparked a heated debate about the legality and morality of using publicly available data for training purposes, especially when the resulting AI models generate content that closely resembles or replicates the original work.

LLMs rely on immense datasets scraped from websites, articles, books, and more to understand language patterns and generate human-like responses. However, much of this data includes copyrighted content, which raises critical ethical and legal questions. Is it ethical to train AI models on content that has been created, curated, and owned by others without their permission? And more importantly, is it even legal?

A growing number of lawsuits are pushing courts to address these very issues. For example, in one high-profile case, the New York Times recently sued OpenAI and Microsoft, accusing them of massive copyright infringement related to the training of the LLMs behind ChatGPT and Microsoft’s Copilot. The lawsuit alleges that millions of the Times’ copyrighted works were used without permission, and that the AI tools not only generate verbatim content from these works but also closely summarize them, mimic their expressive style, and falsely attribute outputs to the New York Times.

The outcome of such lawsuits may have far-reaching implications. If the courts rule that the use of copyrighted content to train LLMs constitutes “fair use,” then content creators may receive no compensation for the exploitation of their work. On the other hand, if the courts rule against the AI companies, the damages could run into billions of dollars, potentially forcing a rethink of how these systems are trained.

The New York Times v. Microsoft case is just one example of the litigation LLM developers now face. Similar lawsuits have emerged across different sectors, revealing the widespread concern about unauthorized data usage in AI model training. For instance, Getty Images v. Stability AI accuses the AI company of infringing over 12 million of its copyrighted photographs, claiming that Stability AI used these images (along with their captions and metadata) to train its image-generating tools, Stable Diffusion and DreamStudio. In another case, Concord Music Group, Inc. v. Anthropic PBC, several large music publishers accused Anthropic of improperly copying copyrighted song lyrics to train its Claude AI model.

Bias

One of the major ethical concerns surrounding Large Language Models (LLMs) is the issue of bias. Despite their sophisticated design, these AI systems often perpetuate harmful stereotypes and reinforce societal biases related to gender, race, and even geographic location. Since LLMs are trained on vast datasets sourced from the internet, they inherit the biases that exist within this content, posing significant ethical challenges.

One study took a closer look at the bias in AI-generated content (AIGC) produced by several prominent LLMs, including ChatGPT and LLaMA. Researchers compared news articles generated by these models with original news from sources like The New York Times and Reuters, both of which are committed to producing unbiased news.

The study revealed that the AI-generated content exhibited substantial gender and racial biases. For instance, the AIGC consistently showed discrimination against females and individuals of Black race, even when using neutral news headlines as prompts. Additionally, when biased prompts were deliberately introduced, all LLMs—with the exception of ChatGPT—failed to resist generating biased content. While ChatGPT showed some ability to decline biased prompts, it too was not free from perpetuating stereotypes, highlighting the complex and ingrained nature of bias in these models.

In a separate study, MIT researchers examined how LLMs reinforce harmful stereotypes, particularly in professional and emotional contexts. The team found that biased LLMs tend to associate specific professions with certain genders. For instance, professions like "secretary" or "flight attendant" were disproportionately associated with women, while "lawyer" and "judge" were linked with men. Similarly, emotions like "anxious" and "depressed" were more often labeled as feminine traits.

But bias in LLMs isn't limited to gender or race. Another study, published in OpenReview, explored geographic bias in LLMs, showing that these models often disproportionately represent certain regions of the world. For instance, LLMs may generate content that is skewed toward Western perspectives or urban viewpoints, while marginalizing rural or non-Western voices. This geographic bias can have profound ethical implications, especially when LLMs are used to inform decision-making in global contexts.

While there have been significant strides toward mitigating bias in LLMs, such as incorporating logic-aware models, these solutions are far from perfect. The ethical challenges surrounding bias in AI will require continued effort from researchers, developers, and policymakers alike. As LLMs become more integrated into our lives, addressing these biases is crucial to ensuring that AI technologies do not reinforce harmful stereotypes and inequality.

The question remains: can LLMs ever truly be free from bias, or is this an inevitable consequence of training AI on imperfect human data?

Environmental Impact

While the rise of Large Language Models (LLMs) like GPT-3 and GPT-4 has transformed industries and reshaped the possibilities of AI, their environmental impact cannot be ignored. These powerful AI systems require vast computational resources, and the energy consumed in their development and operation has significant environmental consequences.

The energy required to train these models is staggering. For example, Hugging Face's BLOOM model emitted 25 metric tons of CO2 during its training process—equivalent to the emissions of about 30 flights between New York and London. When factoring in the entire lifecycle, including data storage, hardware maintenance, and cloud computing resources, the total emissions can double, as in the case of BLOOM, which reached 50 metric tons.

Larger models, such as Google’s PaLM with 540 billion parameters, take this issue to another level. These models require thousands of high-performance chips, consuming immense amounts of electricity, much of which is generated using fossil fuels. This dependence on energy-intensive hardware makes the environmental cost of AI model training a growing concern.

Even after training, the operational costs of LLMs are significant. These models continue to require energy-intensive computing resources for tasks like inference and user interaction. For instance, BLOOM emitted 19 kilograms of CO2 daily post-launch—comparable to driving a car for 54 miles every day. With millions of people relying on these models for various applications, the cumulative energy demand adds up, contributing to ongoing carbon emissions.

The environmental toll of LLMs extends beyond electricity consumption. The hardware used in training and running these models also plays a critical role. Manufacturing high-performance chips, maintaining data centers, and managing the electronic waste from outdated hardware all contribute to the overall environmental footprint of AI. The energy required to produce and dispose of this hardware further compounds the ecological impact, especially when considering the lifecycle emissions of these systems.

Drutek’s Stance

While data scraping, copyright infringement, bias and environmental impact clearly place LLMs as unethical and are arguments that cannot be ignored, Drutek takes a middle-ground approach. Let us explain.

Progress with Awareness

Drutek believes that while LLMs are not without flaws, they are far from irredeemable. The solution isn't to halt progress but to move forward with a clear understanding of the challenges. As we innovate, we must acknowledge issues like data usage and environmental impact and actively work toward mitigating them. Transparency, accountability, and commitment to addressing these shortcomings will allow LLMs to evolve in a more ethical direction.

Moreover, if firms were required to pay for the copyrighted material that GenAI tools are trained on, these technologies could struggle to exist in their current form. The delicate balance between innovation and legal constraints must be carefully navigated to ensure both creativity and fairness.

Energy Usage and Greener Future

The environmental costs of LLMs, though significant today, could lead to breakthroughs in sustainability. These AI systems hold the potential to challenge and overthrow how we tackle energy consumption, waste reduction, and other pressing environmental challenges.

LLMs can optimize resource allocation, streamline logistics, and even model solutions for environmental problems. In this sense, their future utility could help counterbalance their current energy demands.

Ethical Gray Areas

We recognize that no technology—or industry, for that matter—is entirely free from ethical complexities. At Drutek, we advocate for incremental progress rather than demanding perfection from the start.

The goal should be continual improvement, addressing biases, minimizing carbon footprints, and ensuring responsible data use as we learn and grow. Ethics in AI will always be a moving target, but that doesn't mean we shouldn't aim to get closer to it with every step forward.

At the heart of Drutek's stance is the belief that LLMs can become more ethical—if we stay aware of their flaws, act responsibly, and strive for progress.

AI Professional’s Opinions

Our Founder, Kevin Coyle adds further insight into Drutek’s Stance:

"Our approach at Drutek is rooted in responsible innovation. While LLMs are far from perfect, we believe their potential to drive positive change—whether in sustainability, healthcare, or industry—can’t be overlooked. The key is to stay aware of the challenges, like data ethics and environmental impact, and actively work to improve them as we move forward.”

Back to Articles

Stay ahead with AI insights

We care about your data. Read our privacy policy.