Ujala Siddiq Khan-Ethical Challenges AI-MDS-2

Research and Development on Artificial Intelligence (AI) has been making strides for several years but it has only recently started making headlines on an almost daily basis given its impact on various aspects of day-to-day life. Its integration into the systems and processes of the digital world has brought unprecedented revolutions in almost every field, from science and technology to art and literature. For instance, Elon Musk’s Advanced AI machine-learning systems can absorb data and self-improve, potentially leading to a singularity—where AI is likely to (perhaps dangerously) progress uncontrollably, outpacing human abilities—sooner than expected. In this context, there are debates regarding the ethical challenges that it creates and the ways in which AI can and needs to be regulated.

The upside is that AI is aiding people in various fields such as finance, retail, manufacturing, transportation, education, entertainment, hospitality, health, security etc. In weather predictions, satellites utilise AI to process large amounts of data within seconds. The analytical prowess of AI enables accurate forecasting, making it feasible for planners to prepare for extreme weather events beforehand. Similarly, AI is playing a tremendous role in healthcare and cybersecurity by processing vast amounts of data at a swift pace, facilitating quick service delivery and threat mitigation.

The downside is that while AI brings convenience into our lives, it also comes with certain drawbacks. The first challenge is bias and perception. The quality of AI systems relies on the data that they receive. If the collected data is biased, the system will also have biased output.  The lack of transparency concerning the use of AI is another issue. These systems are intricate and hard to comprehend. Global forums are discussing whether some data and algorithms should be made public and, if so, to what extent. Another risk is privacy concerns, as an AI system can collect vast amounts of data about individuals and organisations. Algorithms can twist stories and create narratives by manipulating information across the web. Generative AI can be used for malicious purposes such as infiltration of harmful cybercrimes, greatly disturbing security and stability within communities. Trustworthy AI presents another complex challenge. Ensuring that AI systems align with our values, respect our rights, and establishing methods to measure their performance and impact are significant questions.

Hence, there are growing concerns about the increasing power of AI and the ethical dilemmas it brings. These worries touch on issues like unequal access to innovation and social divisions, challenging the idea of fair progress and shared benefits. As AI develops, it also raises questions about personal rights, such as identity and personal freedom.

States must integrate effective AI policies and regulations into their national security frameworks. These policies and regulations should prioritise the incorporation of AI-relevant curriculum at the national level, crucial for fostering an agile and vigilant environment. This educational approach can empower citizens to recognise and address the ethical challenges posed by AI.

Since the inception of AI policy development, beginning with Canada devising its own AI policy in 2017, around 60 countries have adopted some form of national AI strategy to date. While the formation of such policies within states is in its early stages, establishing harmony among various states’ AI policies could pave the way for easier international harmonisation. Such coordination would enable nations to collaboratively engage in detailed discussions to establish a shared agenda. The aim of a global AI policy should be to establish a unified approach involving all stakeholders. Another mechanism can be through the integration of a catalogue of tools and metrics into AI systems. This catalogue can serve as a comprehensive solution for anyone to exchange methods, practices, and mechanisms for implementing reliable AI. It can also guide on how to use these tools in different contexts and scenarios. One such catalogue has been initiated by the Alan Turing Institute in collaboration with the European Commission.

In conclusion, to regulate AI, nations need to develop their national AI strategies while recognising the importance of global cooperation on knowledge sharing, community building, capacity building and collaboration around AI standards. Such measures are crucial to establish a mature, ethical Al governance ecosystem.

Ujala Siddiq Khan is a Research Assistant at the Centre for Aerospace & Security Studies (CASS), Islamabad, Pakistan. She can be reached at [email protected]

Design credit: Mysha Dua Salman


Share this article

Facebook
Twitter
LinkedIn

Recent Publications

Browse through the list of recent publications.

The US-Israel War on Iran: Objectives, Strategy, and Escalation Management

Zahra Niazi
‘States tend to overestimate themselves or the benefits and swiftness of war, and to underestimate their opponents’ capabilities, intentions, or the costs and duration of war.’ If anything, the 2026 war initiated by the United States and Israel against Iran shall be remembered in the annals of warfare among the most visible manifestations of this dynamic.
The war, immediately preceded by the January mass protests in Iran, did not represent a sudden rupture but rather the continuation of a 47-year-long confrontation and a more intense phase of the June 2025 war.
The US Secretary of War, Pete Hegseth, defined the war’s objectives as being laser-focused: to destroy Iran’s missile capabilities and its security infrastructure, while ensuring that it could never develop nuclear weapons. Beyond these stated objectives, among the priorities on the continuum also lay the objective of regime change, with both President Trump and Prime Minister Netanyahu explicitly calling on the Iranian population to take over the government at the outset of the war.

Read More »

Marka-e-Haq to the Peace Talks: Pakistan’s Middle Power Status

On 7th May 2025, Pakistan’s military forces took the international security community by surprise when it demonstrated operational superiority against its larger belligerent adversary India with its rapid and coordinated response. The Four-Day conflict proved to be a watershed moment for Pakistan, marking its rapid emergence as an important player in the region. In recent years, amidst the ongoing global competition between the United States and China, Islamabad has adopted a position of ’Strategic Balancing,’ where it maintains ties of cooperation with both Beijing and Washington. Deft diplomacy, emphasis on geo-economics, and credible conventional and strategic deterrence have remained the foundational pillars for Pakistan’s ambition as a rising middle power

Read More »

Debunking the S-400 Shield: Lessons from the India-Pakistan Conflict

Air defense has always been a central aspect of warfare. In South Asia, the phenomenon carries immense significance due to compressed reaction times. In this context, one of the most-hyped systems is the Russian-made S-400, touted by New Delhi as a one-stop solution to counter aerial threats from both Pakistan and China.
The 2025 conflict between India and Pakistan marked an important chapter in testing the S-400 technology. The conflict began on May 7, when India attacked what it alleged were terrorist targets in both Pakistani-held Kashmir and Pakistan proper, using drone and missile strikes. The conflict lasted for four days, culminating in a U.S-facilitated ceasefire. However, the brief conflict debunked a lot of the myths regarding the S-400 technology.
First, India claimed that the mobile S-400 would be able to control Pakistan’s airspace. In contrast, Pakistani aircraft continued to operate freely, according to official briefings by the Pakistani military. Although the Pakistan Air Force (PAF) aircraft were in their own airspace, they were still within the air defense range.

Read More »