top of page
Search

Article by: Olivia Carling, Open Dialogues International Foundation


Social media is often presented as a neutral tool that simply shows users the content they want to see. In reality, platforms such as TikTok, Instagram, YouTube, Facebook, and X (Twitter) are powered by algorithms designed to maximize engagement. Their primary goal is to keep users scrolling, clicking, sharing, and watching for as long as possible. While this business model is highly profitable, growing research suggests that it can also amplify misinformation, reinforce harmful stereotypes, and deepen existing social inequalities.



Algorithms are not inherently racist, sexist, or classist. However, they learn from human behavior and historical data. When those data reflect existing prejudices, the algorithms can reproduce and scale those biases to millions of people. Combined with engagement-driven recommendation systems, this creates a digital environment where misinformation and divisive content often outperform factual and balanced information.


One of the most significant problems is the way algorithms reward emotionally charged content. Studies examining social media recommendation systems have found that content provoking anger, outrage, fear, or hostility tends to generate higher engagement rates than neutral information. Because algorithms interpret engagement as a sign of quality or relevance, they often amplify controversial posts regardless of whether they are accurate. Research published in EPJ Data Science found evidence that X's recommendation system amplified low-credibility content more effectively than higher-credibility information. The study also found increased visibility for highly toxic and politically biased posts, demonstrating how recommendation systems can unintentionally contribute to the spread of misinformation.


This dynamic has real-world consequences. During major political events, public health crises, and social movements, false or misleading information can spread faster than verified reporting. Researchers studying misinformation in the United Kingdom found that approximately one in ten social media users regularly engages in sharing exaggerated or false news stories. While this may appear to be a minority, the scale of modern social media means that even a small percentage of users can significantly influence public opinion.


Algorithms also create what researchers call "filter bubbles" or "echo chambers." By analyzing a user's viewing history, likes, comments, and shares, platforms continuously recommend content that aligns with existing beliefs. While this personalization improves user engagement, it can limit exposure to opposing viewpoints and reinforce pre-existing opinions. Over time, users may become increasingly convinced that their perspective represents the majority view because they rarely encounter alternative perspectives. This process contributes to political polarization and weakens democratic dialogue by encouraging people to consume information that confirms rather than challenges their beliefs.


The impact of these systems extends beyond politics. Increasingly, researchers and educators are expressing concern about how recommendation algorithms shape young people's views on gender, race, and class.


One widely discussed example is the rise of misogynistic content targeting teenage boys. Influencers associated with the so-called "manosphere" have gained enormous visibility through algorithmic recommendations on platforms like TikTok, YouTube, and Instagram. Figures such as Andrew Tate became some of the most searched and recommended personalities online despite repeated criticism for promoting sexist ideas and degrading attitudes toward women.


Andrew Tate on his podcast: Tatecast


A recent Common Sense Media study found that 69% of boys aged 11 to 17 reported regular exposure to online content promoting harmful ideas about masculinity. These messages often portray men as dominant, emotionally detached, and entitled while presenting women as inferior or responsible for men's problems. Importantly, many boys reported being shown this content even when they had not actively searched for it. Recommendation systems identified engagement patterns among similar users and pushed the content into their feeds. 


Teachers across the United Kingdom and Ireland have reported growing concerns about the influence of misogynistic influencers on students. Some educators describe hearing boys repeat phrases and ideas popularized by online personalities, often disguised as jokes or irony. While many young users may initially engage with this content for entertainment, repeated exposure can normalize harmful attitudes. Over time, jokes about women being inferior, manipulative, or responsible for social problems can become accepted as common sense rather than recognized as prejudice.


The same mechanisms that amplify misogyny can also reinforce racism. Algorithms frequently prioritize engagement over social responsibility, meaning content that provokes outrage or controversy may receive increased visibility. Throughout social media history, creators have built large audiences by making racist remarks, promoting stereotypes, or using racial controversy as entertainment. Because such content often generates strong reactions from both supporters and critics, it can receive greater engagement and therefore greater algorithmic amplification.


At the same time, research suggests that creators from marginalized communities often face additional barriers. Studies on shadowbanning and algorithmic visibility have found that women, LGBTQ+ creators, plus-size creators, and other underrepresented groups frequently experience reduced visibility, content suppression, or inconsistent moderation. Automated systems sometimes incorrectly flag cultural content, activism, or discussions about discrimination as inappropriate. As a result, the very groups most affected by bias may find it harder to have their voices heard online.


Classism is another less discussed but equally important issue. Social media algorithms frequently reward content associated with wealth, luxury lifestyles, and consumerism because such content attracts attention and aspirational engagement. Influencers displaying expensive vacations, designer clothing, luxury cars, and lavish homes often receive significant algorithmic promotion. Meanwhile, the realities of poverty, economic insecurity, and working-class experiences tend to receive less visibility. This creates a distorted picture of society in which wealth appears normal and universally attainable, contributing to unrealistic expectations and feelings of inadequacy among viewers.


Above, Charlie D’Amelio, ‘Mr Beast’, and Emma Chamberlain, some of the richest influencers in the world 


For young users, these effects can be particularly powerful. Adolescents are still forming their identities, beliefs, and understanding of the world. When recommendation systems repeatedly expose them to misogynistic influencers, racist stereotypes, misinformation, or unrealistic lifestyles, those messages can gradually shape how they think about social issues and other people. What begins as entertainment can become a framework for understanding gender roles, race relations, economic success, and political identity.


Importantly, researchers emphasize that algorithms do not create these social problems from nothing. Instead, they often reinforce existing societal tensions, prejudices, and inequalities. The problem is that social media allows these patterns to spread faster, reach larger audiences, and become embedded in everyday digital experiences.


As social media becomes increasingly algorithm-driven, the challenge facing technology companies is clear. Platforms must decide whether their systems will continue prioritizing engagement above all else or whether they will begin designing algorithms that value reliability, diversity of perspectives, user well-being, and social responsibility. The future of digital media will not only determine what people see online, it will help shape how future generations understand the world itself.



Bibliography 


Cecere, G., Jean, C., Le Guel, F. and Manant, M. (2024). Artificial Intelligence and Algorithmic bias? Field Tests on Social Network with Teens. Technological Forecasting and Social Change, [online] 201, p.123204. doi:https://doi.org/10.1016/j.techfore.2023.123204.


Draper, D. (2023). The Pros and Cons of Social Media Algorithms. [online] Available at: https://bipartisanpolicy.org/wp-content/uploads/2023/10/BPC_Tech-Algorithm-Tradeoffs_R01.pdf.


Jonker, A. and Rogers, J. (2024). What Is Algorithmic bias? [online] IBM. Available at: https://www.ibm.com/think/topics/algorithmic-bias.


Metzler, H. and Garcia, D. (2023). Social Drivers and Algorithmic Mechanisms on Digital Media. Perspectives on Psychological Science, [online] 19(5), pp.735–748. doi:https://doi.org/10.1177/17456916231185057.


Moore, M. (2025). Meet the Richest Influencers in the World – Including a 12-year-old Child. [online] HELLO! Available at: https://www.hellomagazine.com/celebrities/825736/richest-influencers-world/.


Putri, S.D.G., Purnomo, E.P. and Khairunissa, T. (2024). Echo Chambers and Algorithmic Bias: The Homogenization of Online Culture in a Smart Society. SHS Web of Conferences, [online] 202(1), p.05001. doi:https://doi.org/10.1051/shsconf/202420205001.


Singer, A. (2022). The Negative Effects of Social Media Algorithms. [online] THE PENNSYLVANIA STATE UNIVERSITY SCHREYER HONORS COLLEGE. Available at: https://honors.libraries.psu.edu/files/final_submissions/8388.




On 22nd May, ODIF hosted another inspiring session in our DialogueON series, bringing together participants from across the world to explore the urgent social issues. This month, our event focused on climate justice. In particular, we addressed the disproportionate impact of climate change on women, while also highlighting the critical role that young people play as leaders and advocates within climate movements.


Speaker Insights


We were delighted to welcome our first speaker, Cyrus K. Wea Jr. Cyrus is a youth advocate for youth empowerment and sustainable development. 


Drawing from his experiences in civic engagement and advocacy work, Cyrus explored how climate justice extends far beyond environmental concerns and must also be understood as a human rights, social justice, and economic issue. Throughout his discussion, he emphasised that climate change is not gender neutral. Women and girls, particularly those in vulnerable communities, often face the harshest impacts of environmental degradation.


He highlighted how women play essential roles in food security, agriculture, peacebuilding, and community leadership, yet continue to face barriers including limited land ownership, reduced financial protection, restricted access to education, and heightened vulnerability caused by displacement and poverty. 


However, Cyrus stressed that women are not simply victims of climate change but are already leading climate solutions as teachers, organisers, advocates, and community leaders. His recommendations included stronger government advocacy, gender-responsive climate policies, and increased support for women-led grassroots organisations through NGOs and international institutions. 


Our second speaker, Ache William, reinforced the importance of empowering women not only by giving them opportunities, but by recognising them as the driving force behind climate

action. Ache also stressed the importance of creating opportunities for women across all sectors, including engineering, AI, agriculture, and academia.


Dialogue


For the second half of our event, participants reflected on the barriers women face when responding to climate-related crises, including limited opportunities to relocate from affected areas and unequal access to resources. Questions were raised about what practical measures governments and organisations can implement to ensure women are supported equally and meaningfully within climate resilience efforts.


Several participants emphasised the importance of education and representation. There were calls for more women and girls to attend climate justice events, gain access to higher education, and lead climate-related projects and initiatives. Others discussed how women are often central figures within households and local communities.



Contributions also highlighted the importance of locally led climate action. Participants stressed that climate justice cannot be achieved without amplifying community voices. One participant emphasised the need to “meet women where they are” by creating accessible pathways and recognising the structural barriers that many women face. 


Final Thoughts


The session concluded by emphasising that climate justice cannot exist without gender justice. We want to extend a huge thank you to everyone who shared their perspectives during this dialogue. The conversation reminded us that climate justice is deeply interconnected with dignity, opportunity, education, and equality. By centering women, youth, and grassroots communities within climate solutions, we move closer towards a more just, inclusive, and sustainable future for all.


~Naomi Lea




Article by: Olivia Carling, Open Dialogues International Foundation


Young women participants work together on a laptop during an African Girls Can Code Initiative's coding bootcamp held at the GIZ Digital Transformation Center in Kigali, Rwanda in April 2024. Photo: UN Women


Artificial Intelligence is one of the most powerful inventions of the 21st century. It has the power to reshape our lives, but at the same time is not repellent against the biases and inequalities present in our societies, and can actually deepen the issues. The 2024 study, “Unmasking Inequalities of the Code: Disentangling the Nexus of AI and Inequality”, published in Technological Forecasting and Social Change, explored how AI systems have a huge potential to either reinforce existing divides, or become extremely useful tools for inclusion. All this relies on how they are designed, trained and then governed, the latter being a controversial and difficult topic to touch on, as there are so many unpredictable outcomes of AI integration and use. 


Vulnerable communities are constantly at risk for discrimination, and AI facilitates these dangers to minorities, women and children in new ways, as it develops at such a fast rate that policymakers struggle to address situations before they are already outdated. 



For minorities, biased AI can damage every part of life


AI is usually sold to us as unbiased. However, the data it uses often contains many systemic inequalities and prejudices, reflecting how they operate in the real world. Bad data is implicit in suppressing sections of societies; vulnerable groups like women and minorities are often those targeted. In our last article, Carlotta explored how indigenous voices are essential and must be embedded in AI models to empower minority groups. 


This is also true for other groups. AI that was built in the context of the patriarchy pushes it further, for example, algorithms that learn about how most people in a particular job are male, could then favor male job applications when companies employ these AI systems to sort through applications. The issue with AI having access to all the information of the internet is that our data is polluted by a set of myths and outdated beliefs, all leading to discrimination based on gender, ethnicity and sexual identity. 


The majority of human history is plagued with the idea of establishing particular social and political order, extending privilege to males. In Western societies, this furthers into white males, and the effects of this are still seen today. There is a strong assumption that the residues of racist and sexist discrimination feed into our technology just like how they continue to impact modern life. 


A concerning example of racial bias and how they transfer from our societal issues to technological advances is predictive policing. Predictive policing tools are already controversial, but with the implementation of AI, they can become downright discriminatory, as they make assessments about who will commit future crimes and where these future crimes may occur. They have huge risks of exacerbating historical over policing in disadvantaged communities because of racial and ethnic lines.


"Because law enforcement officials have historically focused their attention on such neighbourhoods, members of communities in those neighbourhoods are overrepresented in police records. This, in turn, has an impact on where algorithms predict that future crime will occur, leading to increased police deployment in the areas in question."


- Said Ashwini K.P. during her interactive dialogue at the Human Rights Council’s 56th session in Geneva. 


According to her findings, location-based predictive policing algorithms draw on links between places, events and historical crime data. They then predict when and where it is likely that future crimes happen, and this impacts how police forces plan their patrols. Some use the argument that because of historical bias and discrimination against minorities, systemic and poverty cycles are pushed resulting in crime. However, this is an outdated argument because statistics in places like the UK and US, ethnic minorities are overrepresented in arrest and incarceration rates because of bias, like how black people are over 3 times more likely to be arrested or deemed suspicious than white people. But, the AI is not trained to explain historical reasons behind locations and arrest numbers. It spits out data; data shaped by discriminatory police and authority figures who are more lenient on white people. Police forces should absolutely not be over relying on predictive AI until the biases can be addressed and accounted for, and a real change is seen. We cannot continue to over punish minorities while letting privileged people off easier, and this issue only gets worse the more we rely on predictive AI that has been trained on bad data. 



Artificial Intelligence and gender inequality


Photo: Lara Jameson on Pexels 


Just as there is a racism problem, our world possesses a gender equality problem, where AI not only mirrors the gender bias, but has already been posing active risks towards gender equality. AI has huge danger risks towards women, as well as minorities, primarily through the increase of gender-based violence and the dehumanization of women. The technology advanced quickly and people have taken advantage of it. The terrifying reality is that anyone with a device can make a deepfake, impacting women’s safety and privacy. Furthermore, this often spills over from online abuse to real-life harm and impacts. AI is actively amplifying violence against women, and showing young generations a gender imbalance between who is harmfully targeted. Technology-facilitated violence against women and girls is growing, with 16-58% of women worldwide impacted, and the scary thing is that lawmakers struggle with keeping up to the ever changing technological developments to be able to properly address the issue. AI tools target women and enable access, blackmail, stalking and harassment that have huge real world consequences. 


Consider this: developed by male teams, the majority of deepfake tools are not even designed to work on images of a man’s body. 


AI is pushing the gender divide and making it dangerous for girls and women to exist in society. An example of this is in Pennsylvania, where two teens used AI to create fake nudes of female classmates and then received probation. The boys were 14 at the time and created about 350 images, showing at least 59 girls under 18. What’s worse is that the judge said he hadn’t heard the boys apologize a single time after giving them several opportunities to comment. Tools like this are dangerous and harmful, and create serious safety concerns for young girls. In an age where social media is widespread and present in everyone’s daily life, it is impossible to remain anonymous and to remove all images on the internet of oneself. 


Until these tools get banned or governed properly, billions of people are threatened, and we will not be rid of this fear. Minorities, women, children, all targeted by dehumanizing and prejudiced people, have their abuse and unfair treatment facilitated through AI, and the technology is only getting better. 


Artificial intelligence is incredibly impressive as a technology, and shows the rapid development of society and innovation. But with innovation and creation comes a responsibility necessary to protect those who are still at a disadvantage because of colonialist and patriarchal mindsets.



Bibliography


Adib-Moghaddam, A. (2023). Biased AI Algorithms Can Damage Almost Every Part Of A Minority’s Life. [online] SOAS. Available at: https://www.soas.ac.uk/about/blogs/minorities-biased-ai-algorithms-can-damage-almost-every-part-life.


Bircan, T. and Özbilgin, M.F. (2024). Unmasking Inequalities of the code: Disentangling the Nexus of AI and Inequality. Technological Forecasting and Social Change, [online] 211, p.123925. doi:https://doi.org/10.1016/j.techfore.2024.123925.


Capraro, V. (2024). The Impact of Generative Artificial Intelligence on Socioeconomic Inequalities and Policy Making. PNAS nexus, [online] 3(6). doi:https://doi.org/10.1093/pnasnexus/pgae191.


Jarvis, H. (2024). How AI Is Hardwiring Inequality — and How It Can Fix Itself. [online] Brunel University of London. Available at: https://www.brunel.ac.uk/news-and-events/news/articles/How-AI-is-hardwiring-inequality-%e2%80%94-and-how-it-can-fix-itself.


Mulvihill, G. (2026). Teens Who Used AI to Create Hundreds of Fake Nudes of Classmates Sentenced to Probation in Pennsylvania. [online] CBS News. Available at: https://www.cbsnews.com/pittsburgh/news/pennsylvania-teenagers-probation-ai-fake-nudes-classmates/.


Schellekens, P. and Skilling, D. (2024). Three Reasons Why AI May Widen Global Inequality. [online] Center for Global Development. Available at: https://www.cgdev.org/blog/three-reasons-why-ai-may-widen-global-inequality.


Scolforo, M. (2026). Pennsylvania Teens Get Probation after Using AI to Create Fake Nudes of Classmates. [online] ABC7 Los Angeles. Available at: https://abc7.com/post/lancaster-pennsylvania-teens-get-probation-using-ai-create-fake-nudes-classmates/18778852/.


UN Women (2024). Artificial Intelligence and Gender Equality. [online] UN Women. Available at: https://www.unwomen.org/en/articles/explainer/artificial-intelligence-and-gender-equality.


UN Women (2025). AI-powered Online abuse: How AI Is Amplifying Violence against Women and What Can Stop It. [online] UN Women. Available at: https://www.unwomen.org/en/articles/faqs/ai-powered-online-abuse-how-ai-is-amplifying-violence-against-women-and-what-can-stop-it.


United Nations (2024). Racism and AI: ‘Bias from the past Leads to Bias in the Future’. [online] United Nations Human Rights (OHCHR). Available at: https://www.ohchr.org/en/stories/2024/07/racism-and-ai-bias-past-leads-bias-future.




OPEN DIALOGUES INTERNATIONAL FOUNDATION

Raise your voice, join the conversation! Everyone matters in an Open Dialogue. 

Join us in the mission of making the world a better place for all.

Subscribe to our mailing list!

Thanks for submitting!

  • Instagram
  • Facebook
  • Twitter
  • LinkedIn
4.png

© 2022-2026 by Open Dialogues International

bottom of page