At Smart Story Labs, we are excited to announce a new GitHub project that dives into the transmedia narrative of Yakshi – reimagining this South Asian folklore spirit as a lens to explore cross-cultural storytelling, feminist hauntings, and ecological narratives.
Category: Topic: Tech & Society (STS)
Research Topic: Tech & Society (STS)
-
IndicMMLU-Pro: Benchmarking Indic Large Language Models on Multi-Task Language Understanding
Known by more than 1.5 billion people in the Indian subcontinent, Indic languages present unique challenges and opportunities for natural language processing (NLP) research due to their rich cultural heritage, linguistic diversity, and complex structures. IndicMMLU-Pro is a comprehensive benchmark designed to evaluate Large Language Models (LLMs) across Indic languages, building upon the MMLU Pro (Massive Multitask Language Understanding) framework. Covering major languages such as Hindi, Bengali, Gujarati, Marathi, Kannada, Punjabi, Tamil, Telugu, and Urdu, our benchmark addresses the unique challenges and opportunities presented by the linguistic diversity of the Indian subcontinent. This benchmark encompasses a wide range of tasks in language comprehension, reasoning, and generation, meticulously crafted to capture the intricacies of Indian languages. IndicMMLU-Pro provides a standardized evaluation framework to push the research boundaries in Indic language AI, facilitating the development of more accurate, efficient, and culturally sensitive models. This paper outlines the benchmarks’ design principles, task taxonomy, and data collection methodology, and presents baseline results from state-of-the-art multilingual models.
-
Towards regulating AI : A natural, labour and capital resources perspective
Policymakers who are looking at artificial intelligence (AI) applications are thinking about what we as a society want to achieve and what we need to protect, yet it is not commonly known that AI apps require intensive natural resources, labour and capital.
-
Ceiba Law Firm Annual Retreat
We were pleased to be of service to Ceiba Law for their annual retreat this year. Our director Tammy Mackenzie joined the firm partners and associates to discuss the changes and opportunities of AI for lawyers in cybersecurity and corporate law. A huge shout out to partners Vanessa Henri, Elodie Meyer and Shawn Ford for an invigorating retreat and inspiring firm ethos. A law firm purpose built for the 21st century.
-
GenAI and Religion: Creation, Agency, and Meaning
This paper explores the parallels between Generative Artificial Intelligence (GenAI) and religious systems in three domains: creation, agency, and meaning-making. Both offer frameworks for human engagement but differ in intent, autonomy, and moral accountability. Despite these differences, GenAI and religion share roles as creators, influencers, and meaning facilitators. We address and counter rebuttals to these parallels, highlighting GenAI’s co-constructed outputs and its impact on modern meaning-making. The paper concludes with the societal implications of these parallels in shaping future thought and action.
-
Trustworthy and Responsible AI for Human-Centric Autonomous Decision-Making Systems
Artificial Intelligence (AI) has paved the way for revolutionary decision-making processes, which if harnessed appropriately, can contribute to advancements in various sectors, from healthcare to economics. However, its black box nature presents significant ethical challenges related to bias and transparency. AI applications are hugely impacted by biases, presenting inconsistent and unreliable findings, leading to significant costs and consequences, highlighting and perpetuating inequalities and unequal access to resources. Hence, developing safe, reliable, ethical, and Trustworthy AI systems is essential. Our team of researchers working with Trustworthy and Responsible AI, part of the Transdisciplinary Scholarship Initiative within the University of Calgary, conducts research on Trustworthy and Responsible AI, including fairness, bias mitigation, reproducibility, generalization, interpretability, and authenticity. In this paper, we review and discuss the intricacies of AI biases, definitions, methods of detection and mitigation, and metrics for evaluating bias. We also discuss open challenges with regard to the trustworthiness and widespread application of AI across diverse domains of human-centric decision making, as well as guidelines to foster Responsible and Trustworthy AI models.
-
Unravelling socio-technological barriers to AI integration: A qualitative study of Southern African newsrooms
This study explores the socio-technological barriers to the adoption of artificial intelligence (AI)-powered solutions in three countries of the global south – South Africa, Lesotho, Eswatini, Botswana and Zimbabwe. Through 20 in-depth interviews with key stakeholders, it examines the distribution and circulation of AI technologies within selected newsrooms. Furthermore, the article explores socio-technological obstacles to the integration of AI among journalists. Lastly, it examines the consequences of these socio-technological obstacles to journalism. The article specifically seeks to answer three questions: How are AI technologies integrated in southern African newsrooms? What are the socio-technological barriers attendant to the use of AI in selected news organisations of sub-Saharan Africa? What are the implications of these socio-technological barriers to the process of news production in these newsrooms?
-
Advancements in Modern Recommender Systems: Industrial Applications in Social Media, E-commerce, Entertainment, and Beyond
In the current digital era, the proliferation of online content has overwhelmed users with vast amounts of information, necessitating effective filtering mechanisms. Recommender systems have become indispensable in addressing this challenge, tailoring content to individual preferences and significantly enhancing user experience. This paper delves into the latest advancements in recommender systems, analyzing 115 research papers and 10 articles, and dissecting their application across various domains such as e-commerce, entertainment, and social media. We categorize these systems into content-based, collaborative, and hybrid approaches, scrutinizing their methodologies and performance. Despite their transformative impact, recommender systems grapple with persistent issues like scalability, cold-start problems, and data sparsity. Our comprehensive review not only maps the current landscape of recommender system research but also identifies critical gaps and future directions. By offering a detailed analysis of datasets, simulation platforms, and evaluation metrics, we provide a robust foundation for developing next-generation recommender systems poised to deliver more accurate, efficient, and personalized user experiences, inspiring innovative solutions to drive forward the evolution of recommender technology.
-
Toward a trustworthy and inclusive data governance policy for the use of artificial intelligence in Africa
This article proposes five ideas that the design of data governance policies for the trustworthy use of artificial intelligence (AI) in Africa should consider. The first is for African states to assess their domestic strategic priorities, strengths, and weaknesses. The second is a human-centric approach to data governance, which involves data processing practices that protect the security of personal data and the privacy of data subjects; ensure that personal data are processed in a fair, lawful, and accountable manner; minimize the harmful effect of personal data misuse or abuse on data subjects and other victims; and promote a beneficial, trusted use of personal data. The third is for the data policy to be in alignment with supranational rights-respecting AI standards like the African Charter on Human and Peoples Rights, the AU Convention on Cybersecurity, and Personal Data Protection. The fourth is for states to be critical about the extent to which AI systems can be relied on in certain public sectors or departments. The fifth and final proposition is for the need to prioritize the use of representative and interoperable data and ensure a transparent procurement process for AI systems from abroad where no local options exist.
-
OECD Gender Equality in Technology Governance
Director Mackenzie represented the Aula Fellowship and the AI context in conversations at this global conference for equity. We stand together, or we fall.
-
Beyond the algorithm: Empowering ai practitioners through liberal education
As AI technology continues to transform society, there is a growing need for engineers and technologists to develop interdisciplinary skills to address complex, society-wide problems. However, there is a gap in understanding how to effectively design and deliver inter-disciplinary education programs for AI-related training. This paper addresses this gap by reporting on a successful summer school program that brought together specialists from around the world to engage in deliberations on responsible AI, as part of a Summer School in Responsible AI led by Mila – Quebec Artificial Intelligence Institute. Through deep dive auto-ethnographic reflections from five individuals, who were either organizers or participants, augmented with end-of-program feedback, we provide a rich description of the program’s planning, activities, and impact. Specifically, our study draws from engineering education research, bridging the gap between research and practice to answer three research questions related to the program: (1) How did the program design enable a more effective understanding of interdisciplinary problem-sets? (2) How did participants experience the interdisciplinary work of the program? (3) Did the program affect participants’ impact on interdisciplinary problem-sets after the program? Our findings highlight the benefits of interdisciplinary, holistic, and hands-on approaches to AI education and provide insights for fellow engineering education researchers on how to design effective programs in this field.
-
Decoding the Diversity: A Review of the Indic AI Research Landscape
This review paper provides a comprehensive overview of large language model (LLM) research directions within Indic languages. Indic languages are those spoken in the Indian subcontinent, including India, Pakistan, Bangladesh, Sri Lanka, Nepal, and Bhutan, among others. These languages have a rich cultural and linguistic heritage and are spoken by over 1.5 billion people worldwide. With the tremendous market potential and growing demand for natural language processing (NLP) based applications in diverse languages, generative applications for Indic languages pose unique challenges and opportunities for research. Our paper deep dives into the recent advancements in Indic generative modeling, contributing with a taxonomy of research directions, tabulating 84 recent publications. Research directions surveyed in this paper include LLM development, fine-tuning existing LLMs, development of corpora, benchmarking and evaluation, as well as publications around specific techniques, tools, and applications. We found that researchers across the publications emphasize the challenges associated with limited data availability, lack of standardization, and the peculiar linguistic complexities of Indic languages. This work aims to serve as a valuable resource for researchers and practitioners working in the field of NLP, particularly those focused on Indic languages, and contributes to the development of more accurate and efficient LLM applications for these languages.