ItemConference Paper

Indian Emotional Alignment Score (I-EAS): A Pilot Framework for Culturally-Aware AI Evaluation in Multilingual Contexts

Title
Indian Emotional Alignment Score (I-EAS): A Pilot Framework for Culturally-Aware AI Evaluation in Multilingual Contexts
Creator
Kondaveeti, Anthony Raju; Roy, Apash; Shrivallabha, S.; Aiswarya, V.R.
Description
The current Emotional Intelligence (EI) standards of large language models (LLMs) are predominantly Western, thereby excluding billions of non-Western users from being judged fairly by AI. I-EAS, a new culture-based evaluation system, is grounded in indigenous epistemology and a computational evaluation framework to address a critical gap in AI Fairness. I-EAS takes into account four weighted factors: Emotional Alignment, Cultural Resonance, Coherence, and Code-Switching. It prioritizes cultural appropriateness and maintains a rigorous methodology. The pilot study uses 150 systematically crafted prompts in Hindi, Tamil, and English in diverse Indian cultural scenarios to test three LLMs: Claude Sonnet 4, GPT-4o-mini, and Krutrim-Base. The results highlight the inherent drawbacks of automated cultural assessments, as the weak relationships between human and automated assessments indicate that current NLP models are unable to respond to cultural nuances. The human evaluation was more discriminative than the automated evaluations, as the automated code-switching evaluations were not successful. The limitations of the pilot study include the presence of only one annotator. However, they prove I-EAS as a preliminary methodological and theoretical framework to equitable AI evaluation in culturally diverse situations and the necessity to use hybrid human-computational measures of AI systems in different cultural contexts. 2025 IEEE.
Source
2nd International Conference on Intelligent Systems for Cybersecurity, ISCS 2025;
Date
01-01-2025
Publisher
Institute of Electrical and Electronics Engineers Inc.
Subject
Code-Switching; Cultural AI; Multilingual NLP
Coverage
Kondaveeti A.R., Christ (Deemed to Be University), Department of Statistics and Data Science, Karnataka, Bengaluru, India; Roy A., Christ (Deemed to Be University), Department of Statistics and Data Science, Karnataka, Bengaluru, India; Shrivallabha S., Christ (Deemed to Be University), Department of Statistics and Data Science, Karnataka, Bengaluru, India; Aiswarya V.R., Christ (Deemed to Be University), Department of Psychology, Karnataka, Bengaluru, India
Rights
Restricted Access; Hardcopy may be available in the library
Relation
ISBN: 979-833157243-3;
Format
online
Language
English
Type
Conference paper

Citation

Kondaveeti, Anthony Raju; Roy, Apash; Shrivallabha, S.; Aiswarya, V.R., “Indian Emotional Alignment Score (I-EAS): A Pilot Framework for Culturally-Aware AI Evaluation in Multilingual Contexts,” CHRIST (Deemed To Be University) Institutional Repository, accessed June 18, 2026, https://archives.christuniversity.in/items/show/26183.

Output Formats