Ethical Considerations in the Use of Artificial Intelligence (AI) for Education and Research: A Review

Syed Ali Zuhair Zaidi; Ehtesham Ahmad; Neeraj Shukla

doi:10.69968/ijisem.2024v3si2156-167

Authors

Syed Ali Zuhair Zaidi Research Scholar, Department of Commerce, Khwaja Moinuddin Chishti Language University
Ehtesham Ahmad Head, Department of Commerce, Khwaja Moinuddin Chishti Language University, Lucknow, Uttar Pradesh, India
Neeraj Shukla Assistant Professor, Department of Commerce, Khwaja Moinuddin Chishti Language University, Lucknow, Uttar Pradesh, India

DOI:

https://doi.org/10.69968/ijisem.2024v3si2156-167

Keywords:

Artificial Intelligence (AI), Ethics in Education, AI in Research, Academic Integrity

Abstract

The incorporation of Artificial Intelligence (AI), in the field of education and research has brought about progress allowing for customized learning opportunities effective data examination and inventive research techniques. Nonetheless, these advantages are accompanied by dilemmas that require thoughtful handling to promote the ethical utilization of AI. Artificial Intelligence (AI) enables us to get personalized support and guidance, feedback, predictions, ideas, and conclusion generation by simulating human intelligence. This paper provides an exploration and review of the implications associated with the use of AI, in educational settings and research. A total of 100 papers have been selected from databases such as ScienceDirect, Google Scholar and EBSCO from the last 10 years. The review points out the dangers of AI, such, as maintaining inequalities and undermining academic integrity while also discussing ways to reduce these risks. This paper aims to present ethical considerations and applications of AI in the field of education and research.

References

[1] Ainsworth, S. & Grimshaw, S. (2004). Evaluating the REDEEM authoring tool: can teachers create effective learning environments? International Journal of Artificial Intelligence in Education, 14(3), 279-312.

[2] Alam, A. (2021, November). Possibilities and apprehensions in the landscape of artificial intelligence in education. In 2021 International Conference on Computational Intelligence and Computing Applications (ICCICA) (pp. 1-8). IEEE. https://doi.org/10.1109/ICCICA52458.2021.9697272

[3] Alejandra de la Torre, Maria Baldeon-Calisto, "Generative Artificial Intelligence in Latin American Higher Education: A Systematic Literature Review", 2024 12th International Symposium on Digital Forensics and Security (ISDFS), pp.1-7, 2024. https://doi.org/10.1109/ISDFS60797.2024.10527283

[4] Anthony M. Maina, Jane Kuria, "Building an AI Future: Research and Policy Directions for Africa's Higher Education", 2024 IST-Africa Conference (IST-Africa), pp.01-09, 2024.https://doi.org/10.23919/IST-Africa63983.2024.10569692

[5] Antonio Bucchiarone, Filippo Chiarello, Juliana Elisa Raffaghelli, Vito Giordano, Andrea Vázquez-Ingelmo, Gianluca Schiavo, Alessandra Antonaci, Valentina Grion, Alessandro Guadagni, "Teaching and Recognition of Skills in the Digital Era Through OER-Based Personalized and Gamified Learning: The ENCORE Project", 2024 IEEE Global Engineering Education Conference (EDUCON), pp.1-10, 2024.https://doi.org/10.1109/EDUCON60312.2024.10578861

[6] Antonio Carlos Bento, Elsa Yolanda Torres-Torres, Sérgio Camacho-Léon, "Results with the Use of Artificial Intelligence with OpenAI Applied to Internet of Things Classes", 2024 12th International Conference on Smart Grid (icSmartGrid), pp.181-186, 2024.https://doi.org/10.1109/icSmartGrid61824.2024.10578142

[7] Avni Rustemi, FisnikDalipi, Vladimir Atanasovski, Aleksandar Risteski, "Enhancing Academic Credentials: The Synergy of Blockchain and Artificial Intelligence", 2024 7th International Balkan Conference on Communications and Networking (BalkanCom), pp.206-211, 2024.https://doi.org/10.1109/BalkanCom61808.2024.10557185

[8] Azad, S., Chen, B., Fowler, M., West, M., & Zilles, C. (2020). Strategies for deploying unreliable AI graders in hightransparency high-stakes exams. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics).https://doi.org/10.1007/978-3-030-52237-7_2

[9] Bajaj, G., Lazer, D., & Pentland, A. (2021). Applications of AI in personalized learning: Emerging trends and challenges. Journal of Artificial Intelligence Research, 70(1), 321-338.

[10] Binns, R. (2018). Fairness in machine learning: Lessons from political philosophy. Proceedings of the 2018 Conference on Fairness, Accountability, and Transparency (FAT 2018)*, pp. 149-159.

[11] Borenstein, J., & Howard, A. (2021). The ethics of autonomous systems in education. In Routledge Handbook of the Ethics of Autonomous Systems (pp. 271-283). Routledge.

[12] Bos, E., & Van De Plassche, J. (1994). A knowledge-based, English verb-form tutor. Journal of Artificial Intelligence in Education.

[13] Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., ... &Amodei, D. (2020). Language models are few-shot learners. Advances in Neural Information Processing Systems, 33, 1877-1901.

[14] Casanova, A. (2018). BYJU's: how a learning app is promoting deep conceptual understanding that is improving educational outcomes in India.

[15] Chandradeep Bhatt, Sanjeev Singh, Rahul Chauhan, Teekam Singh, Anita Uniyal, "Artificial Intelligence in Current Education: Roles, Applications & Challenges", 2023 3rd International Conference on Pervasive Computing and Social Networking (ICPCSN), pp.241-244, 2023.https://doi.org/10.1109/ICPCSN58827.2023.00045

[16] Chang, J., & Lu, X. (2019). The Study on Students' Participation in Personalized Learning Under the Background of Artificial Intelligence. 2019 10th International Conference on Information Technology in Medicine and Education (ITME) (pp. 555-558). IEEE.https://doi.org/10.1109/ITME.2019.00131

[17] Char, D. S., Shah, N. H., & Magnus, D. (2018). Implementing machine learning in health care-Addressing ethical challenges. The New England Journal of Medicine, 378(11), 981-983.https://doi.org/10.1056/NEJMp1714229

[18] Chassignol, M., Khoroshavin, A., Klimova, A., &Bilyatdinova, A. (2018). Artificial Intelligence trends in education: A narrative overview. Procedia Computer Science.https://doi.org/10.1016/j.procs.2018.08.233

[19] Chen, X., Zou, D., Xie, H., Cheng, G., & Liu, C. (2022). Two decades of artificial intelligence in education. Educational Technology & Society, 25(1), 28-47.

[20] Collins, A. & Halverson, R. (2010). The second educational revolution: rethinking education in the age of technology. Journal of Computer Assisted Learning, 26(1), 18-27.https://doi.org/10.1111/j.1365-2729.2009.00339.x

[21] Danks, D., & London, A. J. (2017). Regulating autonomous systems: Beyond standards. IEEE Intelligent Systems, 32(1), 88-91.https://doi.org/10.1109/MIS.2017.1

[22] Devedzic, V. (2004). Education and the semantic web. International Journal of Artificial Intelligence in Education, 14(2), 165-191.

[23] Devedžić, V. (2004). Web intelligence and artificial intelligence in education. Journal of Educational Technology & Society, 7(4), 29-39.

[24] Dong, Z., Zhang, Y., Yip, C., Swift, S., & Beswick，K. (2020). Smart campus: definition, framework, technologies, and services. IET Smart Cities, 2(1), 43-54.https://doi.org/10.1049/iet-smc.2019.0072

[25] Duffy, G., & Tucker, S. A. (1995). Political science: Artificial intelligence applications. Social Science Computer Review, 13(1), 1-20.https://doi.org/10.1177/089443939501300101

[26] Esteva, A., Chou, K., Yeung, S., Naik, N., Madani, A., Mottaghi, A., ... &Socher, R. (2019). Deep learning-enabled medical computer vision. Nature Medicine, 25(1), 50-55.

[27] Eubanks, V. (2018). Automating inequality: How high-tech tools profile, police, and punish people with low incomes. St. Martin's Press.

[28] Floridi, L., & Taddeo, M. (2016). What is data ethics? Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 374(2083), 20160360.https://doi.org/10.1098/rsta.2016.0360

[29] Forhan Bin Emdad, Benhur Ravuri, Lateef Ayinde, Mohammad Ishtiaque Rahman, "'ChatGPT, a Friend or Foe for Education?' Analyzing the User's Perspectives on The Latest AI Chatbot Via Reddit", 2024 IEEE International Conference on Interdisciplinary Approaches in Technology and Management for Social Innovation (IATMSI), vol.2, pp.1-5, 2024.https://doi.org/10.1109/IATMSI60426.2024.10502836

[30] Hala NajwanSabeh, "What Drives IT Students Toward ChatGPT? Analyzing the Factors Influencing Students' Intention to Use ChatGPT for Educational Purposes", 2024 21st International Multi-Conference on Systems, Signals & Devices (SSD), pp.533-539, 2024.https://doi.org/10.1109/SSD61670.2024.10548826

[31] Hector R. Amado-Salvatierra, Miguel Morales-Chan, Rocael Hernandez-Rizzardini, Milvia Rosales, "Exploring Educators' Perceptions: Artificial Intelligence Integration in Higher Education", 2024 IEEE World Engineering Education Conference (EDUNINE), pp.1-5, 2024.https://doi.org/10.1109/EDUNINE60625.2024.10500578

[32] Holmes, W., Bialik, M., & Fadel, C. (2019). Artificial intelligence in education: Promises and implications for teaching and learning. Center for Curriculum Redesign.

[33] Hossein Shahri, Mohammed Emad, Nahid Ibrahim, Rao Naveed Bin Rais, Yousef Al-Fayoumi, "Elevating Education through AI Tutor: Utilizing GPT-4 for Personalized Learning", 2024 15th Annual Undergraduate Research Conference on Applied Computing (URC), pp.1-5, 2024.https://doi.org/10.1109/URC62276.2024.10604578

[34] Huang, J., Saleh, S., & Liu, Y. (2021). A review on artificial intelligence in education. Academic Journal of Interdisciplinary Studies, 10(3).https://doi.org/10.36941/ajis-2021-0077

[35] Hutson, M. (2018). Artificial intelligence faces a reproducibility crisis. Science, 359(6377), 725-726.https://doi.org/10.1126/science.359.6377.725

[36] IEEE. (2019). Ethics in action: IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems. IEEE.

[37] Iman A. Akour, Hevron Muhammad Alshurideh, Haitham M. Alzoubi, Muhammad Turki Alshurideh, Yasin Ahmad Antouz, "Integrating Artificial Intelligence in Improving Educational System: The Mediating role of Smart Learning", 2023 International Conference on Business Analytics for Technology and Security (ICBATS), pp.1-5, 2023.https://doi.org/10.1109/ICBATS57792.2023.10111284

[38] Isabella M Venter, Desireé J Cranfield, Rénette J Blignaut, Soha Achi, Andrea Tick, "Conversational AI in Higher Education: Opportunities, Challenges, and Ethical Considerations", 2024 IEEE 28th International Conference on Intelligent Engineering Systems (INES), pp.000195-000202, 2024.https://doi.org/10.1109/INES63318.2024.10629104

[39] JabraouiSiham, Vandapuye Sophia, "Shaping the Perception of Artificial Intelligence: A Study on the Representation of AI Among Young Individuals.", 2024 International Conference on Circuit, Systems and Communication (ICCSC), pp.1-4, 2024.https://doi.org/10.1109/ICCSC62074.2024.10617428

[40] Jan H.R. Woerner, Aleksandra P. Turtova, Andrew S.I.D. Lang, "Transformative Potentials and Ethical Considerations of AI Tools in Higher Education: Case Studies and Reflections", SoutheastCon 2024, pp.510-515, 2024.https://doi.org/10.1109/SoutheastCon52093.2024.10500042

[41] Jobin, A., Ienca, M., &Vayena, E. (2019). The global landscape of AI ethics guidelines. Nature Machine Intelligence, 1(9), 389-399.https://doi.org/10.1038/s42256-019-0088-2

[42] Jordan, M. I., & Mitchell, T. M. (2015). Machine learning: Trends, perspectives, and prospects. Science, 349(6245), 255-260.https://doi.org/10.1126/science.aaa8415

[43] Kant, I. (1993). Grounding for the metaphysics of morals (J. W. Ellington, Trans.). Hackett Publishing Company. (Original work published 1785).

[44] L. Chen, P. Chen and Z. Lin, "Artificial Intelligence in Education: A Review," in IEEE Access, vol. 8, pp. 75264-75278, 2020, doi: 10.1109/ACCESS.2020.2988510.https://doi.org/10.1109/ACCESS.2020.2988510

[45] LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436-444.https://doi.org/10.1038/nature14539

[46] Lee, J., Yun, S., & Lee, S. (2022). Automating research tasks with generative AI: A review of current capabilities and future directions. IEEE Access, 10, 61234-61245.

[47] Lindgren, S., &Holmström, J. (2020). A social science perspective on artificial intelligence: Building blocks for a research agenda. Journal of Digital Social Research (JDSR), 2(3), 1-15.https://doi.org/10.33621/jdsr.v2i3.65

[48] Luckin, R., Holmes, W., Griffiths, M., & Forcier, L. B. (2016). Intelligence unleashed: An argument for AI in education. Pearson.

[49] Luckin, R., Holmes, W., Griffiths, M., & Forcier, L. B. (2016). Intelligence unleashed: An argument for AI in education. Pearson.

[50] Marcus, G., & Davis, E. (2019). Rebooting AI: Building artificial intelligence we can trust. Pantheon Books.

[51] Means, B., Bakia, M., & Murphy, R. (2020). Learning online: What research tells us about whether, when, and how. Routledge.

[52] Mellon, J., & Prosser, C. (2017). Twitter and Facebook are not representative of the general population: Political attitudes and demographics of British social media users. Research & Politics, 4(3), 1-9.https://doi.org/10.1177/2053168017720008

[53] Michael Nieberl, Alexander Zeiser, Holger Timinger, "A Review of Data-Centric Artificial Intelligence (DCAI) and its Impact on manufacturing Industry: Challenges, Limitations, and Future Directions", 2024 IEEE Conference on Artificial Intelligence (CAI), pp.44-51, 2024.https://doi.org/10.1109/CAI59869.2024.00018

[54] Mill, J. S. (1863). Utilitarianism. Parker, Son, and Bourn.

[55] Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., &Floridi, L. (2016). The ethics of algorithms: Mapping the debate. Big Data & Society, 3(2), 1-21.https://doi.org/10.1177/2053951716679679

[56] Mohamed Khalifa, Mona Albadawy, "Using artificial intelligence in academic writing and research: An essential productivity tool," Computer Methods and Programs in Biomedicine Update,Volume 5,2024,100145,ISSN 2666-9900,https://doi.org/10.1016/j.cmpbup.2024.100145

[57] Nicia Guillén-Yparrea, Felipe Hernández-Rodríguez, "Unveiling Generative AI in Higher Education: Insights from Engineering Students and Professors", 2024 IEEE Global Engineering Education Conference (EDUCON), pp.1-5, 2024.https://doi.org/10.1109/EDUCON60312.2024.10578876

[58] O'Neil, C. (2016). Weapons of math destruction: How big data increases inequality and threatens democracy. Crown Publishing Group.

[59] Ohm, P. (2010). Broken promises of privacy: Responding to the surprising failure of anonymization. UCLA Law Review, 57(6), 1701-1777.

[60] RadheyaKetak, Shailesh Mittal, Vansh Gupta, Hina Gupta, "Online Edtech Platform with AI Doubt Assistance", 2024 2nd International Conference on Disruptive Technologies (ICDT), pp.1395-1399, 2024.https://doi.org/10.1109/ICDT61202.2024.10489310

[61] Rajaraman, V., & Grama, A. (2019). Elements of artificial intelligence and data science. Springer.

[62] Roll, I., & Wylie, R. (2016). Evolution and revolution in artificial intelligence in education. International journal of artificial intelligence in education, 26, 582-599.https://doi.org/10.1007/s40593-016-0110-3

[63] Russell, S., & Norvig, P. (2021). Artificial intelligence: A modern approach (4th ed.). Pearson.

[64] Sai Krishna Vishnumolakala, Sobin C C, N P Subheesh, Prabhat Kumar, Randhir Kumar, "AI-Based Research Companion (ARC): An Innovative Tool for Fostering Research Activities in Undergraduate Engineering Education", 2024 IEEE Global Engineering Education Conference (EDUCON), pp.1-5, 2024.https://doi.org/10.1109/EDUCON60312.2024.10578646

[65] Salganik, M. J. (2017). Bit by bit: Social research in the digital age. Princeton University Press.

[66] Selwyn, N. (2019). Should robots replace teachers? AI and the future of education. John Wiley & Sons.

[67] Senior, A. W., Evans, R., Jumper, J., Kirkpatrick, J., Sifre, L., Green, T., ... & Hassabis, D. (2020). Improved protein structure prediction using potentials from deep learning. Nature, 577(7792), 706-710.https://doi.org/10.1038/s41586-019-1923-7

[68] ServetKılıç, "Use of Artificial Intelligence in Teaching Different Disciplines", Interdisciplinary Approach to Fostering Change in Schools, pp.220, 2024.https://doi.org/10.4018/979-8-3693-4119-3.ch009

[69] Shreya Prasad, Nirmalya Mukhopadhyay, Komal Khatal, TejasNabage, Sagar Borude, "CampusXchange: Design and Implementation of an AI-empowered College Social Networking Platform", 2024 IEEE International Conference on Interdisciplinary Approaches in Technology and Management for Social Innovation (IATMSI), vol.2, pp.1-6, 2024.https://doi.org/10.1109/IATMSI60426.2024.10502669

[70] Sison, M., & Ferrero, I. (2015). Business ethics and virtue ethics. In International encyclopedia of the social &behavioral sciences (pp. 570-575). Elsevier.

[71] Slade, S., & Prinsloo, P. (2013). Learning analytics: Ethical issues and dilemmas. American Behavioral Scientist, 57(10), 1510-1529.https://doi.org/10.1177/0002764213479366

[72] Tanja Baksa, Mario Konecki, MladenKonecki, "High School Students' Perception of AI and Its Future Impact on Education", 2024 12th International Conference on Information and Education Technology (ICIET), pp.215-219, 2024.https://doi.org/10.1109/ICIET60671.2024.10542754

[73] Tene, O., &Polonetsky, J. (2013). Big data for all: Privacy and user control in the age of analytics. Northwestern Journal of Technology and Intellectual Property, 11(5), 239-273.

[74] Theodora Kouvara, Vassilis Fotopoulos, ChristoforosKarachristos, TheofanisOrphanoudakis, "Expanding the 'A' in STEAM: Integrating Poetry and AI for Educational Evolution", 2024 IEEE Global Engineering Education Conference (EDUCON), pp.01-07, 2024.https://doi.org/10.1109/EDUCON60312.2024.10578751

[75] Trini Balart, Kristi J. Shryock, "A Framework for Integrating AI into Engineering Education, Empowering Human-Centered Approach for Industry 5.0", 2024 IEEE Global Engineering Education Conference (EDUCON), pp.1-10, 2024.https://doi.org/10.1109/EDUCON60312.2024.10578796

[76] Tripathy, S., &Devarapalli, S. (2020). Emerging trend set by a start-ups on Indian online education system: A case of Byju's. Journal of Public Affairs.https://doi.org/10.1002/pa.2128

[77] Tuomi, I. (2018). The Impact of Artificial Intelligence on Learning, Teaching, and Education. Policies for the future. EUR - Scientific and Technical Research Reports.

[78] Umar Ali Bukar, Md. Shohel Sayeed, Siti Fatimah Abdul Razak, SumendraYogarayan, RadhwanSneesl, "Decision-Making Framework for the Utilization of Generative Artificial Intelligence in Education: A Case Study of ChatGPT", IEEE Access, vol.12, pp.95368-95389, 2024.https://doi.org/10.1109/ACCESS.2024.3425172

[79] ViktoriiaShabunina, Viktor Sarancha, Volodymyr Maslak, Olena Shevchenko, Oksana Tur, "Educational Potential of ChatGPT: Teaching Tool for Students' Competencies Development", 2023 IEEE 5th International Conference on Modern Electrical and Energy System (MEES), pp.1-6, 2023.https://doi.org/10.1109/MEES61502.2023.10402380

[80] Vladislav Yurov, Sergei Kuzenkov, "Using Industry 4.0 Tools in the Process of Training Metallurgical Engineers", 2024 4th International Conference on Technology Enhanced Learning in Higher Education (TELE), pp.243-245, 2024.https://doi.org/10.1109/TELE62556.2024.10605690

[81] Walkington, C., &Bernacki, M. L. (2020). Appraising research on personalized learning: Definitions, theoretical alignment, advancements, and future directions. Journal of Research on Technology in Education, 52(3), 235- 252.https://doi.org/10.1080/15391523.2020.1747757

[82] West, D. M. (2019). AI and education: The role of artificial intelligence in teaching and learning. Brookings Institution.

[83] West, S. M. (2019). Data capitalism: Redefining the logics of surveillance and privacy. Business & Society, 58(1), 20-41.https://doi.org/10.1177/0007650317718185

[84] Williamson, B. (2017). Big data in education: The digital future of learning, policy and practice. Sage Publications.https://doi.org/10.4135/9781529714920

[85] Williamson, B. (2018). The hidden architecture of higher education: building a big data infrastructure for the 'smarter university.' International Journal of Educational Technology in Higher Education.https://doi.org/10.1186/s41239-018-0094-1

[86] Xinyi Sun, "The Application of Artificial Intelligence in Education", Transactions on Computer Science and Intelligent Systems Research, vol.5, pp.953, 2024.https://doi.org/10.62051/yfkk2r20

[87] Yiquan Qin, Yikui Liao, Zhite Wang, "Improved YOLOv8 algorithm for classroom student behavior detection", 2024 IEEE 6th Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC), vol.6, pp.757-761, 2024.https://doi.org/10.1109/IMCEC59810.2024.10575569

[88] Yuan He, Xiaoli Hou, "Construction of Higher Vocational Education Platform Based on Artificial Intelligence", 2023 International Conference on Applied Intelligence and Sustainable Computing (ICAISC), pp.1-8, 2023.https://doi.org/10.1109/ICAISC58445.2023.10199970

[89] Yufei, L., Saleh, S., Jiahui, H., & Abdullah, S. M. S. (2020). Review of the application of artificial intelligence in education. International Journal of Innovation, Creativity and Change, 12(8), 548-562.https://doi.org/10.53333/IJICC2013/12850

[90] Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education - Where are the educators? International Journal of Educational Technology in Higher Education, 16(1), 39.https://doi.org/10.1186/s41239-019-0171-0

[91] Zhou, Y., Zhang, L., & Liu, H. (2023). Ethical implications of generative AI in educational settings: A critical review. Journal of Educational Technology, 12(1), 45-60.

[92] Zou, S. (2017). Designing and practice of a college english teaching platform based on artificial intelligence. Journal of Computational and TheoreticalNanoscience.https://doi.org/10.1166/jctn.2017.6133