BOOK: AOD Foundations

8. AOD in the Age of GenAI

What is GenAI?

Generative Artificial Intelligence (GenAI) is a subset of AI that uses machine learning models to CREATE NEW, ORIGINAL CONTENT, such as text, images, music, or videos based on patterns and structures learned from existing data.The most famous one is ChatGPT, a large language model that was trained on data on the internet.

In recent years, it has gained a lot of attention in education, as it may be tempting for students to cheat using Chat GPT (ChatGPT essays have been found to be better than typical undergrads, and their reflection is similarly excellent (Li et al., 2023)).

Three Strategies for Dealing with GenAI in an AOD

This chapter provides three ideas for deadling with GenAI in an AOD.

GenAI Tools

There are many text-based GenAI tools (i.e. chatbots) that can be used. Below are some options.

Requires Registration but Free
(Note: Due to FIOPPA requirements, you cannot require that learners use these tools - they would have to disclose personal information)

Does NOT Require Registration
(i.e., no need to enter personal information, like your email, so their use could be required in a student assignment...)

Concerns about GenAI Use

Anyone considering the use of GenAI, either as en educator or as a learner, should be aware of some of the issues that come with its use:

Security

  • Privacy & personal information (with murky policies that keep changing)
    Once data is entered into a GenAI prompt, it becomes the property of the GenAI. The tool will use the data going forward. There are therefore issues of privacy in the use of GenAI tool and experts recommend not entering any personally identifiable or sensitive data (CBC, 2023). If you would like a quick "at a glance" comparison of the terms of use of different GenAI tool, consider glancing at this summary table. Note that since GenAI companies update their terms of service frequently, it won't be long until this table is out of date.
  • Data ownership | Data security | Data breaches
    There are tons of issues surrounding intellectual property, ownership of information, and authorship when using GenAI. Firstly, GenAI tools like ChatGPT used documents, articles, and books found on the internet, yet the authors of those works are neither recognized nor compensated for that data. Next, once someone uses GenAI information, their data becomes the property of the GenAI app developers. For this reason, many organizations currently forbid their employees from entering sensitive data into a GenAI. Once a user has the output to a prompt, how do they recognize and cite it, especially since the output will change even when prompted in the same way at a later time? These are just some of the issues arising from the use of GenAI.

Ethical Issues

  • Copyright violations
  • Equity and access (costs and bias towards ESL users)
    Many of the GenAI tools require a subscription to access them. This means that they are not available to everyone, especially those with fewer resources such as internet access to financial resources to purchase the subscription. In addition, there is some indication that some of the plagiarism detection tools has a bias and that they inaccurately flag nonnative English speakers’ written work as generated by GenAI, when this is not the case (Myers, 2023).

Accuracy & Biases

  • Hallucinations and inaccurate information (that the GenAI insists is accurate!)
    GenAI tools don’t understand what they are putting out. They are predictive models. As such, they are prone to making mistakes. In some cases, they invent information, a process known as hallucinations (e.g., ask ChatGPT to come up with the top 10 list of citations on a topic. The citations will all seem plausible, but if you look them up, you will find that none exist…). For this reason, humans, with their experiential learning of the concepts that the GenAI puts out, can and must remain critical and assess the veracity and accuracy of the output.
  • Biases in the data set used to train
    GenAI is trained on large data sets. These data sets – for example documents or images found on the internet – contain within them biases. For example, asking a GenAI to draw a picture of leaders will tend to draw men. There are concerns that as we use more GenAI tools, these biases will be reproduced and amplified. (EG Asian student whosubmitted her photo to GenAI tooland asked it to make the photo look more professional. She got a photo of herselfas a white person, bc manyimages of white people tagged with professional that the GenAI hadbeen trained on.) Or ask DALL-E to draw a “professor” for you and you will get a white male.).

Student Learning

  • Plagiarism
    There is the concern that students will use the GenAI tools to plagiarize on assignments. GenAI tools such as ChatGPT made headlines when it was found that they tend to outperform most students on entrance exams (AI models like ChatGPT and GPT-4 are acing everything from the bar exam to AP Biology. Here's a list of difficult exams both AI versions have passed, 2023). The tool can make it tempting for students to cut corners when faced with uncertainty over their performance and tight deadlines. Some have called ChatGPT the new paper mill. Some plagiarism detecting software was put in place to detect the use of GenAI in assignment, but they were deemed to be highly inaccurate (Murphy Kelly, 2023). One of the best ways to guard against plagiarism is to create assignments that are localized to the specific context of the course. Another way is to invite, rather than forbid, the use of GenAI, and to work alongside the tool, rather than against it.
  • Cognitive offloading  (writing = learning to think  and shaping the mind)
    Some people argue that skills traditionally taught in schools, such as writing, are helpful in shaping the mind to think critically, logically, and to learn to articulate one’s thoughts clearly. If GenAI tools such as ChatGPT take over writing and essays are no longer assigned in schools, some worry that students will miss out on an important aspect of intellectual development.

Other Impacts

  • Environmental
    Most GenAItools require more computing power than a simple web browser search. This takes energy, on a planet that is already taxed with our use of resources… Is the use of such an energy consuming tool, at this period of history, ethical?
  • Labor practices and Global South
    ChatGPT’sOpenAI paid African workers peanuts to “clean the data sets” to make them more palatable, but they paid them peanuts and some of the data these people were exposed to was traumatic.
  • Criminal activity
    There are concerns that GenAI could assist criminals in conducting their activities, such as by designing computer code to help them spread a virus, malware, or hack into a secure system. There are also concerns that the AI could be re-purposed to help criminals create poisons or bombs. Fortunately, GenAI have guardrails that prevent them from engaging in such activities, but they can be tricked…