AI and Chat GPT

Librarian

Profile Photo
Marla Beebe
she/her/hers
chat loading...
Contact:
2nd Floor, Rm 266A
740-351-3461

ChatGPT: Where does the information come from?

ChatGPT was trained on a body of text which allows it to generate text in response to a prompt. Some partial lists of the training dataset exist, and ChatGPT will also provide a partial list when queried. However, the entire body of text that has trained ChatGPT is unknown.

When ChatGPT provides an answer to a question, it will not immediately provide a reference for where the information came from. This is because it is pulling predictive language from a wide variety of places, so the information usually doesn't come from a single source. Because of this, you typically cannot trace the response back to a single parent source or know where the information came from.

Can ChatGPT provide references?

Caution: Asking ChatGPT to provide a list of references for an academic paper is generally NOT a good idea!

Why?

  1. These references may not be where the information actually came from and - more importantly - may not be real sources. Despite sounding plausible, ChatGPT can easily hallucinate citations.

Example of ChatGPT response:

"Here's an example of a peer-reviewed journal article on amphetamine abuse and its intersections with social determinants of health:

Stoové, M. A., Dietze, P. M., Jolley, D., Fry, C. L., Brewer, N., & Hellard, M. E. (2008). Increasing access to sterile injecting equipment andsyringe exchange in a rural area with a high prevalence of bloodborne viruses. Australian Journal of Rural Health, 16(2), 99-106. 
This article describes a study conducted in a rural area of Australia with a high prevalence of bloodborne viruses, including those associated with amphetamine use..."

Citation: OpenAI. (2023, February 17). [ChatGPT response to a prompt about locating an academic journal article]. https://chat.openai.com/

While the response sounds good.........this article does NOT exist. The journal does, as does the lead author. However, Stoové has not published in this journal.

  1. Even if a generated source is real, without accessing the source itself, you will not know its quality. For example, if the source is a study, consider the possible biases in the study sample or discussions, whether the authors draw logical conclusions from the data, etc. If you would like to consider using a source generated by ChatGPT, you need to find and read the source, and then evaluate it for credibility.