Skip to Main Content

ChatGPT

In this research guide you will discover the inner workings of language models such as ChatGPT and the history of artificial intelligence. You'll also gain insight into AI plagiarism and the methods for detecting AI generated text.

How does ChatGPT (and other generative AI like it) work?

"Large Language Models, such as GPT-3, are trained on vast amounts of text data from the internet and are capable of generating human-like text, but they may not always produce output that is consistent with human expectations or desirable values. In fact, their objective function is a probability distribution over word sequences that allows them to predict what the next word is in a sequence."

 

https://www.assemblyai.com/blog/how-chatgpt-actually-works/

 

"Internally ChatGPT uses a combination of machine learning algorithms and deep learning techniques to process and generate text responses. When a user inputs a message into the chat, the system first tokenizes the text, which involves breaking down the words and sentences into individual units. The tokens are then passed through a series of layers, which include the encoder and decoder layers, to generate a response.

One of the key technical details of ChatGPT’s internal architecture is its use of attention mechanisms. Attention mechanisms allow the model to focus on specific parts of the input text, which helps it generate more relevant and contextually accurate responses. This is particularly important in the context of a conversation, where previous messages need to be considered when generating a response

Another technical detail of ChatGPT’s internal architecture is its use of memory modules. These modules allow the model to retain information from previous messages, which helps it generate more coherent and consistent responses. This is especially useful in longer conversations, where the model needs to maintain a sense of context and coherence."

https://www.unimedia.tech/gpt-chatbots/

 

Chat GPT

https://www.atriainnovation.com/en/how-does-chat-gpt-work/

Video Explanation of how ChatGPT Works

About the Library

Visit our Libraries:

Quad Cities Campus
East Campus

Building 1, Room 201

6600 34th Avenue, Moline, IL

309-796-5700

Building A, Room 135

26230 Black Hawk Road, Galva IL

309-854-1730

Hours:

Monday - 8:00 am - 5:00 pm

Tuesday - 8:00 am - 5:00 pm

Wednesday - 8:00 am - 5:00 pm

Thursday - 8:00 am - 5:00 pm

Friday - 8:00 am - 3:00 pm

Saturday & Sunday - Closed

Hours:

Monday - 8:00 am - 4:00 pm

Tuesday - 8:00 am - 4:00 pm

Wednesday - 8:00 am - 4:00 pm

Thursday - 8:00 am - 4:00 pm

Friday - 8:00 am - 2:00 pm

Saturday & Sunday - Closed

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Can’t come to campus? Check out our virtual services:
 
What Library Services are at Black Hawk College?