What Is ChatGPT Doing... and Why Does It Work?(2023.2)
Resource link:
https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-doing-and-why-does-it-work/
https://imzhanghao.com/2023/02/24/chatgpt/
It's just adding one word at a time
the newly generated word is input as context to the model again to generate the next word.
Where Do the Probabilities Come From? from the llm
What is a model? It's a function with billions of parameters, the function and parameters are learned from the huge amount of data.

Last updated