What Is ChatGPT Doing... and Why Does It Work?(2023.2)

Resource link:

https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-doing-and-why-does-it-work/

https://imzhanghao.com/2023/02/24/chatgpt/

  • It's just adding one word at a time

    • the newly generated word is input as context to the model again to generate the next word.

  • Where Do the Probabilities Come From? from the llm

  • What is a model? It's a function with billions of parameters, the function and parameters are learned from the huge amount of data.

Last updated