Obviously it would be someone entering queries and such but the idea that gov and others have better tech than currently public plus people thinking it was an a.i, perhaps it was a group of people asking a chatgpt or they might call theirs Q
You're viewing a single comment thread. View all comments, or full comment thread.
Comments (13)
sorted by:
chatgpt = AI?
Yes, GPT is an AI. I forget the GP part, the T means "transformer" which is how that AI learns to understand the context of text.
Dog bites man vs Man bites dog. Token wise are identical, add key and value pairs to the text read and it might be 1, 2, 3 vs 3, 2, 1 which would be distinct sequences that could have different learned meanings.
Thanks for the explanation. Appreciate.
No problem, that's about as simple as I can explain without needing what might be a chapter of a book. I also like explaining the topic from the perspective of a modestly informed amateur (my home computer could really only replicate experiments that are now 30+ years old)
The previous approach was more complicated, but is what's still used on phones for autocorrect, where the AI "Learns" the token (word) and words that are generally connected with that word ("is a" would be an example of commonly connected) and then a "forget" zone because you generally want to write something like "a tent is a tent", so, it was inferred context mainly because you don't generally repeat.