I'm glad they go in deep on the data feed back on this.
Kurzgesagt made a great video on how this stuff gets generated, an article uses this, data sets get trained on this, and then future outputs will use the article as citation.
This is the paradox to be addressed. In trying to make LLM's more accurate, we try to pin it to citations, but then that means having to trust that the citations are accurate. But having the citations generated by an LLM means it basically becomes impossible to confirm the accuracy.
As it has been said anything after 2022 cannot be reliably trusted. You can do you due diligence but that is a lot of work if you can do it.
Really highlights the idea that a lie will travel around the world before the truth puts its shoes on.
I saw a video on Linked-in. It's a talk by Steve Jobs from 1983, where he is anticipating, what an LLM can do now (at 4:03 in the video). https://lnkd.in/p/ddWU7cTp
My thoughts on the subject: What would Aristotle have said? The LLM is simulating Aristotle's response, based on syntactic and pragmatic dependencies between words and phrases taken from his works. Often you will get a sensible answers, but sometimes you won't. It will require some understanding of the larger context to tell the difference, you again need to read some books in order to tell the difference and in order to engage in a meaningful Socratic dialogue. Without human scrutiny you will get wrong results, and you need some real training to handle that.
I'm glad they go in deep on the data feed back on this.
Kurzgesagt made a great video on how this stuff gets generated, an article uses this, data sets get trained on this, and then future outputs will use the article as citation.
https://www.youtube.com/watch?v=_zfN9wnPvU0
This is the paradox to be addressed. In trying to make LLM's more accurate, we try to pin it to citations, but then that means having to trust that the citations are accurate. But having the citations generated by an LLM means it basically becomes impossible to confirm the accuracy.
As it has been said anything after 2022 cannot be reliably trusted. You can do you due diligence but that is a lot of work if you can do it.
Really highlights the idea that a lie will travel around the world before the truth puts its shoes on.
I saw a video on Linked-in. It's a talk by Steve Jobs from 1983, where he is anticipating, what an LLM can do now (at 4:03 in the video). https://lnkd.in/p/ddWU7cTp
My thoughts on the subject: What would Aristotle have said? The LLM is simulating Aristotle's response, based on syntactic and pragmatic dependencies between words and phrases taken from his works. Often you will get a sensible answers, but sometimes you won't. It will require some understanding of the larger context to tell the difference, you again need to read some books in order to tell the difference and in order to engage in a meaningful Socratic dialogue. Without human scrutiny you will get wrong results, and you need some real training to handle that.
Actually here is the full talk on youtube, the quote is at 20:26 https://www.youtube.com/watch?v=t9HmOz8H0qI