When you let an LLM write a text for you (source code or some scientific stuff) and then you discuss about changes that you want, the LLM will put some comments in the text related to the conversation
These comments will read weird when you do not know the conversation with the LLM. Like: You ask it to make a button read instead of blue and it will at "intentionally made button red here". - Or: The LLM will write that it did not use a certain approach for a derivation or notation just because you asked it to change such things.
You have to explicitly tell the LLM that bit shall only include what has been declared as finalized and that the text (especially prose) shall be self-contained.
Maybe it is hard for an LLM to distinguish the context of the conversation and the context of the text it shall write for you (I mean the abstract context, not the LLM context window).
I think there is a general problem:
When you let an LLM write a text for you (source code or some scientific stuff) and then you discuss about changes that you want, the LLM will put some comments in the text related to the conversation These comments will read weird when you do not know the conversation with the LLM. Like: You ask it to make a button read instead of blue and it will at "intentionally made button red here". - Or: The LLM will write that it did not use a certain approach for a derivation or notation just because you asked it to change such things.
You have to explicitly tell the LLM that bit shall only include what has been declared as finalized and that the text (especially prose) shall be self-contained.
Maybe it is hard for an LLM to distinguish the context of the conversation and the context of the text it shall write for you (I mean the abstract context, not the LLM context window).