Record prompts and responses, and whether the command was run

[simonw]

At the moment this bypasses the LLM mechanism for logging to SQLite, which feels like a wasted opportunity to gather more interesting data.

Plus recording if the user hit "enter" or edited the prompt or cancelled it could be really interesting. In the future that could even work as additional signal for the LLM - could pass in the last 3 "accepted" completions as examples, or even look for similar accepted examples and include those (RAG style) in the prompt.

[simonw]

... if the user does execute the command, we could even track its exit code and make a note if it failed with an error.

And maybe even have a llm cmd -/--retry mechanism of some sort, which automatically sends in the error message from the last attempt to get it to try again.

[gtarpenning]

100% +1 to this