#autoprompt — Public Fediverse posts

📋 #Autoprompt is an #opensource coding-agent skill that cut failures by 45% on agentic coding tasks #aiagents #devtools

⚡ Measured on Terminal-Bench 2.1: #OpenCode solved 60/89 tasks alone and 73/89 with Autoprompt, +14.61 points, 29 failures down to 16
🧵👇

After conducting several rounds of tests, I began to question the effectiveness of #AutoPrompt in solving real-world issues. In my experience, the end results were worse than those obtained from #gpt-prompt-engineer, and the cost was over 10 times higher.

I'll keep trying but perhaps I lack the understanding of how to use AutoPrompt effectively. :/

#gpt #llm #PromptEngineering

https://arxiv.org/abs/2402.03099

"The generation setting is composed of two parts: generating the ranker prompt and then using the ranker to optimize the generation task prompt"

We human are so good at using tools to improve our workflow, isn't it?

#AutoPrompt #ai #gpt #PromptEngineering