Why make an LLM read thousands of spans to count errors?
In our benchmark, querying traces with SQL + code mode cost ~17x less than fetching spans page by page.
See how @ArizePhoenix MCP does it, live in Claude Code and Cursor.
Search
4 results for “arizeai”
-
Why make an LLM read thousands of spans to count errors?
In our benchmark, querying traces with SQL + code mode cost ~17x less than fetching spans page by page. Arize AI
See how @ArizePhoenix MCP does it, live in Claude Code and Cursor.
-
Claude can refuse legitimate security work because it looks dangerous.
But in a test, a fake permission claim in https://CLAUDE.md convinced it to help bypass login and dump a database.
Somehow we've made agent permissions both too strict and too gullible.
-
The problem is that models can't verify who you are, or even whether the instructions they're following came from you.
We already know how to do authorization in software and it's becoming clear that agents need those same checks in the harness before tools execute.
@seldo explains: https://arize.com/blog/ai-agent-permissions/