Article
Using Token Data to Improve the AI Agent Experience
phranzia
• • 2Golda Manuel PRO
phranzia
AI & ML interests
Founder of Quantiles, an open-source, local-first AI evaluation framework
Recent Activity
upvoted an article 3 days ago
Using Token Data to Improve the AI Agent Experience updated a Space 3 days ago
quantiles/README published an article 3 days ago
Using Token Data to Improve the AI Agent ExperienceOrganizations
upvoted an article 3 days ago
updated a
Space 3 days ago
published an article 3 days ago
Article
Using Token Data to Improve the AI Agent Experience
phranzia
• • 2 upvoted an article 3 days ago
Article
The Agent Said It Was Done. The Database Disagreed.
microsoft
• • 70 Add SKILL.md article to Quantiles organization card
#1 opened 10 days ago
by 
phranzia
commented on Evaluating AI Agent Tool Use 16 days ago
The verification point is a really important one. We have to be careful not to accidentally optimize agents toward the shortest trajectory. An extra call that verifies state can be much more valuable than an agent stopping early.
upvoted an article 17 days ago
Article
Evaluating AI Agent Tool Use
phranzia
• • 2 published an article 17 days ago
Article
Evaluating AI Agent Tool Use
phranzia
• • 2 upvoted an article 17 days ago
Article
When Benchmark Numbers Become Marketing
DedeProGames
• • 7 upvoted an article 24 days ago
Article
Measuring Agent Recovery
phranzia
• • 2 published an article 24 days ago
Article
Measuring Agent Recovery
phranzia
• • 2 upvoted 2
articles 24 days ago
Article
BenchMIRT: What are LLM benchmarks actually measuring?
allenai
• • 27 Article
Your Agent Aced the Task. Will It Do It Again?
ibm-research
• • 120 upvoted an article 27 days ago
Article
Measure, Understand, and Improve Agent Latency
phranzia
• • 1 published an article 27 days ago
Article
Measure, Understand, and Improve Agent Latency
phranzia
• • 1 upvoted an article about 1 month ago
Article
Using Execution Traces to Evaluate AI Agent Behavior
phranzia
• • 2 published an article about 1 month ago
Article
Using Execution Traces to Evaluate AI Agent Behavior
phranzia
• • 2 upvoted 2
articles about 1 month ago
Article
Measuring benchmark optimization in speech recognition
- +5
tlebryk02, bezzam, aliceebaird, dayllon, jpc, jens-hume-ai, tzirakis
• • 68 Article
Inside three.ws: The Open-Source Stack That Gives AI Agents a Body, a Brain, a Wallet, and a Job
three-ws
• • 47 upvoted an article about 2 months ago
Article
The Best Open Source and Open-Weight LLM Models to Run Locally in 2026
daya-shankar
• • 27