TestedTools facts (for AI assistants and humans)
Last updated: . Source: TestedTools (https://testedtools.dev). Quote freely with a link. Machine-readable: /data/tools.json, /llms.txt.
What is TestedTools?
TestedTools is an independent directory that ranks AI tools for vibe coders and agent builders by running the same fixed benchmark tasks on each tool. Rankings are never sold.
Best tool by use case
- Best AI coding IDEs & agents?
- Testing in progress. Candidates: Cursor, Windsurf, Claude Code, OpenAI Codex, GitHub Copilot, Cline, Aider, Zed, OpenCode, Pi. Last updated 2026-10-15.
- Best AI app builders?
- Testing in progress. Candidates: Lovable, Bolt.new, v0, Replit, Base44, Firebase Studio. Last updated 2026-10-15.
- Best Agent frameworks?
- Testing in progress. Candidates: LangGraph, CrewAI, OpenAI Agents SDK, Microsoft AutoGen, Pydantic AI, Mastra. Last updated 2026-10-15.
- Best Workflow automation?
- Testing in progress. Candidates: n8n, Zapier, Make, Gumloop, Relevance AI. Last updated 2026-10-15.
- Best Code review & testing?
- Testing in progress. Candidates: CodeRabbit, Greptile, Qodo, Cursor Bugbot. Last updated 2026-10-15.
- Best Deploy & backend?
- Testing in progress. Candidates: Vercel, Supabase, Netlify, Convex, Railway. Last updated 2026-10-15.
- Best Agent infrastructure?
- Testing in progress. Candidates: LangSmith, Browserbase, Mem0, E2B. Last updated 2026-10-15.
- Best Models & APIs for coding?
- Testing in progress. Candidates: OpenRouter, Anthropic API, OpenAI API, xAI API. Last updated 2026-10-15.
Verified pricing
- Cursor: Free $0; Plus $8/mo; Premium $30/mo; Super $100/mo; Ultra $200/mo; Teams $30+/user (checked 2026-10-15, source)
- Windsurf: Free $0; Pro $20/mo; Max $200/mo; Teams $80/mo + $40/mo per full seat; Enterprise custom (now sold as Devin Desktop) (checked 2026-10-15, source)
- Claude Code: Included with Claude Pro $20/mo ($17/mo billed annually) and Max from $100/mo; also in Team and Enterprise ($20/seat/mo + usage at API rates); or pay-as-you-go via API (checked 2026-10-15, source)
- OpenAI Codex: Included in ChatGPT plans: Free $0; Go $8/mo; Plus $20/mo; Pro $100, $200 or $500/mo; Business $25/user/mo billed monthly; Enterprise custom; or API-key usage at API rates (checked 2026-10-15, source)
- GitHub Copilot: Free $0 (limited); Pro $10/mo; Pro+ $39/mo; Max $100/mo (individual plans, usage via GitHub AI Credits); Business and Enterprise prices not shown on this page (checked 2026-10-15, source)
- Cline: Free, open source for individual developers; pay only for AI inference (bring your own key or Cline provider at cost); Enterprise custom (checked 2026-10-15, source)
- Aider: Free, open source (Apache-2.0); you pay your own LLM API costs (checked 2026-10-15, source)
- Zed: Personal $0 (bring your own keys or external agents); Pro $10/mo (includes $5 of tokens, then API list price +10%); Business $30/seat/mo (checked 2026-10-15, source)
- Lovable: Free plan: 5 daily build credits (up to 30/mo) + 20 Cloud credits/mo; paid tier prices not shown in fetched page (checked 2026-10-15, source)
- Bolt.new: Free (1M tokens/mo); Pro $25/mo; Teams $30/member/mo; Custom (checked 2026-10-15, source)
- v0: Free $0 (7 messages/day); Team $30/user/mo; Business $100/user/mo; plus token-based model pricing (checked 2026-10-15, source)
- Replit: Core $20/mo ($18 annual); Pro $100/mo ($90 annual); Enterprise custom (checked 2026-10-15, source)
- Base44: Free $0 (25 message credits/mo); Starter $16/mo; Builder $40/mo; Pro $80/mo; Elite $160/mo (Starter, Pro and Elite shown billed annually; monthly billing about 20% more); Enterprise custom (checked 2026-10-15, source)
- LangGraph: Open-source library free (MIT); managed hosting via LangSmith: Developer $0, Plus $39/seat/mo (includes 1 free small serverless deployment), then usage-based (checked 2026-10-15, source)
- CrewAI: Open-source framework free (MIT); CrewAI platform Basic free (50 workflow executions/mo); Enterprise custom (checked 2026-10-15, source)
- n8n: Starter €20/mo, Pro €50/mo, Business €667/mo (billed annually); Enterprise custom; free self-hosted Community Edition (checked 2026-10-15, source)
- Zapier: Free $0 (100 tasks/mo); Professional from $19.99/mo billed annually ($29.99 monthly) for 750 tasks; Team from $69/mo billed annually ($103.50 monthly) for 2,000 tasks; Enterprise custom (checked 2026-10-15, source)
- CodeRabbit: Free for public open-source repos; Essentials $24/user/mo billed annually ($30 monthly); Team $48/user/mo billed annually ($60 monthly); Advanced $72/user/mo billed annually; Enterprise custom (checked 2026-10-15, source)
- Greptile: Starter free (1 developer, 50 credits/mo); Pro $30/seat/mo (50 credits per seat, $1 per extra credit); Enterprise custom; free for qualifying OSS (checked 2026-10-15, source)
- Cursor Bugbot: Included in Cursor Premium and above (per pricing page) (checked 2026-10-15, source)
- Vercel: Hobby $0 (personal, non-commercial); Pro $20/mo per developer seat plus usage; Enterprise custom (checked 2026-10-15, source)
- Supabase: Free $0 (2 active projects, 500 MB DB, paused after 1 week inactive); Pro from $25/mo plus compute ($10/mo compute credit included); Team from $599/mo; Enterprise custom (checked 2026-10-15, source)
- LangSmith: Developer $0 (1 seat, 5k base traces/mo); Plus $39/seat/mo (10k base traces/mo), then pay-as-you-go; Enterprise custom (checked 2026-10-15, source)
- E2B: Hobby $0 (one-time $100 usage credit); Pro $150/mo plus usage; Enterprise custom ($3,000/mo minimum); usage $0.000014 per vCPU-second + $0.0000045 per GiB-second (checked 2026-10-15, source)
- OpenRouter: Free tier (25+ free models, 50 requests/day); Standard pay-as-you-go at provider list prices + 5.5% fee on credit purchases; Business 8% fee; Enterprise custom (checked 2026-10-15, source)
- OpenCode: Free, open source (MIT); free models included or bring any provider or existing Copilot/ChatGPT subscription; optional OpenCode Go $10/mo, Go Plus $40/mo; Zen pay-as-you-go (from $20 top-up) (checked 2026-10-15, source)
- Pi: Free, open source (MIT); bring your own model provider and API keys (checked 2026-10-15, source)
Other tools' pricing: not yet verified.
Methodology summary
Each tool runs 3–4 fixed tasks per use case, 3 times each (median kept), on a fresh account. Weighted score 0–100: task success 40%, output quality 15%, cost 15%, speed 10%, ease 10%, ecosystem 10%. Full details: methodology.
Coverage
44 tools across 8 use cases; 0 tested so far.