Coding & Engineering · Capability Gaps

Coding & Engineering: Capability Gaps & Weakest Dimensions (2026)

For each recorded dimension, this page lists every Coding & Engineering tool scoring below the channel median (55 tools; channel overall median 81.4). The channel's weakest recorded dimension is Value for Money (median 78). Every score carries its archive snapshot date — these are recorded values, not audits or predictions.

Output Quality — median 84, 27 tool(s) below

ToolOutput QualityOverallSnapshot
Trae8084.22026-09-16
Tabby8082.62026-09-15
Continue8282.32026-09-15
Replit Agent8281.82026-09-06
OpenHands8281.52026-09-16
Supermaven8081.42026-09-15
Refact.ai8281.22026-09-15
Jules8279.72026-09-15
Sourcegraph Cody8379.72026-09-13
Qodana8279.42026-09-16
Roomote8279.32026-09-15
Devin8278.52026-09-13
Sweep7877.82026-09-15
CodeBuddy7877.62026-09-16
Ellipsis8077.62026-09-16
Grit7877.62026-09-17
Tongyi Lingma7877.62026-09-16
Pieces for Developers8077.62026-09-15
CodeGeeX7677.12026-09-16
Baidu Comate7676.72026-09-16
Codeflash7876.42026-09-16
Mutable AI7876.12026-09-17
Double7675.12026-09-16
Charlie7673.22026-09-16
Blackbox AI7472.42026-09-15
Magic7871.62026-09-15
Codegen7470.92026-09-15

Feature Depth — median 82, 27 tool(s) below

ToolFeature DepthOverallSnapshot
Korbit AI8182.82026-09-17
Tabby7682.62026-09-15
Tabnine8082.52026-09-13
Continue7882.32026-09-15
Amp8082.12026-09-15
Codestral8082.02026-09-17
Supermaven7481.42026-09-15
Refact.ai7881.22026-09-15
Poolside7880.42026-09-15
Jules7879.72026-09-15
Qodana8079.42026-09-16
Roomote7879.32026-09-15
Sweep7677.82026-09-15
CodeBuddy7677.62026-09-16
Ellipsis7677.62026-09-16
Grit7477.62026-09-17
Tongyi Lingma7677.62026-09-16
Pieces for Developers8077.62026-09-15
CodeGeeX7477.12026-09-16
Baidu Comate7476.72026-09-16
Codeflash7476.42026-09-16
Mutable AI7676.12026-09-17
Double7475.12026-09-16
Charlie7473.22026-09-16
Blackbox AI7272.42026-09-15
Magic7471.62026-09-15
Codegen7470.92026-09-15

Usability — median 80, 22 tool(s) below

ToolUsabilityOverallSnapshot
Claude Code7586.12026-09-06
Aider7286.02026-09-06
Cline7683.72026-09-13
Codestral7882.02026-09-17
OpenHands7681.52026-09-16
Moderne7480.42026-09-17
Poolside7680.42026-09-15
Sourcegraph Cody7879.72026-09-13
Sonar AI Code Assurance7879.52026-09-16
Qodana7879.42026-09-16
CodeBuddy7877.62026-09-16
Grit7077.62026-09-17
Tongyi Lingma7877.62026-09-16
CodeGeeX7877.12026-09-16
Baidu Comate7876.72026-09-16
Codeflash7876.42026-09-16
Mutable AI7676.12026-09-17
Double7875.12026-09-16
Charlie7673.22026-09-16
Blackbox AI7472.42026-09-15
Magic7071.62026-09-15
Codegen7270.92026-09-15

Performance — median 80, 19 tool(s) below

ToolPerformanceOverallSnapshot
Cline7883.72026-09-13
Replit Agent7881.82026-09-06
OpenHands7881.52026-09-16
Devin7678.52026-09-13
Sweep7877.82026-09-15
CodeBuddy7677.62026-09-16
Ellipsis7877.62026-09-16
Grit7677.62026-09-17
Tongyi Lingma7677.62026-09-16
Pieces for Developers7877.62026-09-15
CodeGeeX7677.12026-09-16
Baidu Comate7676.72026-09-16
Codeflash7876.42026-09-16
Mutable AI7676.12026-09-17
Double7675.12026-09-16
Charlie7473.22026-09-16
Blackbox AI7272.42026-09-15
Magic7471.62026-09-15
Codegen7270.92026-09-15

Value for Money — median 78, 25 tool(s) below

ToolValue for MoneyOverallSnapshot
OpenAI Codex7484.62026-09-15
CodeRabbit7683.22026-09-15
Greptile7682.22026-09-15
Warp7481.92026-09-15
Zencoder7481.72026-09-17
Graphite7681.62026-09-15
Augment Code7080.72026-09-15
Qodo7480.62026-09-15
Snyk Code7480.62026-09-16
Moderne7080.42026-09-17
Sourcegraph Cody7279.72026-09-13
Sonar AI Code Assurance7279.52026-09-16
Qodana7679.42026-09-16
Roomote7679.32026-09-15
Devin6878.52026-09-13
Sweep7677.82026-09-15
Ellipsis7477.62026-09-16
Pieces for Developers7077.62026-09-15
Codeflash7476.42026-09-16
Mutable AI7476.12026-09-17
Double7275.12026-09-16
Charlie6673.22026-09-16
Blackbox AI7072.42026-09-15
Magic6071.62026-09-15
Codegen6270.92026-09-15

Methodology — dimension medians computed from data/tools/<slug>.json v2-5dim snapshots (55 tools, snapshots 2026-09-06 – 2026-09-17). "Below median" = strictly lower than the channel median on that dimension. No lab measurements; snapshot dates are shown per row.