-
Notifications
You must be signed in to change notification settings - Fork 6
Pull requests: nearai/benchmarks
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
fix(mock): combined CA bundle for containers + bash-3.2 build_mock
#246
opened Jul 9, 2026 by
pranavraja99
Contributor
Loading…
fix(mock): gws/gh mock in openclaw/hermes containers + stop mock-env leak
#241
opened Jul 9, 2026 by
pranavraja99
Contributor
Loading…
feat(judge): capture OpenRouter upstream provider in judge traces
#232
opened Jul 7, 2026 by
zetyquickly
Member
Loading…
ci(pinchbench): micro smoke on OpenRouter + parallelism 13
#227
opened Jul 7, 2026 by
pranavraja99
Contributor
Loading…
fix(reborn-memory): correct scorer bugs found by the memory-tools audit
#220
opened Jul 6, 2026 by
BenKurrek
Contributor
Loading…
fix(bench): permissive tool nudge (gpt-5.5 stops abandoning tasks)
#218
opened Jul 5, 2026 by
pranavraja99
Contributor
Loading…
results(gpt-5.5): trustable ClawBench + OfficeQA (6/9)
#217
opened Jul 5, 2026 by
pranavraja99
Contributor
Loading…
fix(pinchbench): stop scoring tasks 0.0 on transient judge failures
#188
opened Jun 26, 2026 by
pranavraja99
Contributor
•
Draft
feat(codex): ChatGPT/Codex subscription for openclaw+hermes + token monitoring
#186
opened Jun 26, 2026 by
pranavraja99
Contributor
Loading…
DeepSeek-V4-Flash drops tool calls on NEAR (repro script + bug report)
#185
opened Jun 26, 2026 by
pranavraja99
Contributor
Loading…
docs(meta-harness): PRD for automated ironclaw reborn-harness optimizer
#126
opened Jun 16, 2026 by
pranavraja99
Contributor
•
Draft
feat(automation-workflows): add self-learning/ benchmarks for self-learning-loops brief
#60
opened Jun 8, 2026 by
sergeiest
Contributor
Loading…
2 tasks
feat(automation-workflows): add secrets/ benchmarks for vault-backed http calls from Slack DM
#55
opened Jun 5, 2026 by
sergeiest
Contributor
Loading…
3 tasks
feat(automation-workflows): add channels/slack benchmarks for Slack channel routing
#54
opened Jun 5, 2026 by
sergeiest
Contributor
Loading…
3 tasks
Reborn: simulated-company eval harness — PRD + golden validator + default-all tools
#50
opened Jun 4, 2026 by
pranavraja99
Contributor
Loading…
chore(baselines): refresh ironclaw baseline to 749f584 ⚠️ pass_rate shifted >5pp
automated
baselines
#47
opened May 29, 2026 by
github-actions
Bot
Loading…
chore(baselines): refresh ironclaw baseline to 9df5e8d ⚠️ pass_rate shifted >5pp
automated
baselines
#40
opened May 27, 2026 by
github-actions
Bot
Loading…
chore(baselines): refresh ironclaw baseline to 2a95799 ⚠️ pass_rate shifted >5pp
automated
baselines
#38
opened May 25, 2026 by
github-actions
Bot
Loading…
chore(baselines): refresh ironclaw baseline to 030cfeb ⚠️ pass_rate shifted >5pp
automated
baselines
#36
opened May 21, 2026 by
github-actions
Bot
Loading…
feat: Build abstraction — score configs (framework + tools + model), not frameworks
#25
opened May 8, 2026 by
pranavraja99
Contributor
Loading…
4 of 6 tasks
feat: structured-data benchmark, 22 scenarios across 4 household categories
#14
opened Apr 10, 2026 by
standardtoaster
Loading…
4 of 5 tasks
feat: workspace.documents seeding, memory tools, tool restriction, numeric assertions
#13
opened Apr 9, 2026 by
standardtoaster
Loading…
4 tasks done
feat: workplace simulation benchmark suite
#11
opened Mar 31, 2026 by
ilblackdragon
Member
•
Draft
2 of 4 tasks
ProTip!
Exclude everything labeled
bug with -label:bug.