[ Benchmarks ]

Transparent evaluation.

Harness hygiene, academic suites, and safety scorecards across Origin and NextGen.

Papers: 8
Latest: 2026-02-18
Area: Benchmarks

Focus areas

Standard suites

MMLU, GPQA, HumanEval, MATH, GSM8K under pinned harnesses.

Ops metrics

Latency canaries and serving SLOs beside academic scores.

Publications

8 papers in this area

2026-02-18Publications

NextGen — Technical Report on Architecture, Training, and Evaluation

Full technical report on NextGen and Origin — architecture, training stack, Gemini-competitive benchmarks, ablations, scaling, and deployment considerations.

Read →

2026-01-20Alignment

Calibration and Abstention — Saying “I Don’t Know” Reliably

Probes and training signals for abstention when evidence is missing—progress and gaps on Origin and NextGen.

Read →

2025-12-03Safety

Safety Evaluation Card — 2025 H2 Snapshot

Compact safety scorecard for Origin, NextGen, and Quark—companion to the full Safety Research report.

Read →

2025-03-19Experiments

Structured Output Constraints — JSON Reliability for Tools

Constrained decoding, schema adherence metrics, and failure taxonomies for Origin and NextGen tool use.

Read →

2025-01-08Benchmarks

Eval Harness Standardization — Templates, Seeds, and Leaderboard Hygiene

How IdonAI locks prompt templates and harness versions so Origin/NextGen numbers stay comparable across cuts.

Read →

2024-03-11Safety

Red-Team Pack v1 — A Minimal Adversarial Suite for Release Gates

First standardized jailbreak and misuse suite used as a hard gate before Origin promotions.

Read →

2023-12-05Infrastructure

Origin Serving Canaries — Latency, Batching, and Failure Budgets

Operational research on validating Origin under load before Quark promotion: SLOs, canaries, and rollback.

Read →

2023-11-16Publications

Origin — Technical Report on IdonAI's Fast Production Model

Full technical report on Origin: architecture, training pipeline, Flash-class benchmark suite, serving infrastructure, distillation methodology, safety interfaces, ablation study, and known limitations.

Read →

[ Research ]

Explore the full archive.

Browse every area, or email the research team about collaborations, datasets, and eval access.

All research Email research