Reproducibility

Benchmark Methodology and Reproduction Instructions

The benchmark contract that keeps XFlowIQ honest: exact versions, same environment, complete results, competitor wins, limitations, scripts, and evidence.

Benchmark hubToken harness
Evidence Contract

Every comparison must carry the same proof fields.

required

Exact product and model versions

Product build number, commit SHA, and package lock hash
Competitor product name, edition, version, and update state
Model names, model dates, judge model names, and API settings when AI benchmarks are involved
Operating system, browser, runtime, hardware profile, and test date
required

Test environment

Clean setup or snapshot used for every repeated test
All network, account, and permission settings documented
No production customer data, secrets, payments, or live provider mutations
required

Baseline configuration

Competitor default configuration
XFlowIQ disabled baseline where relevant
XFlowIQ monitor mode
XFlowIQ recommendation, approval, and receipt mode
required

Complete results

Publish all runs or clearly state exclusion rules before testing
Do not publish cherry-picked best runs
Include errors, false positives, timeouts, and cases where competitors performed better
required

Cases where the competitor performed better

Every page must reserve a visible section for competitor wins
If no competitor wins are found, the page must state the exact tested scope and the possibility that broader tests may differ
required

Limitations

No benchmark is universal
Small fixtures do not prove broad superiority
Security, payment, privacy, and provider integrations need outside review before strong public claims
required

Reproduction scripts or evidence

Scripts or exact manual steps
Raw JSON results
Screenshots or logs
Human approval or verifier receipts
Public date of test and retest schedule
Independence

XFlowIQ comparison pages are independent pages and are not affiliated with the products, vendors, or model providers compared.

Public pages should keep this line visible so comparison SEO stays clean, honest, and reviewable.