test-reliability

Scantrix analyzes automation repositories to uncover framework inefficiencies, flaky tests, and reliability risks.

Verification Trust Engine: Your tests are lying to you. We prove it.

Find the tests that pass sometimes and fail others, and work out why. Reads JUnit XML, so it works with any test framework. Zero dependencies.

Find flaky tests by running your suite repeatedly and diffing the results — language-agnostic via JUnit XML.

Flaky test detection and analytics platform — statistical analysis, root cause classification, quarantine management, suite health metrics. TypeScript/Node.js + PostgreSQL + Redis + Docker + GitHub Actions CI.

Flaky test detection: statistical analysis, flakiness scoring, quarantine recommendations, root cause patterns.

Detect unreliable tests by running them multiple times - Part of Tuulbelt

Rerun a pytest suite N times to find flaky tests, score their stability, and diagnose the likely cause.

Randomize test execution order to detect hidden dependencies and flaky tests

An adaptive testing engine: item response theory, maximum-information item selection, live ability estimation, and differential item functioning.

Observability for .NET test suites. Track test reliability, detect flaky tests, and gain confidence in your testing with minimal setup. Supports NUnit, xUnit, and MSTest.