bench: add repeatable solver measurements

Add an opt-in benchmark probe and JSON runner that separate solve, construction, validation, and rendering time. Record stable search counters, environment metadata, warm-up and repetition policy, timeouts, errors, median spread, and instrumentation overhead.

Compile production solving without counters and interleave counted and plain trials when measuring overhead. Keep heavyweight cases outside the default correctness path while testing counter and report behavior cheaply.

Tests: Debug and Release CTest suites (7 passed each)

Refs: #8
This commit is contained in:
Codex instance
2026-07-30 17:08:05 +01:00
parent ce39d0a4d0
commit 598667b2f3
7 changed files with 555 additions and 1 deletions
+3
View File
@@ -63,3 +63,6 @@ N=9 # Set N to largest size of square.
See [TESTING.md](./TESTING.md) for CTest, Debug, and sanitizer
instructions.
Performance measurements use the separate opt-in suite described in
[BENCHMARKING.md](./BENCHMARKING.md).