HermeticByExpectedOutputCount¶
TL;DR — Performs a hermetic test by comparing the count of a given output in a session to a given expected count
When to use¶
Adds up the number of items found in the configured output names across every session given to the assertion and compares that total with one exact expected count.
Missing output names contribute zero instead of throwing. That makes the assertion useful when you want a strict "exactly N outputs were produced" check over one session or over a filtered group of sessions.
YAML configuration¶
Use the hook name in the matching runtime section, then place hook-specific fields under the configuration object shown in the examples below.
Minimal example¶
Sessions:
- Name: SampleSession
Assertions:
- Name: HermeticByExpectedOutputCountAssertion
Assertion: HermeticByExpectedOutputCount
SessionNames:
- SampleSession
AssertionConfiguration:
OutputNames:
- Reply
- RetryReply
ExpectedCount: 3
Realistic example¶
This assertion totals the number of saved items in Reply and RetryReply for SampleSession and expects the combined count to be exactly 3.
If one of those outputs is missing entirely it contributes zero. The assertion passes only when the final summed count equals 3.
Edge cases¶
- Missing required configuration keys fail schema validation before the hook runs.
- Keep hook names and referenced session or data-source names aligned with the surrounding YAML.