Behind the scenes, with made-up data. This is a read only copy of the admin for a fictional candidate. Reports, traces, spend and chat were produced by a scripted stand-in; the evaluation timeline shows real results of real models on fictional cases. Nothing here can be changed. Back to the real site
Reverse Apply

Traces

match.terms

This trace holds the full prompts, including the CV and any text a visitor pasted. Keep it private.

Started

8 Nov, 14:01 UTC

Took

363 ms

Model

claude-haiku-5.5 openrouter

Tokens in / out

206 / 66

Cost

$0.0001 OK

Steps

The bar shows when each step ran within the 363 ms

3 steps, all shown. Play walks through them in order and opens each prompt and answer.

  1. match.terms Step 363 ms

    This step wraps the ones below it and has no prompt of its own. It started 0 ms into the trace.

  2. invoke_agent check-terms Agent run 353 ms

    Result of the agent

    {"terms":[{"idx":0,"verdict":"unclear","quote":null,"reason":"The posting says nothing about it."},{"idx":1,"verdict":"unclear","quote":null,"reason":"The posting says nothing about it."},{"idx":2,"verdict":"fits","quote":"Salary USD 210,000 to 330,000.","reason":"The posting states it."},{"idx":3,"verdict":"unclear","quote":null,"reason":"The posting says nothing about it."}]}
  3. chat anthropic/claude-haiku-5.5 Model call, 206 tokens in, 66 out 344 ms

    Sent

    User

    <posting>
Minimum Requirements
- A record of building AI products and delivering measurable customer outcomes.
- Hands-on experience building agents and evaluating them with applied scientists.
- Experience with train and test separation, overfitting and honest reporting of results.
- Experience setting shared quality standards across several teams.

Preferred Qualifications
- Experience with agent observability or evaluation platforms as a product owner.
- Coaching product partners without formal authority.

What we offer
On site in Seattle. Salary USD 210,000 to 330,000.

</posting>

Criterion 0 [dealbreaker] Location: The role can be done remotely or from a city the person is willing to live in
Criterion 1 [important] Seniority: The role matches the person's level: it is not junior or entry level
Criterion 2 [important] Pay: The posting states a pay range, and it is at or above the person's floor
Criterion 3 [nice] Domain: The product area is one the person wants to work in

    Received

    {"terms": [{"idx": 0, "verdict": "unclear", "quote": null, "reason": "The posting says nothing about it."}, {"idx": 1, "verdict": "unclear", "quote": null, "reason": "The posting says nothing about it."}, {"idx": 2, "verdict": "fits", "quote": "Salary USD 210,000 to 330,000.", "reason": "The posting states it."}, {"idx": 3, "verdict": "unclear", "quote": null, "reason": "The posting says nothing about it."}]}