Behind the scenes, with made-up data. This is a read only copy of the admin for a fictional candidate. Reports, traces, spend and chat were produced by a scripted stand-in; the evaluation timeline shows real results of real models on fictional cases. Nothing here can be changed. Back to the real site
Reverse Apply

Traces

match.fit

This trace holds the full prompts, including the CV and any text a visitor pasted. Keep it private.

Started

12 Nov, 14:01 UTC

Took

659 ms

Model

amazon.nova-lite-v1:0 bedrock

Tokens in / out

171 / 106

Cost

$0.0000 Error

Steps

The bar shows when each step ran within the 659 ms

5 steps, all shown. Play walks through them in order and opens each prompt and answer.

  1. match.fit Error Step 659 ms

    'NoneType' object has no attribute 'group'

  2. invoke_agent extract-requirements Agent run 294 ms

    Result of the agent

    {"title":"","company":"","minimum_heading":"","desirable_heading":"","requirements":[{"text":"A record of shipping search or retrieval products used by developers.","kind":"minimum"},{"text":"Experience defining and measuring search quality, including offline evaluation and relevance judgments.","kind":"minimum"},{"text":"Experience leading a cross-functional team of engineers and data scientists.","kind":"minimum"},{"text":"Experience with usage-based pricing for an API product.","kind":"minimum"},{"text":"Hands-on work with embeddings, hybrid retrieval and reranking.","kind":"desirable"},{"text":"Familiarity with the web publishing ecosystem, crawlers and answer engine optimization.","kind":"desirable"},{"text":"You have written code to test an idea yourself.","kind":"desirable"}]}
  3. chat amazon.nova-lite-v1:0 Model call, 171 tokens in, 106 out 285 ms

    Sent

    User

    <posting>
About us
Northwind builds search for developers and their agents.

What you'll do
- Own the roadmap for our search API and talk to developers every day.

Minimum Requirements
- A record of shipping search or retrieval products used by developers.
- Experience defining and measuring search quality, including offline evaluation and relevance judgments.
- Experience leading a cross-functional team of engineers and data scientists.
- Experience with usage-based pricing for an API product.

Preferred Qualifications
- Hands-on work with embeddings, hybrid retrieval and reranking.
- Familiarity with the web publishing ecosystem, crawlers and answer engine optimization.
- You have written code to test an idea yourself.

Compensation
Remote in Europe. EUR 110,000 to 140,000 plus equity.

</posting>

    Received

    {"requirements": [{"text": "A record of shipping search or retrieval products used by developers.", "kind": "minimum"}, {"text": "Experience defining and measuring search quality, including offline evaluation and relevance judgments.", "kind": "minimum"}, {"text": "Experience leading a cross-functional team of engineers and data scientists.", "kind": "minimum"}, {"text": "Experience with usage-based pricing for an API product.", "kind": "minimum"}, {"text": "Hands-on work with embeddings, hybrid retrieval and reranking.", "kind": "desirable"}, {"text": "Familiarity with the web publishing ecosystem, crawlers and answer engine optimization.", "kind": "desirable"}, {"text": "You have written code to test an idea yourself.", "kind": "desirable"}]}
  4. invoke_agent judge-evidence Error Agent run 321 ms

    'NoneType' object has no attribute 'group'

  5. chat amazon.nova-lite-v1:0 Error Model call 298 ms

    'NoneType' object has no attribute 'group'