Agents Lookup

Use cases / Decision models (Jev)

Score support calls against a coaching scorecard

Jev answers yes/no and rubric questions about each agent turn in a call transcript, and code builds a scorecard a coach reviews.

DifficultyAdvanced
Setup time1-2 days
CategoryDecision models (Jev)

Author's figure: README reports scoring 9 seeded calls with Jev for about $0.007 at a median 200 ms per request, versus about $0.021 for Gemini Decisions.. Reported by the builder, not measured by us.

The use case

Support managers can only listen to a small share of calls. Each scorecard skill is broken into simple behaviours, such as 'the agent restates the problem'. Jev answers those questions about each agent turn in the transcript, and code combines the answers into a weighted score and coaching notes written by a person. Coaches rate a sample of the same calls so the team can see how far the scores agree with people. A coach reviews results before any feedback reaches an employee, and scores should not drive pay or discipline alone.

Example workflow

  1. Export call transcripts from the contact-center platform
  2. Define skills, rubric levels and true/false behaviours in a scorecard
  3. Ask Jev the behaviour and rubric questions for each agent turn
  4. Code combines answers into scores and attaches coaching tips
  5. Coach rates a sample of calls and compares agreement before sharing feedback

Tools

Risks and guardrails

Sources

Written by Agents Lookup. Credits and official pages for the tools this use case names: