Agents Lookup

Use cases / Decision models (Jev)

Screen news articles for relevance before an LLM writes the briefing

Jev gives each fetched article a relevance probability so only on-topic stories reach the expensive model that writes the briefing.

DifficultyIntermediate
Setup time2-4 hours
CategoryDecision models (Jev)

Author's figure: Author reports about 18% fewer input tokens at a 0.70 threshold with blind-panel quality mostly unchanged, and a net loss when the writing model is a mini-class model.. Reported by the builder, not measured by us.

The use case

Teams that send news search results to a frontier model for daily briefings pay for every off-topic article in the prompt. Keyword search pulls in loose matches. Jev reads each article's title and snippet and returns the probability that it is truly about the query. Articles above a set threshold go on to the writing model; the rest are dropped. The author found savings only at frontier prices and suggests a lower threshold where missing a story is costly. A person still reads the finished briefing before it is shared and spot-checks dropped articles when the threshold changes.

Example workflow

  1. Pull candidate articles from the Currents News API keyword search
  2. Send each title and description to Jev with one yes/no relevance question
  3. Keep articles whose relevance probability clears a threshold such as 0.70
  4. Pass the kept articles to Claude or another frontier model to write the briefing
  5. Review the briefing and sample dropped articles before changing the threshold

Tools

Risks and guardrails

Sources

Written by Agents Lookup. Credits and official pages for the tools this use case names: