AI in Practice

Jev and Its Open-Source Alternatives: When a Decision Model Beats a Chatbot

Which team gets this ticket? Is this email a complaint? A lot of AI work in business software is a tiny decision, repeated thousands of times a day. What TypeSafe's Jev does, how the open-source rivals Laya, Kev and OpenJev compare, and how to test one on your own data.

4:24 video 6 chapters Full transcript below
Key takeaways

Key takeaways

If you only have a minute, these are the points that matter.

Transcript

Read along

Press a timestamp to play the video from that moment.

0:00

Which team should get this ticket? Is this email a complaint? How urgent is this lead?

0:05

A lot of the AI work inside business software isn't conversation. It's a quick judgement, repeated thousands of times a day.

0:11

Chat models can do it, but they're slow and costly for the job, and their answers still need parsing.

0:16

In September, Jev, a model built for nothing but these decisions, went viral. Open-source rivals followed within days.

0:24

Here's what Jev does, how the open rivals compare, and how to try one safely.

0:28

Jev and its open-source rivals. When a decision model beats a chatbot.

0:32

First, what Jev actually does. TypeSafe AI, a San Francisco startup, released it in early access on 15 September 2026.

0:41

It doesn't write text. You send it your application's state and a set of typed questions.

0:46

It returns a choice, a yes or no judgement, or a score, each with a probability attached.

0:52

TypeSafe's numbers are striking: answers in 70 to 500 milliseconds, and $0.042 per million input tokens, with output free.

1:00

Every answer must be one of the options you defined, so Jev can't return a malformed result. It can still pick the wrong option.

1:07

The company is open about the caveats. It can't prove the price isn't subsidised, and its own team built the workflows behind its benchmarks.

1:14

Developers piled in anyway. A September study counted 2,170 public projects using Jev. Routing and automation drew the most attention.

1:24

Now the open-source rivals. TypeSafe hasn't published Jev's weights, so none of them is a true copy.

1:30

Most are built on generative language models such as Qwen. Several simply read answer probabilities off them. That ranks the options, but doesn't calibrate them.

1:39

Laya is the exception: a dedicated decision model based on ModernBERT, released under Apache 2.0, with its own calibration training.

1:47

Its author's benchmarks put it 6 to 8 times faster than published measurements of Jev: roughly 33 to 40 milliseconds per call, on one T4 GPU.

1:56

The catch is in its own model card. Without fine-tuning, it scores below simply guessing the most common answer.

2:02

Kev takes another route: small models built on Qwen3.5 that speak Jev's own API format. Code written for Jev can point at your server instead.

2:11

Its 9B model scores 0.812 against Jev's 0.857 on a development set. The author stresses this isn't a controlled comparison.

2:20

And OpenJev claims to sit within 1.4 points of hosted Jev on 10,000 questions. That figure is also self-reported.

2:27

Next: hosted or self-hosted? Jev is hosted only. You call TypeSafe's API on the US West Coast, or reach it through AI gateways.

2:36

For a European business, the case for an open model is rarely price. At Jev's listed rate, your own GPU is unlikely to be cheaper.

2:44

The case is control. Customer emails and tickets never leave your servers, and nobody can change the model or the price under you.

2:51

Language is the other test. Laya's English checkpoint collapses on non-Latin scripts while staying confident. On Khmer text, it scored 0% accuracy at 95% confidence.

3:03

Bulgarian is written in Cyrillic. So route it to a multilingual model, and test it on real messages first.

3:08

So where does a decision model fit? Your code gathers the facts, the model makes one narrow judgement, and your code acts on it.

3:16

The model never sends an email or edits a record itself. That makes it far easier to test than an always-on agent.

3:22

Customer support is the classic fit. Routing a request or flagging an angry customer is exactly what a fast decision model can take off a slower, pricier one.

3:31

To try one, pick one decision you already make by hand or with a chat model. Collect a few hundred real examples with the right answers.

3:38

Run Jev and one open model against them. Compare accuracy, speed, and how often each is confidently wrong.

3:45

That last number matters most. A confident mistake is the one your code won't catch.

3:50

Watch for quiet mistakes at scale. One AI-driven import created 790 duplicate records, because “not found” silently became “new”.

3:59

And sometimes a plain rule beats any model. So challenge the obvious fix, including whether AI is needed at all.

4:06

A decision model won't replace your agents or your developers. It replaces the slow, fragile if-statement in the middle of a workflow.

4:13

Want help choosing a model, or wiring one into an existing system? Talk to an engineer at teamarcai.com.

Related article
More videos

Keep watching

All videos
Contact

Recognise your own system in one of these?

Tell us what is going on and we will suggest a first step.

Let’s talk