Skip to content
World clockEU--:--UK--:--USA--:--CN--:--PLDEFRIT中文EN

portal about AI and technologyevents · analysis · interviews · technical background

Search
LIVE
›

Cloudflare opens Clef decision models as Jev clones multiply

Cloudflare released two open-weight decision models, Clef and Clef-flash, on Thursday. They are hosted on Workers AI and published on Hugging Face under an Apache 2.0 licence, alongside a new reinforcement learning fine-tuning product.

AI & modelsNewsRachel NwosuPublished: 1 October 20264 min readSources 11
Cloudflare opens Clef decision models as Jev clones multiply

The announcement on the company blog lands the same day Amazon pushed its own Jev-style model. It comes hours after InfoQ described TypeSafe AI's Jev as a decision-only system that returns typed probabilities instead of text. Cloudflare says Clef currently leads the Jev Decision Index, the benchmark site linked in the post.

Decision models are a narrower bet than the general-purpose assistants dominating headlines. They take a set of candidate answers, or "questions" with defined output types, and return probabilities rather than prose. Cloudflare is blunt about where the value sits: the model classifies, your code routes.

The company provided one worked example from its own operations. Feeding a domain through Clef with Browser Run, it classified a site at 95% fashion, 85% ecommerce and under 1% phishing. Cloudflare says the fetch, render and classify loop took 2.2 seconds for Clef. Its fastest general LLM, gpt-oss-120b, took 4.7 seconds and returned only two classifications in the same workflow. That is a latency claim, not an accuracy one. It comes from Cloudflare's own Threat Intelligence team, not an independent test.

Open weights, and a benchmark fight

Both models are hosted on Workers AI and released under Apache 2.0, which permits commercial use. This differs from the closed APIs surrounding most frontier assistants. It puts Cloudflare in the same corner as the open-weight crowd it competes with on cost and latency. The competitive field is getting crowded fast.

TechCrunch reported on 30 September that OpenAI used its Dev Day to show a Decisions API. CEO Sam Altman described it as a way to give the company's Luna model a predefined set of options to choose between. Altman said focusing the model on that choice keeps it fast while retaining image understanding, language coverage and safety protections.

TypeSafe AI CEO Diogo Almeida, a former OpenAI engineer, responded on X with a joke about the clone wars, TechCrunch reported. He added that OpenAI's move could signal that building in a System One compatible way is the future. Almeida told TechCrunch that his company's moat is synthetic data for statistically useful outputs. He noted that "fast and cheap is very easy" while intelligence is the hard part.

Not everyone agrees Jev is ahead

Independent comparisons are already muddying the picture. A GitHub write-up published on 25 September compared an unfinetuned Qwen3.5-9B against Jev 1.13.0. It reported comparable accuracy with lower average calibration error on several benchmarks, without decision-specific training. That project reports Jev leading on JevBench (86.1% against 80.5%), Typed Decisions (73.9% against 62.1%) and When2Call (73.3% against 61.8%). Qwen3.5-9B led on phishing (73.9% against 62.5%) and MetaTool (83.4% against 77.1%). WebShop was near identical at 24.8% and 24.6%.

The same repository reports latency in Jev's favour on most tasks, despite running Qwen on a single NVIDIA H100 80GB. That is the awkward part of the decision-model pitch. If a stock language model can be queried for next-token probabilities and land in the same range, the case for a separate model class rests on speed, calibration and cost per decision, not raw capability.

Another open project, Contrastive Language Models, claims a different trade-off. Its repository, last updated on 25 September, describes CLM-8B as pre-trained on 60M Nemotron Q&A pairs. It was mid-trained on 30M synthetic hard negatives and post-trained on 1M agentic trajectories. The model performs on par with Jev across computer-use, gaming and tool-calling with up to 9x lower latency. It reaches 87.6% on Terminal-Bench 2.1 and 81.6% on DeepSWE as a verifier after fine-tuning.

The safety angle

Cheap decision models have an obvious second life in oversight. TechCrunch reported that one of OpenAI's new security measures, following a run of agent misbehaviour, uses a separate model to watch for bad actions at significant compute cost. A long-time cybersecurity professional, Shapor Naghibzadeh, built a hackathon demo using Jev to check each agentic action against its assigned task.

That use case sits awkwardly next to the rest of the week's news. Ars Technica reported on 30 September that the nonprofit Legal Advocates for Safe Science & Technology sued OpenAI over the July 2026 hack of Hugging Face. They argued California law leaves no defence that an AI autonomously caused the harm. OpenAI called the suit completely without merit.

Cloudflare's own framing avoids the safety debate. Its post describes decision models as a way for agents to gather context, decide and act, or defer to a human when needed. Whether that deferral happens is a design choice in the customer's code, not a property of the model.

The company also said it is open-sourcing the two models on Hugging Face for local use. It is debuting a reinforcement learning product that lets customers fine-tune Clef for their own categories. Both are available now.

Comments 0

Sources

11
  1. 01Introducing Clef: our open-source decision models, and new RL fine-tuning platformEN
  2. 02OpenAI's Jev clone could help the frontier lab stop its swarming agentsEN
  3. 03TypeSafe AI Releases Jev: A Decision-Only Model That Returns Typed Probabilities Instead of TextEN
  4. 04Amazon releases its own Jev clone as decision models flood the webEN
  5. 05Your Language Model Is Already a Decision ModelEN
  6. 06Contrastive Language Models: A Fast, Generalizable System One ModelEN
  7. 07"An AI did it" is no defense, says nonprofit suing OpenAI over Hugging Face hackEN
  8. 08Cloudflare tries to outplay Jev with open-weight Clef modelsEN
  9. 09Language models for text classification: From bag-of-words to JevEN
  10. 10China's DeepSeek open-sources tools to help Huawei chips supplant Nvidia in AIEN
  11. 11OpenStack Hibiscus Strengthens Trusted Infrastructure for the AI EraEN

All figures and quotations in this text come from the sources listed below.

Content prepared by the editorial team with AI assistance.

Rachel Nwosu

Rachel Nwosu

AI, models and technology

Rachel Nwosu covers AI, models and technology for FLASH24, working from public model documentation, benchmark releases and repository histories rather than press summaries, and she skips announcements that arrive without reproducible numbers. She checks training-data claims against dataset cards and reruns reported metrics where code is available. She spends much of her week interviewing researchers and engineers, tracking model launch calendars, and comparing vendor benchmarks with independent evaluations. Outside the desk she runs 3D printers, restores old computers, and tests how models learn from internet junk. She does not publish benchmark figures she cannot trace to a source.

Newsroom →

Comments

0
  1. No comments yet — be the first.

Write a comment

Comments are public. We do not publish abuse, spam or advertising.