The hottest new #AI model doesn’t generate words. #agenticengineering #jev #decision #model
This video introduces Jev, a new AI model from TypeSafe AI, that functions as a general-purpose classifier or decision-making model. Unlike traditional Large Language Models (LLMs) like ChatGPT, Jev does not generate text; instead, it directly provides probabilistic decisions in response to typed questions about unstructured data. This approach makes Jev significantly cheaper and faster, as it avoids the computational overhead of text generation, enabling developers to integrate AI-powered decisions more broadly and efficiently into software.
read more
The speaker introduces Jev, a novel AI model developed by TypeSafe AI, a company founded by Diego Almeida, a former OpenAI researcher who contributed to instruction-following research for ChatGPT. Jev's core innovation lies in its divergence from generative AI models; it functions exclusively as a general-purpose classifier or decision-making model rather than generating text.
To illustrate Jev's utility, the speaker provides the example of scanning an email inbox with thousands of emails. A typical approach with an LLM (Large Language Model) would involve sending each email to the LLM, asking it to classify the email (e.g., spam, receipt, newsletter, urgent, needs response), and then receiving a generated text output, possibly in JSON format, along with an explanation. Most of this generated text, including the explanation, would then be discarded, as the primary need is often just a decision or classification.
Jev streamlines this process by skipping the text generation step entirely. When given an email, a user or system asks Jev 'typed questions'—effectively seeking direct classifications or probabilities. For instance, it can return a choice indicating the email's category, a score for its urgency, or the probability that a specific 'yes' or 'no' statement about the email content is true. Furthermore, Jev is designed to evaluate several such judgments in parallel, meaning a single email can be simultaneously checked for spam, urgency, response requirement, and category without generating a single paragraph of output.
This non-generative approach offers significant efficiency and cost benefits. TypeSafe AI currently prices Jev based only on input tokens, at an approximate rate of 4 cents per million tokens. This dramatic reduction in cost, compared to LLMs that charge for both input and output tokens, makes AI-powered decision-making dramatically cheaper. The speaker links this to the Jevons Paradox, where something becoming dramatically cheaper often leads to a massive increase in its consumption. The thesis is that by making AI judgment cheap, developers will start integrating it into many more parts of their software.
Jev itself is a closed, hosted model. TypeSafe AI claims it utilizes a new architecture involving a parallel sampler and a training method they call RLCD. However, specific details regarding its weights, parameter counts, and low-level architecture have not been publicly disclosed. The speaker anticipates that this non-generative, decision-focused AI model will likely inspire similar models from other companies, as the core idea of a reusable AI decision primitive is compelling. The video concludes by emphasizing that AI models don't always need to 'talk' or generate extensive text; sometimes, software simply needs a precise, efficient decision, which Jev aims to provide.