IBM's Granite Switch 4.1 serves chat, decisions and speech from one model
Sorted AI17 OctIBM released Granite Switch 4.1 in 8B and 30B sizes. Each bundles a base model with small add-on adapters for general decisions and safety checks, plus a built-in speech-to-text model that IBM says is the fastest on the OpenASR leaderboard. IBM says the combined model uses about the same GPU memory as the base model alone and can switch between chat, decision and transcription requests on one endpoint; its demo transcribes audio, summarises it, screens for harmful content and checks 15 custom flags in real time. It runs in vLLM with a plug-in and in llama.cpp. The speed and accuracy comparisons are IBM's own and not independently tested.
Why it matters: If you self-host models to transcribe calls and then tag or screen them, one Granite Switch endpoint could replace two or three services. Try IBM's demo with your own flags before planning a switch.
IBM Granite (Hugging Face blog) ↗AI-assisted, reviewed by Sorted AI
▲ 0
0 comments