# IBM Puts Chat, Decisions and Speech in Granite Switch 4.1

Published 2026-10-17 · AI.info Team · AI.info

> IBM’s Granite Switch 4.1 combines chat, decision and safety adapters with an embedded speech-recognition encoder in 8B and 30B checkpoints. The speech path transcribes English audio into text for the language model, with lowercase, unpunctuated output and no joint training of the encoder and language model.

One [IBM](https://ai.info/companies/ibm) model endpoint can take a spoken question, transcribe it, respond in chat and switch to a decision or safety-check task. IBM published details of Granite Switch 4.1 on October 15, following model-card release dates of October 14 for its 8B and 30B versions. The checkpoints combine a Granite 4.1 language model with decision and safety adapters and an embedded speech-recognition encoder.

Source [huggingface.co](https://huggingface.co/blog/ibm-granite/granite-switch-4-1)

## Two adapters, one speech encoder

The 8B and 30B versions use a decision adapter for choosing among labeled options and a Guardian adapter for detecting safety risks. The decision adapter returns a probability distribution over the supplied options, while Guardian can check for risks including harmful content, jailbreaking, violence and social bias. The speech component is Granite Speech 5.0 TurboCTC, a 470-million-parameter encoder for English transcription.

The transcription step feeds text into the language model’s chat context; the model card says the speech encoder and language model have not been jointly trained. That distinction makes the feature a speech-to-text path into a text model, not a single model trained to understand audio and language together. The card also flags English-only input and lowercase, unpunctuated transcription output.

> “Check out our Speech-to-Decisions HF space where granite-switch-4.1-8b transcribes audio, generates summaries, screens for harmful content, and tests 15 other user-defined flags—all running on a single endpoint in real time.”
>
> IBM Granite authors Kate Soule, Subhajit Chaudhury, Hendrik Strobelt and Luis A. Lastras write

## The bundle fits base-model memory, IBM says

The adapters and speech technology occupy approximately the same GPU VRAM as the underlying base model by itself, IBM says. The company attributes that to adapters that can reuse the base model’s key-value cache across requests, alongside a co-located speech encoder. The design aims to avoid running separate model copies for chat, decisions and transcription, though the release does not publish a GPU-memory figure or a direct memory comparison.

Both checkpoints are listed under the Apache 2.0 license and can be run with Hugging Face Transformers or vLLM. They are composed from Granite 4.1 base models with 8 billion and 30 billion parameters, respectively. Developers activate the adapters through control tokens in the chat template, and the 8B checkpoint can also summarize transcripts and check more than 15 generic flags.

## Decision claims need benchmark detail

IBM’s Guardian adapter averages better than Jev 1.13, Microsoft-Decision-1, GPT-Luna-Decisions and Clef-Flash on safety-related decision tasks, the company says. The announcement does not provide score tables or the evaluation details needed to assess that comparison, so it is a company-reported result rather than a fully documented benchmark in the post. IBM also describes a separate five-step retrieval workflow race against Jev-27B, but gives no elapsed-time figures there.

The release’s practical boundary is clearer: Granite Switch puts text generation, labeled-option decisions, safety checks and English transcription behind one model interface. Speech input still passes through a separate embedded encoder, and its output arrives as lowercase text without punctuation.

## Sources

1. Original source · Blog post [IBM Granite on Hugging Face · Granite switch](https://huggingface.co/blog/ibm-granite/granite-switch-4-1) huggingface.co

Other pages read

2. [IBM Granite on Hugging Face · Granite switch 4.1 8b](https://huggingface.co/ibm-granite/granite-switch-4.1-8b) huggingface.co
3. [IBM Granite on Hugging Face · Granite switch 4.1 30b](https://huggingface.co/ibm-granite/granite-switch-4.1-30b) huggingface.co

## Related stories

- [Apple Researchers Find Telling Languages Apart Helps Speech Models](https://ai.info/news/apple-language-separation-multilingual-speech-models)
- [Apple Finds Online Teachers Improve Federated Speech Recognition](https://ai.info/news/apple-online-teachers-federated-speech-recognition)
- [NASA and IBM Open-Source a Lunar Model for Ice and Crater Mapping](https://ai.info/news/nasa-ibm-open-source-lunar-model-ice-crater-mapping)
- [Ai2 Releases AstaBrief, an 8B Model for Faster Scientific Reports](https://ai.info/news/ai2-releases-astabrief-8b-scientific-reports)
- [IFM Releases Six Fully Open K2 Horizon AI Models](https://ai.info/news/ifm-releases-six-fully-open-k2-horizon-ai-models)

## Explore

[More articles](https://ai.info/news)

---

Canonical: https://ai.info/news/ibm-granite-switch-4-1-chat-decisions-speech
