Cohere confidential computing hides AI data, even from Cohere
Why it matters
Cohere has put Confidential Computing on Cohere Model Vault into public beta. Encryption usually protects data while it is stored and while it travels across a network; this targets the third state, data in use, while the model runs. Inference runs in a hardware-backed confidential environment spanning the CPU and GPU, and Cohere says the host operating system, hypervisor, infrastructure administrators, cloud provider and Cohere operators are prevented from reading protected workload memory. Before sensitive data is sent, customer-side software verifies signed evidence about the environment, and if it does not satisfy the policy, the client refuses to send the request. The public beta runs on NVIDIA H100 GPUs on Microsoft Azure, with beta models including Embed, Rerank, Parse, Transcribe and North Mini Code. Caveat: Cohere says it does not eliminate all risk or replace application security, compliance or data-residency controls.
Read the source: Cohere (blog) (opens in a new tab)
All hits from 24 Oct 2026More SecurityGet the daily hits by email