Cohere's Model Vault now runs inference that even its operators cannot read
Cohere opened a public beta of Confidential Computing on Model Vault, its dedicated managed model service. Inference runs inside hardware-isolated memory spanning the CPU and GPU, so infrastructure software and operators cannot see the plaintext data. Before sending anything, customer software checks signed hardware evidence that the protected environment is in place, a step called remote attestation. The beta runs on NVIDIA H100 GPUs on Microsoft Azure.