推理服务的 SLA 工程:SLO、错误预算与容量规划
推理服务向用户承诺「99.9% 可用、P99 延迟 2 秒」——承诺的背后是一套 SLA 工程:SLO 的定义、错误预算的运营、容量规划的科学。本篇拆解推理服务 SLA 的特有指标(TTFT/TPOT 的分位数)、错误预算的纪律、以及容量规划的三步法。
阅读全文 →
全部文章
ARCHIVE 共 443 条早报|网易云音乐鸿蒙版正式上线/任正非重申「华为不造车」/腾讯QClaw将停运
🏢任正非重申「华为不造车」,将继续帮助东风造好车
📈曝 DeepSeek 年化收入运行率达 10 亿美元,数月内翻倍
🎵网易云音乐鸿蒙版正式上线,支持歌单同步与多终端使用
💬余承东回应问界调整:赛力斯主动提出主导,华为将聚焦其余四界…
G^2PTQ: Improving LLM Post-Training Quantization with Generalized Gradient Compensation
Post-training quantization (PTQ) is a practical approach to reducing the memory and computational footprint of large lan…
PrismML brings its tiny LLMs to Qualcomm-powered smart glasses
The AI Lab PrismML — founded by Caltech researchers and advised by UC Berkeley’s Ion Stoica — has created a version of i…
华为大模型双子星联手创业,要找物理世界的Scaling Law
Jay* 2026-09-25 14:14:07 来源:量子位
一场物理世界的基模实验
程浅 发自 凹非寺
量子位 | 公众号 QbitAI
数亿元资金,投向了一场物理世界的基模实验。
Physical AI创业公司**息壤开物**宣布,…
Deepmind was built to chase AGI, but its new chief just wants Gemini 4 out the door
Sep 24, 2026
Koray Kavukcuoglu wants to release Gemini 4 well before the end of the year. He calls the AGI question, whi…
Google's new Flash TTS models let you design AI voices from scratch using text descriptions
Sep 23, 2026
Nano Banana Pro prompted by THE DECODER
Key Points
Google has released two new text-to-speech models, Gemin…
GPT-6之后,具身智能走向何方?诺因发布GLOW技术报告,给出机器人“一教就会”的答案
量子位的朋友们* 2026-09-24 16:20:12 来源:量子位
人类演示一次,机器人即可实现跨场景任务复用
一直以来,要让机器人学会一项新任务,往往需要重新采集数据、编写固定流程,或进行针对性训练。这类方式可以解决确定性较高的任务…
Google Releases Gemini 3.8 Flash TTS and Flash-Lite TTS With Prompt-Based Voice Design
Google has released Gemini 3.8 Flash TTS and Gemini 3.8 Flash-Lite TTS, 2 new text-to-speech models in its Gemini Audio …
How Reproducible Are Evaluation Conclusions? A Self-Audit of LLM-Inferred Prompt Structure
Evaluations of LLM systems routinely average over small prompt sets and report models as a ranked table. We ask how much…
Your Transformer Can Hold Two Thoughts at Once: Evidence of Linear Superposition in LLMs
While Large Language Models (LLMs) rely on highly non-linear components, in this work we demonstrate that they exhibit f…
ChatGPT Voice gets closer to "Her" with email, calendar, and Slack access
Sep 23, 2026
ChatGPT Voice gets a major upgrade.** The globally available voice feature now runs on OpenAI's new GPT-6 A…
Alibaba launches Qwen Audio 3.1 with new models and slashes AI audio prices by up to 95 percent
Sep 23, 2026
Alibaba's AI team Qwen has released Qwen-Audio-3.1, a lineup of five models for speech recognition (ASR), t…