Grounding 选型指南:向量索引、知识图谱、语义层,到底该用哪个
系列第 ③ 篇,对应技能地图第 2 格「Grounding」。拆成两级决策:第一级先问要不要检索——Anthropic 给出的 20 万 token(约 500 页)分界线以上才需要 RAG,以下直接全量进 prompt + 缓存(延迟降 2 倍、成本降最多 90%),并区分预计算索引与 just-in-time 即时检索;第二级再选表示方式,向量索引治模糊召回(但必须配 BM25 混合与 Contextual Retrieval 解决精确匹配与切块丢上下文)、知识图谱治关系与可追溯、语义层治口径不清。附可量化收益表(检索失败率 5.7% → 3.7% → 2.9% → 1.9%)、四个实现注意项、context rot 与上下文压缩/笔记/子智能体三件套,以及一张可抄的选型决策树。
阅读全文 →
全部文章
ARCHIVE 共 70 条Privacy Failure in Split-LLM Training, The Returned Gradient Nullifies the Decoys
We present a systems-security case study of a two-node split-LLM training system whose privacy evaluation passed while l…
What Else Needs Fixing? Exploring Cost-Effective Test-Time Compute for Revision Propagation in Artifacts Generated Through Conversation
Large Language Models (LLMs) often help users generate artifacts through iterative cycles of generation and revision in …
Enoki: Efficient Multi-Level Hallucination Detection
Ensuring factuality remains a critical challenge for deploying LLMs in high-stakes settings. Existing hallucination dete…
Recognition-Refusal Misalignment in LLMs: Why Models Answer Structurally Unanswerable Questions
Large language models often answer structurally unanswerable questions, such as computing cot(-540°) or evaluating (1).s…
HyQuant: Hybrid-Precision Quantization for LLM Attention
Quantization has been widely adopted in LLM training and inference to reduce cost and improve efficiency. However, low-b…
A Three-Layer Caching Architecture for Low-Latency LLM Web Search on Commodity CPU Hardware
AI-powered search products such as ChatGPT search, Google's AI Overviews, and Perplexity provide LLM-synthesized answers…
GPT-5 发布:统一系统路由下一代旗舰
OpenAI 发布 GPT-5,将快速响应与深度推理统一到一个系统内自动路由,在编码、数学、多语言与幻觉抑制上全面提升,并大幅加强 Agentic 任务能力。
GPT-4o 发布:原生全模态与实时语音交互
OpenAI 发布 GPT-4o('o' 为 omni),文本、音频、图像端到端统一训练,语音对话平均延迟降至 320 毫秒,接近人类对话反应速度。
OpenAI 发布 Sora:视频生成的 GPT-3 时刻
Sora 基于扩散模型与 Transformer 架构,可直接从文本生成长达一分钟的高保真视频,展示了对物理世界'世界模拟器'式的理解潜力。
GPT-4 发布:多模态与长上下文的分水岭
OpenAI 发布 GPT-4,支持图文多模态输入,在律师资格考试等专业基准上达到人类前 10% 水平,并引入 32K 长上下文版本。
← 上一页
第 6 / 6 页 · 共 70 条