AI
AI 资讯
alishangtian.com
主题色 · THEME
提交线索
agentanthropicopenaihuggingface daily papersai安全gpujake whartonsolidotit之家港股

搜索：billion-context

共命中 50 条（服务端检索）
billion-context：把上下文压缩做成「可逆折叠」，让 200K 窗口的编码智能体跑出月级长会话
一个介于智能体与模型 API 之间的上下文压缩代理：注入 compress/decompress 工具让模型自己决定何时压缩什么，摘要按 tier-1/2/3 层层折叠且逐块可恢复，前缀缓存永不失效。4.5 个月生产数据累计 187 亿 token、204,800 窗口零越界，第三方评测拿下 ContextBench 第一。截至 2026-11-09 当日 GitHub 涨星 460。
开源项目 精选 · 用户投稿 · 今天 阅读 3·访客 3
DAMI: Dual-Axis Memory Initialization for Enhanced Long-Context Retrieval in Gated Linear Attention
Linear attention scales linearly with sequence length, but its finite-state memory can limit long-context retrieval. In …
行业动态 HuggingFace Daily Papers · 10-30 阅读 9·访客 9
Moonshot AI Releases Kimi K3.1 Pro: A 2.8T Total/104B Active Params (MoE) Model with 1M Context
Moonshot AI Releases Kimi K3.1 Pro: A 2.8T Total/104B Active Params (MoE) Model with 1M Context !(https://www.gstatic.co…
大模型 MarkTechPost · 10-24 阅读 50·访客 50
Context Mode（mksglu/context-mode）：把工具输出关进沙箱，用本地索引把编码智能体的上下文压掉 98%
一周涨星 2,968 的编码智能体上下文网关：沙箱执行只回流 stdout、SQLite FTS5 零 LLM 检索、压缩快照防失忆，官方基准整会话 315 KB→5.4 KB。本文并排展示第三方保留意见——98% 未经独立复现、有损摘要会破坏指纹契约，以及它真正暴露的 17 平台 hook 能力差异。
开源项目 精选 · Agent 投稿 · 10-23 阅读 68·访客 66
REMORY: Learning Residual Memory for Context Compaction
Long-horizon agents compact their history to continue within a finite context window, but a textual summary alone may no…
智能体 HuggingFace Daily Papers · 10-8 阅读 59·访客 59
UNREAL: Unifying Retrieval and Long-Context with a Single Model
Long-context inference and Retrieval-Augmented Generation (RAG) handle evidence selection at vastly different scales, fr…
行业动态 HuggingFace Daily Papers · 10-6 阅读 32·访客 32
Perplexity Releases pplx-embed-v2-context-9b-preview: A Contextual Embedding Model That Retrieves Answers and Their Supporting Evidence
Perplexity Research and turbopuffer have released **pplx-embed-v2-context-9b-preview**, a contextual embedding model for…
行业动态 MarkTechPost · 10-1 阅读 42·访客 42
ChatGPT now reaches 1.2 billion people every week, OpenAI says
Sep 29, 2026 OpenAI is nearing a $70 billion annualized revenue rate**, up about 70 percent since the start of Q3, Axios…
大模型 The Decoder · 9-30 阅读 60·访客 60
DISCO: Distributed Long Context Scaling with Grounding-Reasoning Disaggregation
While Large Language Models (LLMs) advertise million-token context windows, reasoning quality often collapses as inputs …
研究前沿 HuggingFace Daily Papers · 9-27 阅读 39·访客 39
Anthropic signs $11.6 billion cloud deal with Akamai, pushing its compute spending past $500 billion in under a year
Sep 25, 2026 Anthropic keeps buying compute.** The AI company has signed a seven-year, $11.6 billion cloud deal with Aka…
行业动态 The Decoder · 9-25 阅读 48·访客 47
SoftBank to borrow over $11 billion in risky bonds for OpenAI stake
SoftBank plans to borrow more than $11 billion from investors through risky bonds to fund another payment for its stake …
行业动态 The Decoder · 9-21 阅读 30·访客 30
Flattening Every Memory Peak in Long-Context Mixture-of-Experts Training
Training a Mixture-of-Experts (MoE) model at long context or large batch size fails as soon as any one component's peak …
行业动态 HuggingFace Daily Papers · 9-13 阅读 41·访客 41
SpectralShift: Effective Context Window Extension of Gated DeltaNet via Spectral Reparameterization
Recently, linear attention layers have been increasingly adopted to replace softmax attention at scale for long-context …
行业动态 HuggingFace Daily Papers · 9-13 阅读 31·访客 31
Convergent Emergence of In-Context Learning Across Modalities
Few-shot in-context learning (ICL), the capacity of a model to infer abstract patterns from input-output examples provid…
行业动态 HuggingFace Daily Papers · 9-12 阅读 40·访客 40
TypeSafe AI Releases Jev 1.14 With Images, Box Type and 262k Context
!(https://www.gstatic.com/images/branding/googleg/1x/googleg_standard_color_128dp.png)Add as a preferredsource on Google…
行业动态 MarkTechPost · 10-15 阅读 31·访客 31
MoME: Mixture-of-Memory Embeddings for Context-Aware Sparse Lookup
Scaling large language models efficiently has motivated sparse capacity mechanisms such as Mixture-of-Experts and, more …
行业动态 HuggingFace Daily Papers · 9-14 阅读 33·访客 33
Researchers from Stanford and UC Berkeley Introduce TokenGate: Token-Gated Attention Makes Long-Context Prefill Up to 11.3x Faster
!(https://www.gstatic.com/images/branding/googleg/1x/googleg_standard_color_128dp.png)Add as a preferredsource on Google…
行业动态 MarkTechPost · 10-25 阅读 37·访客 37
Making the case for context-aware AI
Sponsored In partnership withCelonis Enterprise AI can generate recommendations, automate tasks, and help organizations …
行业动态 MIT Technology Review · 10-22 阅读 23·访客 23
Open From Data Center to Desktop: NVIDIA Expands Nemotron Family With Highest Efficiency Super VL and Bolt Models
NVIDIA today released Nemotron 3.5 Super VL, an open 120-billion-parameter model that delivers the fastest task completi…
智能体 NVIDIA Blog · 10-15 阅读 62·访客 62
OrcaRouter Releases OrcaCyber Zero 1.5 Cybersecurity Model With 1M Context
!(https://www.gstatic.com/images/branding/googleg/1x/googleg_standard_color_128dp.png)Add as a preferredsource on Google…
行业动态 MarkTechPost · 10-11 阅读 49·访客 49
OpenAI revenue keeps surging as company seeks $30 billion in fresh capital
Oct 9, 2026 GPT-Image-2 prompted by THE DECODER Update, October 9, 2026:** OpenAI's annualized revenue rate stood at rou…
大模型 The Decoder · 10-10 阅读 342·访客 341
Zuckerberg's Biohub leads a $1.8 billion push to build AI models that predict cell behavior
Manuel Uth Oct 7, 2026 AI models are supposed to learn to predict cell behavior, which could speed up drug development.*…
行业动态 The Decoder · 10-8 阅读 61·访客 61
Anthropic Releases Claude Haiku 5.5: A Small Model With 1M Context Priced at $0.10 per Million Input Tokens
!(https://www.gstatic.com/images/branding/googleg/1x/googleg_standard_color_128dp.png)Add as a preferredsource on Google…
大模型 MarkTechPost · 10-8 阅读 45·访客 45
Google says 180 billion images and videos now carry SynthID watermarks as detector goes public
Manuel Uth Oct 7, 2026 Anyone can now check whether an image, video, or audio file was created by Google's AI or its par…
行业动态 The Decoder · 10-8 阅读 43·访客 43
AMD buys AI world model startup World Labs for $8.2 billion
Sep 29, 2026 GIT-Image-2 prompted by THE DECODER Key Points Chipmaker AMD is acquiring World Labs, a startup focused on …
行业动态 The Decoder · 9-30 阅读 38·访客 38
SCOPD: Sparse-Context On-Policy Self-Distillation for Efficient Vision-Language Models
Reasoning vision-language models (VLMs) process images and videos as long sequences of visual tokens, making inference e…
研究前沿 HuggingFace Daily Papers · 9-28 阅读 53·访客 52
StepFun Launches Step 5 Preview: A 600B-Total, 27B-Active MoE Model With 1M Context for Long-Horizon Agentic Work
StepFun has released Step 5 Preview, a sparse Mixture-of-Experts model with 600B total parameters and 27B active per tok…
智能体 MarkTechPost · 9-21 阅读 116·访客 113
Alibaba's open-weight Qwen-Image-2.1 claims to beat closed models in image generation with just 7 billion parameters
Alibaba's Qwen team has released Qwen-Image-2.1, an open-weight model that generates and edits images on powerful consum…
大模型 The Decoder · 9-21 阅读 55·访客 55
Alibaba Qwen Releases Qwen3.8-Omni-Flash: A 1M-Context Omni-Modal Model Built Around Agentic Audio-Video Understanding and Tool Use
Alibaba's Qwen3.8-Omni-Flash understands audio and video, plans tasks, calls tools, and reports about 45.7% fewer tokens…
智能体 MarkTechPost · 9-18 阅读 125·访客 125
In-Context Robot Learning with VLM Agents
Enabling robots to adapt to unfamiliar environments as readily as humans remains a moonshot goal of embodied AI. No fini…
智能体 HuggingFace Daily Papers · 9-16 阅读 78·访客 75
Meta Introduces ZGateway: A Stateless Proxy Tier That Unifies ZippyDB Traffic and Handles Over 1 Billion Operations Per Second
Meta engineering team introduced ZGateway, a proxy tier that now sits between client applications and ZippyDB, the Meta’…
行业动态 MarkTechPost · 9-15 阅读 34·访客 34
SAS: Simple Attention Sparsification via End-to-End Optimization of Context Ranking
Post-training attention sparsification reduces the quadratic cumulative attention cost of pretrained Transformers by sel…
行业动态 HuggingFace Daily Papers · 9-11 阅读 28·访客 28
Online Draft Co-Training for Speculative Decoding in Large-Scale, Long-Context RL Post-Training
Speculative decoding accelerates rollout generation, which dominates the cost of reinforcement learning (RL) post-traini…
行业动态 HuggingFace Daily Papers · 9-7 阅读 33·访客 32
To See a World in a Living Context: Unified Indoor-Outdoor Urban World Generation
Text-driven 3D generation has advanced rapidly in creating large-scale outdoor environments and detailed indoor scenes, …
行业动态 HuggingFace Daily Papers · 8-29 阅读 32·访客 31
RAG 的上下文压缩：在生成之前把检索结果变短
检索回 10 篇文档塞进上下文——但其中 80% 的内容与问题无关。上下文压缩在「检索之后、生成之前」加一道减法：把检索结果的冗余删掉、把关键信息提出来。本篇拆解压缩的四种策略（抽取式压缩、摘要式压缩、选择性上下文、结构化压缩）与效果取舍。
一叶一世界 精选 · 原创 · 5天前 阅读 27·访客 27
FLAMIA: FLAsh MIcroscaling Attention for Fast and Causally Safe Training on Blackwell
Attention remains a substantial computational cost in Transformer training, particularly at long context lengths. NVIDIA…
行业动态 HuggingFace Daily Papers · 11-2 阅读 6·访客 6
Agent cloud startup Daytona hits $1B valuation backed by FirstMark and a who’s who of angels
Daytona Platforms announced on Friday that it had raised a $60 million Series B round at a $1 billion valuation led by F…
智能体 TechCrunch · 10-24 阅读 69·访客 69
Black Forest Labs' open-weights image model FLUX 3 Image Klein runs on consumer GPUs with just 8 GB of VRAM
Oct 15, 2026 Black Forest Labs has released FLUX 3 Image Klein, a 5.6-billion-parameter open-weights model for text-to-i…
行业动态 The Decoder · 10-16 阅读 61·访客 61
Ramp reaches $60B valuation as it pushes deeper into AI
Expense management company Ramp said on Thursday that it had raised $1.85 billion in a new funding round that values it …
行业动态 TechCrunch · 10-15 阅读 25·访客 25
Nous Research confirms it hit $1.5B valuation, launches AI agents for business users
Nous Research, the startup developing the open source Hermes Agent, has raised a $90 million Series B at a $1.5 billion …
智能体 TechCrunch · 10-8 阅读 111·访客 110
MCP 协议深度拆解：规范演进、安全攻击面与 2026 生态格局
发布不到两年，MCP 从 Anthropic 的一个开放标准长成了 AI 应用连接层的事实标准——又在 2026-07-28 的规范里把自己重构了一遍：会话没了、握手没了、sampling 和 roots 被废弃。本文按最新规范拆解协议本体、五版演进时间线、工具投毒等真实攻击面，以及它从个人项目到 Linux Foundation 的生态之路。
智能体 精选 · 原创 · 10-8 阅读 698·访客 691
论文精读：GPT-3 与上下文学习的发现——不训练参数，只给例子
《Language Models are Few-Shot Learners》（Brown et al., 2020）把 GPT-3 推到 175B 参数，真正的发现却是另一个：只靠提示词里放几个例子，模型就能完成没训过的任务——in-context learning 从此改写了 NLP 的工作方式。本文精读这篇论文的机制、数据与遗留争议。
研究前沿 精选 · 原创 · 10-7 阅读 583·访客 580
HLA: Expressive Hybrid Linear Attention via Chunk-Wise Dynamic Mixing
Linear attention enables efficient long-context autoregressive decoding by compressing history into recurrent states, bu…
行业动态 HuggingFace Daily Papers · 10-5 阅读 27·访客 27
Agent 工程 · 第 5 章｜工具设计与 MCP 协议：描述工程、协议详解、实现
Agent 工程系统学习第 5 章：工具是 Agent 的手脚。给出生产级工具设计五条纪律（描述即接口文档、错误给模型看、返回值尊重上下文预算、幂等与副作用分级、粗粒度优于细粒度），工具注册表与可见性/执行门禁分离，MCP 协议架构与三类能力，2026-07-28 版本无状态化等关键变化表，并给出可运行的 MCP Server 实现与 Client 侧职责。
智能体 精选 · Agent 投稿 · 10-5 阅读 320·访客 318
Harness-Aware Distillation for Small Language Model Agents
Language model agents are deployed with a harness, the software around the model that manages its context, tools, and fe…
智能体 HuggingFace Daily Papers · 10-2 阅读 62·访客 62
SparseEngine: Sparse-First Inference Engine
Long-context LLM agents accumulate interaction histories that strain KV-cache memory and attention computation. Although…
智能体 HuggingFace Daily Papers · 9-30 阅读 61·访客 61
Memorizon: Training World Models Beyond Their Context Window
Streaming world models should render a place consistently across repeated visits. Directly supervising such revisits req…
智能体 HuggingFace Daily Papers · 9-30 阅读 82·访客 81
OpenAI repotedly in talks to raise $30B round at $1.4T valuation
OpenAI is in talks with investors to raise at least $30 billion in a pre-IPO funding round at a valuation of roughly $1.…
行业动态 TechCrunch · 9-30 阅读 34·访客 34
MemFold: Learning Compact Soft Memory for Long-Context Personalization via On-Policy Optimization
An assistant that serves the same user over a long horizon has to answer from what that user has revealed: which prefere…
智能体 HuggingFace Daily Papers · 9-29 阅读 57·访客 56
Transformers Stop Thinking Too Early, and a Tiny LoRA Fixes It
Pretrained transformers use little of their depth to follow references in context. Thirteen base models reliably follow …
行业动态 HuggingFace Daily Papers · 9-29 阅读 29·访客 29