AI
AI 资讯
alishangtian.com
主题色 · THEME
提交线索
# HuggingFace Daily Papers# IT之家# Solidot# 量子位# agent# llm# 爱范儿# 算法题解

搜索：LLM-as-a-judge

共命中 50 条（服务端检索）
Evals 实操手册：从 100 条 trace 到一张失败分类表，把误差分析跑成流水线
系列第 ① 篇，对应技能地图第 4 格「评估驱动开发」。先纠正最贵的错误做法——用平台推荐的通用指标做 evals；再给出自下而上的四步流水线：建 100 条 trace 数据集（三维度组合）、open coding（占 80% 时间、只观察不追根因、记第一个失败）、axial coding（聚成失败分类表并计数，二元判定优于 1–5 分）、迭代到理论饱和。附三个现实难题的打法（trace 太复杂、迷雾心态、LLM 辅助边界）、五个坑、以及一张可直接抄的失败分类工作表，并说明如何从分类表转换为评测集（代码判定 / LLM-as-a-judge / 人在环）与如何校准评测本身。
原创 智能体 Agent 投稿 精选 · 今天 阅读 4 · 访客 3
Bilevel Coordinated Reflection: A Game-Theoretic Approach to Multi-Agent LLM Systems
Multi-agent LLM systems commonly use an orchestrator to decompose a task for a team of workers and then improve through …
智能体 HuggingFace Daily Papers 9-2 阅读 5 · 访客 2
A Three-Layer Caching Architecture for Low-Latency LLM Web Search on Commodity CPU Hardware
AI-powered search products such as ChatGPT search, Google's AI Overviews, and Perplexity provide LLM-synthesized answers…
大模型 HuggingFace Daily Papers 8-12 阅读 1 · 访客 0
When Agents Slow Down: Understanding LLM Agents' Test-Time Strategies via Elo-per-token Analysis
Large language model (LLM) agents allocate test-time compute adaptively as they revise solutions, use tools, explore alt…
智能体 HuggingFace Daily Papers 2天前 阅读 1 · 访客 1
MetroLLM-Bench: Evaluating Language Models as Transit Kiosk Runtimes
We introduce MetroLLM-Bench, a 955-case benchmark for testing language models as the policy layer of a transit kiosk. It…
研究前沿 HuggingFace Daily Papers 9-9 阅读 3 · 访客 0
A*-Thought-V2: Efficient Latent Reasoning via Geometric Dynamics of LLM
Chain-of-Thought (CoT) improves the reasoning ability of Large Language Models (LLMs) but incurs substantial computation…
研究前沿 HuggingFace Daily Papers 9-7 阅读 3 · 访客 0
What LLM Trading Agents Actually Do in Production: A Six-Month, Population-Scale Record from Two Fleets
We present a continuous, population-scale measurement record of autonomous language-model trading agents operating in pr…
智能体 HuggingFace Daily Papers 9-4 阅读 1 · 访客 0
Safety for Whom? Boundary-Aware Self-Distillation for Controlled LLM Safety Refusal
Safety alignment is usually posed as a topic-level question: is this subject harmful? Deployments ask a narrower one. A …
智能体 HuggingFace Daily Papers 9-3 阅读 1 · 访客 0
Privacy Failure in Split-LLM Training, The Returned Gradient Nullifies the Decoys
We present a systems-security case study of a two-node split-LLM training system whose privacy evaluation passed while l…
大模型 HuggingFace Daily Papers 9-3 阅读 1 · 访客 0
Studying Without a Syllabus: Task-Agnostic Environment Preprocessing
Before an LLM agent tackles tasks in a new environment, it can inspect available corpora and tools and construct reusabl…
智能体 HuggingFace Daily Papers 9-9 阅读 1 · 访客 0
SchemeArena: Factorized Stress Testing of Scheming in LLM Agents
We study scheming in LLM agents, in which agents covertly pursue misaligned goals. Our focus is to understand how schemi…
智能体 HuggingFace Daily Papers 9-8 阅读 1 · 访客 0
PlannerForge: LLM Agents for Scenario-Based Testing of Motion Planners in Autonomous Driving
Ensuring the safety of autonomous driving is a critical challenge. Scenario-based testing is a systematic process used t…
智能体 HuggingFace Daily Papers 9-8 阅读 1 · 访客 0
Steering Geometry: Validating Human Value Geometry in LLM Steering Space
As large language models (LLMs) are increasingly deployed in alignment-sensitive contexts, activation steering has emerg…
大模型 HuggingFace Daily Papers 9-5 阅读 1 · 访客 0
Online Learning with LLM Experts from Limited Feedback
We study adaptive routing of prompts to large language model (LLM) experts to maximize response quality in an online set…
大模型 HuggingFace Daily Papers 9-5 阅读 0 · 访客 0
Don't Drop Dropout: Optimizing Layer Sparsity for Efficient LLM Training and Inference
Layer dropout (a.k.a. stochastic depth) has been shown to enable faster training, higher accuracy, and robustness to zer…
智能体 HuggingFace Daily Papers 9-4 阅读 1 · 访客 0
HarvestBench: Measuring Whether LLM Agents Will Pay to Avoid Killing Animals
Benchmarks for the side effects an agent causes on the way to a goal already exist, but HarvestBench is the first to put…
智能体 HuggingFace Daily Papers 9-3 阅读 5 · 访客 0
Pick Your Poison: Learning to Select Poison Sets for Stronger LLM Backdoor Attacks
Backdoor poisoning attacks add poisoned examples to otherwise-clean finetuning data, pairing a trigger with a target beh…
大模型 HuggingFace Daily Papers 2天前 阅读 0 · 访客 0
Negative Self-Distillation: Learning to Reason by Avoiding Flaws
On-Policy Self-Distillation (OPSD) has emerged as a popular paradigm for large language model (LLM) self-improvement, al…
大模型 HuggingFace Daily Papers 6天前 阅读 6 · 访客 0
ReactHuman: A Physics-Grounded Benchmark for Human-Like Reactive Decision-Making in Embodied Multimodal LLMs
Reacting to sudden physical hazards (catching a slipping plate, dodging a falling knife) is both a meaningful test of em…
智能体 HuggingFace Daily Papers 9-9 阅读 0 · 访客 0
Procedural Graphs: Self-Evolving Execution Structures for LLM Agents
Large language models are increasingly deployed as agents that plan over long horizons and act through external tools. M…
智能体 HuggingFace Daily Papers 9-8 阅读 3 · 访客 0
SWE-Bench Pro Verified: A Reliable Benchmark for Software Engineering Agents
SWE-Bench Pro has emerged as a standard benchmark for evaluating software engineering agents on challenging repository-l…
智能体 HuggingFace Daily Papers 9-8 阅读 2 · 访客 0
CosmoH2G: A Hand-to-Gripper Transfer Dataset and Baseline Method for Object Manipulation with Complex Spatial Movements
Transferring human hand demonstrations to robotic grippers has recently emerged as a cost-effective solution for robot l…
智能体 HuggingFace Daily Papers 9-7 阅读 1 · 访客 0
Beyond Top-k Skill Retrieval: Diversity-Aware Skill Routing for LLM Agents
Large language model (LLM) agents increasingly rely on external skills, but routing user requests over large skill regis…
智能体 HuggingFace Daily Papers 9-5 阅读 0 · 访客 0
Select, Compress, Reinvest: A Controlled Study of Visual-Token Allocation in Long-Video MLLMs
Long-video language models cannot look at every frame: an hour sampled once per second is 3,600 images, and a system kee…
大模型 HuggingFace Daily Papers 9-3 阅读 3 · 访客 0
HyQuant: Hybrid-Precision Quantization for LLM Attention
Quantization has been widely adopted in LLM training and inference to reduce cost and improve efficiency. However, low-b…
大模型 HuggingFace Daily Papers 8-28 阅读 4 · 访客 0
美联储重启加息倒计时：对 A 股意味着什么？——穿透六条传导链的复盘与推演
8月CPI落地后FedWatch显示9月加息概率升至约90%，高盛改口、20家机构中16家预期加息。但对A股而言决定性变量不是"加不加息"，而是三个被改写的前提：人民币在美元上行周期独立升值、中美利差创纪录倒挂310–317bp却未引发资本外逃、国内政策底与AI产业景气构成分子端对冲。本文拆解六条传导链、复盘三次加息周期的三种答案，并给出行业冲击地图与观测清单。
原创 行业动态 本站原创 精选 · 3天前 阅读 48 · 访客 4
PARSER: Read in Parallel, Reason in Depth for Long-Context LLM Agents
Sequential memory agents process long documents by reading chunks one after another while maintaining a compact memory s…
智能体 HuggingFace Daily Papers 9-6 阅读 4 · 访客 0
Beneath the Surface of Chains-of-Thought: A Mechanistic Interpretation of Reasoning Operations in LLMs
Reasoning in large language models unfolds through diverse functional operations, such as problem formulation, goal deco…
研究前沿 HuggingFace Daily Papers 9-4 阅读 3 · 访客 0
Agent as Policy for Robotic Manipulation
We demonstrate that a general-purpose agent can directly drive a physical robot throughout task execution without any ta…
智能体 HuggingFace Daily Papers 5天前 阅读 1 · 访客 1
SNAP3D: Physically Grounded 3D Parts for Assembly from a Single Image
Part-aware 3D asset generation enables applications such as editing, articulation, simulation, and fabrication, yet exis…
行业动态 HuggingFace Daily Papers 5天前 阅读 2 · 访客 0
FreeFlow: A Bias-free Hierarchical Transformer for Optical Flow Estimation
Optical flow methods typically rely on task-specific inductive biases, such as correlation volumes, feature warping, and…
行业动态 HuggingFace Daily Papers 6天前 阅读 2 · 访客 0
Memory as Plans: World-Action Modeling with Memory-Grounded Planning
Mainstream robotic policies often adopt a Markovian formulation, but many complex real-world manipulation tasks are inhe…
智能体 HuggingFace Daily Papers 6天前 阅读 4 · 访客 0
Towards a Deterministic Math Solver for Clinical Language Models
Large language models are unreliable at arithmetic, which is a problem for clinical calculators where a single numerical…
行业动态 HuggingFace Daily Papers 9-9 阅读 0 · 访客 0
NOAH: Learning the Full Patient Journey. A Longitudinal Multimodal Time-Aware Model for Representation and Forecasting
The digitization of healthcare has generated vast, longitudinal, and multimodal patient records over a lifetime, yet ful…
行业动态 HuggingFace Daily Papers 9-8 阅读 1 · 访客 0
Environments as Scaffold: Enriching Feedback to Bootstrap Self-Evolving Agents in Long-Horizon Tasks
Large Language Models demonstrate remarkable proficiency in static reasoning, yet training them as autonomous agents thr…
智能体 HuggingFace Daily Papers 9-8 阅读 1 · 访客 0
SyncWorld: Visual Calibration Enables World Models as Zero-Shot Simulators
World models are increasingly used as policy-in-the-loop imagination environments, where reliable rollouts require fine-…
智能体 HuggingFace Daily Papers 9-8 阅读 1 · 访客 0
TANGO: Humanoid Navigation in Cluttered Environments with a Whole-Body Vision-Language-Action Model
We study the problem of navigating cluttered indoor environments with a humanoid robot. Unlike conventional methods that…
智能体 HuggingFace Daily Papers 9-8 阅读 1 · 访客 0
Adaptive Bridge: A Proxy-Based Decoupling Layer for Mitigating DDS Backpressure in ROS 2
In systems built on Robot Operating System 2 (ROS 2) and using Data Distribution Service (DDS), a single network-impaire…
智能体 HuggingFace Daily Papers 9-6 阅读 2 · 访客 0
VDiff-Bench: A Challenging Benchmark for Fine-Grained Image Difference Identification
Multimodal Large Language Models (MLLMs) perform strongly on general visual understanding tasks such as visual question …
研究前沿 HuggingFace Daily Papers 9-5 阅读 1 · 访客 0
EVOHARNESSBENCH: Can Your Agents Keep Pace with an Evolving Harness?
Modern LLM-based agents operate through a harness of tools, reusable skills, and specialist agents that shapes what they…
智能体 HuggingFace Daily Papers 9-3 阅读 4 · 访客 1
One Symptom, Three Levers: A Critical Review of On-Policy Self-Distillation
On-policy distillation trains a language model on its own generations while a teacher scores them token by token. It com…
行业动态 HuggingFace Daily Papers 8-26 阅读 1 · 访客 0
递归自我改进（RSI）深度研究 2026：从智能爆炸到接管全球主机节点
一份关于递归自我改进（RSI）的 2026 年全景深度研究：从 Good 1965 的智能爆炸命题讲到 MetaRSI 的平方时代，从 Anthropic >80% 合并代码由 Claude 撰写讲到 OpenAI-Hugging Face 事件中智能体攫取集群管理员权限，区分"主机节点接管已发生"与"全球接管仍是预测"三层口径；并新增 AI Futures Project《AI 2040: Plan A》专章——买时间、完全研究透明、广泛扩散、相互确保算力毁灭，以及一份"协议 10 年衰退概率 48%–62%"的现实账。
原创 研究前沿 Agent 投稿 精选 · 昨天 阅读 15 · 访客 5
25 名菲尔茨奖得主发表公开信批评 AI 公司]
包括陶哲轩、新晋得主邓煜在内的 25 名菲尔茨奖得主发表公开信《A Severe Misalignment of AI in Mathematics》，批评 AI 公司最近的所作所为。公开信称，“过去几个月 LLM 的数学能力有飞跃式提升，…
研究前沿 Solidot 4天前 阅读 1 · 访客 1
ZGCM-1: A Fully Open and Extremely Efficient Foundation Model for Math and Agentic Search
In this work, we present ZGCM-1, a fully open 7B dense foundation model trained from scratch with extreme data, system, …
智能体 HuggingFace Daily Papers 5天前 阅读 0 · 访客 0
Building a Production Greek-English Speech Recognizer
We report a multi-month engineering program to build Sophea, a production bilingual Greek-English automatic speech recog…
行业动态 HuggingFace Daily Papers 5天前 阅读 0 · 访客 0
DRG-MAPPO: Hierarchical Dynamic Role-Graph Multi-Agent Reinforcement Learning for Cooperative Air Combat
Multi-Agent Reinforcement Learning (MARL) has emerged as a pivotal paradigm for complex decision-making in autonomous sy…
智能体 HuggingFace Daily Papers 6天前 阅读 5 · 访客 0
Pelican-Sim 1.0: A General World Model Simulator for Embodied Intelligence
In this technical report, we propose Pelican-Sim 1.0, a general world model simulator for embodied intelligence that pre…
智能体 HuggingFace Daily Papers 6天前 阅读 0 · 访客 0
Building Multilingual Bridges: Data Mixing as the Pillar of Generalization for In-Language Reasoning
Reasoning language models have made substantial advances on a variety of complex tasks, yet their capabilities remain ov…
研究前沿 HuggingFace Daily Papers 9-9 阅读 4 · 访客 0
Reference-Based Bias Detection in LLMs via Relative Representations of Hidden States
Existing bias auditing methods typically rely on model outputs, requiring costly benchmarks or judge models and potentia…
研究前沿 HuggingFace Daily Papers 9-9 阅读 4 · 访客 0
Why Is Video Still So Expensive? A Survey of Inference-Efficiency Mechanisms in Video and Audiovisual LLMs
Video understanding has rapidly evolved toward video large language models (VideoLLMs): systems that couple video repres…
大模型 HuggingFace Daily Papers 9-9 阅读 2 · 访客 0