搜索:Benchmark

共命中 50 条(服务端检索)
Pumpire: Unified Benchmark for Metric Distance Estimation
We present Pumpire, a unified benchmark for evaluating metric point-pair distance estimation capability of both image- a…
智能体 HuggingFace Daily Papers · 10-8 阅读 79·访客 79
A Coding Guide to Google Research’s MSEB: Writing Sound Encoders to the Benchmark Contract and Scoring Them Across Classification, Clustering, Retrieval and Segmentation
In this tutorial, we work with **MSEB**, the Massive Sound Embedding Benchmark from Google Research, and approach it fro…
研究前沿 MarkTechPost · 9-27 阅读 54·访客 53
Benchmark Radar: A Living Database and Search Engine for AI Benchmarks and Evaluation
Benchmark researchers and developers of large language models (LLMs) and other AI systems need to find relevant evaluati…
研究前沿 HuggingFace Daily Papers · 9-10 阅读 57·访客 56
SWE-Bench Pro Verified: A Reliable Benchmark for Software Engineering Agents
SWE-Bench Pro has emerged as a standard benchmark for evaluating software engineering agents on challenging repository-l…
智能体 HuggingFace Daily Papers · 9-8 阅读 110·访客 105
OpenAI launches GPT-6.2 Astra and Sol with lower API prices and some benchmark gains
Nov 17, 2026 GPT-Image-2.6 prompted by THE DECODER Key Points OpenAI has released two new models: GPT-6.2 Astra and GPT-…
研究前沿 The Decoder · 4天前 阅读 22·访客 22
Moonshot AI pivots Kimi models from coding to science as benchmark gains flatten
Manuel Uth Nov 16, 2026 Because Moonshot AI sees diminishing returns in coding, the Beijing startup is redirecting its K…
研究前沿 The Decoder · 5天前 阅读 28·访客 28
GPBam: A Retrieval-Aware German Public Law Exam Benchmark
Legal reasoning in civil-law systems is not rule-lookup: the German state examination asks for a structured opinion (Gut…
研究前沿 HuggingFace Daily Papers · 11-13 阅读 6·访客 6
JFinBench: A Continuously Refreshable Japanese Financial Benchmark from the Latest Certification Exams
Large language models (LLMs) are increasingly applied to finance, creating a need for benchmarks that evaluate their cap…
研究前沿 HuggingFace Daily Papers · 11-13 阅读 7·访客 7
WebArena-Pro: A Heterogeneous, Multimodal, Reproducible Benchmark for Web Agents
Web agents powered by large language and vision-language models are increasingly applied to realistic browser work that …
智能体 HuggingFace Daily Papers · 11-13 阅读 10·访客 10
Do Underwater Image Quality Metrics Agree with Human Perception? A Benchmark with Human Choices, Simple Edits and Generative Drift
Underwater image enhancement is challenging to evaluate due to the lack of clean reference images, so researchers rely o…
研究前沿 HuggingFace Daily Papers · 11-13 阅读 6·访客 6
Consensus Capture in Reference-Based UAV Video Stabilization: A Benchmark on Dynamic Urban Scenes
Reference-frame stabilization registers every frame of a hovering-drone video onto one reference frame, keeping object p…
研究前沿 HuggingFace Daily Papers · 11-12 阅读 7·访客 7
DeepMind reveals Gemini Robotics 2.5 and open safety benchmark "ASIMOV-jailbreak"
Google DeepMind has revealed a new generation of the AI-powered Gemini Robotics platform. In the 2.5 release, Google say…
智能体 Ars Technica · 11-10 阅读 20·访客 20
TurtLES: A Large-Scale Benchmark for Turbulent 3D Neural PDE Surrogates
Machine-learning surrogates are increasingly used to accelerate computational fluid dynamics, yet progress is limited by…
研究前沿 HuggingFace Daily Papers · 11-6 阅读 13·访客 13
SOMA: A Benchmark for Fine-Grained Egocentric Behavior and Body-Motion Understanding
Perceiving human body motion is critical for multimodal systems that understand and assist people. Yet current evaluatio…
研究前沿 HuggingFace Daily Papers · 10-26 阅读 23·访客 23
AgentVQA: A Unified Benchmark for Agentic Visual Understanding
Vision-language models (VLMs) can perform a broad range of tasks across diverse settings, yet their performance in agent…
智能体 HuggingFace Daily Papers · 10-22 阅读 55·访客 55
AnyGameRenderer: Entity-Consistent Generative Rendering Across Games and an Entity-Level Benchmark
AI coding agents can now build small playable games in minutes, but the results usually look like programmer art: gray b…
智能体 HuggingFace Daily Papers · 10-22 阅读 61·访客 61
Code2Video-Compass: A Comprehensive Benchmark for General-Purpose Code-Based Video Generation across T2V, I2V, and V2V
Code-based video generation offers fine-grained control, targeted editing, and component reuse compared with direct vide…
研究前沿 HuggingFace Daily Papers · 10-20 阅读 36·访客 36
Datalab Releases OmniParseBench: An Open OCR Benchmark With 16,288 Pass/Fail Tests to Audit OCR Parsers
!(https://www.gstatic.com/images/branding/googleg/1x/googleg_standard_color_128dp.png)Add as a preferredsource on Google…
研究前沿 MarkTechPost · 10-15 阅读 61·访客 61
Towards Physically Grounded Articulated 3D Assets: A Multi-Agent Pipeline and Benchmark
In this paper, we study physically grounded articulated 3D asset generation---moving the goal from reproducing how objec…
智能体 HuggingFace Daily Papers · 10-9 阅读 84·访客 84
KaliBench: A Fine-Grained Benchmark for Cybersecurity Tool Use on Kali Linux with Runtime-Free Verifiable Rewards
LLMs are increasingly applied to cybersecurity workflows, where they are expected to translate analysts' intent into too…
研究前沿 HuggingFace Daily Papers · 10-1 阅读 30·访客 30
VTR-Bench: A Systematic Benchmark for Evaluating Visual Text Rendering in Video Generation
Recent video generation models can produce highly realistic videos from natural language instructions, with visual quali…
研究前沿 HuggingFace Daily Papers · 10-1 阅读 58·访客 58
OpenTumorBoard: A Real-World Benchmark of Multidisciplinary Tumor Board Discussion Trajectories
Multidisciplinary tumor boards integrate multimodal clinical observations and longitudinal patient histories through spe…
研究前沿 HuggingFace Daily Papers · 9-26 阅读 38·访客 38
End-to-End Multimodal Data Augmentation and Adversarial Robustness Benchmark with AugLy for Images, Text, Audio, and PyTorch
In this tutorial, we build a comprehensive multimodal augmentation and robustness workflow with **AugLy** for images, te…
研究前沿 MarkTechPost · 9-26 阅读 49·访客 49
SatNav: A Scalable Benchmark for Long-Horizon UAV Vision-Language Navigation from Satellite Imagery
Urban uncrewed aerial vehicle (UAV) vision-language navigation (VLN) requires agents to follow instructions across exten…
智能体 HuggingFace Daily Papers · 9-25 阅读 76·访客 76
GPT-6 Astra and Claude Fable turn robot arms into slapstick killer robots in new safety benchmark
Leading AI models usually attempt dangerous tasks rather than refuse them when controlling a robot, according to the Rob…
智能体 The Decoder · 9-19 阅读 118·访客 116
OmniVBench: A Benchmark and Large-Scale Dataset for Omni Reference-to-Video Generation
Reference-to-video (R2V) generation is evolving toward increasingly general and versatile reference control, giving rise…
研究前沿 HuggingFace Daily Papers · 9-18 阅读 58·访客 58
VākQA: A Benchmark and Evaluation Study for Telugu Spoken Factoid Question Answering
Question answering has advanced rapidly with large language models, but predominantly for high-resource languages, in bo…
智能体 HuggingFace Daily Papers · 9-17 阅读 79·访客 78
TeleAntiFraud 2.0: A Refreshable, Profile-Grounded, and Audio-Based Benchmark for Telecom Fraud Detection
Telecom fraud scripts evolve rapidly and are often designed to resemble routine service conversations, creating two key …
研究前沿 HuggingFace Daily Papers · 9-17 阅读 35·访客 35
RiskChainBench: A Benchmark for Obfuscated Platform Message Restoration and Evidence-Grounded Web Investigation
Platform abuse campaigns conceal redirection instructions with emojis, homophones, character decomposition, and redundan…
研究前沿 HuggingFace Daily Papers · 9-15 阅读 46·访客 44
CADWorld: Computer-Use Benchmark for Long-Horizon Computer-Aided Design
Computer-use agents are increasingly evaluated in realistic desktop environments, but existing benchmarks provide limite…
智能体 HuggingFace Daily Papers · 9-14 阅读 86·访客 85
StochBench: A Domain-Specific Benchmark for Stochastic Processes in Lean
Leading benchmarks for formal theorem proving with large language models are small collections drawn from competition ma…
研究前沿 HuggingFace Daily Papers · 9-8 阅读 29·访客 27
VDiff-Bench: A Challenging Benchmark for Fine-Grained Image Difference Identification
Multimodal Large Language Models (MLLMs) perform strongly on general visual understanding tasks such as visual question …
研究前沿 HuggingFace Daily Papers · 9-5 阅读 35·访客 34
WearableQA: A Benchmark for Health Reasoning over Real-World Wearable Data
Recent advances in wearable sensing enable continuous monitoring of physiological and behavioral signals, yet existing b…
研究前沿 HuggingFace Daily Papers · 9-4 阅读 42·访客 39
Measuring the Checker: Mutation Analysis for GPU-Kernel Benchmark Oracles
Benchmarks for LLM-generated GPU kernels decide correctness with a few random inputs and a loose floating-point toleranc…
研究前沿 HuggingFace Daily Papers · 9-2 阅读 39·访客 39
本体对齐怎么评:OAEI Ground Truth、F 值与部署边界
本体对齐的分数并非脱离数据集的真理。以 OAEI 2025 为例,拆解参考映射、Precision/Recall/F 值、track 特定协议与标注不完备性,说明公开 benchmark 能回答什么、不能代替什么。
后端技术 精选 · 原创 · 昨天 阅读 8·访客 8
PolyRoute: A Twelve-Language and Code-Mixed Benchmark for Typed-Decision Routing, with Baselines and a Leaderboard
Typed-decision encoders answer a question about a text in one forward pass, but their behaviour outside English is rarel…
研究前沿 HuggingFace Daily Papers · 11-10 阅读 8·访客 8
Datalab Introduces OmniExtractBench to Fix Bias and Opacity in Extraction Benchmarks
Datalab**has released OmniExtractBench, an open benchmark for structured document extraction. It tests how accurately a …
研究前沿 MarkTechPost · 10-2 阅读 42·访客 42
ScholarCatalyst: A Benchmark for Retrieving Papers That Inspire New Research
What makes great scientists great? Even as AI systems start to make progress on open problems, scientists remain far ahe…
研究前沿 HuggingFace Daily Papers · 10-1 阅读 37·访客 37
RGBD20K: A Large-Scale Benchmark for RGB-D Semantic Segmentation
In this paper, we propose RGBD20K, a novel dataset for facilitating the development of more robust and general RGB-D sem…
研究前沿 HuggingFace Daily Papers · 9-24 阅读 37·访客 37
APort Vault: Benchmarking AI Agent Payment Authorization with the Open Agent Passport
APort Vault is a benchmark for payment authorization in tool-using AI agents. It replays 4,371 attacks written by humans…
智能体 HuggingFace Daily Papers · 9-18 阅读 99·访客 97
OpenAI这是拿千禧年难题当Benchmark刷啊。。。
爆料直指霍奇猜想]
研究前沿 量子位 · 9-11 阅读 39·访客 35
ReactHuman: A Physics-Grounded Benchmark for Human-Like Reactive Decision-Making in Embodied Multimodal LLMs
Reacting to sudden physical hazards (catching a slipping plate, dodging a falling knife) is both a meaningful test of em…
智能体 HuggingFace Daily Papers · 9-9 阅读 80·访客 79
Last Translation Benchmark
For scientific progress, we need benchmarks that test the limits of state-of-the-art models, and evaluation methods that…
研究前沿 HuggingFace Daily Papers · 9-3 阅读 29·访客 28
一篇读懂评测污染:你的 Benchmark 分数可能是个假象
GSM8K 的题目被背下来了会怎样——拆解污染的三条进入路径、n-gram 与 Min-K% 检测法,以及动态基准的军备竞赛。
大模型 精选 · 原创 · 11-9 阅读 70·访客 70
智能体生态观察 · 第 59 篇|生产环境评测:在线灰度、影子流量与回归集
benchmark 分数高不等于生产能用。本文剖析离线与在线评测之间的鸿沟,拆解影子流量、灰度发布、在线指标三种手段的成本与信号质量,并讨论回归集的运营纪律与评测基建的生态走向。
智能体 精选 · 原创 · 3天前 阅读 27·访客 27
InclusionMed: Benchmarking AI for Inclusive Healthcare
Advancing medical AI for inclusive healthcare requires evaluation across diverse healthcare roles, tasks, and care setti…
研究前沿 HuggingFace Daily Papers · 6天前 阅读 4·访客 4
SWE-CoWork: Benchmarking Coding Agents as Digital Employees in Organizations
A coding agent working within a software organization must establish what to build, collaborate with colleagues, and ver…
智能体 HuggingFace Daily Papers · 11-15 阅读 6·访客 6
Reducing Batch Makespan for LLM Agent Workloads through Inference-Environment Coordination
Efficient batch execution of agent tasks is critical to LLM training and development workflows, including benchmark eval…
智能体 HuggingFace Daily Papers · 11-12 阅读 7·访客 7
SO-Arena: Benchmarking the Capability Spectrum and Reliability of System One Models
System One models promise fast, general-purpose decision-making without lengthy token generation. However, understanding…
研究前沿 HuggingFace Daily Papers · 11-11 阅读 6·访客 6
推理服务的压测方法:从基准工具到容量验证
「压测一下」在推理服务上远比传统服务复杂:压什么指标(TTFT/吞吐)、怎么模拟真实流量(长度分布)、用什么工具(vLLM benchmark、k6、自研)。本篇拆解推理服务压测的方法论——场景设计、指标采集、瓶颈定位,以及压测报告的正确打开方式。
大模型 精选 · 原创 · 11-4 阅读 56·访客 56