Pulse-AI
Search Saved Edit domains

Weekly research brief · Week 43

What mattered in AI research this week

19 Oct to 25 Oct 2026. The papers worth your attention, why they matter, and what to tell clients.

Includes papers arXiv published late (submitted from 16 Oct), so nothing slips between weeks.

Start here

This week at a glance

The three papers most worth your time, across every domain.

01Retrieval-augmented generation
Raise with clients
  • Surprising result
  • Reframes the problem

Retrieval Augmented Generation Compositionality

RAG pipeline components do not reliably compound their isolated performance gains when combined, and the best-performing pipeline composition shifts as document corpus size expands.

The authors created LASAGNA, an open-source evaluation framework, to test 450 RAG configurations across eight benchmarks and corpus sizes from 5K to 200K documents. They found that combining individually strong techniques yielded significantly lower improvements than expected, optimizing for retrieval could degrade faithfulness, and winning architectures varied with corpus scale. Consequently, isolated component benchmarks are poor predictors of end-to-end system efficacy.

Client angle, caveats & evidence

Client angle Relevant if a client is stacking multiple RAG components under the assumption that benchmark gains will compound additively at enterprise scale.

Caveats The study tests corpora up to 200K documents, which may not capture dynamics in ultra-large enterprise repositories.

“three retrieval techniques predict a +47% combined improvement but deliver only +17% when used together.”

Ido Levy, Segev Shlomov, Leshem ChoshenPreprint, not peer reviewed · 54 community upvotes · code released

02AI agents
Read in full
  • New benchmark
  • Reframes the problem

OR-License: Evaluating LLM Agents as Real-World Operations Research Practitioners

It benchmarks LLM agents against real-world client engagements and reveals that while some models beat human experts on conditional objective quality, zero match human performance once deployment feasibility is accounted for.

The authors introduce OR-License, a benchmark derived from 31 industrial operations research engagements totaling $3.68 million, paired with a client simulator (ORSim) to evaluate end-to-end problem translation and feasibility. Across 11 frontier LLMs, no model matched the human expert reference in Deployment-Adjusted Quality (DAQ), with the top configuration reaching an 88.39% feasibility rate and 0.87 DAQ against the 1.0 expert baseline. Trajectory analysis showed task-equalized research-chain completion rates ranging between only 24% and 45% due to formulation and implementation failures.

Client angle, caveats & evidence

Client angle Relevant if a client is considering deploying LLM coding agents to independently formulate and solve complex enterprise optimization or operations research problems.

Caveats The benchmark relies on a simulated client (ORSim) for information disclosure rather than live human stakeholders, and evaluates a relatively small sample of 31 problem instances.

“several exceed the expert reference in conditional objective quality, but none matches its DAQ; the strongest primary Claude Code configuration achieves 88.39% strict feasibility and a DAQ of 0.87”

Peisong Wang, Feixue Liu, Yize Meng et al.Preprint, not peer reviewed · 52 community upvotes · code released

03Retrieval-augmented generation
Read in full
  • New benchmark

MMEnterprise-Bench: Evaluating Enterprise Agents over Evolving Multimodal Records

Higher retrieval recall achieved through larger models or budgets fails to consistently improve answer accuracy when enterprise workplace data contains temporal and cross-source conflicts.

This paper presents MMEnterprise-Bench, a suite of 1,613 questions testing evidence reasoning, conflict resolution, and unanswerability over evolving multimodal records from simulated projects. Evaluating 10 multimodal LLMs revealed that even top models struggle with cross-source or temporal conflicts and multi-image evidence. The study demonstrates that expanding retrieval budgets or retriever scale does not guarantee better downstream accuracy.

Client angle, caveats & evidence

Client angle Relevant if a client is deploying multimodal agents across frequently revised collaborative repositories containing mixed text and image records.

Caveats The benchmark relies on simulated collaboration projects rather than actual enterprise workplace environments.

“increasing the retrieval budget or employing a larger retriever improves evidence recall but does not consistently translate into higher answer accuracy.”

Seohyun Lee, Jongha Kim, Dohwan Ko et al.Preprint, not peer reviewed · 33 community upvotes · code released

Explore

Your domains this week

Each domain has its own page with every paper, the week's takeaway and what to tell clients.

A white humanoid robot against a warm brown wall
Domain 01

AI agents

3 papers worth your time

This week's papers suggest that autonomous agents struggle with practical execution challenges, showing failures in real-world deployment feasibility for operations research and an inability to autonomously recover from execution errors in computer-use tasks.

  • 1 × Read in full
  • 2 × Skim it
Open AI agents
Rows of books on tall wooden library shelves
Domain 02

Retrieval-augmented generation

4 papers worth your time

This week's papers suggest that increasing model scale, retrieval budgets, or architectural complexity does not reliably boost RAG performance, as multi-source enterprise bottlenecks persist and naive dense retrieval can outperform complex agentic designs.

  • 2 × Read in full
  • 1 × Skim it
  • 1 × Raise with clients
Open Retrieval-augmented generation
Colourful lines of code on a dark editor screen
Domain 03

LLMs for code

2 papers worth your time

This week’s papers suggest that improving the infrastructure around coding agents—such as co-adapting execution harnesses during training or deploying external trajectory monitors—can substantially boost performance and reduce inference costs on SWE-bench benchmarks.

  • 1 × Read in full
  • 1 × Skim it
Open LLMs for code
A factory floor filled with orange industrial machines
Domain 04

Computer vision for industrial applications

2 papers worth your time

This week’s papers suggest that industrial vision systems benefit from integrating domain logic, such as formalized standard operating procedures or decoupled compliance reasoning, to improve inspection decision-making.

  • 1 × Skim it
  • 1 × Raise with clients
Open Computer vision for industrial applications

Photos on Unsplash by Alex Knight, Susan Q Yin, Florian Olivo and Simon Kadula.

How this brief is made

  1. 1
    Scan

    Every new arXiv paper in each domain, plus community signals from Hugging Face.

  2. 2
    Judge

    Gemini scores each abstract for relevance, evidence and hype, and for the signals that matter: a new benchmark, a surprising result, or a reframing.

  3. 3
    Check

    Every summary is fact-checked against its abstract. Quotes and numbers must appear there verbatim, or they are removed.

Papers are preprints and not peer reviewed. Open the paper before quoting it to a client.