IIA sets human-in-the-loop rule for AI in indexing

Index administrators may use AI to flag data outliers, but a human must confirm whether each flag is a real market move, according to a new Index Industry Association report.

The report examines administrators overseeing more than three million benchmarks and makes human-in-the-loop governance a central rule. It was written by IIA chief executive Kirsten Wegner and John Jacobs, a former Nasdaq executive and former executive director of the Georgetown Psaros Center for Financial Markets and Policy. The IIA also separates index administration from portfolio analysis: "an index remains a measure of a market, not an investment product or recommendation."

For advisors selecting a fund, the report puts execution risk on the fund manager, not the index provider. ETF Trends reported that separating index administration from portfolio analysis protects calculation agents from downstream trading fallout and leaves fund firms carrying execution risk if automated tools falter. That makes the written methodology — outlier rules, rebalancing schedules, data sources — the due-diligence document to review, and the more AI does the discovery work, the more weight the written rules carry.

The report describes generative AI as a "navigation layer" for benchmark selection. It lists three functions: discoverability, to surface relevant indices; comparability, to evaluate rule differences across providers; and composability, to analyze how benchmarks can be combined or customized.

Brian Coco, VettaFi's head of index products, said AI has compressed client iteration from weeks or months to hours and days. "It does not replace the diligence the index provider must perform, but helps flush out concepts and investment theses quicker and more efficiently," he said.

Accountability falls to whoever set the agent running. "AI is a tool, not a get out of jail free card," said Dale Gabbert, a partner and head of funds at Fieldfisher. "The starting point is that you are responsible for anything an AI agent that you set up does." For a manager that uses an agent to run rebalancing, that leaves the execution risk, and the record of human review, on the fund's side of the IIA's line.