Internal Research Tool Generates Actual False Information

Issues with Politico’s AI-Driven Reports

Politico’s AI-based research tools for premium subscribers are producing fictional reports about imaginary lobbying groups. This includes analyses of entities like the Basket Weaver Guild and the League of Left-Handed Plumber.

Developed in partnership with Startup Capitol AI, the tool was intended to help Politico Pro subscribers create detailed reports from journalism sources quickly. However, instead, it has resulted in what some union members describe as distorted information and poorly constructed news content, as reported by Semafor.

In defense of the tool, Politico mentioned that the most requested feature was a customizable summary of political topics, stating that the product is still “a work in progress.”

The AI-generated reports, which have raised concerns among Politico’s editorial team, led to a complaint filed earlier this year. They argued the tool breaches contractual agreements regarding adherence to journalistic ethics and the necessity of human oversight. Examples of the AI’s fictional outputs were even displayed around the newsroom in Virginia.

One of these made-up reports allegedly features lobbying efforts by the non-existent Basket Weaver Guild, which supposedly advocates for better data privacy laws. Additionally, the fictional left-handed plumbers were depicted as pushing for tax exemption on tips, with fake details about Republican Senator Ted Cruz woven into the narrative.

Moreover, the tool reportedly made factual errors about real events. For instance, early reports on Roe v. Wade contained inaccuracies. The AI conjured scenarios as though the Supreme Court’s decision was still pending, with claims about potential actions by Indiana’s lawmakers being premature.

John Schreus, president of the News Guild, emphasized that this issue goes beyond a mere contractual disagreement. It raises significant questions about the role of AI in journalism. The dispute is expected to proceed to arbitration in July, which could influence the future of AI integration in newsrooms.

Axel Springer, Politico’s parent company, is pushing for wider AI adoption. CEO Mathias Döpfner recently indicated that companies need to embrace AI or risk becoming obsolete, according to Semafor.