Journalists need rigorous model assessments. So the author developed exactly this kind of test with a team of academics, journalists, and research assistants at NYU Journalism, from Sloane Lab at the University of Virginia and MuckRock. As a starting point, she decided to look at two categories of AI tools that feel immediately useful for core journalistic work: chatbots for making summaries of meetings, and AI models for scientific research. Our research was conducted with support from the Patrick J. McGovern Foundation.

