Thiel-Backed AI Project Shifts Focus, Now Ranks Media Performance

A technology project with financial backing from Peter Thiel has undergone a significant transformation, moving from its initial concept to a new model centered on assessing media performance. This initiative, now operating under the name "The Primary," utilizes advanced artificial intelligence to rank both individual journalists and news publications. According to the Hollywood Reporter, this rebranded service employs a methodology driven by large language models (LLMs) to analyze and score media content. The assessment criteria and algorithms behind these scores are part of the platform's design to provide a quantifiable evaluation of journalistic work. Notably, some reporters covering artificial intelligence for The New York Times have reportedly received particularly low rankings from this system. The evolution of this project, which was previously known as an "AI Tribunal," indicates a shift in its strategic direction. While the earlier iteration suggested a more adjudicative role, the current "scoreboard model" focuses on comparative ranking. This change in nomenclature and function reflects a pivot towards a system that aims to categorize and rate media entities based on perceived quality or influence, as determined by its AI processes. Such a system introduces new considerations for how journalistic standards and credibility might be perceived through automated evaluation. The reliance on large language models for these assessments means the platform processes vast amounts of text to form its conclusions, though the specific parameters for scoring are not publicly detailed. The impact of such rankings on the reputations of news outlets and individual journalists remains a subject of ongoing discussion within the media industry. The development highlights a growing trend of technology intersecting with traditional media, particularly in areas of content analysis and performance metrics. As AI tools become more sophisticated, their application in fields like journalism evaluation is expanding, prompting conversations about objectivity, algorithmic bias, and the future of media scrutiny. The Primary represents one such application, offering a novel approach to appraising news reporting and its creators.