SCROLL NEWS / DISCOVERY
Search headlines
Find the stories shaping the conversation.
Results for " Ranking " 1,603 found 🔀 AI-powered Shuffle
Recruiting services vary on Arkansas football's 2027 class ranking
Arkansas football has 24 commitments going into July and stands at No. 29 and No. 38 nationally by 247Sports and On3 industry ranking respectively.
NFL 2026 offseason power rankings countdown: Can Giants, Saints take a leap forward?
Follow along as preview and power rank all 32 teams.
Dolphins Current Uniforms Receive Top 10 Ranking
The Miami Dolphins have a storied history, including their uniforms, which have received a top 10 ranking.
NFL QB rankings: Arizona Cardinals QB Jacoby Brissett near bottom
Even with career numbers last season, Jacoby Brissett is one of the lowest-ranked QBs in the league, per PFF.
Raiders top newcomers ranked by immediate impact
We went about listing the Raiders top ten veteran newcomers and ranking them by how much of an impact they will have right away.
http://democrats-energycommerce.house.gov/media/press-releases/republicans-disastrous-health-care-agenda-leaves-millions-americans-without
House Energy and Commerce Committee Ranking Member Frank Pallone Jr., D-N.J., and Senate Finance Committee Ranking Member Ron Wyden, D-Ore., today released their latest report monitoring the devastating impact of Donald Trump and Republicans’ Big Ugly Bill, which has forced millions of Americans to face skyrocketing health care costs and even drop coverage entirely.
NFL offseason power rankings: No. 25 New York Giants quit messing around at head coach with John Harbaugh hire
Cowboys and Eagles dominate roster strength comparison across NFC East
Ranking the NFC East rosters by player grades
Jaylen Waddle and Courtland Sutton rank sixth in CBS Sports’ dynamic duo wide receiver ranking
Will 2026 be the year that the Denver Broncos once against boast two 1,000-yard wide receivers?
Bucs' Mayfield Disrespected in New QB Tier Rankings
Despite delivering Pro Bowl performances and stabilizing Tampa Bay post-Brady, Baker Mayfield remains overlooked, landing in a baffling "volatile" tier behind less proven signal-callers and aging stars.
2026 NFL WR dynamic duo rankings: Cowboys' Cee Dee Lamb-George Pickens tandem among elite
Which NFL team has the best pair of wide receivers?
Who had the best year in college sports? Ranking all 68 Power Four schools from the 2025-26 seasons
An in-depth look at Power Four programs in football, men's and women's basketball, baseball, softball and volleyball
NFL offseason power rankings: No. 27 Las Vegas Raiders might finally have a plan, starting with Fernando Mendoza
UFC Power Rankings after UFC Baku
Hello everyone, and welcome back for another week of rankings in the UFC. As we look forward to no fights this week, we were definitely spoiled by the UFC Baku card. There were a few upsets, but none bigger than…
Booming Business: Texas Secures Top Spot for Climate Fourth Year Running
Texas was recognized as the Best Business Climate in the nation for the fourth year in a row by Business Facilities magazine in their 2026 Annual Rankings Report.
2026 NL Central Power Rankings: Week 14
Brewers, Cubs surge ahead as rest of division struggles
MLB Power Rankings: Are the Phillies ready to make a declaration on the NL East?
The Phillies have surged into the top five at the same time the Braves are struggling
Conservative presidential power expert set to assist investigation into Trump foes
John Yoo — a well-known and, in some legal and political circles, infamous conservative lawyer — will assist a Justice Department investigation that has theorized a yearslong conspiracy against President Donald Trump and is looking at several former high-ranking federal officials.
Rams news: QB battle, power rankings, top 100, power rankings
Some stories about the NFC West rival LA Rams from the last week for Arizona Cardinals fans to know.
Orlando Magic Have Something to Prove After Latest Power Rankings
New head coach Sean Sweeney faces immense pressure to transform Orlando's talented core into postseason contenders and silence doubters following a mediocre mid-pack ranking and trade rumors.
Where the ACC landed in Athlon Sports' conference rankings
Athlon Sports ranked the ACC fourth among FBS conferences entering the 2026 college football season.
Ravens have 5 players on CBS Sports' Top 100, but one omission stands out
Lamar Jackson headlines Baltimore's representatives on CBS Sports; top 100 ranking, but Zay Flowers' absence is sure to spark debate.
Peters, Bergman lead Michigan delegation in calling on Small Business Administration to approve disaster declaration
WASHINGTON, DC — U.S. Senator Gary Peters (D-MI), Ranking Member of the Homeland Security and Governmental Affairs Committee, led members of the Michigan Congressional Delegation in urging the Small Business Administration (SBA) to support Michigan Governor Gretchen Whitmer’s request for an administrative disaster declaration following the severe thunderstorms, tornadoes, high winds, large hail and torrential […]
Kroenke Sports & Entertainment deemed most valuable sports empire
The Jones family ($17.6B) and Harris Blitzer Sports & Entertainment ($16.91B) followed KS&E in the CNBC rankings.
AI Assistant Tool QED Scores bioRxiv Preprint Quality
QED, an AI assistant tool, evaluates the originality and validity of bioRxiv preprints, assigning them QED Scores. Researchers report that its rankings often align with expert opinion.
http://democrats-energycommerce.house.gov/media/press-releases/pallone-opening-remarks-health-subcommittee-markup-15-bills
Energy and Commerce Committee Ranking Member Frank Pallone, Jr. (D-NJ) delivered the following opening remarks today at a Health Subcommittee markup of 15 bills:
Ranking Big 12 recruiting classes via average commit distance
The Big 12 recruiting landscape continues to change as programs continue to shuffle throughout the conference. Texas Tech is pushing to sign the nation’s No. 1 class in the 2027 cycle and it firmly sits atop the league’s recruiting rankings. The Red Raiders are the only Big 12 team with a top-25 haul, per the […]
Top 100 NFL players of 2026: Myles Garrett tops rankings as Rams boast three players in top 10
Pete Prisco shares his 100 best players entering the new season
NFL offseason power rankings: No. 30 Arizona Cardinals restart the road to relevance, yet again
Gators among top-20 rated teams in EA Sports College Football 27
EA Sports views Florida as one of the nation's 25-best teams entering the 2026 season, so where exactly did the Gators land in CFB 27 rankings?
If Virginia’s ‘best state for business’ ranking falls, data center taxation debate will get the blame
But will Virginia fall? We don’t know yet, but we do know how CNBC has changed its formula. Here’s a look at whether that helps or hurts the state.
Ohio State star Jeremiah Smith gets first ever notoriety by EA Sports
Ohio State superstar wide receiver Jeremiah Smith has received a first-ever ranking at launch for 'College Football 27' and the folks at EA Sports.
Politics: What Donald Trump’s Defense Policy Means For Black Service Members
Black Americans serving in the U.S. military have long lived with a great contradiction. The country they’re fighting to protect is the same one that’s failed to serve and protect them.Despite this, Black Americans continue to enlist. There are over 350,000 Black active duty and select reserve members and more than 2.4 million Black veterans. That’s according to the Institute for Veterans and Military Families at Syracuse University.This year, Defense secretary Pete Hegseth has blocked or delayed the promotions of more than a dozen Black and female senior officers. He’s also dismissed several high-ranking Black and female officers, according to The Atlantic. This comes amid the second Trump administration’s aggressive rollback of programs and policies connected to diversity, equity and inclusion.Black military members have always battled discrimination. But for some, this is a step too far in the wrong direction. So, what does their future hold? And what does it mean for the U.S. military?Find more of our programs online. Listen to 1A sponsor-free by signing up for 1A+ at plus.npr.org/the1a.
QED Science Launches AI Infrastructure for Scientific Validation
Recognizes The 1% After Blind Evaluation of 57,455 Scientific PreprintsTEL AVIV, Israel, June 24, 2026 (GLOBE NEWSWIRE) -- QED Science, a science validity engine and modern infrastructure for researchers, funders, institutions and life science organizations today launched The 1%, the top 574 life science preprints. The company anonymously scored 57,455 bioRxiv preprints submitted between May 2025 and April 2026 for originality and validity. The ranking is powered by QED Score, QED Science’s vali
Dolphins dead last in recent power rankings
Frank Schwab of Yahoo Sports predicts a difficult 2026 for Miami.
NFL offseason power rankings: No. 31 New York Jets try to put Aaron Glenn's horrific first season behind them
Netflix’s New #1 Show Is a Crime Thriller Everyone Can Finally Agree on
A new Netflix thriller has taken over the number 1 spot, knocking a usual chart-topper down the rankings. Viewers are calling it binge-worthy, twist-filled, and impossible to pause once you start. Find out more here.
Cited 23 June: Project Cosmos launch | Science ‘under attack’ at Bonn | Emissions inequality
Carbon Brief explains how it built a major new database of climate science research and unveils a new ranking of the 500 most highly cited publications, authors and institutions in climate science.
NFL offseason power rankings: No. 32 Miami Dolphins start over in Year Zero, but at least with Malik Willis aboard
Ranking SEC recruiting classes via average commit distance
The 2027 recruiting cycle is moving at warp speed this summer. Prospects are making their college decisions in droves amidst official visit season. Dominoes are falling and classes are being built. Looking at the SEC, many programs are in states that are littered with blue-chip talent. You’ll often see the top schools go nationwide in […]
Lamar Jackson ranked No. 2 among fantasy QBs for 2026
Lamar Jackson landed behind Josh Allen and ahead of Jalen Hurts in a 2026 fantasy football quarterback ranking.
SEC dominates EA Sports 'toughest places to play' in CFB27
In the EA Sports CFB27 ranking of toughest environments, nobody can match the SEC.
Gunner Stockton snubbed from Joel Klatt's top-10 QB rankings
Georgia quarterback Gunner Stockton was left off Joel Klatt's top 10 list despite his impressive 2025 season and winning back-to-back SEC titles
Fantasy Baseball Rest-of-Season Rankings: Scott Pianowski's updated risers and fallers as of June 22
Every 2026 World Cup team ranked, according to FIFA
As this year's World Cup approaches the knockout rounds, here are the updated FIFA rankings for all 48 teams, with the USA making a major move upward.
Fantasy Baseball 2-Start Pitcher Rankings: At least 5 hurlers warrant strong consideration as streamers this week
Ranking the NFL's biggest offseason losers: Patriots, Packers facing questions
Three playoff teams crack the list of NFL clubs that had the worst offseasons
Ranking the top 10 NFL offseasons: Myles Garrett trade was a win-win for two teams on AFC heavy list
From blockbuster free agent signings to draft-day steals, we rank the NFL franchises that made the biggest roster upgrades.
Japan takes massive leap in the World Cup Power Rankings
Japan crushed Tunisia in the 1,000th World Cup game ever played and are looking like a legitimate contender this summer.
NFC North TE Rankings for 2026
The latest in our NFC North positional rankings sees us take a look at the tight end position. This is […]
🚨Official: Mexico climb the FIFA rankings
The Mexico national team is enjoying a strong moment at the World Cup on home soil, as in addition to being close to earning nine points in the group stage for the first time, it would also set a new ...
The definitive ranking of every Pixar movie (including 'Toy Story 5')
Love movies? Live for TV? USA TODAY's Watch Party newsletter has all the best recommendations, delivered right to your inbox. Sign up now and be one of the cool kids.
Way-too-early SEC softball power rankings for 2027 season
Teams such as Texas, Alabama, and Oklahoma headline the early 2027 SEC softball power rankings. Here is how the conference currently looks for 2027.
UMass Amherst Ag and Food Science Programs Ranked Among the Best in the World
Source: UMass News & Media The University of Massachusetts Amherst Agricultural Sciences and Food Sciences and Technology programs have again been ranked among the Top 10 worldwide in the 2026-27 Best Global Universities by U.S. News & World Report. The 12th annual edition of U.S. News & World Report Best Global Universities rankings evaluating more than 2,250 institutions in the U.S. and
Power ranking the Steelers’ position groups: Defense
What’s Pittsburgh’s biggest strength on defense?
NC ranks 9th nationally in business using AI
North Carolina is emerging as a leader in AI adoption, with over 22% of its businesses utilizing the technology, ranking ninth nationwide.
Team's post-op kidney injury risk model could aid prevention
The machine learning-derived model was 88% accurate in ranking preoperative patients according to risk for postoperative acute kidney injury.
MLB starting pitcher power rankings entering week 13
MLB has completed the first 12 weeks of the 2026 season. Specific players have continued producing great numbers, while a handful are missing time due to injury. Now is the time when player production starts garnering attention for All-Star rosters.…
MLB power rankings: Dodgers, Braves and Brewers make up all-NL top 3, followed by Yankees and Rays
Panthers get dissed for 'entertainment' factor in NFL ranking
Will the Carolina Panters be entertaining to watch in 2026?
University of Texas at Austin Named Among Best Global Universities
U.S. News & World Report placed UT in the top 10 in the U.S. and top-tier worldwide in a variety of science subjects for its 2026-2027 rankings.
2026 America’s Top States for Business: How we are ranking all 50 U.S. states
America's Top States for Business rankings reflect the measures states are using to attract corporations amid urgency to build new facilities across the U.S.
To be America's Top State for Business in 2026, 'speed to market' wins
CNBC’s 2026 America’s Top States for Business rankings is a race as companies chase record investments in AI and defense in deciding where to locate.
WNBA power rankings: Who’s struggling most with the league’s new whistle
The league has placed an emphasis on freedom of movement to address growing physicality and some teams have adapted better than others.
Emigholz on Jersey Thing: Business Climate Analysis Shows Competitive Struggles with Neighboring States
In a recent interview on Jersey Thing with Eric Scott, NJBIA Chief Government Affairs Officer Christopher Emigholz said New Jersey’s disappointing ranking
Ranking Member of House Armed Services Committee: ‘The war was really stupid’
Fantasy Baseball Rest-of-Season Rankings: Scott Pianowski's updated risers and fallers as of June 15
College football's most experienced offenses: Ranking all 138 FBS units ahead of the 2026 season
A full breakdown of rushing, passing and receiving efficiency for every FBS roster
Fantasy Baseball 2-Start Pitcher Rankings: Cardinals, A's, Mets make rotation shuffles to open up more streaming options
MLB power rankings: Brewers and The Miz rise after conquering Philly
Milwaukee moves up to No. 2 in.USA TODAY Sports power rankings behind their ace phenom.
French business schools lead FT Masters in Finance 2026 ranking
ESCP tops the table amid growing demand as graduates seek sanctuary from a tough job market
Pacifica businesses launch 'Project 1334' in response to last-place ranking in WalletHub study
It's called "Pacifica Project 1334," and it's in response to a recent WalletHub study that placed Pacifica dead last among small U.S. cities for starting a business. Here's how the campaign initiative leans into the criticism with humor.
Why Qatar qualified for World Cup, but not Italy
The qualification process can be quite misaligned with the FIFA world rankings.
Every Major Streaming Device Brand Ranked Worst To Best
Nvidia, Apple, and Roku lead our ranking of the best streaming device brands, while Google, Amazon, and Onn offer distinct strengths.
Top 2027 high school football prospects in Pennsylvania
Pennsylvania has long been an under-the-radar hotspot for high school football talent, and the 2027 class might be its best in recent memory. This year’s crop features three five-star prospects in the Rivals Industry Ranking — tied with California and just one behind Florida. The class isn’t just top-heavy, though. Twelve players in the state […]
Treasure State Top Five: Montana combat sports legends
It’s time for the first ever Treasure State Top Five where SWX Montana’s Josh Dugan will be breaking down his top five rankings for a number of different categories in
ICYMI: Chairman Cruz Hosts Roundtable on the Protect College Sports Act - U.S. Senate Committee on Commerce, Science, & Transportation
Click here to watch a video recap of the roundtable. WASHINGTON, D.C. – U.S. Senate Commerce Committee Chairman Ted Cruz (R-Texas), Ranking Member Maria Cantwell (D-Wash.), and Senator Chris Coons (D-Del.) hosted a roundtable with coaches, student athletes, and university presidents to discuss the Protect College Sports Act. Chairman Cruz emphasized, “The Protect College Sports Act is […]
Clemson doubt continues? Athlon Sports predicts Tigers’ 2026 finish
Clemson is seemingly outside the Top 3 in every ACC rankings yet. Are the Tigers being undervalued?
College sports bill authors making pitch to Black caucus
The authors of a Senate bill that would overhaul college athletics warned this week that a lack of congressional action this year could financially wreck historically Black colleges and universities and could reduce chances for college educations for minority students. Senate Commerce Committee Chair Ted Cruz, R-Texas, and ranking member Maria Cantwell, D-Wash., said they […]
White House polices hitting small business contractors hard, Senator says
Sen. Ed Markey (D-Mass.), ranking member of the small business committee, found more than 6,500 small firms have left the federal market in the last 15 months.
Seattle tumbles in ranking for best U.S. cities for foreign businesses
The ranking is based on metrics important to foreign investors, including business environment, workforce talent and trade war resilience.
2026 World Cup: Predictions, rankings, team-by-team schedules, rosters and everything else you need to know before kickoff
http://democrats-energycommerce.house.gov/media/press-releases/pallone-opening-remarks-subcommittee-hearing-health-care-transparency
Energy and Commerce Committee Ranking Member Frank Pallone, Jr. (D-NJ) delivered the following opening remarks at a Health Subcommittee hearing on "Lowering Health Care Costs for All Americans: Examining Policies to Increase Health Care Transparency:"
Akron's Bower Speaks at College Sports Roundtable
WASHINGTON, D.C. - On Wednesday (June 10), Chairman Ted Cruz (R-Texas) and Ranking Member Maria Cantwell (D-Wash.) held a roundtable with coaches, student at...
AI token leaderboards are 'dystopian': Replit AI chief
As Amazon and others rethink AI-use rankings, Replit's AI head said it was a poor measure of employee performance.
Seattle slips in ranking of best U.S. cities for foreign investment, fueling concerns about business climate
The fourth annual list compiled by British newspaper Financial Times and stock market index Nikkei ranks Seattle 13th among 95 U.S. cities — a drop of 11 places from last year's second-place position.
Indiana child well-being rank declines in national report
Despite improvement in some categories, Indiana's overall ranking fell four spots, its worst ranking since 2021.
MLB second basemen power rankings entering week 12
MLB has completed 11 weeks of the 2026 season. Certain players are having great seasons, but injuries are starting to affect some of the game’s best players. Heading into week twelve, here are the top ten second basemen around the…
Ranking the 15 NFL quarterbacks who most need a Super Bowl win for their legacy
Ranking 15 quarterbacks that need to win the Super Bowl to define their legacy in the NFL.
WNBA power rankings: Worst 2026 offseason additions, including Satou Sabally
Are we sure Satou Sabally and the New York Liberty are the right fit for each other? We search for an answer in this week's WNBA power rankings.
Atlanta Braves News: Trade Thoughts, 2026 Draft Prospect Rankings, More
Plenty of Trade Talks Ahead
Bears RB duo came inches away from claiming NFL's top rank - and they have a strong shot to repeat as one of the league's best
The Chicago Bears running back duo of D'Andre Swift and Kyle Monangai ranked second in the NFL in latest RB duo rankings, and yet they still seem to be disrespected.
We can create the future of science right now
Paul Litvak is the founder and Executive Director of the Robyn Dawes Institute and a Visiting Scholar at UC Berkeley. He has a PhD in Behavioral Decision Research from Carnegie Mellon where he studied emotions and the sunk cost bias. Over 15 years in industry, he solved a wide range of challenging technical problems. At Meta he created models optimizing the ad review process. At Google he ran experiments to measure social influence. At Airbnb, he was a product manager leading machine learning teams optimizing search ranking and price suggestions. He also co-founded and led product at Rhythmic Health, a venture-backed biosensing startup, creating an accurate low cost system using a color changing strip and a smart phone to measure salivary lactate. The bottleneck At this point, it is uncontroversial to say that science needs to stop using the PDF article as the unit of knowledge and currency. The unbearable slowness of scientific publishing, the profit motive and margins: I’m not saying anything new. The PDF also sucks because it’s hard to extract structured information, which makes it hard to do evidence synthesis. As a result, we do much less evidence synthesis than is needed. And evidence synthesis ultimately undergirds most policy and medical decision-making. I can see second-by-second real-time odds for any sporting or newsworthy event, but a school board can’t see the best evidence on whether their 8th graders should be taught algebra. As a society, we don’t treat this as an important problem. Again, not controversial. Not only is the problem well understood, but the solution has already been laid out. What we need is AI-assisted living evidence synthesis - (1) an open knowledge graph of atomic claims, (2) claims linked to evidence, (3) assessment and synthesis of each piece of evidence, and (4) continuous updating with new data. What few realize (yet) is that the technical capacity to build this vision for a significant portion of science already exists. Not only that, scientists and startup teams are already building many of these components. I know this because I’ve been surveying the space and talking to many of the builders. There are some missing pieces: for example, evaluations of how well some of the components work. But at this point, most of what’s missing is a fully end-to-end working integration of all of these parts. In the rest of this essay, I’m going to lay out all the parts of a working living evidence layer for science and who is working on them, and propose concrete next steps for building this system. What’s now possible The diagram above outlines the components of a living evidence synthesis platform, including some of the teams working on each component1. Scientific PDFs are processed into claims with associated evidence. The evidence is subjected to a forensic audit, methodological evaluation and robustness and reproducibility checks. Finally it’s given a weight in a continuously updating synthesis. What follows is a description and status of each component and a few of the teams working on them. Document understanding The first thing you need to be able to do is turn an article into structured data. Mostly that means parsing PDFs. There are often multicolumn layouts that confuse non-specialized PDF to text processing libraries. For scientific papers, there is the added complexity of parsing formulas and tables and figures. This is a really hot area - there are startups offering APIs, and it seems like a new open source package gets posted to Github every few weeks. What follows isn’t exhaustive. A package called GROBID was the state of the art for a while, they didn’t update their package for nearly two years until very recently. In the meantime reducto.ai released an AI powered PDF extraction API, PaddleOCR became popular, IBM released a model called Docling, and both Mistral and Gemini created models and libraries. I also know of at least one other well-funded psychology research group working on a paper parser. By contrast, there are few open evals in this space, with no extensive evals for complex table comprehension in particular. Nonetheless, I’m confident this will be a solved problem soon, given the combination of LLM advances and developer interest. Hypothesis level extraction There has been increasing interest in comprehending the extracted text of papers and linking information to evidence for each hypothesis. A lot of work has already been done. Trialstreamer (Marshall et al. 2020) and RobotReviewer LIVE (Marshall et al. 2023) demonstrated automated extraction of trial population, intervention, and outcome at scale on clinical RCTs. PaperQA2 (Skarlinski et al. 2024) and Ai2 ScholarQA (2024) extended this to retrieval-augmented question answering with citation grounding. Elicit, Consensus, and SciSpace operationalized claim-level extraction for end users. OpenEval (Booeshaghi et al. 2026) is the most recent and most ambitious: 1.96 million atomic claims extracted from 16,087 eLife manuscripts using Claude Sonnet 4.5, grouped into ~299,000 results, with LLM evaluations showing 81% agreement with human peer review on a 2,487-paper subset. None of these solutions link claims to test-statistics, as you would need to evaluate randomized controlled trials. This is why I built the evidence.guide API - to extract hypotheses and associated test statistics from behavioral science papers. The best public eval of this kind of extraction I’m aware of comes from the recent SCORE project - they had humans code thousands of psychology papers to extract their claims by hand. It would be extremely helpful to the world if all scientific PDFs were available as structured open data. I’ve been working to make this happen, both directly at Berkeley and through coordination with large entities I can’t yet speak of; as hard as it is to do, I think it’s possible2. Forensic audit A lot of work has been done on forensic audit, but some gaps remain. Of course, for biology papers that rely on images for evidence, there are a variety of tools (notably Proofig and ImageTwin) to spot anomalies. These are still well short of what sleuths like Elizabeth Bik can do on her own, but these tools are constant companions among fraud analysts. There’s someone working on auditing Excel files for anomalies, and a number of teams are automating numerical checks like GRIM and SPRITE, including Scrutiny project, the INSPECT-SR team as well as statcheck. The regcheck team is building a way to use AI to compare preregistrations to analyses in papers, to ensure there aren’t significant deviations. Nonetheless, there are many other kinds of anomalies to screen for, both public and less publicly known. And there are no formal evals for anomaly detection that I’m aware of. Still, there’s a lot to draw from in this space and I’m pretty certain we will be able to scan papers for most kinds of obvious anomalies in the near future. Methodological review This area has been white hot, though I fear for many of the startups in this space, because this capability may become commoditized. There are at least six different AI peer review companies, including Refine.ink, Reviewer3, ReviewerZero.ai, Q.E.D. Science, Paper Wizard, and Isitcredible. Coarse (a pun on refine) was also recently created as an open source alternative. These systems provide qualitative feedback on the content of papers, spotting methodological weaknesses and mathematical errors. They seem to work pretty well, and many academics report bitterly that they exceed the average quality of typical peer reviewers. But there are few evals here either. What evals exist so far involve using LLM-as-judge (circularity problems abound) or comparing against human reviews of questionable quality. What you’d ideally want is an eval that measures capturing known errors in papers3. Reproducibility and robustness Another active area has been using AI agents to automate computational reproducibility4 and robustness5 checks in papers that report numerical results. For more recent papers where data and code are available, AI agents can see whether they can re-run the analyses and produce the numbers reported in the published paper. In addition to a handful of individual academics who have been experimenting using Claude Code for this, the Institute for Replication is a leading group working on building an end to end system. The evals related to this problem are the most mature, with CORE-Bench (Siegel, Kapoor, Narayanan 2024) and PaperBench (OpenAI 2025) available to benchmark agents on this task. There is also work on getting AI agents to test alternative ways of analyzing the data to ensure the results are robust to small analytic design choices. Synthesis This is the most underdeveloped area where significant investment is required. Although some automated evidence synthesis systems exist — for example, otto-sr is building an AI agent to write systematic reviews — none of these incorporate the full range of paper level signals to weight evidence appropriately. Nor is there anything like an eval or a gold standard for a good systematic review. Arguably Cochrane reviews are the closest we have to gold standard human systematic reviews, though I’ve heard academics in the know complain about their uneven quality. A key question for a synthesis platform is how to weight anomalies and methodological issues in assessing the quality of a piece of evidence. This is an unsolved problem and one I’m very keen to work on. Continuous updating There are many pieces of basic infrastructure available for monitoring for new research and initiating updates. OpenAlex is the current open citation graph. Retraction Watch integrated into Crossref in October 2023. Scite tracks how citations support, contrast, or mention prior claims. The Living Evidence Network demonstrated continuous-update workflows in clinical guidelines. Engineering this is a relatively straightforward task. When you look over this technical architecture and all the progress being made, it’s hard not to be optimistic that a living guide to scientific evidence will be built. The stakeholders are ready The social infrastructure for this is starting to coalesce — it’s not just a pie in the sky academic exercise to imagine this coming into existence. Institutions like the Center for Open Science, the Institute for Replication, the INSPECT-SR, the Living Evidence Network and more are all working on scaling work to improve research quality. Funders are also aligned. The Sloan Foundation has funded living evidence work through COS. Coefficient Giving supports the Institute for Replication and COS. The Astera Institute and the Institute for Progress have shown interest in this space. NIH has established an Office for Replication and Reproducibility. Although there are (very unfortunately) serious headwinds in science funding generally, there is an active group of funders interested in metascience. A brief word about what I’ve been doing at RDI. First, as a Visiting Scholar at Berkeley I’ve been actively figuring out how a non-profit and a public university can conduct and make public the results of large-scale academic article data mining. With some of the money I raised from donors, I commissioned a legal analysis of recent case law and publisher text data mining (TDM) agreements in order to understand whether a massive open data mining of academic articles is possible (with caveats, it is). I’ve also been working to bring together stakeholders in this space, and identify gaps. I’ve also been doing some software development in this space, with more to come. A pilot proposal The assumption undergirding all of this is that an AI, given all this information, would make the right judgment about a scientific claim with lots of conflicting evidence, weighing all the factors appropriately. That’s the hypothesis we need to test. Randomized control trial research is the best place to focus on first. RCTs are used to make many of the important decisions in society - from medical trials to public policy changes. And they use a relatively uniform set of inferential statistics with lots of known and available diagnostics. Behavioral science experiments, within the broader realm of RCTs, should be first used as a testbed whose results can be generalized. Because behavioral science is at the vanguard of open science practices, replications abound (there are thousands of them) to serve as ground truth training data. Key Hypothesis Therefore the pilot would test, in behavioral RCTs that have been replicated, whether the quality of evidence for a claim can be used to accurately predict whether that claim will replicate. Secondary Hypotheses Compared to claims that replicated, non-replicated claims demonstrate a greater share of forensic anomalies in their source literatures. Hypothesis level claim and statistic extraction is accurate enough to scale living evidence without onerous human review costs. Replication prediction is more accurate than prediction markets6 or journal prestige. If all the different quality signals we gather do accurately predict which studies will replicate, then we can use that model to score evidence to power the living evidence layer. Why this is informative regardless of outcome If the pilot succeeds, the architecture extends to medical RCTs (where Living Evidence already operates and integration is mostly about claim representation), then to slices of basic biology with stable replication structure. If it fails, the field learns which quality signals are load-bearing and which ones metascience has oversold. Either result is a contribution to knowing what the literature supports. Implications for funders Because this burgeoning ecosystem of builders already exists, a well-informed philanthropic or government funder could play a crucial catalyzing role in bringing this future about. They could play at least three roles: creating open structured datasets, publishing open benchmarks and incentivizing the solving of key technical challenges. First, open archives of papers that the government maintains, like PubMed, could be turned into structured data amenable to large scale metascience and claim aggregation. I know the US government already has an interest in doing this, though some key open questions remain unanswered. How do you determine the best models and systems for accurately extracting information from papers? How can you establish a robust way to allow researchers to flag errors and correct them? And finally, how do you create a legal regime in working with publishers to maximize the scope of available papers? For the latter, a university or a private philanthropy may be better positioned to make structured data publicly available under journal subscription terms or fair use. Philanthropists or government funders could also coordinate to create or commission benchmarks that evaluate whether important problems have been solved. For example, an open benchmark for claim extraction from a range of different scientific article types would be extremely helpful. Ensuring the underlying data are accurate is vital for creating these evaluations. I’ve discussed opportunistically using various human-created datasets for this purpose, but a consistent problem is that errors in human data make it difficult for them to serve as a gold standard. Finally, with structured data and benchmarks available, the government or private philanthropy could use them to incentivize groups to develop machine learning systems that meet these benchmarks. Prizes are one potentially valuable tool for this. For example, you could establish a prize for a system that accurately updates a living meta-analysis for a small set of claims. Prizes are particularly useful as signals of problem importance, and can help create vibrant ecosystems of public and private research—see, for example the role the government played in kickstarting the current work on nuclear fusion. Conclusion The drawbacks of the current scientific publishing system are known. Scientists agree, metascientists agree, philanthropists agree: the published PDF plus citation graph isn’t the right substrate for maintaining a representation of the evidence base in science. The pieces needed to build the alternative either already exist or are rapidly taking shape. The community is forming around exactly this problem, with concrete partnerships and shared infrastructure. A pilot should start on behavioral science RCTs because that’s the slice of empirical science most amenable to legibility, where replication ground truth is richest, and where the failure modes are best documented. What’s been missing is the galvanizing mission to assemble these pieces into something that works. That’s what I’m proposing to build. *** 1 I have a broader field map that I’ll release publicly soon. This is me, building in public! 2 If this is something that you are excited about, please reach out and talk to me. 3 More on this very soon too! 4 This tests whether, given the code and the data, you can get the same statistics as reported in the published paper. 5 This tests whether the results are the same as a paper’s given alternative analytical decisions in conducting the analysis (like outlier omission). Closely related is the idea of a “multiverse” where you come up with many different ways of answering the same underlying research question with the same data, and test whether the results hold in all those alternative methods. There’s been work on the latter as well. 6 Some of the replications, e.g. those from the SCORE project, had paired the experiments with forecasts from prediction markets. So we get to look at this for free.
College football's most experienced teams: Ranking all 138 FBS rosters ahead of the 2026 season
A full overall, offensive and defensive breakdown of every team in major college football
MLB Power Rankings: Who needs a salary cap? Why almost every team is still in playoff contention
If you like parity, what more could you want than this?