SCROLL NEWS / DISCOVERY
Search headlines
Find the stories shaping the conversation.
Results for " GQ " 4,795 found 🔀 AI-powered Shuffle
“AI polls” are fake polls
A few weeks after Donald Trump’s second presidential win, I took the train up from London (where I was living at the time) to Oxford to attend a conference on polls and forecasts of the 2024 election. Most of the attendees were pollsters or academics, but I also watched presentations from Aaru and Electric Twin, two companies that do what is interchangeably called synthetic sampling, silicon sampling, or synthetic audiences. Stripped of startup jargon, that means they use large language models (LLMs) to simulate responses to public opinion polls by having AI agents take on the role of survey respondents. I had already heard of Aaru thanks to some articles with eye-catching headlines like “No people, no problem: AI chatbots predict elections better than humans” in the months leading up to Election Day. The founders were making some big, some might even say far-fetched claims, such as: “within two years, we will simulate the entire globe — from the way crops are grown in Ukraine to how that impacts production of oil in Iraq, trade through the strait of Malacca, and elections for the mayor of Baltimore.” When Semafor asked Aaru’s cofounders — Cameron Fink and Ned Koh — about my boss, they said “we respect all those who came before us.” Nate (as he so often does) shared his thoughts on Twitter: Fink and Koh were relatively good-natured about this back-and-forth when we spoke at Oxford. They even offered to mail me one of the t-shirts featuring Nate’s quote they apparently had made. I never took them up on the offer, which I now somewhat regret. These synthetic sampling companies fell off my radar for a while, but they do still exist. In fact, Aaru recently received a $1 billion valuation. Is what they’re doing anywhere close to the most important frontier in AI development? Not by a longshot, especially when Anthropic just developed a model so adept at exploiting software vulnerabilities that it’s only being released to 40 companies. Still, silicon sampling is increasingly finding its way into public polling. Axios reported in March that “a majority of people trust their own doctors and nurses” based on findings from Aaru — without mentioning that the “people” in that sentence were actually LLMs. Around the same time, the Public Sentiment Institute “boosted” their online sample of 373 real survey respondents with 114 AI agents.1 (Spoiler alert: even the co-founder of Electric Twin doesn’t think that’s a particularly defensible approach.) Polling companies like Qualtrics and Ipsos are also developing synthetic data panels. So, what should we make of these … “polls”? Let’s get one thing out of the way: whatever they are, they’re not polls in the way that term is usually defined. Subscribe You can’t replace polls with AI On one hand, using LLMs to essentially make up fake survey respondents sort of sounds like the dumbest idea ever, one that will at best imperfectly replicate real polls while introducing all sorts of biases. On the other hand, with LLMs improving at a remarkable, perhaps even alarming rate, maybe that means I’m a dinosaur at the ripe old age of 24 because I still want to rely on polls that talk to actual people. I’m not going to argue that synthetic samples are completely useless. In fact, as I’ll return to later, there is evidence that some techniques can replicate topline survey results quickly and cheaply. But the marketing from certain companies can be slightly optimistic. “No traditional poll will exist by the time the next general election occurs,” said Fink in 2024. We’re just 206 days away from the midterms, and based on the fact that I still have to collect a bunch of polls every day, I’d say he should have run that prediction by a sample of AI agents before the interview.2 To see why synthetic samples can’t replace polls, here’s a quick primer on how they work. The simplest version of these models involves taking a LLM (like ChatGPT or Claude), giving it a demographic profile (e.g., a white, college-educated woman who lives in Utah and makes $70k a year), and then asking it to respond to a survey question. You repeat that process a few thousand times using different demographic profiles and end up with a sample of synthetic survey responses. The actual models used by private companies are more sophisticated than this, usually because they incorporate more hypothesized demographic characteristics for each agent and provide them with extra information. Aaru, for example, feeds agents a diet of news and information they’d be likely to consume, while Electric Twin incorporates their customers’ proprietary data about the audience they’re trying to replicate. The way Ben Warner, the co-founder of Electric Twin, explained it to me was “we have a large amount of data on […] for instance, 5,000 people. Can we make an accurate prediction of how they would respond to another question?” Still, it should be obvious why synthetic samples can’t replace polls. Polling is fundamentally a data collection process. We might use surveys to make predictions by feeding them into election forecasts, but the main purpose of a poll isn’t prediction, it’s gathering new data about what people think and how they feel. Silicon sampling, on the other hand, produces no new data. It’s simply a model: you input LLM training data, demographic prompts, and a bunch of other information, and it spits out a prediction for what a poll would say. We love models here, but models aren’t polls. That difference is an important philosophical sticking point for most pollsters I talk to. “I think politics should stay away from [synthetic sampling], because we’re trying to […] represent the voice of the people,” said Natalie Jackson, a vice president at GQR Insights. Democratic pollster John Hagner told me: “I think I’m just incredibly skeptical of this idea. I don’t think it’s research. At that point, you’re asking the machine to tell you what you already believe.” Hagner has seen some presentations of early synthetic sampling experiments, but so far, “if it’s being used in a campaign, people are keeping it incredibly quiet.”3 But Eli, I hear you saying, aren’t polls themselves increasingly governed by modeling decisions? Indeed they are: pollsters’ choices on which sampling method to use, how to define their likely voter models, and how to weight their samples can and do lead to dramatic differences in the results they publish. Aaru even referenced these limitations in the methodology statement included with that maternal mortality “poll” — although I’m using the term “methodology statement” loosely here, because it doesn’t really explain how the model works at all. We can ignore the (frankly preposterous) implication that synthetic sampling isn’t subject to a separate set of biases. The important point is that there’s still a meaningful difference between using weighting and other statistical techniques on actual polling data and using a model to predict what a poll would say. The latter is far closer to election forecasts or techniques like MRP — potentially useful models, but not a replacement for polls.4 To be fair, other synthetic sampling companies are perfectly happy with the distinction between polls and models. Warner compared polling and synthetic sampling to different tools in a toolbox. “The mistake I think we make is we think that these new tools should either work in exactly the same way or somehow replace these old tools,” he said. “Rather than thinking of it as, okay, so we’ve always had the hammer, we’ve always had the screwdriver, now we’ve got a saw. But don’t use a saw to try [to] do the job of a hammer.” A quick comment from Nate Eli didn’t ask me for a comment — rather rude of him, don’t you think? But since I’m editing this story, I figured I’d add a few quick thoughts rather than putting words in his mouth. Beyond the frequently misleading marketing, what bothers me about the AI “poll” hype is that as AI tools make statistical inference cheaper and/or better (note that these are not synonyms) that actually increases the comparative value of collecting original data. You might be able to train a model to make a reasonable estimate of what some hard-to-reach poll respondent would say — say, a young Black man who voted for Trump. (Such a person checks a number of boxes for a voter who is usually hard to reach in surveys.) Indeed, this is closely related to what models like the Silver Bulletin forecast already do. They essentially smooth out the kinks in noisy survey data by making inferences based on past voting patterns or national polls or surveys of other states. But you don’t actually know what these voters think unless you’re reaching them directly. If there’s a shift in opinion among this subgroup, you’re not going to detect it. So if I were running a campaign, I’d invest more in going the extra mile to find a representative sample of those voters. And then I’d hire some smart quants — or Claude? — to figure out the implications for campaign strategy based on proprietary data that my competitors didn’t have access to. -Nate Silver Are these models any good? If synthetic surveys are just a new type of model, the next obvious question is whether the models are at least accurate. The answer very much depends on who you ask. On one end of the spectrum, you have the maximalist argument that synthetic sampling is more accurate than actual polls. “It’s an incredibly challenging problem to go to someone and say ‘hey, we’re going to be more accurate at predicting human behavior than you, even when you talk to your customers directly’,” Koh recently told CNBC. In his view, synthetic sampling isn’t a saw to polling’s hammer, it’s “magic.” There’s certainly evidence that synthetic samples can replicate certain survey toplines. But if Aaru does have any examples of their approach outperforming the polls, they’re keeping those to themselves.5 Aaru’s 2024 election model, for example, had Kamala Harris leading in Michigan, Nevada, Pennsylvania, and Wisconsin on November 4th. And although they’ve since taken down their forecast page, they gave Harris a 50.5 percent chance of winning the race on November 2nd.6 After the election, Fink told Semafor he was happy enough with those results because they were “within margin of error,” a term that is completely meaningless when applied to a “sample” of AI agents. And of course, Aaru says their models have improved since 2024, so supposedly now they’d be more accurate than the polls? Still, their stronger argument is on cost: “We are significantly faster and cheaper than traditional polling, and still more accurate,” said Fink. The first two claims are undeniably true, but the third brings us to the opposite end of the spectrum. Both Jackson and Hagner are skeptical that these models are reliable for anything beyond replicating common survey toplines. “I just […] don’t think the machines are what we want when we’re looking for nuanced views. My example on this is people in Arizona and Nevada in 2024 who voted for Trump and voted for expanding abortion in their states on ballot initiatives,” said Jackson. Hagner identified another issue. Maybe the synthetic respondents, like sycophantic LLMs, are inhuman in one important way: they’re too nice. “The reports that have come through at the meetings that I’ve been at are that the early experiments on this, they cannot get respondents to be as racist or sexist or, frankly, as negative as human respondents,” he said. Academic research mostly agrees on this point. While there are some papers that show promising results when using LLMs to replicate polling data, most show that LLMs suffer from various quirks like producing too few “don’t know” responses and can seriously overpredict the favorability of politicians like Donald Trump and Kamala Harris. They also seem to struggle with too little variation between demographic subgroups, so the difference in predicted opinion between Democrats and Republicans, for example, is too small. When I asked Warner about these studies, his response to these papers was that just because academics can’t get synthetic sampling to work doesn’t mean that the technique doesn’t work in general. “Actually, the argument is, okay, yours does not [work]. That does not mean […] for this complex set of machinery, which uses a lot of investment, a lot of time, a lot of money, you can’t get it to work.” Cards on the table, I’m somewhat sympathetic to this argument because academics aren’t exactly great at making election forecasts. Usually, the people with skin in the game are the most accurate. Warner’s argument is that the approach Electric Twin takes — which includes, for example, making multiple predictions for each synthetic respondent using different models and prompts and subsequently averaging those to get a final prediction in a sort of ensemble forecast — produces better results than the simpler academic models. Warner shared a comparison between his method and the method from a recent academic paper with me, and Electric Twin was indeed able to get more accurate replication. But even still, he acknowledged that synthetic sampling “is not a crystal ball.” “If you asked me, do I think using other data sources will be more accurate than asking somebody who they will vote for, I would probably say no. But if you asked me ‘would your system be useful for our turnout modeling today?’ I would say yes.” For better or worse, it looks like the method is already getting more popular in the market research world. Most of the clients Aaru touts these days are businesses like EY and McDonald’s. And AI will probably begin to pop up in other parts of the political polling process. Pollsters are already using it to code open-ended survey responses, and some firms, like YouGov, are testing using LLMs to ask survey respondents questions. More worryingly, one danger to actual polls is that AI agents can be used to infiltrate online surveys. Most online polls use various checks to prevent that from happening, but there’s conflicting evidence on how effective those filters are and how prevalent AI agents currently are in online panels. If those agents ever become impossible to detect, it might spell the end of online polling, but the solution isn’t to replace all of your respondents with ChatGPT. Silver Bulletin is a reader-supported publication. To receive new posts and support our work, consider becoming a subscriber. Subscribe 1 That particular poll obviously doesn’t meet Silver Bulletin standards for aggregation. But we exclude all Public Sentiment Institute polls from our averages because we classify them as an amateur polling firm. 2 You could argue that Fink meant the next presidential election, but (a) I’m also confident we’ll still have real polls in 2028 and (b) in that case he should have asked an LLM to define “general election.” 3 Quick caveat: that’s reporting from a Democratic pollster. It’s possible that Republicans are more willing to use AI in political campaigns. 4 Indeed, Silver Bulletin does not include “polls” produced by MRP in our forecasts or averages, and we think it’s extremely misleading when their practitioners describe them in a way that suggests original data had been collected among a large number of states or Congressional districts. 5 A recent report from Aaru and EY did show two examples of a synthetic estimate being closer than a survey to a real-world benchmark — but I’d take those findings with a grain of salt because the report reads more like an ad and didn’t involve any sort of prediction being made ahead of time. 6 For comparison, our odds for Harris on the same day were 48.2 percent.
Where to watch Athletics vs. New York Mets: Live stream, start time, TV channel, odds for Saturday, April 11
The Athletics and Mets continue their series in New York on Saturday.
Where to Watch Boston Red Sox vs St. Louis Cardinals Live Stream, TV Channel for Saturday, April 11, 2026
The Red Sox and Cardinals continue their series in St. Louis on Saturday.
2026 NFL mock draft 8.1: Cardinals surprise with their picks (yes, plural), while Giants take a weapon at No. 5
Engadget review recap: ASUS ZenBook A16, AirPods Max 2, Sonos Play and LG Sound Suite
A roundup of the latest reviews from Engadget.
WNBA free agency news, live updates: Brittney Griner joining Sun; Kelsey Mitchell signing supermax with Fever; Nneka Ogwumike to Sparks
Victor Wembanyama eligible for MVP, other awards after playing in 65th game this season despite rib injury
Victor Wembanyama is eligible to win the MVP award, but will he actually do it?
Masters 2026: Brooks Koepka's driver was set to the wrong setting
Koepka noticed the error after his round on Thursday at Augusta National.
Wearables need to cross from consumer to health care market
They could repeat Fitbit's story if they don't cross over from consumer to health care products.
How OpenAI's reported ad plans could change the AI business model
OpenAI (OPAI.PVT) is reportedly projecting $100 billion in advertising revenue by 2030. Yahoo Finance Technology Editor Dan Howley explains how this could shift the artificial intelligence (AI) business model.
NFL Draft 2026: Ohio State has 3 defenders who are worth top-10 picks, positional value be damned
Tigers' Parker Meadows lands on 10-day IL with arm fracture, concussion after collision sent OF to hospital
Broncos ownership group becomes largest minority partner of Rockies, reportedly buys 40 percent stake in MLB club
Amazon Luna ends support for third-party subscriptions and game purchases
You'll no longer be able to stream games you bought from EA, GOG and Ubisoft through the platform.
French government says au revoir Windows, bienvenue Linux
It's part of a broader European movement to reduce reliance on American tech.
Italy's UniCredit says no plans to liquidate Russian business
UniCredit said on Friday it had no plans to liquidate its Russian business or return the banking licence held by its local subsidiary, which the Italian lender has held onto during the Ukraine conflict.
2026 NFL mock draft 8.1: Cardinals surprise with their picks (yes, plural), while Giants take a weapon at No. 5
NFL news, live updates: Texans reportedly pick up fifth-year options on QB C.J. Stroud and edge Will Anderson Jr.
Nneka Ogwumike returning to Los Angeles Sparks in free agency
Nneka Ogwumike is moving on from the Seattle Storm after two seasons, signing a new deal to join the Los Angeles Sparks in free agency, according to her sister, ESPN’s Chiney Ogwumike.
Masters 2026: Robert MacIntyre under fire for lewd gesture in Round 1
MacIntyre stuck up his middle finger — a no-no at Augusta National.
Trump admits error in accusations about New York health care fraud
The error prompted health analysts to question how many of the Republican administration’s sweeping anti-fraud efforts around the country were based on faulty findings.
Microsoft starts removing unnecessary Copilot buttons in Windows 11
Microsoft has rolled out a Notepad update for Windows Insiders that removes the Copilot branding and icon from within the app, Windows Central has reported.
Cowboys trade rumors could impact Bengals on draft night
The Cowboys might be trading around the top 10. It could hurt (or help) the Bengals.
Italy's UniCredit considers liquidating Russian banking business, Kommersant reports
Italian bank UniCredit has abandoned plans to sell its Russian unit and is considering liquidating the business and relinquishing its banking license in Russia instead, the Kommersant daily reported on Friday, citing unnamed sources.
Jayson Tatum scores 24 for Celtics in first game at Madison Square Garden since Achilles injury, but Knicks win
Sabrina Carpenter, Mona Lisa and Ozempic: A roundup of the buzziest Coachella 2026 billboards
Debuting bold billboards that reflect their visual aesthetic has become a rite of passage for Coachella performers.
Instagram comments can now be edited (within 15 minutes)
You can edit any Instagram comment you've left via a new "Edit" button.
‘Future of America:’ Science students awarded for moon projects at Kennedy Space Center
As the record-breaking Artemis II mission inspires millions around the world, some of Central Florida’s little space enthusiasts are getting some well-deserved recognition too.
Victor Wembanyama's extreme ceiling: How end-of-season awards voting could be an indicator of historic success
Masters 2026 leaderboard, tee times, how to watch: 60-year-old Jose Maria Olazabal turning back the clock
MLB Injury Report: Updates for Juan Soto, Mookie Betts, Gerrit Cole, more for fantasy baseball early in April
Spotify now lets you turn off all video
It has separate toggles for Canvas, music videos and all other types.
JBL Live 780NC and 680NC review: Great leaps, greater missteps
JBL's latest Live series headphones are a solid duo that don't quite achieve greatness.
Masters leaderboard, tee times, how to watch: Keep up with Rory McIlroy, Scottie Scheffler at Augusta National
Google bakes NotebookLM, its research tool, into Gemini
Google has fully integrated NotebookLM, its AI-powered research tool, into the Gemini app.
Tyrese Haliburton says he's returned to 5-on-5 action as Pacers star takes big step in his Achilles recovery
Pistons' Cade Cunningham returns against the Bucks on Wednesday
Cunningham last played on March 17 and is no longer eligible for NBA awards.
Barcelona-Atlético Madrid, PSG-Liverpool live updates, scores: Champions League quarterfinal first legs continue
Fantasy Baseball: Examining Andy Pages, José Soriano and more early-season regression candidates
'Euphoria' made her a star. Now she's diving into the internet's darkest corners.
Barbie Ferreira opens up about her dark new role in "Faces of Death," navigating fame in the internet age and why she's still watching "Euphoria."
Darren Till signs with BKFC after Misfits split: 'I’m coming to be the face of violence'
The former UFC star and Misfits Boxing veteran announced a multi-fight deal Tuesday that will see Till debut on May 30 at BKFC 90 in Birmingham, England.
Young entrepreneurs to take the lead at children’s business fair in Mount Crawford
The event will take place at the Green Valley Book Fair on Saturday, April 11, from 10 a.m. to 2 p.m. and is free and open to the public.
The surprising science behind why travel makes you happier
Researchers found a link between new experiences and better moods—here's how it works.
The World’s First Computer Sank 2,000 Years Ago. Science Finally Solved One of Its Biggest Mysteries.
Using, oddly enough, techniques developed to analyze gravitational wave signals.
Draymond Green rips Kings for tanking, says NBA needs to 'fine the hell out of people' to prevent tactic
Fender Elie review: Handsome speaker/amp hybrids with excellent clarity
The first two speakers from Fender Audio are almost amazing, but not quite.
The Viral “Office Air” Theory Explained: Why Your Skin and Hair Change During the Workday
Can “office air” really affect how you look? Experts explain how indoor environments impact skin, hair, and overall appearance throughout the workday.
Amazon is cutting off support for older Kindles
Amazon has sent out emails to some of its users, with a warning that it’s discontinuing support for Kindle ereaders and Fire tables released in 2012 or earlier.
Trump is expected to meet NATO leader Rutte as he muses about pulling out of the military alliance
NATO Secretary-General Mark Rutte is expected to meet with President Donald Trump to try to smooth over the president’s anger with the military alliance over the Iran war
Reynaldo Lopez and Jorge Soler throw punches in wild Braves-Angels brawl
Sandy Alcantara questions Marlins' decision to end his bid for back-to-back shutouts in 9th inning
Dropping the Series Opener: Mets 4, Dbacks 3
The Arizona Diamondbacks dropped the series opener to the New York Mets on Tuesday, falling 4-3 in extra innings after squandering a late lead. Leading 3-2 into the eighth, the D-backs watched the game slip away as the bullpen allowed tying and winning runs against Jonathan Loaisiga and Paul Sewald. This felt like a painfully […]
Cleveland Browns NFL Draft Profile: DE David Bailey, Texas Tech
Could the Browns add a high-impact DE in the draft to pair with Myles Garrett? Should they?
Champions League quarterfinals results: Bayern Munich strikes quick to edge Real Madrid; Kai Havertz wins it late for Arsenal against Sporting
U.K. blocks Kanye West from entering Britain to headline now canceled festival: What led to the ban
Kanye West was scheduled to headline Wireless Festival, one of the U.K.'s biggest music festivals, this summer.
Fernando Mendoza, likely No. 1 overall pick, will reportedly not attend 2026 NFL Draft, opts to stay home
Catherine O'Hara's brother says actress 'wasn't talking much in the end,' said goodbye to him in a dream
Catherine O'Hara's brother Michael P. O'Hara shares the 'sort of goodbye' he had with his sister after her death in January. 'She wasn't talking much in the end,' he says. 'She didn't really want to talk on the phone.'
Chrome finally adds support for vertical tabs.
Before today, every other major browser but Chrome offered support for vertical tabs.
Vance stumps for Hungary’s Orban as Trump-aligned movement faces critical test
The vice president traveled to Budapest as Trump’s deadline for an Iran deal loomed Tuesday, backing the administration’s closest ideological ally in Europe.
Chicago Bears HOFer Steve McMichael diagnosed with CTE year after death
McMichael died in April 2025 following a 5-year battle with ALS.
Willson Contreras after being hit by Brewers: 'Next time they hit me again, I'm going to take one of them out'
Motorola announces Moto Pad and next-gen Moto G Stylus
They'll be available starting April 16 and April 30, respectively.
Artemis II astronaut puts all of our iPhone moon photos to shame
NASA astronaut Reid Wiseman took a photo of the far side of the moon with an iPhone 17 Pro.
José Ramírez becomes Cleveland Guardians' all-time leader in games played, with his sights set on Hall of Fame and postseason glory
The controlled fairway-finder drive every golfer needs
GOLF Top 100 Teacher David Armitage breaks down the five keys you need to master the low, controlled fairway-finder drive.
Instant observations: Sixers fall to Spurs despite Victor Wembanyama injury
Joel Embiid had 34 points and 12 rebounds and the Spurs lost Victor Wembanyama at halftime, but the Sixers still fell 115-102 to San Antonio in a critical playoff race...
Victor Wembanyama leaves Spurs-76ers early with left rib contusion
The MVP candidate appeared to be favoring his left side after a collision with Paul George during the second quarter.
UConn vs. Michigan score, live updates: March Madness ends with NCAA men's basketball championship
Mystics reportedly fire GM Jamila Wideman after 1 season
Washington is making a major front office change on the first day of free agency.
North Carolina to reportedly hire former Nuggets coach Michael Malone as Hubert Davis' replacement
Malone won an NBA championship with the Denver Nuggets during the 2022-23 season.
Giants All-Pro DT Dexter Lawrence reportedly requests trade, not participating in OTAs
The Giants and Lawrence have reportedly been through two seasons attempting to negotiate a contract.
Samsung's Music Studio speakers and two of its 2026 soundbars are available now
Samsung's home theater lineup this year includes two new speakers and four new soundbars.
Where to watch New York Knicks vs. Atlanta Hawks: Live stream, start time, TV channel, odds for Monday, April 6
The Knicks and Hawks face off in Atlanta on Monday night.
ACC basketball uniform rankings
From Duke’s timeless dominance to modern misses across the conference, we rank all 18 ACC basketball uniforms.
Ravens' 56-man roster as off-season workouts begin
The Baltimore Ravens are set to begin their nine-week offseason workout program on Monday. Here’s a full look at the current 55-man roster
Stephen Curry drops 29 points in return from knee injury as Warriors fall to Rockets
Stephen Curry missed 27 games due to a lingering knee injury.
Asian shares mostly gain while oil prices keep rising
Asian markets that are open for trading are mostly rising as investors continue to closely watch the war in Iran, soaring oil prices and what President Donald Trump might say next
Cooper Flagg follows up 51-point game with 45 to outduel LeBron James, send reeling Lakers to defeat
Flagg is the first rookie to post 40-point efforts in consecutive games since Allen Iverson did it five times during the 1996-97 season.
After getting 'smacked' by UCLA, Dawn Staley and powerhouse South Carolina look toward future and how they'll regroup
Marlins' Pete Fairbanks makes 3rd career start before paternity leave
Fairbanks threw 27 pitches in his lone inning, allowing three hits, including a three-run home run by Yankees first baseman Ben Rice that gave New York a 3-1 lead.
UCLA locks down South Carolina for dominant win, program's first NCAA championship
UCLA got to the Final Four on the strength of the nation’s best offense. When it showed up, it was a defensive juggernaut.