AI-generated survey results consistently differ from human surveys
Average absolute error (in percentage points) between human and synthetic respondents on 3 replicated survey waves
* Estimates for Asian adults are representative of English speakers only.
Source: Surveys of U.S. adults and “digital twins” synthetic analysis using Claude Opus 4.6 set to low reasoning with extended profile information and expert reflection. Surveys were conducted Jan. 20-26, 2026 (replicated March 9-12 and April 7-10), March 23-29, 2026 (replicated March 30-April 2), and April 20-26, 2026 (replicated April 27-May 1).
“Can AI Stand In for Human Survey-Takers? Not Really”
Source: Surveys of U.S. adults and “digital twins” synthetic analysis using Claude Opus 4.6 set to low reasoning with extended profile information and expert reflection. Surveys were conducted Jan. 20-26, 2026 (replicated March 9-12 and April 7-10), March 23-29, 2026 (replicated March 30-April 2), and April 20-26, 2026 (replicated April 27-May 1).
“Can AI Stand In for Human Survey-Takers? Not Really”
PEW RESEARCH CENTER
AI-generated survey results consistently differ from human surveys
Average absolute error (in percentage points) between human and synthetic respondents on 3 replicated survey waves
| Group | Wave 185 | Wave 190 | Wave 192 | Average across waves |
|---|---|---|---|---|
| Total | 11.3 | 14.7 | 11.2 | 12.4 |
| White | 11.7 | 14.1 | 11.6 | 12.5 |
| Hispanic | 12.7 | 16.8 | 12.3 | 13.9 |
| Black | 14.1 | 18.5 | 12.7 | 15.1 |
| Asian | 12.5 | 16.1 | 11.9 | 13.5 |
| 18-29 | 11.6 | 15.8 | 11.8 | 13.1 |
| 30-49 | 11.6 | 14.8 | 11.6 | 12.7 |
| 50-64 | 12.1 | 14.6 | 11.3 | 12.7 |
| 65+ | 12.5 | 14.6 | 11.4 | 12.8 |
| Rep/Lean Rep | 15.1 | 16.6 | 16.4 | 16.1 |
| Dem/Lean Dem | 12.2 | 16.7 | 11.9 | 13.6 |
| Some College | 11.8 | 14.9 | 11.5 | 12.7 |
| H.S. graduate or less | 12.3 | 16.1 | 12.5 | 13.6 |
| College graduate+ | 11.1 | 14.2 | 10.4 | 11.9 |
| Men | 11.5 | 14.2 | 11.4 | 12.4 |
| Women | 11.5 | 15.2 | 11.1 | 12.6 |
* Estimates for Asian adults are representative of English speakers only.
Source: Surveys of U.S. adults and “digital twins” synthetic analysis using Claude Opus 4.6 set to low reasoning with extended profile information and expert reflection. Surveys were conducted Jan. 20-26, 2026 (replicated March 9-12 and April 7-10), March 23-29, 2026 (replicated March 30-April 2), and April 20-26, 2026 (replicated April 27-May 1).
“Can AI Stand In for Human Survey-Takers? Not Really”
Source: Surveys of U.S. adults and “digital twins” synthetic analysis using Claude Opus 4.6 set to low reasoning with extended profile information and expert reflection. Surveys were conducted Jan. 20-26, 2026 (replicated March 9-12 and April 7-10), March 23-29, 2026 (replicated March 30-April 2), and April 20-26, 2026 (replicated April 27-May 1).
“Can AI Stand In for Human Survey-Takers? Not Really”
PEW RESEARCH CENTER
