---
title: "Appendix B: Additional tables"
description: "### Different models get different questions correct"
date: "2026-09-30"
authors:
  - name: "Athena Chapekis"
    job_title: "Computational Social Scientist"
    link: "https://www.pewresearch.org/staff/athena-chapekis/"
  - name: "Arnold Lau"
    job_title: "Research Methodologist"
    link: "https://www.pewresearch.org/staff/arnold-lau/"
  - name: "Samuel Bestvater"
    job_title: "Associate Director, Data Labs"
    link: "https://www.pewresearch.org/staff/samuel-bestvater/"
  - name: "Sono Shah"
    job_title: "Former Associate Director, Research"
    link: "https://www.pewresearch.org/staff/sono-shah/"
  - name: "Andrew Mercer"
    job_title: "Principal Methodologist"
    link: "https://www.pewresearch.org/staff/andrew-mercer/"
  - name: "Aaron Smith"
    job_title: "Director, Data Labs"
    link: "https://www.pewresearch.org/staff/aaron-smith/"
url: "https://www.pewresearch.org/data-labs/2026/09/30/appendix-b-additional-tables-6/"
categories:
  - "Artificial Intelligence"
  - "Methodological Research"
  - "Uncategorized"
---

# Appendix B: Additional tables

### Different models get different questions correct

*Questions where each synthetic sample achieved a question-level average absolute error of 5.0 percentage points or less, when compared with real ATP data*

| Independent variable | n1 | n2 |
| --- | --- | --- |
| Germany | 40 | 60 |
| Spain | 50 | 50 |
| France | 60 | 40 |

Note: Refer to the Wave 185 questionnaire for full question wording.Source: Survey of U.S. adults and “digital twins” synthetic analysis using models set to low reasoning with extended profile information and expert reflection. Survey was conducted Jan. 20-26, 2026 (replicated March 2-3 with OpenAI GPT-5.1; and replicated March 9-12 and April 7-10 with Claude Opus 4.6).

“Can AI Stand In for Human Survey-Takers? Not Really”

---

**Next:** [Appendix C: Full list of variables in profile information](https://www.pewresearch.org/data-labs/2026/09/30/appendix-c-full-list-of-variables-in-profile-information.md)