---
title: "Appendix E: Validation of GPT-4 topic classification"
description: "For our latest survey data about news influencers, read the “News Influencers Fact Sheet.”"
date: "2024-11-18"
authors:
  - name: "Galen Stocking"
    job_title: "Associate Director, Research"
    link: "https://www.pewresearch.org/staff/galen-stocking/"
  - name: "Luxuan Wang"
    job_title: "Research Associate"
    link: "https://www.pewresearch.org/staff/luxuan-wang/"
  - name: "Michael Lipka"
    job_title: "Associate Director, Research"
    link: "https://www.pewresearch.org/staff/michael-lipka/"
  - name: "Katerina Eva Matsa"
    job_title: "Director, News and Information Research"
    link: "https://www.pewresearch.org/staff/katerina-eva-matsa/"
  - name: "Regina Widjaya"
    job_title: "Computational Social Scientist"
    link: "https://www.pewresearch.org/staff/regina-widjaya/"
  - name: "Emily Tomasik"
    job_title: "Research Analyst"
    link: "https://www.pewresearch.org/staff/emily-tomasik/"
  - name: "Jacob Liedke"
    job_title: "Former Research Analyst"
    link: "https://www.pewresearch.org/staff/jacob-liedke/"
url: "https://www.pewresearch.org/journalism/2024/11/18/appendix-e-validation-of-gpt-4-topic-classification/"
categories:
  - "Influencers"
  - "Media Industry"
  - "News Influencers"
  - "Politics & Media"
  - "Politics Online"
  - "Social Media"
  - "Social Media & the News"
datasets:
  - name: "American Trends Panel Wave 150"
    url: "https://www.pewresearch.org/dataset/american-trends-panel-wave-150/"
---

# Appendix E: Validation of GPT-4 topic classification

*For our latest survey data about news influencers, [read the “News Influencers Fact Sheet.”](https://www.pewresearch.org/journalism/fact-sheet/news-influencers-fact-sheet/)*

[![Table showing topic labeling accuracy metrics](https://www.pewresearch.org/wp-content/uploads/sites/20/2024/11/PJ_2024.11.18_news-influencers_E-01.png?w=310)](https://www.pewresearch.org/journalism/2024/11/18/appendix-e-validation-of-gpt-4-topic-classification/pj_2024-11-18_news-influencers_e-01/)

[![Table showing subtopic labeling accuracy metrics](https://www.pewresearch.org/wp-content/uploads/sites/20/2024/11/PJ_2024.11.18_news-influencers_E-02.png?w=410)](https://www.pewresearch.org/?attachment_id=191823)