---
title: "Appendix B: Agreement score between coders and model accuracy metrics"
description: "[![](https://www.pewresearch.org/wp-content/uploads/sites/20/2024/10/pl_2024.10.08_tiktok_a_b_01.png?w=640)](https://www.pewresearch.org/?attachment_id=188749)"
date: "2024-10-08"
authors:
  - name: "Regina Widjaya"
    job_title: "Computational Social Scientist"
    link: "https://www.pewresearch.org/staff/regina-widjaya/"
  - name: "Samuel Bestvater"
    job_title: "Senior Data Scientist"
    link: "https://www.pewresearch.org/staff/samuel-bestvater/"
  - name: "Aaron Smith"
    job_title: "Director, Data Labs"
    link: "https://www.pewresearch.org/staff/aaron-smith/"
url: "https://www.pewresearch.org/data-labs/2024/10/08/appendix-b-agreement-score-between-coders-and-model-accuracy-metrics-tiktok-2024/"
categories:
  - "Digital News Landscape"
  - "Social Media & the News"
  - "TikTok"
datasets:
  - name: "American Trends Panel Wave 133"
    url: "https://www.pewresearch.org/dataset/american-trends-panel-wave-133/"
---

# Appendix B: Agreement score between coders and model accuracy metrics

[![](https://www.pewresearch.org/wp-content/uploads/sites/20/2024/10/pl_2024.10.08_tiktok_a_b_01.png?w=640)](https://www.pewresearch.org/?attachment_id=188749)