Inter-coder testing scores | Pew Research Center

Numbers, Facts and Trends Shaping Your World

Newsletters
Press
My Account
Donate
Contacted By Us?

Read our research on:

Beliefs & Practices
Donald Trump
Middle East

Search

Topics

Politics & Policy

International Affairs

Immigration & Migration

Race & Ethnicity

Religion

Age & Generations

Gender & LGBTQ

Family & Relationships

Economy & Work

Science

Internet & Technology

News Habits & Media

Methodological Research

Full Topic List

Regions & Countries

Asia & the Pacific

Europe & Russia

Latin America

Middle East & North Africa

North America

Sub-Saharan Africa

Multiple Regions / Worldwide

Formats

Feature

Fact Sheet

Video

Data Essay
Publications
Our Methods
Short Reads
Tools & Datasets
Experts
About Us

Research Topics
Publications
Short Reads
Tools & Datasets
About Pew Research Center
Newsletters
Press
My Account
Contacted By Us?

Search
Read Our Research On:

Beliefs & Practices
Donald Trump
Middle East

>

Research Topics

>

News Habits & Media

>

Media & Society

>

>

Bots & Misinformation

April 5, 2018

Methodology

Inter-coder testing scores

Inter-coder testing scores

Download

Inter-coder testing scores

1 2 3 4 5 67

Next Page →

Embed

© PEW RESEARCH CENTER

Infographic Gallery

Methodology
In a sample of 206 accounts coded by a third party, a threshold near 0.43 produces the highest level of accuracy in classifying bot accounts
Verified Twitter accounts have little impact on numbers of automated accounts shared
Including or excluding verified accounts exceeding a Botometer score of 0.43 does not affect results much
Random effects analysis of bot shares by content
Random effects analysis of bot shares by audience score
The most accurate Botometer threshold for classifying bot accounts is below 0.5, based on a sample of 100 hand-coded accounts
Inter-coder testing scores

901 E St. NW, Suite 300
Washington, DC 20004
USA
(+1) 202-419-4300

Research Topics

Politics & Policy

International Affairs

Immigration & Migration

Race & Ethnicity

Age & Generations

Family & Relationships

Internet & Technology

News Habits & Media

Methodological Research

Follow Us

Email Newsletters
YouTube
Instagram
Facebook
LinkedIn
X
Bluesky
Threads
RSS Feed

ABOUT PEW RESEARCH CENTER Pew Research Center is a nonpartisan, nonadvocacy fact tank that informs the public about the issues, attitudes and trends shaping the world. It does not take policy positions. The Center conducts public opinion polling, demographic research, computational social science research and other data-driven research. Pew Research Center is a subsidiary of The Pew Charitable Trusts, its primary funder.

© 2026 Pew Research Center

About
Terms & Conditions
Privacy Policy
Cookie Policy
Feedback
Careers
Contact Us

Privacy Notice

We use cookies and other technologies to help improve your experience; some are necessary for the site to work, and some are optional. Learn more in our privacy policy.

Essential Cookies

These cookies are required for the website to function and cannot be switched off.

Analytics Cookies

These cookies are used to collect information about how you use our website.

Marketing Cookies

These cookies are used to track your activity and show you personalized content.

Meta (Facebook) PixelPinterest TagLinkedIn Insight TagReddit Pixel

Preferences

These cookies allow the website to remember choices you make.