Those who say a lot of progress has been made on racial equality are least likely to say a lot more needs to be done