Fewer voters in both parties now say Biden is a factor in their midterm vote