Dads tend to be less worried than moms about their children facing certain hardships