Most Republicans continue to say GOP should be more conservative