But the president’s attitude is not their only problem