OpenAI showed that AI can tackle long-standing problems in mathematics. Experts are excited about the possibilities — and worried about what comes next for their field.