AI Agents or data driven ML

been thinking about some stuff.

should people spend time on classical ML models like XGBOOST or just get some agents to write some smart old skool forecasts using the collective knowledge of humans , all of which is documented by LLMs? I'd have some sort of natural preference for AI non LLM machines finding patterns over LLMs just aping human knowledge, but hey, I could be wrong!