Billionaire Elon Musk said the "cumulative sum of human knowledge" has been exhausted to train AI as of last year. "The only way to supplement [real-world data] is with synthetic data, where the AI creates [training data]," Musk said. "With synthetic data...[AI] will sort of grade itself and go through this process of self-learning," he added.