Researchers Develop AI Capable of Self-Training Without Real-World Data
Researchers from Tel Aviv University and Stanford University have developed a novel AI training method that allows models to acquire general learning capabilities without exposure to real-world data. This study, supervised by Dr. Yoav Levine and conducted by Dr. Kfir Dolev, demonstrates a significant step towards a long-sought goal in AI training. The method involves two AI models learning together: one generates short computer programs that produce symbol sequences, and the other is trained to predict the next symbol. The generating model receives feedback to improve its ability to create challenges suitable for the learning model. After training on these artificial sequences, the model's predictive capability was evaluated on real-world data, including text, images, sounds, music, code, and DNA sequences, showing consistent improvement with increased computational resources. The system also inferred rules from examples during testing without additional training, and familiar mathematical patterns, such a...