MIT CSAIL Research Reveals AI Art Attribution Decay with Large Datasets
Researchers at MIT's Computer Science and Artificial Intelligence Laboratory (CSAIL) have identified a phenomenon called 'attribution decay' in AI-generated images. Their study indicates that as generative models are trained on increasingly large datasets, the connection between individual training examples and the final output diminishes. This means that removing a single image, or even all images by a specific artist or of a particular person, from the training data often does not alter the generated sample. The team developed a 'diffusion ensemble' architecture, composed of many smaller components, each trained on a different data slice. This architecture allows for the precise removal of training examples to observe the impact on the output without retraining the entire model, a process previously prohibitive due to computational demands. Their findings, published in Nature Communications, suggest that for sufficiently large datasets, the question of whose work contributed to an AI-generated image may ...