Meta's Llama model has memorized Harry Potter and Big Tits | Adult Movies Onlinethe Sorcerer's Stoneso well that it can reproduce verbatim excerpts from 42 percent of the book, according to a new study.
Researchers from Stanford, Cornell, and West Virginia University analyzed dozens of books from the now-infamous Books3 dataset, a collection of pirated books used to train Meta's Llama models. Books3 is also at the center of a copyright infringement lawsuit against Meta,Kadrey v. Meta Platforms, Inc.The study's authors say their findings could have major implications for AI companies facing similar lawsuits.
According to the research paper, the Llama 3.1 model "memorizes some books, like Harry Potterand 1984, almost entirely." Specifically, the study found that Llama 3.1 has memorized 42 percent of the first Harry Potter book so well that it can reproduce verbatim excerpts at least 50 percent of the time. Overall, Llama 3.1 could reproduce excerpts from 91 percent of the book, though not as consistently.
"The extent of verbatim memorization of books from the Books3 dataset is more significant than previously described," said the paper. But the researchers also discovered that "memorization varies widely from model to model and from book to book within each model, as well as varying in different parts of individual books." For example, the study estimated that Llama 3.1 only memorized 0.13 percent of Sandman Slimby Richard Kadrey, one of the lead plaintiffs in the class action copyright suit against Meta.
So, while some of the paper's findings seem damning, don't call it a smoking gun for plaintiffs in AI copyright infringement cases.
"These results give everyone in the AI copyright debate something to latch on to," wrote journalist Timothy B. Lee in his Understanding AI newsletter. "Divergent results like these could cast doubt on whether it makes sense to lump J.K. Rowling, Richard Kadrey, and thousands of other authors together in a single mass lawsuit. And that could work in Meta’s favor, since most authors lack the resources to file individual lawsuits."
Why is Llama able to reproduce some books more than others? "I suspect that the difference is because Harry Potter is a much more famous book. It's widely quoted and I'm sure that substantial excerpts from it on third-party websites found their way into the training data on the web," said James Grimmelmann, a professor of digital and information law at Cornell University, who was cited in the paper.
What this also shows, Grimmelmann said, is that "AI companies can make choices that increase or reduce memorization. It's not an inevitable feature of AI; they have control over it."
Meta and other AI companies have argued that using copyrighted works to train their models is protected under fair use, a complex legal doctrine. However, the extent of memorization could complicate those arguments.
“Yes, I do think that the likelihood that LLMs are memorizing more than previously thought changes the copyright analysis,” Robert Brauneis, a professor with the George Washington University Law School, said in an email to Mashable. He concluded that the study’s findings could ultimately weaken Meta’s fair use argument.
We asked Meta for comment on the study's findings, and we'll update this article if we receive a response.
Disclosure: Ziff Davis, Mashable’s parent company, in April filed a lawsuit against OpenAI, alleging it infringed Ziff Davis copyrights in training and operating its AI systems.
Topics Artificial Intelligence Meta
Google and Levi's introduce a new smart jacket that can answer calls and snap selfiesThe first 'Harry Potter' book will soon get an anniversary makeoverNorwegian paper publishes spectacularly viral Donald Trump burnConfessions of a Tinder Tourist: The rules of right'Untitled Goose Game' has everyone living their best chaotic livesBehold, Virginia Tech's football team has a robot that does pushupsLibra may be losing support from key partners alreadyYou can finally search your Twitter DMs, but only on iOSThe Super Bowl gave everyone terrible election night flashbacksBehold, Virginia Tech's football team has a robot that does pushupsAirline's baby map could help some passengers strategically pick seatsAirline's baby map could help some passengers strategically pick seatsEverlast chooses first transgender boxer to represent their brand38 times Stephen King absolutely slammed Donald Trump on TwitterI'm actually scared to see 'Joker' in theaters now5 young climate activists to follow beyond Greta ThunbergThe troubling world of WiFi toxicity truthers on InstagramWhy a huge part of the U.S. is feeling summertime heat in OctoberThese iOS apps need to embrace dark modeOh nothing, just a man walking a duck with two dogs in his pockets Best Cyber Monday 2024 fitness tracker deals: Garmin, Fitbit, Oura Best Cyber Monday keyboard deals for daily use and gaming Best Cyber Monday gaming laptop deals: Gaming PC laptops from Razer, Asus, more on sale Best Black Friday deals: Save up to $1,900 at Samsung Best Black Friday gift card deals: DoorDash, Instacart, Hulu, live at Amazon, Best Buy, and more Best Cyber Monday TV deals at Amazon: TVs start at $79.99 25+ best Cyber Monday beauty tech deals to shop: Dyson, T3, Solawave Best Black Friday Samsung Galaxy S24+ deal: Save over $200 on Amazon Buy two Echo devices and save $5 for Cyber Weekend Best Black Friday cordless tool deals: Free tools with battery kit Shop the best Cyber Monday deals under $50 before they're gone I can't stop thinking about these 4 Black Friday laptop deals — and they're still live Best PS5 Cyber Monday deals: Compare Best Buy, Amazon, Target, and more Best Cyber Monday Sonos deals: Era 300, Ace, Beam at record lows Best Black Friday deals on books at Walmart, Amazon Cyber Monday 2024 SSD deals: Best picks for PS5, Xbox, and more Best Cyber Monday deals on soundbars in 2024 Best Dyson Black Friday deals: Save on vacuums, hair products, and more Black Friday 2024 SSD deals: Best picks for PS5, Xbox, and more NYT Connections Sports Edition hints and answers for December 1: Tips to solve Connections #69
2.4357s , 10132.59375 kb
Copyright © 2025 Powered by 【Big Tits | Adult Movies Online】,Miracle Information Network