The mov18plus | Adult Movies Onlinefloodgates have opened for building AI reasoning models on the cheap.
Researchers at Stanford and the University of Washington have developed a model that performs comparably to OpenAI o1 and DeepSeek R1 models in math and coding — for less than $50 of cloud compute credits.
What's more, the model was trained on only 1,000 questions, and took just 26 minutes and 16 Nvidia H100 GPUs. Stanford researcher Niklas Muennighoff said in a email to Mashable that the cost is an estimate based on the GPU runtime and number of H100 GPUs used.
The AI industry of late is all about how new approaches to the pre and post training process can massively save computing costs, as evidenced by DeepSeek's disruptive impact. On top of that, developers are now able to build on top of existing AI models at little or no cost, through APIs, open-source access, and even closed-source models by distilling their data, bringing the costs down even more.
According to the team's research paper which was published last Friday, s1 was trained on a dataset consisting of "1,000 carefully curated questions paired with reasoning traces and answers distilled from Gemini Thinking Experimental." Google's Gemini Thinking Experimental model is accessible with daily limits through AI Studio. While it's a closed-source model, that clearly hasn't stopped researchers from making use of its responses.
SEE ALSO: OpenAI launches 'deep research' AI agent for ChatGPTNext, the researchers used an "off the shelf" pretrained model from Alibaba-owned lab, Qwen, and performed supervised fine-tuning of its curated dataset. Then, the team created a token budget to control the amount of compute time for testing the model. If s1 went over budget on thinking tokens, it was cut off and forced to generate whatever answer it came up with. If the researchers wanted the model to spend more "test-time compute" on a problem, they would simply tell the model to "wait," which extended its thinking time and led to more accurate results.
By controlling the amount of time and compute spent on a problem, the researchers were able to show how increased thinking team leads to improved performance.
S1 is one example of open-source reasoning models that have been developed for a fraction of the cost of flagship models from Google and OpenAI. In January, UC Berkeley researchers released an open-source reasoning model called Sky-T1 that cost $450, "demonstrating that it is possible to replicate high-level reasoning capabilities affordably and efficiently," per its blog post. There's also the open-source rStar-Math reasoning model from Microsoft Asia researchers, Tulu 3 from non profit research institute Ai2, and HuggingFace has its own initiative to replicate DeepSeek's R1.
As high-quality models become more accessible and cheaper, we're starting to see a power shift from the few AI heavy hitters, to the many.
Topics Artificial Intelligence OpenAI
Previous:Bomb Envy
Drinking from the Original FountainApple plans a big rebrand of iOS and macOS, report saysEverybody Hates MartyThe Art of WorkHeadstone EpitaphTheater of PainLife and DreamThe Stranger WithinKeystone RaceRush Limbaugh’s Kid ControlInanimate Objects with Party HatsCalifornia GothicRush Limbaugh’s Kid ControlRiding the Goddamn ElephantOf Monsters and MenMucked UpPicture Postcards From Train StationsTwo LoversOverproduction and Its DiscontentsThe Dutiful Wife Best places to buy refurbished electronics in 2025 Ryzen 5 3600 vs. 3600X: Which should you buy? NYT mini crossword answers for April 14, 2025 Best portable power station deal: Save $520 on Anker Solix C1000 Today's Hurdle hints and answers for April 26, 2025 This cable management hack is only $7.89 at Amazon 2019's word of the year is 'climate strike' How tariffs could affect the influencer economy 'Andor,' Star Wars, and Mon Mothma's dancing: The meme we need 5 Days of Awesome Wallpapers: Geometric and Architectural Wallpapers Strange Brigade Benchmarked How Blizzard Saved Diablo III From Disaster Anatomy of a Mouse Stuff Your Kindle Day: How to get free cozy mystery books on April 24 Best smartwatch deal: Get the Google Pixel Watch 3 for $50 off NYT Strands hints, answers for April 15 5 Great Chrome Extensions You Should Install Best smart bulb deal: Get 43% off Lepro B2 AI Bulbs This 'starry night' toad was lost to scientists for decades A longshot federal recycling bill brings good ideas to the forefront
1.9366s , 8224.0234375 kb
Copyright © 2025 Powered by 【mov18plus | Adult Movies Online】,Miracle Information Network