Posted by admin

Apple's latest AI breakthrough, OpenELM, is an open-source language model that significantly outperforms earlier models like OLMo by being 2.36 percent more accurate while using only half the pretraining tokens. This state-of-the-art model, developed using texts from diverse public sources, incorporates advanced techniques such as layer-wise scaling and RMSNorm to enhance performance and efficiency. With its open-source availability, OpenELM provides unprecedented access to its training processes and performance benchmarks, encouraging widespread innovation and collaboration in the AI research community. Become a Member of the channel and Supporter of AI Revolution → https://www.youtube.com/channel/UC5l7RouTQ60oUjLjt1Nh-UQ/join Sources: https://arxiv.org/abs/2404.14619 https://machinelearning.apple.com/research/openelm #apple #ai