Snowflake Announces Hosting of Llama 3.1 Collection in Snowflake Cortex AI for Enterprises
Snowflake, a leading data cloud platform, has made a groundbreaking announcement that is set to revolutionize the world of artificial intelligence. The company has revealed that it will be hosting the Llama 3.1 collection of multilingual open-source large language models (LLMs) in Snowflake Cortex AI, providing enterprises with the tools to harness and build powerful AI applications at scale.
The highlight of this offering is Meta’s largest and most powerful open-source LLM, Llama 3.1 405B, which has been optimized by Snowflake’s industry-leading AI Research Team for both inference and fine-tuning. This optimization allows for a massive 128K context window from day one, enabling real-time inference with significantly lower latency and higher throughput compared to existing open-source solutions.
By partnering with Meta, Snowflake is providing customers with easy access to the latest AI models in the AI Data Cloud, with a strong focus on trust and safety. The collaboration between Snowflake and Meta aims to democratize powerful natural language processing and generation applications, making them more accessible and efficient for enterprises.
Snowflake’s AI Research Team is not only bringing cutting-edge models to customers through Snowflake Cortex AI but also contributing to the broader AI community by open-sourcing its Massive LLM Inference and Fine-Tuning System Optimization Stack. This breakthrough in open-source inference and fine-tuning systems sets a new standard for multi-hundred billion parameter models, addressing the challenges posed by massive model scale and memory requirements.
With Snowflake’s optimized infrastructure for fine-tuning and the availability of Snowflake Cortex Guard to safeguard against harmful content, enterprises can now easily harness the power of AI for a wide range of applications. Snowflake’s commitment to AI safety and transparency ensures that customers can trust the models they are using, paving the way for a new era of innovation in the AI ecosystem.