Snowflake Announces Hosting of Llama 3.1 Collection in Snowflake Cortex AI for Enterprises

Snowflake, a leading data cloud platform, has made a groundbreaking announcement that is set to revolutionize the world of artificial intelligence. The company has revealed that it will be hosting the Llama 3.1 collection of multilingual open-source large language models (LLMs) in Snowflake Cortex AI, providing enterprises with the tools to harness and build powerful AI applications at scale.

This offering includes Meta’s largest and most powerful open-source LLM, Llama 3.1 405B, with Snowflake developing and open-sourcing the inference system stack to enable real-time, high-throughput inference. This move aims to democratize powerful natural language processing and generation applications, making them more accessible and efficient for businesses.

Snowflake’s industry-leading AI Research Team has optimized Llama 3.1 405B for both inference and fine-tuning, supporting a massive 128K context window from day one. This optimization enables real-time inference with significantly lower latency and higher throughput compared to existing open-source solutions, providing a more seamless and efficient AI experience for users.

By partnering with Meta, Snowflake is not only providing customers with easy access to cutting-edge AI models but also ensuring trust and safety through a comprehensive approach built into the foundational level of the platform. This collaboration aims to empower enterprises and the AI community with new research and open-source code that supports advanced AI capabilities.

Snowflake’s AI Research Team continues to push the boundaries of open-source innovations, with the recent launch of Llama 3.1 405B marking a significant milestone in the development of AI technologies. The team is now open-sourcing its Massive LLM Inference and Fine-Tuning System Optimization Stack, in collaboration with industry leaders, to establish a new state-of-the-art for open-source inference and fine-tuning systems for multi-hundred billion parameter models.

Overall, Snowflake’s latest announcement signifies a major step forward in the world of AI, providing businesses with the tools and resources needed to leverage the power of advanced language models for a wide range of applications. With a focus on efficiency, accessibility, and safety, Snowflake is paving the way for the future of AI innovation.