Announcing the LlamaIndex integration with Azure AI

At Microsoft Ignite in Chicago, LlamaIndex announces that years of productive collaboration with Microsoft have resulted in a complete stack for end-to-end Retrieval-Augmented Generation (RAG) and knowledge-augmented agents, available entirely on Azure.

Core components

The stack starts at the fundamental base of any generative AI application, the LLM, with Azure OpenAI Service. The powerful models available can be enhanced with your private data by using Azure AI Embeddings stored in the scalable, performant Azure AI Search vector store. Using these core components and LlamaIndex, you can easily put together a world-class RAG app.

Learn more about RAG in LlamaIndex.

Storage and memory

LlamaIndex integration with Azure AI also provides for further refinement of a RAG stack, with the combination of the Azure Doc Store and Azure KV Store allowing incremental loading of new data into RAG applications while the Azure Chat Store gives a chatbot application fast, persistent memory of previous interactions.

Enhancing agents with tools

In 2024 LlamaIndex has pushed beyond our foundations in the RAG space to supporting full agents via our powerful, flexible Workflows abstraction and we’ve seen enthusiastic adoption in the community. Azure’s services come into play here too, with a suite of agentic tools including the Azure Code Interpreter providing fast, safe execution of generated code, as well as agentic tools for text-to-speech generation, computer vision and language translation

Getting to production quickly

Most recently, the ongoing collaboration between LlamaIndex and Azure AI has resulted in LlamaIndex templates in the AI App Template Gallery, an easy path to get from zero to sixty with your Azure-based agentic AI applications using LlamaIndex.

Looking to the future

“We’re excited that our collaboration with Microsoft has resulted in so many happy customers already, and we can’t wait to see what else we come up with together in the years ahead,” said Jerry Liu, CEO and co-founder, “Microsoft’s AI ecosystem has been invaluable to users of LlamaCloud and LlamaParse in giving them the confidence to deploy cutting-edge AI solutions with security they can trust.”