LlamaIndex

LlamaIndex Jul 23, 2024

LlamaIndex Newsletter 2024-07-23

Hello, Llama Followers! 🦙

Welcome to this week’s edition of the LlamaIndex newsletter! We’re thrilled to share some exciting updates about our products, including LlamaCloud, LlamaParse, and LlamaAgents. You’ll also find success stories with LlamaCloud, extensive guides, in-depth tutorials, and information about upcoming hackathons.

🤩 The highlights:

  1. LlamaCloud Updates: New features including LlamaCloud Chat, enhanced Teams collaboration, and expanded integrations with Notion, Slack, Jira, and SharePoint. Blogpost, Tweet.
  2. Scaleport AI’s Accelerated Development with LlamaCloud: Scaleport AI boosts development speed and sales with LlamaCloud and LlamaIndex, improving data handling and OCR accuracy across multiple industries. Blogpost.
  3. Claude Sonnet-3.5 Integration with LlamaParse: Integration of Claude Sonnet-3.5 with LlamaParse improves chart understanding and data extraction capabilities. Notebook, Tweet.
  4. Multimodal RAG Cookbook: A new guide for processing text, diagrams, charts, and tables in slide decks using LlamaParse, LlamaIndex, and GPT-4o. Notebook, Tweet.
  5. Human in the Loop with LlamaAgents: Implementation includes HumanService for math queries and agent handling for other inquiries, managed via Gradio app and RabbitMQ. Code.

✨ Feature Releases and Enhancements:

  1. We have released new features on LlamaCloud like LlamaCloud Chat for instant conversational data access, enhanced Teams functionality for collaboration, and expanded data integration with connectors for Notion, Slack, Jira, and improved SharePoint support. Blogpost, Tweet.
  2. We integrated Claude Sonnet-3.5 with LlamaParse to enhance document parsing capabilities, offering advanced chart understanding and structured data extraction with improved validation and scalability. Notebook, Tweet.
  3. We have released a cookbook on Multimodal RAG for processing slide decks rich in text, diagrams, charts, and tables using LlamaParse, LlamaIndex, and GPT-4o, blending text and image data for comprehensive document analysis. Notebook, Tweet.
  4. We have implemented Human in the Loop with LlamaAgents in our new example that integrates a HumanService object for handling math queries and an agent for other queries, all managed through a Gradio app and RabbitMQ messaging. Code.
  5. We have made huge improvements to markdown-based table reconstruction in LlamaParse, enabling the parsing of very complex tables while ensuring that rows and columns remain well-aligned. Notebook, Tweet.
  6. Marcus Schiesser has enhanced RAGapp, a docker-deployable, enterprise-ready RAG application, with MistralAI and Groq support for rapid inference, and a Cohere reranker to boost result relevance.

💡 Use-cases:

  • Scaleport AI accelerated development and improved sales with LlamaCloud and LlamaIndex to streamline AI development, reducing prototype timelines, simplifying data ingestion, and improving OCR accuracy across key industries like Legal, eCommerce, Real Estate, and Finance. Blogpost.
  • Merlinn, an open-source LLM-powered on-call copilot community project features a Slack assistant that manages production incidents automatically, integrating with tools like Datadog, PagerDuty, GitHub, Notion, and Confluence using core components from LlamaIndex in both Python and TypeScript. Repository.

🗺️ Guides:

  • Guide to Building a Multi-Agent Concierge System to demonstrate how to create a complex tree system with specialized sub-agents and meta-agents for efficient customer interaction handling. Blog, Tweet.
  • Guide on Improving Vector Search - Reranking with PostgresML and LlamaIndex

✍️ Tutorials:

  • Laurie’s video tutorial on Building and deploying Multi-Agent RAG systems with LlamaIndex.
  • Pavan Kumar tutorial on Chatting with Podcasts and Videos using OpenAI, Qdrant and Gemma2.
  • Lakshmi Narayana tutorial on Agentic RAG with LlamaIndex to enhance generative AI applications with intelligent routing, multi-step reasoning, and adaptive learning.

🎤 Talks, Webinars and Podcasts:

  • Jerry Liu’s talk on advanced LlamaIndex capabilities, introducing ‘Llama Agents’ for deploying microservice-based agents that communicate via a unified API.
  • Jerry Liu discusses high-quality data, prompt engineering, long context windows, and RAG on the StackOverflowPodcast with Jerry Chen.
  • Webinar with Yixin Hu (VU Amsterdam) and Thomas Hulard (McDermott) on Evaluating RAG with LlamaIndex.
  • Webinar with the cofounders of Deasie (Reece, Leonard, Mikko) on improving RAG with advanced parsing and metadata.

💻 Hackathons:

  • We’re sponsoring a month-long hackathon with PingCAP for their #TiDB database! Join us, AWS Cloud, Anyscale Compute, Dify AI, Jina AI, Lepton AI, and NPI AI to compete for over $30,000 in prizes, including $12,000 in cash for the first-place winner. Sign up here.