LlamaIndex Newsletter 2024–01–30

Hello LlamaIndex Adventurers 🦙,

Welcome to another thrilling week at LlamaIndex! It’s brimming with community contributions and a wealth of educational content that will take your LlamaIndex experience to new heights. Dive into our latest features, comprehensive tutorials, insightful guides, and interactive demos, all designed to supercharge your journey with LlamaIndex.

But first, let’s ignite your excitement with a reminder about our upcoming first-ever in-person hackathon, happening February 2nd-4th. Don’t miss this incredible chance to mingle with fellow RAG aficionados, collaborate on exciting projects, and vie for a share of over $16,000 in prizes!

Your creations inspire us! Whether it’s a project, article, or video that you’re proud of, we’d love to see it. Share your brilliance with us at news@llamaindex.ai. And for those who haven’t yet, make sure to subscribe to our newsletter on our website — it’s your gateway to all the latest and greatest from LlamaIndex, delivered directly to your inbox.

🤩 The highlights:

1. RAG CLI: Easy-to-use tool for local file indexing and search, with advanced integration and customization features. Docs, Tweet.
2. JSONalyze: Efficiently summarizes large JSON datasets, transforming them into SQLite for detailed SQL queries. Docs, Tweet.
3. OpenAI Embeddings: We now support the latest OpenAI text-embedding-3-small and text-embedding-3-large embeddings for improved accuracy and cost-effectiveness in data retrieval. Docs, Tweet.
4. ReAct Agent Guide: From scratch guide for building ReAct agents, covering all key aspects from setup to memory management.
5. Slack Bot: Step-by-step guide for developing a learning Slack bot, integrated with advanced data engines and deployment tools.

✨ Feature Releases and Enhancements:

• We have launched RAG CLI: A straightforward command-line tool for indexing and searching any local file, featuring integration with IngestionPipeline, QueryPipeline, and ChromaDB, with support for local models and customizable logic. Docs, Tweet.
• We have introduced JSONalyze, a query engine that swiftly summarizes large JSON datasets. It transforms JSON data into an SQLite table, enabling precise SQL queries for efficient data analysis, combining LlamaIndex’s capabilities with text-to-SQL technology. Docs, Tweet.
• We have launched day 0 support for OpenAI’s latest embedding models featuring cost-effective text-embedding-3-small and high-performance text-embedding-3-large, both with customizable dimensions for enhanced retrieval accuracy in Python and TypeScript versions of LlamaIndex. Docs, Tweet.
• We have launched Infer-Retrieve-Rerank as a LlamaPack, a technique developed by Karel Doostrlnck, as a simple yet effective LLM-based approach for tackling complex classification challenges with numerous categories, applicable in areas like medical diagnosis and job skill assessment. LlamaPack, Tweet.
• We have launched LlamaPack with Vanna AI: An advanced text-to-SQL tool using RAG for storing, indexing, and generating SQL queries. LlamaPack.
• We have integrated with Zilliz Cloud Pipeline in partnership with Zilliz Universe. This fully managed, scalable retrieval service supports multi-tenancy. Blog, Tweet.
• We have partnered with Exa which created an advanced RAG-powered web search, designed for LLMs and now integrated with Llama Index agents, enhancing workflow automation and data source combination. Notebook, Tweet.
• We have integrated with Neutrino, offering GPT-4 level performance at significantly reduced costs by smartly allocating queries to the most suitable model from a diverse range. Docs, Twitter.

🗺️ Guides:

• Guide to Building a ReAct Agent from Scratch and cookbook detailing the essential components for creating your agents, including reasoning prompts, output parsing, tool selection, and memory management.
• Guide to Building Slack Bot: Create and deploy an intelligent Slack bot that learns from conversations and accurately answers organizational queries, featuring integration with Qdrant Engine and Render.

✍️ Tutorials:

• Marco Bertelli tutorial on Empowering Your Chatbot: Unveiling Dynamic Knowledge Sources with Advanced Integration.
• Tonic Validate tutorial on Implementing integration tests for LlamaIndex.
• Chia Jeng Yang tutorial on Injecting Knowledge Graphs in different RAG stages.
• Wenqi Glantz tutorial on Jump-start Your RAG Pipelines with Advanced Retrieval LlamaPacks and Benchmark with Lighthouz AI.

🎥 Webinar

• LlamaIndex Webinar on Efficient Parallel Function Calling Agents with LLMCompiler with Sehoon Kim and Amir Gholami.

🏢 Calling all enterprises:

Are you building with LlamaIndex? We are working hard to make LlamaIndex, even more, Enterprise-ready and have sneak peeks at our upcoming products available for partners. Interested? Get in touch.