Posts

Showing posts with the label RAG

Enabling AI in Enterprise Java with Spring AI, Multi-Agents RAG and LiteLLM

Image
  Overview With Spring AI Multi-Agent RAG, I wanted to explore how AI capabilities can be integrated into a Java and Spring-based backend in a way that makes sense for enterprise teams. Instead of forcing organizations to jump to a completely different ecosystem just to work with LLMs, this project shows that existing Spring Boot applications, Java teams, and enterprise architectures can adopt AI capabilities directly within the stack they already use. A lot of AI tooling still assumes teams are ready to rebuild around Python-first frameworks. That is fine for experimentation, but it is not how most enterprise systems work. The practical question is not whether AI can be built in Python. Of course it can. The real question is whether existing enterprise teams can add AI capabilities without abandoning the stack, language, and operational model they already trust. ·         Java ·         Spring Boot ·...

Generative AI - Chat with your data

Image
 Overview In the digital age, we can use the power of generative AI to build custom innovative solutions by enabling users to interact with their documents or websites through natural language conversations. This blog-post focuses on a simple use-case where the user can chat/query an uploaded PDF, JSON data or an existing website with natural language conversations using RAG(Retrieval-Augmented Generation). The entire stack is based on open source technologies and can be implemented without having to pay a dime. Tech stack: Node js - Popular Backend framework based on Javascript Langchain JS   - Javascript based framework for developing applications powered by language models Cohere - Open source LLM model Mongo DB Atlas -  an integrated suite of data services centered around a cloud database which can also store vector embeddings. Pre-Requisites Node JS -  Install version 18 and above. Cohere API Key - Sign up to Cohere and procure an API Key (free of cost) Mongo ...