In this article, we will use retrieval augmented generation (RAG) with one of the most common large language models (LLMs) to see how it can improve LLM context and response quality. Firstly, we will dive into what is retrieval augmented generation. As the name suggests in RAG, the LLM will retrieve data from external sources and use that data as input to the LLM prompt to augment the response quality.

According to AWS documentation, “Retrieval-Augmented Generation (RAG) is the process of o