ChatRTX

ChatRTX is a demo application from NVIDIA that allows users to personalize a GPT large language model (LLM) connected to their own content—docs, notes, photos, or other data. Leveraging retrieval-augmented generation (RAG), NVIDIA TensorRT-LLM software, and NVIDIA RTX acceleration, users can query a local chatbot to get answers quickly with privacy and security as the data stays on the local PC.