Nvidia’s Chat with RTX brings a personal AI chatbot to your PC

Nvidia, known for its chips and graphics processing units (GPUs), is venturing into the world of generative AI.

The chip manufacturing giant on February 13 released an early version of its ‘Chat with RTX,’ which lets users personalise a chatbot with their own content on Windows PCs.

What is Chat with RTX?

Chat with RTX is a free tech demo that lets users create their own chatbot using local files as sources of knowledge.

Think of it this way: you have a bunch of documents and notes stored on your computer. By adding these local files on a PC as a dataset to an open-source large language model like Mistral or Llama 2, users can generate relevant answers to queries.

Chat with RTX uses retrieval-augmented generation (RAG), Nvidia TensorRT-LLM software and Nvidia RTX acceleration to bring generative AI capabilities to local, GeForce-powered Windows PCs.

RAG is a method that improves the precision and dependability of generative AI models by incorporating information obtained from external sources.

The tool supports various file formats, including .txt, .pdf, .doc/.docx and .xml.