README.md

Data Ingestion and Preparation

This directory contains notebooks to load datasets from Huggingface, create documents with IDs, and create vector embeddings stored in the data directory to avoid rerunning when restarting the kernel.