Sinji Delfin
About the project
Sinji Delfin was created for Arnes HackatON 2026 as a secure AI assistant for Slovenian public-administration documents. It retrieves relevant document passages, respects group-based access permissions, and answers with either a locally hosted model or a remote language-model API.
Technologies used
- Python, FastAPI, and SQLite for the application and access-control layer
- Pinecone and Sentence Transformers for retrieval-augmented generation
- Hugging Face Transformers, PyTorch, PEFT, LoRA, and QLoRA for the local model
- JWT authentication with a lightweight JavaScript web interface