Diognes is currently a work in progress LLM chatbot entirely built from scratch. While early versions will utilize autoregressive generation paradigms, future versions will explore diffusion-based language modeling and reasoning.

The project is focused on building a deep understanding of the inner workings of language models, and exploring novel architectures and training paradigms for next generation models.