Luth-LFM2, 1.2B/700M/350M parameters models fine tuned in French in collaboration with Liquid AI.
Projects
Personal projects and open source contributions
Luth is a state-of-the-art series of fine-tuned LLMs for French, delivering improved French instruction-following, math, and general knowledge capabilities.
LeCarnet is a 2M+ corpus of simple French stories for training small language models.
FlashAttention-2 for sliding window attention in Triton (forward + backward).
A minimalist implementation of Paligemma 2 from scratch in PyTorch.
Conditional Wasserstein Generative Adversarial Network with Gradient Penalty implementation for a Kaggle competition.
Implementation of word2vec algorithm for learning word embeddings from text corpora using skip-gram and CBOW architectures.
Volleyball referee hand signal recognition in real-time or through videos.