Enlighten-Instruct

Fine-tune Mistral-7b on the Enlighten codebase

Full tutorial on Medium

Dataset is already available in the dataset folder but you can create your version with DataGenerator.ipynb
Run FineTune.ipynb on Google Colab
Run MergeAdapterWithBase.ipynb and quantize-gguf.ipynb on Kaggle

Adapter - merged model - Quantized model