# Huggingface Fine-tuning

### Contents

1. [**Transformer Fine-tuning**](huggingface-fine-tuning/transformer-fine-tuning)
2. [**PEFT: Fine-tuning**](huggingface-fine-tuning/peft-fine-tuning)[ **Basic**](huggingface-fine-tuning/peft-fine-tuning)
3. [**PEFT: Fine-tuning with QLoRA**](huggingface-fine-tuning/peft-fine-tuning-with-qlora)
4. [**PEFT: Fine-tuning Phi-2 with QLoRA**](huggingface-fine-tuning/peft-fine-tuning-phi-2-with-qlora)
5. [**Axoltl Fine-tning with QLoRA** ](huggingface-fine-tuning/axoltl-fine-tuning-with-qlora)
6. [**TRL: RLHF Alignment Fine-tuning**](huggingface-fine-tuning/trl-rlhf-alignment-fine-tuning)
7. [**TRL: DPO Fine-tuning with Phi-3-4k-instruct**](huggingface-fine-tuning/trl-dpo-fine-tuning-with-phi-3-4k-instruct)
8. [**TRL: ORPO Fine-tuning with Llama3-8B**](huggingface-fine-tuning/trl-orpo-fine-tuning-with-llama3-8b)
9. [**Convert GGUF gemma-2b with `llama.cpp`**](huggingface-fine-tuning/convert-gguf-gemma-2b-with-llama.cpp)
10. [**Apple Silicon Fine-tuning Gemma-2B with `MLX`**](huggingface-fine-tuning/apple-silicon-fine-tuning-gemma-2b-with-mlx)
11. [**LLM Mergekit**](huggingface-fine-tuning/llm-mergekit)

***

### References:

* Huggingface 공식 문서: [https://huggingface.co/docs](https://huggingface.co/docs)
* Toward Data Science: [https://towardsdatascience.com](https://towardsdatascience.com)
* DeepLearning.ai 튜토리얼: [https://www.deeplearning.ai/short-courses/](https://www.deeplearning.ai/short-courses/)
* mlabonee Blog: [https://mlabonne.github.io/blog/](https://mlabonne.github.io/blog/)
* Mergekit github: [https://github.com/arcee-ai/mergekit](https://github.com/arcee-ai/mergekit)
* Alex Ishida github: [https://github.com/alexweberk](https://github.com/alexweberk)
* Llama.cpp github: [https://github.com/ggerganov/llama.cpp](https://github.com/ggerganov/llama.cpp)
* Axotle github: [https://github.com/OpenAccess-AI-Collective/axolotl](https://github.com/OpenAccess-AI-Collective/axolotl)
