update readme aug 2024
Browse files
README.md
CHANGED
|
@@ -6,69 +6,73 @@ colorTo: green
|
|
| 6 |
sdk: static
|
| 7 |
pinned: true
|
| 8 |
tags:
|
|
|
|
| 9 |
- inference
|
| 10 |
- function calling
|
| 11 |
-
- long context
|
| 12 |
-
- mistral
|
| 13 |
-
- deepseek
|
| 14 |
-
- yi
|
| 15 |
-
- code-llama
|
| 16 |
- quantization
|
| 17 |
-
- SFT
|
| 18 |
-
- fine-tuning
|
| 19 |
---
|
| 20 |
-
*last updated
|
| 21 |
## About
|
| 22 |
Trelis Research provides:
|
| 23 |
-
- Function-calling models.
|
| 24 |
- Advanced LLM fine-tuning scripts.
|
| 25 |
- Advanced LLM inference guides.
|
| 26 |
- Advanced vision fine-tuning scripts.
|
| 27 |
-
- Advanced voice/transcription fine-tuning scripts.
|
| 28 |
- One click LLM API templates
|
| 29 |
-
|
| 30 |
-
## Function-calling Models and Datasets
|
| 31 |
-
|
| 32 |
-
[Get access here](https://trelis.com/function-calling/)
|
| 33 |
-
|
| 34 |
-
- Fine-tuned models for function calling - from 1.3B to 70B in size, incl. Mixtral, Yi, Deepseek, Llama and more. [Collection here](https://huggingface.co/collections/Trelis/function-calling-v3-657199ecbe378693925c7915)
|
| 35 |
-
- Dataset to fine-tune models for function calling. [Access here](https://huggingface.co/datasets/Trelis/function_calling_v3)
|
| 36 |
-
- Scripts to fine-tune models for function calling and structured responses.
|
| 37 |
|
| 38 |
## ADVANCED Fine-tuning Scripts
|
| 39 |
|
| 40 |
[Get access here](https://trelis.com/advanced-fine-tuning-scripts/)
|
| 41 |
|
| 42 |
-
|
| 43 |
-
|
| 44 |
-
|
| 45 |
-
|
| 46 |
-
|
| 47 |
-
|
| 48 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 49 |
|
| 50 |
## ADVANCED Inference
|
| 51 |
|
| 52 |
[Get access here](https://trelis.com/enterprise-server-api-and-inference-guide/)
|
| 53 |
|
| 54 |
-
- Server setup, API setup and inference guide for open source models
|
| 55 |
-
- Inference for function calling
|
|
|
|
|
|
|
|
|
|
|
|
|
| 56 |
|
| 57 |
-
## ADVANCED Vision
|
| 58 |
|
| 59 |
[Get access here](https://trelis.com/advanced-vision/)
|
| 60 |
|
| 61 |
- Dataset Preparation
|
| 62 |
-
- Fine-tuning Llava
|
| 63 |
|
| 64 |
-
## ADVANCED Transcription
|
| 65 |
|
| 66 |
[Get access here](https://trelis.com/advanced-transcription/)
|
| 67 |
|
| 68 |
-
- Fine-tuning Whisper on custom datasets
|
| 69 |
- Dataset Generation
|
| 70 |
-
-
|
|
|
|
| 71 |
|
| 72 |
## One-click LLM API/Server Templates
|
| 73 |
- Check out the full list [here](https://github.com/TrelisResearch/one-click-llms)
|
| 74 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 6 |
sdk: static
|
| 7 |
pinned: true
|
| 8 |
tags:
|
| 9 |
+
- fine-tuning
|
| 10 |
- inference
|
| 11 |
- function calling
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 12 |
- quantization
|
|
|
|
|
|
|
| 13 |
---
|
| 14 |
+
*last updated August 1st 2024*
|
| 15 |
## About
|
| 16 |
Trelis Research provides:
|
|
|
|
| 17 |
- Advanced LLM fine-tuning scripts.
|
| 18 |
- Advanced LLM inference guides.
|
| 19 |
- Advanced vision fine-tuning scripts.
|
| 20 |
+
- Advanced voice/transcription fine-tuning scripts.
|
| 21 |
- One click LLM API templates
|
| 22 |
+
- Function-calling models.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 23 |
|
| 24 |
## ADVANCED Fine-tuning Scripts
|
| 25 |
|
| 26 |
[Get access here](https://trelis.com/advanced-fine-tuning-scripts/)
|
| 27 |
|
| 28 |
+
- retrieval (bm25, similarity, re-rankers)
|
| 29 |
+
- wikipedia fine-tuning and dataset creation
|
| 30 |
+
- ReFT fine-tuning
|
| 31 |
+
- multi-gpu fine-tuning
|
| 32 |
+
- orpo fine-tuning
|
| 33 |
+
- memorization fine-tuning
|
| 34 |
+
- mamba-fine-tune
|
| 35 |
+
- DPO fine-tuning
|
| 36 |
+
- chat-fine-tuning
|
| 37 |
+
- function-calling fine-tuning
|
| 38 |
+
- long-context fine-tuning
|
| 39 |
+
- quantization
|
| 40 |
+
- supervised-fine-tuning
|
| 41 |
+
- unsupervised-fine-tuning
|
| 42 |
|
| 43 |
## ADVANCED Inference
|
| 44 |
|
| 45 |
[Get access here](https://trelis.com/enterprise-server-api-and-inference-guide/)
|
| 46 |
|
| 47 |
+
- Server setup, API setup and inference guide for open source models
|
| 48 |
+
- Inference for function calling
|
| 49 |
+
- Monte Carlo Inference Methods
|
| 50 |
+
- Private Data Redaction
|
| 51 |
+
- Structured Data Extraction with LLMs
|
| 52 |
+
- Verified RAG citations
|
| 53 |
|
| 54 |
+
## ADVANCED Vision Fine-tuning
|
| 55 |
|
| 56 |
[Get access here](https://trelis.com/advanced-vision/)
|
| 57 |
|
| 58 |
- Dataset Preparation
|
| 59 |
+
- Fine-tuning Llava, IDEFICS2
|
| 60 |
|
| 61 |
+
## ADVANCED Transcription and Voice Cloning
|
| 62 |
|
| 63 |
[Get access here](https://trelis.com/advanced-transcription/)
|
| 64 |
|
|
|
|
| 65 |
- Dataset Generation
|
| 66 |
+
- Fine-tuning Whisper speech-to-text on custom datasets
|
| 67 |
+
- Voice Cloning Fine-tuning / Text-to-Speech
|
| 68 |
|
| 69 |
## One-click LLM API/Server Templates
|
| 70 |
- Check out the full list [here](https://github.com/TrelisResearch/one-click-llms)
|
| 71 |
+
|
| 72 |
+
## Function-calling Models and Datasets
|
| 73 |
+
|
| 74 |
+
[Get access here](https://trelis.com/function-calling/)
|
| 75 |
+
|
| 76 |
+
- Fine-tuned models for function calling - from 1.3B to 70B in size, incl. Mixtral, Yi, Deepseek, Llama and more. [Collection here](https://huggingface.co/collections/Trelis/function-calling-v3-657199ecbe378693925c7915)
|
| 77 |
+
- Dataset to fine-tune models for function calling. [Access here](https://huggingface.co/datasets/Trelis/function_calling_v3)
|
| 78 |
+
- Scripts to fine-tune models for function calling and structured responses.
|