Text Ranking
Transformers
PyTorch
Safetensors
deberta
pair-ranker
pair_ranker
reward_model
reward-model
RLHF
Instructions to use llm-blender/pair-ranker with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use llm-blender/pair-ranker with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("llm-blender/pair-ranker", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Dongfu Jiang commited on
Commit ·
f5ed554
1
Parent(s): ab31e5e
Update README.md
Browse files
README.md
CHANGED
|
@@ -49,7 +49,7 @@ which is trained on [mixinstruct](https://huggingface.co/datasets/llm-blender/mi
|
|
| 49 |
| MLM-Scoring | 64.77 | -4.03 | -0.88 | 7.00 | 33.87 | 30.39 | 7.29 | 14.09 | 21.46 |
|
| 50 |
| SimCLS | **73.14** | -3.22 | -0.38 | 3.50 | 52.11 | 49.93 | 26.72 | 46.24 | 60.72 |
|
| 51 |
| SummaReranker | 71.60 | -3.25 | -0.41 | 3.66 | **55.63** | 48.46 | 23.89 | 42.44 | 57.54 |
|
| 52 |
-
| [PairRanker](https://huggingface.co/llm-blender/pair-ranker)
|
| 53 |
|
| 54 |
## Usage Example
|
| 55 |
Since PairRanker contains some custom layers and tokens. We recommend use our pairranker with our llm-blender python repo.
|
|
|
|
| 49 |
| MLM-Scoring | 64.77 | -4.03 | -0.88 | 7.00 | 33.87 | 30.39 | 7.29 | 14.09 | 21.46 |
|
| 50 |
| SimCLS | **73.14** | -3.22 | -0.38 | 3.50 | 52.11 | 49.93 | 26.72 | 46.24 | 60.72 |
|
| 51 |
| SummaReranker | 71.60 | -3.25 | -0.41 | 3.66 | **55.63** | 48.46 | 23.89 | 42.44 | 57.54 |
|
| 52 |
+
| [**PairRanker**](https://huggingface.co/llm-blender/pair-ranker) | 72.97 | **-3.14** | **-0.37** | **3.20** | 54.76 | **57.79** | **30.08** | **50.68** | **65.12** |
|
| 53 |
|
| 54 |
## Usage Example
|
| 55 |
Since PairRanker contains some custom layers and tokens. We recommend use our pairranker with our llm-blender python repo.
|