Update README.md
Browse files
README.md
CHANGED
@@ -112,6 +112,8 @@ model-index:
|
|
112 |
|
113 |
This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) on the [msmarco-co-condenser-margin-mse-sym-mnrl-mean-v1](https://huggingface.co/datasets/sentence-transformers/msmarco-co-condenser-margin-mse-sym-mnrl-mean-v1) dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
|
114 |
|
|
|
|
|
115 |
## Model Details
|
116 |
|
117 |
### Model Description
|
@@ -155,7 +157,7 @@ Then you can load this model and run inference.
|
|
155 |
from sentence_transformers import SentenceTransformer
|
156 |
|
157 |
# Download from the 🤗 Hub
|
158 |
-
model = SentenceTransformer("joe32140/ModernBERT-base-
|
159 |
# Run inference
|
160 |
sentences = [
|
161 |
'what county is hayden in',
|
|
|
112 |
|
113 |
This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) on the [msmarco-co-condenser-margin-mse-sym-mnrl-mean-v1](https://huggingface.co/datasets/sentence-transformers/msmarco-co-condenser-margin-mse-sym-mnrl-mean-v1) dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
|
114 |
|
115 |
+
I finetune ModernBERT-base using script from offical repo https://github.com/AnswerDotAI/ModernBERT/blob/main/examples/train_st.py on a RTX 4090 GPU with batch size 128 taking under an hour.
|
116 |
+
|
117 |
## Model Details
|
118 |
|
119 |
### Model Description
|
|
|
157 |
from sentence_transformers import SentenceTransformer
|
158 |
|
159 |
# Download from the 🤗 Hub
|
160 |
+
model = SentenceTransformer("joe32140/ModernBERT-base-msmacro")
|
161 |
# Run inference
|
162 |
sentences = [
|
163 |
'what county is hayden in',
|