joe32140 commited on
Commit
3231b22
·
verified ·
1 Parent(s): 3a4f119

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -112,6 +112,8 @@ model-index:
112
 
113
  This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) on the [msmarco-co-condenser-margin-mse-sym-mnrl-mean-v1](https://huggingface.co/datasets/sentence-transformers/msmarco-co-condenser-margin-mse-sym-mnrl-mean-v1) dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
114
 
 
 
115
  ## Model Details
116
 
117
  ### Model Description
@@ -155,7 +157,7 @@ Then you can load this model and run inference.
155
  from sentence_transformers import SentenceTransformer
156
 
157
  # Download from the 🤗 Hub
158
- model = SentenceTransformer("joe32140/ModernBERT-base-DPR-8e-05")
159
  # Run inference
160
  sentences = [
161
  'what county is hayden in',
 
112
 
113
  This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) on the [msmarco-co-condenser-margin-mse-sym-mnrl-mean-v1](https://huggingface.co/datasets/sentence-transformers/msmarco-co-condenser-margin-mse-sym-mnrl-mean-v1) dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
114
 
115
+ I finetune ModernBERT-base using script from offical repo https://github.com/AnswerDotAI/ModernBERT/blob/main/examples/train_st.py on a RTX 4090 GPU with batch size 128 taking under an hour.
116
+
117
  ## Model Details
118
 
119
  ### Model Description
 
157
  from sentence_transformers import SentenceTransformer
158
 
159
  # Download from the 🤗 Hub
160
+ model = SentenceTransformer("joe32140/ModernBERT-base-msmacro")
161
  # Run inference
162
  sentences = [
163
  'what county is hayden in',