zhichao-geng commited on
Commit
1d60e18
1 Parent(s): 7cc6254

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -16
README.md CHANGED
@@ -131,19 +131,14 @@ The above code sample shows an example of neural sparse search. Although there i
131
 
132
  ## Detailed Search Relevance
133
 
134
- | Dataset | [opensearch-neural-sparse-encoding-v1](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-v1) | [opensearch-neural-sparse-encoding-v2-distill](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-v2-distill) | [opensearch-neural-sparse-encoding-doc-v1](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-doc-v1) | [opensearch-neural-sparse-encoding-doc-v2-distill](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-doc-v2-distill) |
135
- |---------|-------------------------------------------------------------------------|-------------------------------------------------------------------------------------|------------------------------------------------------------------------------|------------------------------------------------------------------------------------------|
136
- | Trec Covid | 0.771 | 0.775 | 0.707 | 0.690 |
137
- | NFCorpus | 0.360 | 0.347 | 0.352 | 0.343 |
138
- | NQ | 0.553 | 0.561 | 0.521 | 0.528 |
139
- | HotpotQA | 0.697 | 0.685 | 0.677 | 0.675 |
140
- | FiQA | 0.376 | 0.374 | 0.344 | 0.357 |
141
- | ArguAna | 0.508 | 0.551 | 0.461 | 0.496 |
142
- | Touche | 0.278 | 0.278 | 0.294 | 0.287 |
143
- | DBPedia | 0.447 | 0.435 | 0.412 | 0.418 |
144
- | SCIDOCS | 0.164 | 0.173 | 0.154 | 0.166 |
145
- | FEVER | 0.821 | 0.849 | 0.743 | 0.818 |
146
- | Climate FEVER | 0.263 | 0.249 | 0.202 | 0.224 |
147
- | SciFact | 0.723 | 0.722 | 0.716 | 0.715 |
148
- | Quora | 0.856 | 0.863 | 0.788 | 0.841 |
149
- | **Average** | **0.524** | **0.528** | **0.490** | **0.504** |
 
131
 
132
  ## Detailed Search Relevance
133
 
134
+ <div style="overflow-x: auto;">
135
+
136
+ | Model | Average | Trec Covid | NFCorpus | NQ | HotpotQA | FiQA | ArguAna | Touche | DBPedia | SCIDOCS | FEVER | Climate FEVER | SciFact | Quora |
137
+ |-------|---------|------------|----------|----|----------|------|---------|--------|---------|---------|-------|---------------|---------|-------|
138
+ | [opensearch-neural-sparse-encoding-v1](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-v1) | 0.524 | 0.771 | 0.360 | 0.553 | 0.697 | 0.376 | 0.508 | 0.278 | 0.447 | 0.164 | 0.821 | 0.263 | 0.723 | 0.856 |
139
+ | [opensearch-neural-sparse-encoding-v2-distill](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-v2-distill) | 0.528 | 0.775 | 0.347 | 0.561 | 0.685 | 0.374 | 0.551 | 0.278 | 0.435 | 0.173 | 0.849 | 0.249 | 0.722 | 0.863 |
140
+ | [opensearch-neural-sparse-encoding-doc-v1](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-doc-v1) | 0.490 | 0.707 | 0.352 | 0.521 | 0.677 | 0.344 | 0.461 | 0.294 | 0.412 | 0.154 | 0.743 | 0.202 | 0.716 | 0.788 |
141
+ | [opensearch-neural-sparse-encoding-doc-v2-distill](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-doc-v2-distill) | 0.504 | 0.690 | 0.343 | 0.528 | 0.675 | 0.357 | 0.496 | 0.287 | 0.418 | 0.166 | 0.818 | 0.224 | 0.715 | 0.841 |
142
+ | [opensearch-neural-sparse-encoding-doc-v2-mini](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-doc-v2-mini) | 0.497 | 0.709 | 0.336 | 0.510 | 0.666 | 0.338 | 0.480 | 0.285 | 0.407 | 0.164 | 0.812 | 0.216 | 0.699 | 0.837 |
143
+
144
+ </div>