BXresearch/DeBERTa2-0.9B-SentenceTransformer-v2

SentenceTransformer based on microsoft/deberta-v2-xlarge

This is a sentence-transformers model finetuned from microsoft/deberta-v2-xlarge on the negation-triplets, vitaminc-pairs, scitail-pairs-qa, scitail-pairs-pos, xsum-pairs, sciq_pairs, qasc_pairs, openbookqa_pairs, msmarco_pairs, nq_pairs, trivia_pairs, gooaq_pairs, paws-pos and global_dataset datasets. It maps sentences & paragraphs to a 1536-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: microsoft/deberta-v2-xlarge
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 1536 tokens
• Similarity Function: Cosine Similarity
• Training Datasets:
  • negation-triplets
  • vitaminc-pairs
  • scitail-pairs-qa
  • scitail-pairs-pos
  • xsum-pairs
  • sciq_pairs
  • qasc_pairs
  • openbookqa_pairs
  • msmarco_pairs
  • nq_pairs
  • trivia_pairs
  • gooaq_pairs
  • paws-pos
  • global_dataset
• Language: en

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: DebertaV2Model 
  (1): Pooling({'word_embedding_dimension': 1536, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("BXresearch/DeBERTa3-0.4B-ST-v2")
# Run inference
sentences = [
    '"""Music of the Night"" and ""All I Ask of You"" are songs from which stage musical?"',
    'All I Ask of You - YouTube All I Ask of You Want to watch this again later? Sign in to add this video to a playlist. Need to report the video? Sign in to report inappropriate content. Rating is available when the video has been rented. This feature is not available right now. Please try again later. Published on Jan 6, 2012 Twenty-second in a series of clips from the 2004 film version of The Phantom of the Opera. Performed by Patrick Wilson as Raoul and Emmy Rossum as Christine. For more Phantom, find us on Facebook: http://www.facebook.com/ThePhantomOfT... Or follow us on Twitter: http://www.twitter.com/TheOperaGhosts Or add us to your Google+ Circles: https://plus.google.com/1019282273838... Category',
    'Beatles US Labels - Variations \xa0 THE CAPITOL � APPLE    LABEL DISCOGRAPHY\xa0 In early 1964, Capitol Records became    the primary U.S. manufacturer of The Beatles major releases.\xa0 When    Apple Records was formed by the Beatles in 1968, Capitol still maintained    production and distribution control over the Beatles records.\xa0 When    Apple was dissolved in 1975, the entire Beatles catalog, including solo    releases, reverted back to Capitol. In the early 1990�s, all The    Beatles/solo Capitol product was reissued on the Apple label.\xa0 The Beatles, collectively and    individually, have also appeared on several other labels over the    years.\xa0 However, most of these releases failed to stay in production    long enough to experience significant label design changes.\xa0 The    relatively few that did, are thoroughly identified in their respective    sections.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 1536]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]

Evaluation

Metrics

Semantic Similarity

• Dataset: sts-test
• Evaluated with EmbeddingSimilarityEvaluator

Metric	Value
pearson_cosine	0.9198
spearman_cosine	0.9284
pearson_manhattan	0.9339
spearman_manhattan	0.9293
pearson_euclidean	0.9345
spearman_euclidean	0.9298
pearson_dot	0.9045
spearman_dot	0.9029
pearson_max	0.9345
spearman_max	0.9298

Binary Classification

• Dataset: allNLI-dev
• Evaluated with BinaryClassificationEvaluator

Metric	Value
cosine_accuracy	0.7285
cosine_accuracy_threshold	0.7859
cosine_f1	0.6415
cosine_f1_threshold	0.6171
cosine_precision	0.5418
cosine_recall	0.7861
cosine_ap	0.6217
dot_accuracy	0.7324
dot_accuracy_threshold	706.6836
dot_f1	0.64
dot_f1_threshold	562.2188
dot_precision	0.5199
dot_recall	0.8324
dot_ap	0.6281
manhattan_accuracy	0.7305
manhattan_accuracy_threshold	643.9918
manhattan_f1	0.6386
manhattan_f1_threshold	860.7285
manhattan_precision	0.518
manhattan_recall	0.8324
manhattan_ap	0.6164
euclidean_accuracy	0.7305
euclidean_accuracy_threshold	20.6974
euclidean_f1	0.6445
euclidean_f1_threshold	26.8806
euclidean_precision	0.5462
euclidean_recall	0.7861
euclidean_ap	0.6174
max_accuracy	0.7324
max_accuracy_threshold	706.6836
max_f1	0.6445
max_f1_threshold	860.7285
max_precision	0.5462
max_recall	0.8324
max_ap	0.6281

Binary Classification

• Dataset: Qnli-dev
• Evaluated with BinaryClassificationEvaluator

Metric	Value
cosine_accuracy	0.7168
cosine_accuracy_threshold	0.631
cosine_f1	0.7122
cosine_f1_threshold	0.5601
cosine_precision	0.6188
cosine_recall	0.839
cosine_ap	0.757
dot_accuracy	0.6973
dot_accuracy_threshold	540.0211
dot_f1	0.6992
dot_f1_threshold	466.7582
dot_precision	0.5794
dot_recall	0.8814
dot_ap	0.7258
manhattan_accuracy	0.7266
manhattan_accuracy_threshold	778.5676
manhattan_f1	0.7196
manhattan_f1_threshold	868.3278
manhattan_precision	0.6373
manhattan_recall	0.8263
manhattan_ap	0.7646
euclidean_accuracy	0.7266
euclidean_accuracy_threshold	25.0615
euclidean_f1	0.7173
euclidean_f1_threshold	27.6739
euclidean_precision	0.6495
euclidean_recall	0.8008
euclidean_ap	0.7629
max_accuracy	0.7266
max_accuracy_threshold	778.5676
max_f1	0.7196
max_f1_threshold	868.3278
max_precision	0.6495
max_recall	0.8814
max_ap	0.7646

Training Details

Training Datasets

negation-triplets

• Dataset: negation-triplets
• Size: 4,987 training samples
• Columns: anchor, entailment, and negative
• Approximate statistics based on the first 1000 samples:

  	anchor	entailment	negative
  type	string	string	string
  details	min: 4 tokens mean: 21.87 tokens max: 144 tokens	min: 5 tokens mean: 13.72 tokens max: 46 tokens	min: 4 tokens mean: 13.94 tokens max: 39 tokens

• Samples:

  anchor	entailment	negative
  a very dirty toilet in a tiled bathroom	A dirty toilet in a dirty bathroom with a octagon tile floor.	A clean toilet in a dirty bathroom with an octagon tile floor.
  enjoy the wildlife	Enjoy the animals.	Ignore the animals.
  A man looking inside of birdcages on a sidewalk.	A man, holding his hat, is looking into the bird cage.	A man, holding his hat, is looking away from the bird cage.

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

vitaminc-pairs

• Dataset: vitaminc-pairs at be6febb
• Size: 4,987 training samples
• Columns: claim and evidence
• Approximate statistics based on the first 1000 samples:

  	claim	evidence
  type	string	string
  details	min: 6 tokens mean: 16.62 tokens max: 54 tokens	min: 7 tokens mean: 36.79 tokens max: 133 tokens

• Samples:

  claim	evidence
  Mase was born before 1976 .	Mase was born Mason Drell Betha in Jacksonville , Florida , on August 27 , 1975 , as a fraternal twin born almost two months premature .
  On Rotten Tomatoes , Going in Style received more than 105 reviews and a rating of under 47 % .	On Rotten Tomatoes , the film has an approval rating of 46 % based on 106 reviews , with an average rating of 5.3/10 .
  Aaron Charles Donald is an American football defensive end for Los Angeles Rams .	Aaron Charles Donald ( born May 23 , 1991 ) is an American football defensive end for the Los Angeles Rams of the National Football League ( NFL ) .

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

scitail-pairs-qa

• Dataset: scitail-pairs-qa at 0cc4353
• Size: 4,987 training samples
• Columns: sentence1 and sentence2
• Approximate statistics based on the first 1000 samples:

  	sentence1	sentence2
  type	string	string
  details	min: 7 tokens mean: 15.84 tokens max: 41 tokens	min: 7 tokens mean: 14.96 tokens max: 41 tokens

• Samples:

  sentence1	sentence2
  A negative enthalpy change is observed in an exothermic reaction.	What enthalpy change is observed in an exothermic reaction?
  Fungus-like protists such as slime molds reproduce with spores.	How do fungus-like protists such as slime molds reproduce?
  Unlike energy, matter doesn’t need to be constantly added to ecosystems because it is recycled through ecosystems.	Unlike energy, what doesn’t need to be constantly added to ecosystems because it is recycled through ecosystems?

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

scitail-pairs-pos

• Dataset: scitail-pairs-pos at 0cc4353
• Size: 4,987 training samples
• Columns: sentence1 and sentence2
• Approximate statistics based on the first 1000 samples:

  	sentence1	sentence2
  type	string	string
  details	min: 8 tokens mean: 23.21 tokens max: 64 tokens	min: 7 tokens mean: 15.66 tokens max: 39 tokens

• Samples:

  sentence1	sentence2
  During equinox times the Sun's vertical ray is shining directly on the Earth's equator and neither hemisphere is tilted toward or away from the Sun.	The sun is directly over the equator during.
  All the baby s major organs begin to develop in the first 6 to 8 weeks of pregnancy, so tight control from the moment of conception is critical.	By 8 weeks, all major organs start developing.
  Nobody disputes that all modern humans belong to one species, Homo sapiens .	Humans belong to the species homo sapiens.

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

xsum-pairs

• Dataset: xsum-pairs
• Size: 4,987 training samples
• Columns: summary and document
• Approximate statistics based on the first 1000 samples:

  	summary	document
  type	string	string
  details	min: 8 tokens mean: 25.19 tokens max: 44 tokens	min: 51 tokens mean: 217.32 tokens max: 422 tokens

• Samples:

  summary	document
  Chester's Elliott Durrell salvaged a 1-1 draw at Boreham Wood with a late wonder strike.	Morgan Ferrier's fifth-minute effort looked like it would be enough for the hosts after the 24-year-old evaded Blaine Hudson to get in behind and tap the ball home. After that the game became scrappy, with neither side creating many clear-cut chances, although Chester's Ryan Astles was forced into a goal-line clearance after 70 minutes to block a Matthew Paine drive. Just when it looked like Chester boss Jon McCarthy was staring at a fourth defeat in his first five games, Durrell picked the ball up around halfway, spotted Grant Smith off his line and struck from distance to level things up with seven minutes remaining. Report supplied by the Press Association Match ends, Boreham Wood 1, Chester FC 1. Second Half ends, Boreham Wood 1, Chester FC 1. Substitution, Chester FC. Sam Hughes replaces Kane Richards. Goal! Boreham Wood 1, Chester FC 1. Elliott Durrell (Chester FC). Substitution, Boreham Wood. Jordan Chiedozie replaces Morgan Ferrier. Substitution, Boreham Wood. Aaron Kuhl replaces Kenny Davis. Substitution, Chester FC. Elliott Durrell replaces Jordan Chapell. Evan Horwood (Chester FC) is shown the yellow card for a bad foul. Second Half begins Boreham Wood 1, Chester FC 0. First Half ends, Boreham Wood 1, Chester FC 0. Goal! Boreham Wood 1, Chester FC 0. Morgan Ferrier (Boreham Wood). First Half begins. Lineups are announced and players are warming up.
  A major trauma centre in Stoke-on-Trent has been rated the best in the country for saving the lives of patients.	The University Hospitals of North Midlands Major Trauma Centre has the best total rolling survival rates of any adult major trauma single site centre since 2013. Latest statistics show that for every 1,000 people treated in the last four years, 13 more survived than expected. The centre is based at Royal Stoke University Hospital. Medical director Dr John Oxtoby, described it as a "huge accomplishment". See more stories from across Stoke and Staffordshire here The figures come from the Trauma Audit and Research Network, an independent monitor of trauma care in England and Wales. The data shows the centre also had the best survival rates for adult major trauma in 2015-16, when there were 15 extra survivors per 1,000 patients than expected. "To have the best survival rates over four years of any major trauma centre is a phenomenal achievement," Dr Oxtoby added. The centre treats patients from as far away as north Wales and the Peak District. Those treated include people seriously injured in incidents such as vehicle crashes, falls, or assaults.
  Sunderland defender Paddy McNair will miss the rest of the season because of a cruciate knee ligament injury.	The 21-year-old, signed from Manchester United in August, has made 12 appearances for a Black Cats side that are 19th in the Premier League. He was injured during his side's 3-0 win over Hull City on Saturday. "We won't see him again this season and all we can hope is getting him right for the start of next season," said Sunderland boss David Moyes. "I think he'd just started to find his way in the Premier League - even though he had experience at Manchester United - and the games he was having were bringing him on and giving him confidence." The injury means McNair is unlikely to feature in Northern Ireland's World Cup 2018 qualifier against Norway in March.

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

sciq_pairs

• Dataset: sciq_pairs at 2c94ad3
• Size: 4,987 training samples
• Columns: sentence1 and sentence2
• Approximate statistics based on the first 1000 samples:

  	sentence1	sentence2
  type	string	string
  details	min: 7 tokens mean: 16.93 tokens max: 76 tokens	min: 2 tokens mean: 86.84 tokens max: 512 tokens

• Samples:

  sentence1	sentence2
  The procedure known as angioplasty is used when what part of the circulatory system is clogged?	When a blood vessel gets clogged, there is no medical equivalent of "Drano" that will clear it out. There is, however, a procedure known as angioplasty. A thin tube with a balloon is threaded through the blood vessels. Once in place, the balloon is inflated to compress the clog against the artery wall.
  Mollusks such as squid and octopi, which must hunt to survive, possess what complex organs containing millions of neurons?	Figure 35.2 Nervous systems vary in structure and complexity. In (a) cnidarians, nerve cells form a decentralized nerve net. In (b) echinoderms, nerve cells are bundled into fibers called nerves. In animals exhibiting bilateral symmetry such as (c) planarians, neurons cluster into an anterior brain that processes information. In addition to a brain, (d) arthropods have clusters of nerve cell bodies, called peripheral ganglia, located along the ventral nerve cord. Mollusks such as squid and (e) octopi, which must hunt to survive, have complex brains containing millions of neurons. In (f) vertebrates, the brain and spinal cord comprise the central nervous system, while neurons extending into the rest of the body comprise the peripheral nervous system. (credit e: modification of work by Michael Vecchione, Clyde F. Roper, and Michael J. Sweeney, NOAA; credit f: modification of work by NIH).
  Combining nonpolar olive oil and polar vinegar yields what type of mixture?	Another familiar example is the mixing of vinegar and olive oil. Olive oil is a nonpolar substance, while vinegar (which is mostly water and acetic acid) is polar. The result is a heterogeneous mixture that exhibits a bilayer.

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

qasc_pairs

• Dataset: qasc_pairs at a34ba20
• Size: 4,987 training samples
• Columns: sentence1 and sentence2
• Approximate statistics based on the first 1000 samples:

  	sentence1	sentence2
  type	string	string
  details	min: 4 tokens mean: 11.33 tokens max: 22 tokens	min: 13 tokens mean: 33.52 tokens max: 67 tokens

• Samples:

  sentence1	sentence2
  What happens before the rigid structure that surrounds the plant cell dilates?	Dilation occurs when cell walls relax.. Cell wall is the rigid structure that surrounds the plant cell. Dilation occurs when the rigid structure that surrounds the plant cell relaxes.
  Reusing plastic bags has a positive impact on what?	recycling has a positive impact on the environment. Plastic bags are recyclable and they are reusable. Reusing plastic bags has a positive impact on the environment
  What protects the body from harmful substances?	skin is used for protecting the body from harmful substances. Skin is a protective organ. organs protect the body from harmful substances

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

openbookqa_pairs

• Dataset: openbookqa_pairs
• Size: 3,007 training samples
• Columns: question and fact
• Approximate statistics based on the first 1000 samples:

  	question	fact
  type	string	string
  details	min: 3 tokens mean: 13.75 tokens max: 78 tokens	min: 4 tokens mean: 11.34 tokens max: 31 tokens

• Samples:

  question	fact
  Heat exposure at higher temperatures without ability to regulate internal body temperatures will result in the expiration of which of these?	if an organism becomes too hot then that organism may die
  Which of the following would be part of the water cycle?	evaporation is a stage in the water cycle process
  polar bears are white due to an inherited	the color of fur is an inherited characteristic

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

msmarco_pairs

• Dataset: msmarco_pairs at 28ff31e
• Size: 4,987 training samples
• Columns: sentence1 and sentence2
• Approximate statistics based on the first 1000 samples:

  	sentence1	sentence2
  type	string	string
  details	min: 4 tokens mean: 8.68 tokens max: 21 tokens	min: 16 tokens mean: 75.36 tokens max: 238 tokens

• Samples:

  sentence1	sentence2
  how many days is it in a month	Each month has either 28, 30, or 31 days during a common year, which has 365 days. During leap years, which occur nearly every 4 years, we add an extra (intercalary) day, Leap Day, on 29 February, making leap years 366 days long.
  who were the peloponnesian wars between? who won them?	The Greek city-state of Sparta won the war against Athens. The war, known as the Peloponnesian War, raged for 27 years between the Athenian realm and the Peloponnesian coalition commanded by the Spartans. The Peloponnesian War began in 431 B.C.C. and ended in 404 B.C.E. when Athens conceded defeat to Sparta.
  average nurse practitioner salary ny	Nurse Practitioner New York, NY Salary. Nurse Practitioner New York, NY average salary is $91,897, median salary is $79,060 with a salary range from $20,530 to $1,926,393. Nurse Practitioner New York, NY salaries are collected from government agencies and companies. Each salary is associated with a real job position.

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

nq_pairs

• Dataset: nq_pairs at f9e894e
• Size: 4,987 training samples
• Columns: sentence1 and sentence2
• Approximate statistics based on the first 1000 samples:

  	sentence1	sentence2
  type	string	string
  details	min: 10 tokens mean: 11.79 tokens max: 23 tokens	min: 14 tokens mean: 131.1 tokens max: 512 tokens

• Samples:

  sentence1	sentence2
  parks and rec episode where ron gets a hernia	The Stakeout (Parks and Recreation) Back at city hall, Ron (Nick Offerman) remains immobile in his chair all day due to a hernia which causes excruciating pain if he moves. Ron remains immobile in his seat well into the night, until the janitors turn the lights off on him. The intern, April (Aubrey Plaza), returns to check on him, and wheels Ron out to the car on his office chair to bring him to the hospital.
  when did jane beale come back to eastenders	Jane Beale Jane Beale (also Collins and Clarke) is a fictional character from the BBC soap opera, EastEnders, played by Laurie Brett. She made her first appearance on 21 June 2004. Brett took maternity leave in 2011[1] and departed on 19 May.[2] She returned on 8 November[3] and departed again on 27 January 2012.[4][5] Jane made temporary a return to the show on 6 January 2014 until 20 May and permanently from 24 November 2014.[6][7] Her major storylines have included her relationship and later marriages to Ian Beale (Adam Woodyatt); the first ended due to his affair with Glenda Mitchell (Glynis Barber), an affair with Grant Mitchell (Ross Kemp), accidentally shot by Ian's stepson Steven Beale (Aaron Sidwell) which results her desire to have a child of her own following a hysterectomy, a relationship with Masood Ahmed (Nitin Ganatra), her popular friendship with Tanya Branning (Jo Joyner), covering up her adopted son Bobby's (Eliot Carrington) role in the murder of her stepdaughter Lucy Beale (Hetti Bywater), being paralysed after brutally attacked with a hockey stick by Bobby, caught up in the fire at Beale's restaurant, which was started by Steven before she was then left in the blaze by Max Branning (Jake Wood) and being forced by Max to leave Walford which led to a second departure on 23 October 2017.[8] She made a voiceover appearance on 8 December.
  who sings what lovers do with maroon 5	What Lovers Do "What Lovers Do" is a song by American pop rock band Maroon 5 featuring American R&B singer SZA. It was released on August 30, 2017, as the lead single from the band's sixth studio album Red Pill Blues (2017).[4] The song contains an interpolation of the 2016 song "Sexual" by Neiked featuring Dyo, therefore Victor Rådström, Dyo and Elina Stridh are credited as songwriters.

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

trivia_pairs

• Dataset: trivia_pairs at a7c36e3
• Size: 4,987 training samples
• Columns: query and answer
• Approximate statistics based on the first 1000 samples:

  	query	answer
  type	string	string
  details	min: 8 tokens mean: 17.26 tokens max: 64 tokens	min: 24 tokens mean: 205.76 tokens max: 402 tokens

• Samples:

  query	answer
  What word is the most common synonym of the word “corsair”?	Corsair Synonyms, Corsair Antonyms
  "What scale initially related wind conditions to their effects on the sails of a man of war, from ""sufficient for steerage"" to ""which canvas sails couldn't withstand."""	Oil droplets transport due to irregular waves: Development of large-scale spreading coefficients "The sea state can be defined in a variety of ways. For example, one may use the Beaufort scale (Singleton, 2008) that describes the sea state based on qualitative terms. It is an empirical yet expedient scale. " [Show abstract] [Hide abstract] ABSTRACT: The movement of oil droplets due to waves and buoyancy was investigated by assuming an irregular sea state following a JONSWAP spectrum and four buoyancy values. A technique known as Wheeler stretching was used to model the movement of particles under the moving water surface. In each simulation, 500 particles were released and were tracked for a real time of 4.0 h. A Monte Carlo approach was used to obtain ensemble properties. It was found that small eddy diffusivities that decrease rapidly with depth generated the largest horizontal spreading of the plume. It was also found that large eddy diffusivities that decrease slowly with depth generated the smallest horizontal spreading coefficient of the plume. The increase in buoyancy resulted in a decrease in the horizontal spreading coefficient, which suggests that two-dimensional (horizontal) models that predict the transport of surface oil could be overestimating the spreading of oil. Full-text · Article · Jan 2016
  What is the name given to the collection of Welsh legends?	1000+ images about Welsh - Legends & Folklore on Pinterest

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

gooaq_pairs

• Dataset: gooaq_pairs at b089f72
• Size: 4,987 training samples
• Columns: sentence1 and sentence2
• Approximate statistics based on the first 1000 samples:

  	sentence1	sentence2
  type	string	string
  details	min: 8 tokens mean: 11.52 tokens max: 19 tokens	min: 13 tokens mean: 56.25 tokens max: 143 tokens

• Samples:

  sentence1	sentence2
  how long does it take to get used to getting up earlier?	The most efficient method for changing the time you wake up is to do it gradually — 10–15 minutes earlier for 1–3 days until you feel used to it, and then lower it down. If you get up at 8 a.m. generally, don't suddenly change it to 6 a.m. Try 7:45 a.m. first.
  what are the differences among standards goals and objectives?	Standard: Written expectations of what students are expected to know at a specific stage of education. These are based off of learning objectives. Goal: Unique to an individual student. May stem from a standard, but also relates to a student's academic habits and organization.
  how do u work out the surface area of a triangular prism?	A triangular prism has three rectangular sides and two triangular faces. To find the area of the rectangular sides, use the formula A = lw, where A = area, l = length, and h = height. To find the area of the triangular faces, use the formula A = 1/2bh, where A = area, b = base, and h = height.

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

paws-pos

• Dataset: paws-pos at 161ece9
• Size: 4,987 training samples
• Columns: sentence1 and sentence2
• Approximate statistics based on the first 1000 samples:

  	sentence1	sentence2
  type	string	string
  details	min: 8 tokens mean: 25.62 tokens max: 52 tokens	min: 8 tokens mean: 25.61 tokens max: 52 tokens

• Samples:

  sentence1	sentence2
  Primidone also causes exfoliative dermatitis , Johnson -- Stevens syndrome , and toxic epidermal necrolysis .	Primidone also causes exfoliative dermatitis , Johnson - Stevens -- Syndrome and toxic epidermal necrolysis .
  The agency was founded in 1976 in Chicago , and it entered the New York market in 1998 and Milwaukee in 2009 .	The agency was founded in Chicago in 1976 and entered New York in 1998 and Milwaukee in 2009 .
  After his death , the widow of Kellow Mary Hope Kellow with her daughter Mary moved to Sydney .	After his death , Kellow 's widow Mary Hope Kellow moved to Sydney with her daughter Mary .

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

global_dataset

• Dataset: global_dataset
• Size: 36,619 training samples
• Columns: sentence1 and sentence2
• Approximate statistics based on the first 1000 samples:

  	sentence1	sentence2
  type	string	string
  details	min: 4 tokens mean: 28.68 tokens max: 368 tokens	min: 2 tokens mean: 55.88 tokens max: 512 tokens

• Samples:

  sentence1	sentence2
  The Turks , Tibetans , Muslim Arabs , and Tang competed for control of Central Asia until the tang 's collapse in the 10th century .	The Turks , Tang , Muslim Arabs and the Tibetans competed for control over Central Asia until the collapse of the Tang in the 10th century .
  What do animals use to reproduce?	an animal needs to attract a mate to reproduce. Animals mate because of smells. animals attract with smells
  Some touch receptors sense a difference in pain or what?	Some touch receptors sense differences in temperature or pain.. Heat and temperature are the same. Some touch receptors sense differences in heat or pain.

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

Evaluation Datasets

vitaminc-pairs

• Dataset: vitaminc-pairs at be6febb
• Size: 128 evaluation samples
• Columns: claim and evidence
• Approximate statistics based on the first 1000 samples:

  	claim	evidence
  type	string	string
  details	min: 9 tokens mean: 19.71 tokens max: 38 tokens	min: 9 tokens mean: 32.5 tokens max: 78 tokens

• Samples:

  claim	evidence
  Dragon Con had over 5000 guests .	Among the more than 6000 guests and musical performers at the 2009 convention were such notables as Patrick Stewart , William Shatner , Leonard Nimoy , Terry Gilliam , Bruce Boxleitner , James Marsters , and Mary McDonnell .
  COVID-19 has reached more than 185 countries .	As of , more than cases of COVID-19 have been reported in more than 190 countries and 200 territories , resulting in more than deaths .
  In March , Italy had 3.6x times more cases of coronavirus than China .	As of 12 March , among nations with at least one million citizens , Italy has the world 's highest per capita rate of positive coronavirus cases at 206.1 cases per million people ( 3.6x times the rate of China ) and is the country with the second-highest number of positive cases as well as of deaths in the world , after China .

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

negation-triplets

• Dataset: negation-triplets
• Size: 128 evaluation samples
• Columns: anchor, entailment, and negative
• Approximate statistics based on the first 1000 samples:

  	anchor	entailment	negative
  type	string	string	string
  details	min: 8 tokens mean: 14.54 tokens max: 46 tokens	min: 6 tokens mean: 12.12 tokens max: 21 tokens	min: 6 tokens mean: 12.43 tokens max: 22 tokens

• Samples:

  anchor	entailment	negative
  A Marine that is looking at his cell phone.	A marine in uniform using a smart phone.	Not a marine in uniform using a smart phone.
  A snowboarder on a wide plain of snow	A snow field with a snowboarder on it	An empty field with no snowboarder on it
  Three men, one holding pipes, another holding a large object above his head, and one resting against the pipe bed on the truck, are looking at the camera.	three men look at the camera	three men ignore the camera

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

scitail-pairs-pos

• Dataset: scitail-pairs-pos at 0cc4353
• Size: 128 evaluation samples
• Columns: sentence1 and sentence2
• Approximate statistics based on the first 1000 samples:

  	sentence1	sentence2
  type	string	string
  details	min: 9 tokens mean: 20.13 tokens max: 53 tokens	min: 8 tokens mean: 15.48 tokens max: 23 tokens

• Samples:

  sentence1	sentence2
  humans normally have 23 pairs of chromosomes.	Humans typically have 23 pairs pairs of chromosomes.
  A solution is a homogenous mixture of two or more substances that exist in a single phase.	Solution is the term for a homogeneous mixture of two or more substances.
  Upwelling The physical process in near-shore ocean systems of rising of nutrients and colder bottom waters to the surface because of constant wind patterns along the shoreline.	Upwelling is the term for when deep ocean water rises to the surface.

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

scitail-pairs-qa

• Dataset: scitail-pairs-qa at 0cc4353
• Size: 128 evaluation samples
• Columns: sentence1 and sentence2
• Approximate statistics based on the first 1000 samples:

  	sentence1	sentence2
  type	string	string
  details	min: 7 tokens mean: 16.6 tokens max: 33 tokens	min: 8 tokens mean: 15.67 tokens max: 33 tokens

• Samples:

  sentence1	sentence2
  Magma comes toward earth's crust through mantle plumes.	What substance comes toward earth's crust through mantle plumes?
  The understory of the rainforest commonly has ferns and other ground plants.	What part of the rainforest commonly has ferns and other ground plants?
  Because trees add water vapor to air, cutting down forests leads to longer periods of drought.	Because trees add water vapor to air, cutting down forests leads to longer periods of what?

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

xsum-pairs

• Dataset: xsum-pairs
• Size: 128 evaluation samples
• Columns: summary and document
• Approximate statistics based on the first 1000 samples:

  	summary	document
  type	string	string
  details	min: 13 tokens mean: 25.42 tokens max: 46 tokens	min: 67 tokens mean: 213.0 tokens max: 354 tokens

• Samples:

  summary	document
  An exam paper for Scottish secondary pupils is being re-issued after a mistake was spotted.	The National 5 Modern Studies exam will take place on Friday afternoon. The Scottish Qualification Authority (SQA) said the paper has been reprinted because of a typographical error. The exams body said there was no suggestion of a security breach. A spokesman added that it had procedures in place to deal with situations like this. The printing mistake in the original paper was in a diagram, not a question. The SQA said it acted quickly after the error was spotted. The reprinted paper - with the correct text in the diagram but otherwise identical - will be issued to exam centres across Scotland. Last year the Higher English paper was replaced amid fears of a security breach. The SQA also faced criticism over mistakes in the National 5 computing paper. Earlier this month, the SQA announced that teachers would not have access to exam papers until the day after each test takes place. It said the change was in order to improve security and confidentiality. The largest teachers' union, the EIS, has condemned the move.
  US regulators have told seven carmakers the recall of airbags made by Japanese firm Takata is likely to expand.	The National Highway Traffic Safety Administration (NHTSA) has written to firms including Mercedes-Benz, Jaguar-Land Rover and Tesla to ask which of their models use the Takata parts. About 23.4 million Takata airbag inflators have been recalled in the US. The airbags have been linked to eight deaths and more than 100 injuries around the world. It was found they can inflate with excessive force, spraying metal shrapnel at the drivers. The driver and passenger airbags were in more than 19 million cars sold by 11 different companies such as Honda in the US. In the letters sent last week, the NHTSA said the recall "will likely grow to include vehicles that are outside the scope of the current recalls". The agency will attend a public meeting in Washington on 22 October to discuss the Takata investigation and whether it will take over management of the recalls to speed up the repairs. Carmakers are struggling to get parts with only 4.4 million airbag inflators replaced since the start of this month. The other automakers that received the letters include Suzuki, Volvo Trucks, Volkswagen and Spartan Motors. So far Mercedes, Jaguar-Land Rover and Tesla have all said the air bags they used from Takata are not part of current recalls, according to the Associated Press.
  A salt lake in Melbourne has turned pink due to a combination of sunlight, warm temperatures and low rainfall.	Wildlife officers said algae growing in the salt crust at the bottom of Westgate Park's lake produce a red pigment. "Enjoy the views, but we recommend you don't come into contact with the water," Parks Victoria said. The phenomenon also occurs in Spain's Salina de Torrevieja, Canada's Dusty Rose Lake and Senegal's Lake Retba. In Australia, the natural occurring sight can be seen in Victoria's Murray-Sunset National Park and Western Australia's Lake Hillier. You might also be interested in: Dr Mark Norman, Parks Victoria chief conservation scientist, said the colouration was caused by a harmless, single-cell alga known as Dunalliela. "It's completely natural," he said. "We often get comments that it looks like an industrial accident of pink paint." Dr Norman said that even though the water is not dangerous, he would not recommend taking a swim. "It's so salty and muddy on the bottom that you would come out looking like a frosted rum ball, especially when you dried," he said. Parks Victoria said the lake is expected to return to blue when the weather cooled and the rainfall increased.

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

sciq_pairs

• Dataset: sciq_pairs at 2c94ad3
• Size: 128 evaluation samples
• Columns: sentence1 and sentence2
• Approximate statistics based on the first 1000 samples:

  	sentence1	sentence2
  type	string	string
  details	min: 9 tokens mean: 16.98 tokens max: 58 tokens	min: 2 tokens mean: 86.18 tokens max: 512 tokens

• Samples:

  sentence1	sentence2
  What structures receive blood from the atria and pump it out of the heart?	The bottom two chambers of the heart are called the left and right ventricles. The ventricles receive blood from the atria and pump it out of the heart, either to the lungs or to the rest of the body.
  Amphibians have permeable skin which allows for the exchange of oxygen and carbon dioxide, what is this "breathing called?"	Characteristics of Amphibians As tetrapods, most amphibians are characterized by four well-developed limbs. Some species of salamanders and all caecilians are functionally limbless; their limbs are vestigial. An important characteristic of extant amphibians is a moist, permeable skin that is achieved via mucus glands that keep the skin moist; thus, exchange of oxygen and carbon dioxide with the environment can take place through it ( cutaneous respiration). Additional characteristics of amphibians include pedicellate teeth—teeth in which the root and crown are calcified, separated by a zone of noncalcified tissue—and a papilla amphibiorum and papilla basilaris, structures of the inner ear that are sensitive to frequencies below and above 10,00 hertz, respectively. Amphibians also have an auricular operculum, which is an extra bone in the ear that transmits sounds to the inner ear. All extant adult amphibians are carnivorous, and some terrestrial amphibians have a sticky tongue that is used to capture prey.
  What form do alkali metals take at room temperature?	Alkali metals are all solids at room temperature.

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

qasc_pairs

• Dataset: qasc_pairs at a34ba20
• Size: 128 evaluation samples
• Columns: sentence1 and sentence2
• Approximate statistics based on the first 1000 samples:

  	sentence1	sentence2
  type	string	string
  details	min: 5 tokens mean: 11.25 tokens max: 21 tokens	min: 20 tokens mean: 34.65 tokens max: 66 tokens

• Samples:

  sentence1	sentence2
  Warm body temperature requires what?	an animal usually requires a warm body temperature for survival. Most animals require water regularly. a warm body temperature requires water
  what rotates causing cycles of day and night?	a planet rotating causes cycles of day and night on that planet. Of all the planets, Mars is most like Earth. Mars rotating causes cycles of day and night
  What being tilted on its rotating axis causes spring, summer, autumn, and winter.	the Earth being tilted on its rotating axis causes seasons. Spring, summer, autumn, and winter are the seasons of the year. Earth being tilted on its rotating axis causes spring, summer, autumn, and winter.

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

openbookqa_pairs

• Dataset: openbookqa_pairs
• Size: 128 evaluation samples
• Columns: question and fact
• Approximate statistics based on the first 1000 samples:

  	question	fact
  type	string	string
  details	min: 3 tokens mean: 13.96 tokens max: 47 tokens	min: 4 tokens mean: 11.78 tokens max: 28 tokens

• Samples:

  question	fact
  The thermal production of a stove is generically used for	a stove generates heat for cooking usually
  What creates a valley?	a valley is formed by a river flowing
  when it turns day and night on a planet, what cause this?	a planet rotating causes cycles of day and night on that planet

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

msmarco_pairs

• Dataset: msmarco_pairs at 28ff31e
• Size: 128 evaluation samples
• Columns: sentence1 and sentence2
• Approximate statistics based on the first 1000 samples:

  	sentence1	sentence2
  type	string	string
  details	min: 4 tokens mean: 9.1 tokens max: 22 tokens	min: 25 tokens mean: 74.29 tokens max: 200 tokens

• Samples:

  sentence1	sentence2
  tcf routing number illinois	Routing Number 271972572. Tcf National Bank Illinois Routing Number. TCF NATIONAL BANK ILLINOIS ROUTING ABA NUMBER. 271972572 routing number is a 9-digit number designed and assigned to Tcf National Bank Illinois by The American Bankers Association (ABA) to identify the financial institution upon which a payment was drawn.
  why was jamestown so important other then being the first permanent english settlement	Credit: National Park Service. View full size image. Jamestown, founded in 1607, was the first successful permanent English settlement in what would become the United States. It was located on Jamestown Island, in Virginia, about 30 miles (47 kilometers) up the James River from the Atlantic coast.amestown, founded in 1607, was the first successful permanent English settlement in what would become the United States.
  when was the town of farragut tn incorporated	In January of 1980, residents decided to incorporate by an overwhelming margin. The Town of Farragut was incorporated on January 16, 1980, with the first board of Mayor and Alderman elected on April 1, 1980.

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

nq_pairs

• Dataset: nq_pairs at f9e894e
• Size: 128 evaluation samples
• Columns: sentence1 and sentence2
• Approximate statistics based on the first 1000 samples:

  	sentence1	sentence2
  type	string	string
  details	min: 9 tokens mean: 12.24 tokens max: 25 tokens	min: 29 tokens mean: 128.73 tokens max: 512 tokens

• Samples:

  sentence1	sentence2
  when did rodan and fields start direct sales	Rodan + Fields In 2002, Drs. Fields and Rodan launched Rodan + Fields. Products were sold in department stores. In 2003, Rodan + Fields was purchased by Estée Lauder.[1] In 2007, Drs. Fields and Rodan reacquired the brand[4] and transitioned the company from department stores to multi-level marketing, where consultants are paid a commission for their own sales and for the sales of people they recruit.[1]
  what are the house names in harry potter	Hogwarts Hogwarts is divided into four houses, each bearing the last name of its founder: Godric Gryffindor, Salazar Slytherin, Rowena Ravenclaw and Helga Hufflepuff. Throughout the school year, the houses compete for the House Cup, gaining and losing points based on actions such as performance in class and rule violations. The house with the highest end-of-year total wins and has its colours displayed in the Great Hall for the following school year. Each house also has its own Quidditch team that competes for the Quidditch Cup. These two competitions breed rivalries between the houses. Houses at Hogwarts are living and learning communities for their students. Each house is under the authority of one of the Hogwarts staff members. The Heads of the houses, as they are called, are in charge of giving their students important information, dealing with matters of severe punishment, and responding to emergencies in their houses, among other things. Each year, year level groups of every separate house share the same dormitory and classes. The dormitory and common room of a House are, barring rare exceptions, inaccessible to students belonging to other Houses.
  when was calibri font made available for use	Calibri Calibri (/kəˈliːbri/) is a sans-serif typeface family designed by Luc(as) de Groot in 2002–2004 and released to the general public in 2007, with Microsoft Office 2007 and Windows Vista.[2][3] In Office 2007, it replaced Times New Roman as the default typeface in Word[4] and replaced Arial as the default in PowerPoint, Excel, Outlook, and WordPad. Creator de Groot described its subtly rounded design as having "a warm and soft character".[3]

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

trivia_pairs

• Dataset: trivia_pairs at a7c36e3
• Size: 128 evaluation samples
• Columns: query and answer
• Approximate statistics based on the first 1000 samples:

  	query	answer
  type	string	string
  details	min: 8 tokens mean: 16.59 tokens max: 38 tokens	min: 27 tokens mean: 199.75 tokens max: 373 tokens

• Samples:

  query	answer
  Theodore Francis international airport is in which US state?	Theodore Francis Green State Airport, Providence RI Hotels Near the Airport T. F. Green Airport (sometimes called T. F. Green International Airport) (IATA: PVD, ICAO: KPVD, FAA LID: PVD) , also known as Theodore Francis Green State Airport and Providence International Airport is located in Warwick, six miles (10 km) south of Providence, in Kent County, Rhode Island, USA. Completely rebuilt in 1996, it was the first state-owned airport in the United States. Providence International Airport is a popular alternative to Boston, Massachusetts' often busy Logan International Airport, as delays and wait time are minimal. There are two terminals with two concourses, North and South. The South Concourse has eight gates, and the North Concourse has 14 gates. Gate 8 is designed for international arrivals for use by Air Canada and SATA International flights; it is directly connected to customs, which is on the lower level of the concourse. The terminal contains a number of stores and restaurants, and a central food court. Local Time: 17-Jan-2017 12:02 AM © Copyright 2017, Providence-Airport.com, not the official airport website
  What is the English for ‘Duirt me leat go raibh me breoite’?	Duirt mé leat go raibh mé breoite – Susan Hated Literature That is the enscription on Spike Milligan’s headstone . For those of you without Irish it is a translation of what he wanted: “I told you I was ill.” Duirt mé (I told) pronounced durtch may (like the month) leat (you) pronounced lat go raibh mé (that I was) pronounced not like the english go, but the o is sorta like “uh”; raibh can have a variety of pronunciations, I’d usually say row (as in to fight, not to do anything in a boat), but you could say rev, or rav, and mé is may (again) breoite (ill) pronounced bro-tcha Here endeth the very bad Irish lesson, from which you are probably more confuddled than you were before? On a secondary issue, why is the Irish language constantly described as Gaelic? It’s Irish, or Gaeilge. The latter only if you are speaking as Gaeilge. I mean I don’t say that some German person was speaking in Deutsch unless I’m attempting to say it in German. This is a pet peeve of mine, feel free to ignore :)
  Which group sung the 1997 Eurovision Song Contest winning Love Shine A Light?	Eurovision 1997 - Katrina & The Waves - Love shine a light - YouTube Eurovision 1997 - Katrina & The Waves - Love shine a light Want to watch this again later? Sign in to add this video to a playlist. Need to report the video? Sign in to report inappropriate content. Rating is available when the video has been rented. This feature is not available right now. Please try again later. Uploaded on Sep 14, 2008 Eurovision 1997 - Katrina & The Waves - Love shine a light Category

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

gooaq_pairs

• Dataset: gooaq_pairs at b089f72
• Size: 128 evaluation samples
• Columns: sentence1 and sentence2
• Approximate statistics based on the first 1000 samples:

  	sentence1	sentence2
  type	string	string
  details	min: 8 tokens mean: 11.01 tokens max: 17 tokens	min: 15 tokens mean: 57.03 tokens max: 96 tokens

• Samples:

  sentence1	sentence2
  can i use full synthetic oil in my snowblower?	So, while synthetic will do better in temperature extremes, (extremes not seen in a properly running snow blower) it will get dirty at the same rate as regular oil. Therefore we will need to replace it at the same intervals as regular oil, but at a greater cost.
  what is the difference between primary and foreign key in sql?	Difference between Primary Key and Foreign Key. Primary key uniquely identify a record in the table. Foreign key is a field in the table that is primary key in another table. ... By default, Primary key is clustered index and data in the database table is physically organized in the sequence of clustered index.
  how to change administrator windows 10?	['Under Settings > Accounts > Family & other users, select the account owner name, then select Change account type.', 'Under Account type, select Administrator and OK.', 'Sign in with the new administrator account.']

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

paws-pos

• Dataset: paws-pos at 161ece9
• Size: 128 evaluation samples
• Columns: sentence1 and sentence2
• Approximate statistics based on the first 1000 samples:

  	sentence1	sentence2
  type	string	string
  details	min: 10 tokens mean: 25.58 tokens max: 41 tokens	min: 10 tokens mean: 25.4 tokens max: 41 tokens

• Samples:

  sentence1	sentence2
  They were there to enjoy us and they were there to pray for us .	They were there for us to enjoy and they were there for us to pray .
  After the end of the war in June 1902 , Higgins left Southampton in the `` SSBavarian '' in August , returning to Cape Town the following month .	In August , after the end of the war in June 1902 , Higgins Southampton left the `` SSBavarian '' and returned to Cape Town the following month .
  From the merger of the Four Rivers Council and the Audubon Council , the Shawnee Trails Council was born .	Shawnee Trails Council was formed from the merger of the Four Rivers Council and the Audubon Council .

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

global_dataset

• Dataset: global_dataset
• Size: 325 evaluation samples
• Columns: sentence1 and sentence2
• Approximate statistics based on the first 1000 samples:

  	sentence1	sentence2
  type	string	string
  details	min: 5 tokens mean: 31.88 tokens max: 344 tokens	min: 2 tokens mean: 55.72 tokens max: 512 tokens

• Samples:

  sentence1	sentence2
  when was the world cup	In the first World Cup final, held on July 30, 1930, 93,000 spectators looked on as Uruguay defeated Argentina 4–2 in a rematch of the 1928 Olympic gold medal game. Uruguay went on to win its second World Cup in 1950 with a 2-1 win over Brazil in Rio de Janeiro.
  Highlands-based Neil Anderson set up the camera in a part of Strathspey in the Cairngorms. He said: "I knew the cat used a path fairly regularly and seeing that snow was forecast I rigged up my camera trap. "I went away for a couple of weeks so when I finally checked the camera it was a great surprise to come back to." The wildcat was photographed on 13 January. Mr Anderson, whose credits include commissions for the BBC's Springwatch wildlife programmes, also photographs wildlife in other parts of the world. The Scottish wildcat is one of the world's most endangered animals. Habitat loss and breeding with domestic and feral cats are factors behind a severe decline in the mammals.	A rare Scottish wildcat has been photographed on a camera trap rigged up by a wildlife cameraman.
  can phi be disclosed for marketing purposes?	The Privacy Rule addresses the use and disclosure of protected health information for marketing purposes by: ... Requiring individual authorization for all uses or disclosures of protected health information for marketing purposes with limited exceptions.

• Loss: CachedGISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.025}
  

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: steps
• per_device_train_batch_size: 64
• per_device_eval_batch_size: 128
• gradient_accumulation_steps: 3
• learning_rate: 1.5e-05
• weight_decay: 0.001
• num_train_epochs: 2
• lr_scheduler_type: cosine_with_min_lr
• lr_scheduler_kwargs: {'num_cycles': 0.5, 'min_lr': 1.5e-06}
• warmup_ratio: 0.25
• save_safetensors: False
• fp16: True
• push_to_hub: True
• hub_model_id: bobox/DeBERTa2-0.9B-ST-v2-checkpoints-tmp
• hub_strategy: all_checkpoints
• batch_sampler: no_duplicates

All Hyperparameters

Click to expand

• overwrite_output_dir: False
• do_predict: False
• eval_strategy: steps
• prediction_loss_only: True
• per_device_train_batch_size: 64
• per_device_eval_batch_size: 128
• per_gpu_train_batch_size: None
• per_gpu_eval_batch_size: None
• gradient_accumulation_steps: 3
• eval_accumulation_steps: None
• learning_rate: 1.5e-05
• weight_decay: 0.001
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• max_grad_norm: 1.0
• num_train_epochs: 2
• max_steps: -1
• lr_scheduler_type: cosine_with_min_lr
• lr_scheduler_kwargs: {'num_cycles': 0.5, 'min_lr': 1.5e-06}
• warmup_ratio: 0.25
• warmup_steps: 0
• log_level: passive
• log_level_replica: warning
• log_on_each_node: True
• logging_nan_inf_filter: True
• save_safetensors: False
• save_on_each_node: False
• save_only_model: False
• restore_callback_states_from_checkpoint: False
• no_cuda: False
• use_cpu: False
• use_mps_device: False
• seed: 42
• data_seed: None
• jit_mode_eval: False
• use_ipex: False
• bf16: False
• fp16: True
• fp16_opt_level: O1
• half_precision_backend: auto
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• local_rank: 0
• ddp_backend: None
• tpu_num_cores: None
• tpu_metrics_debug: False
• debug: []
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_prefetch_factor: None
• past_index: -1
• disable_tqdm: False
• remove_unused_columns: True
• label_names: None
• load_best_model_at_end: False
• ignore_data_skip: False
• fsdp: []
• fsdp_min_num_params: 0
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• fsdp_transformer_layer_cls_to_wrap: None
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• deepspeed: None
• label_smoothing_factor: 0.0
• optim: adamw_torch
• optim_args: None
• adafactor: False
• group_by_length: False
• length_column_name: length
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• skip_memory_metrics: True
• use_legacy_prediction_loop: False
• push_to_hub: True
• resume_from_checkpoint: None
• hub_model_id: bobox/DeBERTa2-0.9B-ST-v2-checkpoints-tmp
• hub_strategy: all_checkpoints
• hub_private_repo: False
• hub_always_push: False
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• include_inputs_for_metrics: False
• eval_do_concat_batches: True
• fp16_backend: auto
• push_to_hub_model_id: None
• push_to_hub_organization: None
• mp_parameters:
• auto_find_batch_size: False
• full_determinism: False
• torchdynamo: None
• ray_scope: last
• ddp_timeout: 1800
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• dispatch_batches: None
• split_batches: None
• include_tokens_per_second: False
• include_num_input_tokens_seen: False
• neftune_noise_alpha: None
• optim_target_modules: None
• batch_eval_metrics: False
• eval_on_start: False
• batch_sampler: no_duplicates
• multi_dataset_batch_sampler: proportional

Training Logs

Click to expand

Epoch	Step	Training Loss	xsum-pairs loss	global dataset loss	scitail-pairs-pos loss	nq pairs loss	qasc pairs loss	trivia pairs loss	scitail-pairs-qa loss	vitaminc-pairs loss	sciq pairs loss	negation-triplets loss	gooaq pairs loss	msmarco pairs loss	openbookqa pairs loss	paws-pos loss	Qnli-dev_max_ap	allNLI-dev_max_ap	sts-test_spearman_cosine
0.0058	3	7.8503	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.0116	6	8.4022	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.0174	9	11.1776	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.0231	12	9.7845	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.0289	15	8.9224	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.0347	18	11.1202	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.0405	21	7.413	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.0463	24	7.7803	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.0501	26	-	5.3947	6.3484	2.5062	10.4474	6.6809	6.1073	2.9786	4.1224	0.8978	3.9176	8.0953	15.7827	6.4026	1.6077	0.6094	0.3453	0.3223
0.0521	27	7.9729	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.0578	30	6.0587	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.0636	33	5.6742	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.0694	36	6.5406	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.0752	39	5.4429	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.0810	42	6.7855	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.0868	45	5.3403	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.0925	48	4.2282	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.0983	51	4.7411	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.1003	52	-	4.4624	3.8914	1.1342	6.2954	4.8895	5.7900	2.0086	3.9298	0.7183	3.2670	5.7852	7.5325	3.4273	0.4783	0.5957	0.4051	0.5257
0.1041	54	3.9082	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.1099	57	4.3922	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.1157	60	3.2655	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.1215	63	3.1043	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.1272	66	2.2074	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.1330	69	1.4414	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.1388	72	1.5937	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.1446	75	1.0306	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.1504	78	1.0784	0.4360	0.6714	0.1109	1.2714	1.3059	1.0828	0.1282	3.7639	0.2034	1.4773	0.7032	1.3856	1.1711	0.0449	0.6293	0.4747	0.8291
0.1562	81	0.9674	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.1620	84	0.9335	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.1677	87	0.8806	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.1735	90	0.631	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.1793	93	0.3384	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.1851	96	0.404	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.1909	99	0.6488	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.1967	102	0.4728	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.2005	104	-	0.1409	0.3990	0.0726	0.5425	0.4244	0.6438	0.0485	3.3142	0.1505	1.3401	0.2238	0.5883	0.5924	0.0358	0.7154	0.5430	0.8863
0.2024	105	0.5094	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.2082	108	0.8002	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.2140	111	0.3886	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.2198	114	0.6937	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.2256	117	0.2909	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.2314	120	0.3885	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.2371	123	0.29	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.2429	126	0.3485	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.2487	129	0.3931	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.2506	130	-	0.0513	0.3591	0.0457	0.2678	0.2206	0.1540	0.0365	3.8795	0.1231	1.1135	0.1206	0.2162	0.4568	0.0261	0.6993	0.5638	0.9082
0.2545	132	0.3394	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.2603	135	0.1276	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.2661	138	0.3569	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.2719	141	0.1231	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.2776	144	0.3086	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.2834	147	0.3541	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.2892	150	0.2597	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.2950	153	0.1585	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.3008	156	0.1436	0.0503	0.2959	0.0376	0.2004	0.1717	0.0823	0.0410	3.8346	0.0871	0.9441	0.0767	0.1350	0.4304	0.0213	0.7239	0.5807	0.9177
0.3066	159	0.1941	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.3123	162	0.3041	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.3181	165	0.2358	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.3239	168	0.2148	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.3297	171	0.8567	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.3355	174	0.3668	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.3413	177	0.3278	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.3470	180	0.474	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.3509	182	-	0.0382	0.3900	0.0550	0.2525	0.1511	0.0624	0.1251	3.8444	0.0825	0.8706	0.1212	0.4176	0.7894	0.0209	0.7187	0.5555	0.9103
0.3528	183	0.5365	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.3586	186	0.6902	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.3644	189	0.4105	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.3702	192	0.2434	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.3760	195	0.1521	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.3817	198	0.1878	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.3875	201	0.3544	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.3933	204	0.1397	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.3991	207	0.2982	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.4010	208	-	0.0290	0.2504	0.0209	0.2429	0.1335	0.0537	0.0243	3.2105	0.0851	0.6793	0.0728	0.0954	0.4361	0.0224	0.7266	0.5853	0.9212
0.4049	210	0.1875	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.4107	213	0.169	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.4165	216	0.2341	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.4222	219	0.1806	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.4280	222	0.2736	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.4338	225	0.1772	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.4396	228	0.131	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.4454	231	0.0825	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.4512	234	0.2745	0.0315	0.2459	0.0264	0.2080	0.1237	0.0534	0.0236	3.4479	0.0854	0.6366	0.0623	0.0320	0.4140	0.0188	0.7252	0.5810	0.9186
0.4569	237	0.131	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.4627	240	0.2012	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.4685	243	0.0855	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.4743	246	0.1181	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.4801	249	0.0992	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.4859	252	0.0375	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.4916	255	0.1503	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.4974	258	0.1239	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.5013	260	-	0.0130	0.2468	0.0173	0.1420	0.1050	0.0554	0.0256	2.7884	0.0917	0.6254	0.0432	0.4505	0.4391	0.0200	0.7392	0.5874	0.9206
0.5032	261	0.1849	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.5090	264	0.0453	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.5148	267	0.118	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.5206	270	0.2285	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.5263	273	0.072	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.5321	276	0.1449	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.5379	279	0.2179	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.5437	282	0.0687	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.5495	285	0.071	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.5514	286	-	0.0061	0.2986	0.0183	0.1662	0.1212	0.0679	0.0217	3.9508	0.0967	0.6451	0.0508	0.0296	0.4552	0.0236	0.7463	0.5938	0.9179
0.5553	288	0.0855	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.5611	291	0.103	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.5668	294	0.1555	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.5726	297	0.1069	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.5784	300	0.2014	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.5842	303	0.1028	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.5900	306	0.2425	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.5958	309	0.1639	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.6015	312	0.099	0.0050	0.2365	0.0077	0.0879	0.1507	0.0483	0.0146	3.3625	0.0870	0.5403	0.0421	0.0490	0.4215	0.0250	0.7519	0.5889	0.9191
0.6073	315	0.1218	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.6131	318	0.1575	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.6189	321	0.178	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.6247	324	0.0777	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.6305	327	0.0696	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.6362	330	0.1206	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.6420	333	0.0926	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.6478	336	0.1357	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.6517	338	-	0.0059	0.1910	0.0106	0.1182	0.1399	0.0288	0.0014	3.1742	0.0752	0.5640	0.0658	0.0380	0.4194	0.0252	0.7395	0.5983	0.9249
0.6536	339	0.1234	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.6594	342	0.1056	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.6652	345	0.1525	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.6710	348	0.1425	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.6767	351	0.1401	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.6825	354	0.1271	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.6883	357	0.0598	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.6941	360	0.0681	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.6999	363	0.1132	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.7018	364	-	0.0103	0.2425	0.0113	0.0261	0.0636	0.0199	0.0031	3.7764	0.0742	0.5828	0.0730	0.0260	0.3494	0.0232	0.7288	0.5859	0.9237
0.7057	366	0.0714	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.7114	369	0.1816	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.7172	372	0.1609	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.7230	375	0.1123	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.7288	378	0.1906	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.7346	381	0.0689	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.7404	384	0.1897	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.7461	387	0.1268	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.7519	390	0.1256	0.0064	0.1842	0.0084	0.0449	0.0450	0.0288	0.0021	3.1047	0.0667	0.5752	0.0530	0.0238	0.3462	0.0247	0.7399	0.5969	0.9273
0.7577	393	0.1201	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.7635	396	0.0995	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.7693	399	0.0825	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.7751	402	0.0778	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.7808	405	0.0696	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.7866	408	0.1332	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.7924	411	0.0684	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.7982	414	0.2002	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.8021	416	-	0.0040	0.1487	0.0090	0.0566	0.0831	0.0294	0.0034	2.4590	0.0779	0.5903	0.0677	0.0167	0.3658	0.0260	0.7521	0.6094	0.9273
0.8040	417	0.0455	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.8098	420	0.15	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.8156	423	0.1232	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.8213	426	0.193	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.8271	429	0.1856	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.8329	432	0.0898	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.8387	435	0.0242	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.8445	438	0.0693	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.8503	441	0.1245	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.8522	442	-	0.0069	0.1455	0.0086	0.0449	0.0873	0.0173	0.0023	2.7578	0.0706	0.5208	0.0646	0.0137	0.3374	0.0260	0.7479	0.6047	0.9263
0.8560	444	0.114	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.8618	447	0.0713	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.8676	450	0.1336	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.8734	453	0.0612	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.8792	456	0.1083	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.8850	459	0.0584	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.8907	462	0.0929	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.8965	465	0.066	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.9023	468	0.0423	0.0033	0.1635	0.0082	0.0396	0.0649	0.0181	0.0039	2.9874	0.0643	0.5298	0.0726	0.0085	0.3434	0.0263	0.7469	0.6148	0.9274
0.9081	471	0.0809	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.9139	474	0.3409	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.9197	477	0.0726	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.9254	480	0.101	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.9312	483	0.0944	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.9370	486	0.0431	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.9428	489	0.1061	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.9486	492	0.0843	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.9524	494	-	0.0037	0.2037	0.0072	0.0217	0.0711	0.0133	0.0121	3.5029	0.0671	0.4939	0.0774	0.0053	0.3318	0.0254	0.7531	0.6148	0.9238
0.9544	495	0.1177	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.9602	498	0.1513	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.9659	501	0.1944	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.9717	504	0.0969	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.9775	507	0.1293	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.9833	510	0.15	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.9891	513	0.046	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
0.9949	516	0.1007	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.0006	519	0.0359	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.0026	520	-	0.0082	0.1803	0.0151	0.0323	0.0395	0.0216	0.0192	3.2003	0.0655	0.5109	0.0655	0.0125	0.3490	0.0268	0.7571	0.6092	0.9309
1.0064	522	0.0547	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.0122	525	0.0669	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.0180	528	0.0965	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.0238	531	0.1971	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.0296	534	0.0637	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.0353	537	0.0341	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.0411	540	0.0513	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.0469	543	0.0435	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.0527	546	0.2092	0.0050	0.2294	0.0091	0.0332	0.0594	0.0088	0.0137	3.7179	0.0693	0.4823	0.0706	0.0153	0.4174	0.0269	0.7441	0.6121	0.9259
1.0585	549	0.054	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.0643	552	0.046	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.0701	555	0.0982	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.0758	558	0.0441	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.0816	561	0.1141	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.0874	564	0.1131	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.0932	567	0.0423	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.0990	570	0.1062	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.1028	572	-	0.0078	0.1511	0.0157	0.0469	0.0278	0.0130	0.0196	2.5838	0.0720	0.4972	0.0634	0.0129	0.3413	0.0289	0.7696	0.6270	0.9246
1.1048	573	0.0428	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.1105	576	0.2265	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.1163	579	0.0881	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.1221	582	0.0932	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.1279	585	0.0474	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.1337	588	0.0512	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.1395	591	0.0316	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.1452	594	0.1243	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.1510	597	0.0416	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.1530	598	-	0.0054	0.1718	0.0119	0.0454	0.0240	0.0164	0.0349	3.1179	0.0790	0.5401	0.0685	0.0077	0.3325	0.0261	0.7455	0.6176	0.9281
1.1568	600	0.0591	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.1626	603	0.1668	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.1684	606	0.1302	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.1742	609	0.0912	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.1799	612	0.0357	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.1857	615	0.0239	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.1915	618	0.0682	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.1973	621	0.0634	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.2031	624	0.1228	0.0042	0.1740	0.0106	0.0218	0.0461	0.0092	0.0024	3.1393	0.0768	0.5298	0.0594	0.0093	0.3543	0.0274	0.7508	0.6279	0.9260
1.2089	627	0.1741	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.2147	630	0.0413	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.2204	633	0.1496	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.2262	636	0.0229	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.2320	639	0.0871	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.2378	642	0.0785	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.2436	645	0.2074	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.2494	648	0.0647	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.2532	650	-	0.0026	0.1904	0.0103	0.0195	0.0470	0.0090	0.0005	3.3713	0.0704	0.5323	0.0584	0.0123	0.3422	0.0279	0.7599	0.6287	0.9222
1.2551	651	0.0664	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.2609	654	0.012	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.2667	657	0.1048	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.2725	660	0.0221	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.2783	663	0.1205	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.2841	666	0.1324	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.2898	669	0.0897	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.2956	672	0.0388	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.3014	675	0.0425	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.3033	676	-	0.0032	0.2147	0.0083	0.0181	0.0401	0.0095	0.0011	3.6178	0.0722	0.5532	0.0449	0.0059	0.3618	0.0274	0.7621	0.6191	0.9233
1.3072	678	0.0356	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.3130	681	0.0997	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.3188	684	0.0517	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.3246	687	0.0348	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.3303	690	0.2454	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.3361	693	0.0975	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.3419	696	0.1477	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.3477	699	0.0737	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.3535	702	0.1786	0.0040	0.1623	0.0145	0.0152	0.0326	0.0065	0.0013	3.0246	0.0690	0.5546	0.0335	0.0082	0.3399	0.0281	0.7760	0.6212	0.9250
1.3593	705	0.1141	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.3650	708	0.072	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.3708	711	0.0617	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.3766	714	0.0886	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.3824	717	0.047	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.3882	720	0.1327	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.3940	723	0.0498	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.3997	726	0.0671	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.4036	728	-	0.0041	0.1652	0.0181	0.0105	0.0391	0.0076	0.0017	3.1377	0.0692	0.5127	0.0450	0.0100	0.3439	0.0285	0.7675	0.6126	0.9263
1.4055	729	0.0376	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.4113	732	0.027	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.4171	735	0.1266	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.4229	738	0.1187	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.4287	741	0.0168	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.4344	744	0.0214	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.4402	747	0.0473	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.4460	750	0.0086	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.4518	753	0.1337	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.4537	754	-	0.0027	0.1709	0.0130	0.0092	0.0235	0.0074	0.0014	3.3135	0.0679	0.5448	0.0443	0.0048	0.3484	0.0279	0.7719	0.6258	0.9266
1.4576	756	0.0334	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.4634	759	0.0601	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.4692	762	0.0268	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.4749	765	0.0265	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.4807	768	0.0137	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.4865	771	0.0073	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.4923	774	0.0395	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.4981	777	0.02	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.5039	780	0.0329	0.0020	0.1861	0.0087	0.0081	0.0226	0.0090	0.0018	3.5041	0.0706	0.5487	0.0464	0.0043	0.3515	0.0270	0.7594	0.6210	0.9306
1.5096	783	0.0126	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.5154	786	0.13	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.5212	789	0.0177	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.5270	792	0.0164	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.5328	795	0.0367	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.5386	798	0.0544	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.5443	801	0.0135	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.5501	804	0.0159	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.5540	806	-	0.0027	0.1521	0.0080	0.0088	0.0182	0.0095	0.0014	2.8949	0.0700	0.5246	0.0340	0.0050	0.3503	0.0280	0.7704	0.6211	0.9278
1.5559	807	0.0181	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.5617	810	0.0109	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.5675	813	0.031	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.5733	816	0.0907	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.5790	819	0.0256	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.5848	822	0.0171	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.5906	825	0.0809	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.5964	828	0.0451	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.6022	831	0.0205	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.6041	832	-	0.0031	0.1462	0.0077	0.0086	0.0192	0.0109	0.0021	2.6891	0.0708	0.5463	0.0337	0.0052	0.3298	0.0282	0.7747	0.6249	0.9243
1.6080	834	0.009	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.6138	837	0.0213	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.6195	840	0.0679	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.6253	843	0.0184	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.6311	846	0.0119	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.6369	849	0.041	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.6427	852	0.0318	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.6485	855	0.0245	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.6542	858	0.0765	0.0037	0.1507	0.0073	0.0145	0.0233	0.0102	0.0017	2.8041	0.0741	0.5282	0.0355	0.0056	0.3279	0.0284	0.7719	0.6267	0.9254
1.6600	861	0.0247	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.6658	864	0.0407	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.6716	867	0.042	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.6774	870	0.024	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.6832	873	0.0223	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.6889	876	0.0268	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.6947	879	0.0049	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.7005	882	0.0371	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.7044	884	-	0.0034	0.1573	0.0073	0.0088	0.0218	0.0106	0.0025	2.9740	0.0741	0.5448	0.0370	0.0044	0.3086	0.0280	0.7681	0.6227	0.9274
1.7063	885	0.0131	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.7121	888	0.0397	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.7179	891	0.0324	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.7237	894	0.026	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.7294	897	0.0436	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.7352	900	0.0117	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.7410	903	0.044	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.7468	906	0.028	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.7526	909	0.0324	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.7545	910	-	0.0029	0.1603	0.0063	0.0110	0.0201	0.0089	0.0017	3.0405	0.0740	0.5347	0.0382	0.0045	0.3147	0.0275	0.7685	0.6262	0.9274
1.7584	912	0.019	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.7641	915	0.0037	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.7699	918	0.0182	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.7757	921	0.0199	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.7815	924	0.0298	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.7873	927	0.0387	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.7931	930	0.031	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.7988	933	0.0587	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.8046	936	0.0186	0.0025	0.1647	0.0061	0.0109	0.0183	0.0073	0.0014	3.0794	0.0717	0.5319	0.0372	0.0041	0.3218	0.0273	0.7687	0.6308	0.9269
1.8104	939	0.0476	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.8162	942	0.0394	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.8220	945	0.0692	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.8278	948	0.0501	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.8335	951	0.0315	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.8393	954	0.0055	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.8451	957	0.0105	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.8509	960	0.0182	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.8548	962	-	0.0020	0.1701	0.0057	0.0119	0.0172	0.0063	0.0014	3.1208	0.0714	0.5205	0.0394	0.0040	0.3202	0.0273	0.7645	0.6263	0.9282
1.8567	963	0.0259	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.8625	966	0.0149	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.8683	969	0.0319	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.8740	972	0.0126	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.8798	975	0.0293	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.8856	978	0.0055	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.8914	981	0.031	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.8972	984	0.0127	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.9030	987	0.0058	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.9049	988	-	0.0022	0.1574	0.0067	0.0111	0.0139	0.0067	0.0015	2.9796	0.0695	0.5309	0.0410	0.0041	0.3159	0.0275	0.7671	0.6260	0.9278
1.9087	990	0.0141	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.9145	993	0.1319	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.9203	996	0.0166	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.9261	999	0.0121	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.9319	1002	0.0301	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.9377	1005	0.0067	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.9434	1008	0.0216	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.9492	1011	0.0094	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.9550	1014	0.0686	0.0023	0.1575	0.0065	0.0095	0.0121	0.0072	0.0016	2.9838	0.0695	0.5424	0.0417	0.0042	0.3157	0.0274	0.7660	0.6270	0.9279
1.9608	1017	0.0271	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.9666	1020	0.069	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.9724	1023	0.0303	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.9781	1026	0.0391	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.9839	1029	0.0428	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.9897	1032	0.0106	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.9955	1035	0.0478	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
1.9974	1036	-	0.0022	0.1650	0.0061	0.0085	0.0121	0.0072	0.0017	3.0683	0.0704	0.5342	0.0425	0.0044	0.3159	0.0273	0.7646	0.6281	0.9284

Framework Versions

• Python: 3.10.12
• Sentence Transformers: 3.0.1
• Transformers: 4.42.4
• PyTorch: 2.4.0+cu121
• Accelerate: 0.32.1
• Datasets: 2.21.0
• Tokenizers: 0.19.1

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}