File size: 42,489 Bytes
c4e00cd |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 801 802 803 804 805 806 807 808 809 810 811 812 813 814 815 816 817 818 819 820 821 822 823 824 825 826 827 828 829 830 831 832 833 834 835 836 837 838 839 840 841 842 |
---
base_model: cross-encoder/ms-marco-MiniLM-L-6-v2
datasets: []
language: []
library_name: sentence-transformers
pipeline_tag: sentence-similarity
tags:
- sentence-transformers
- sentence-similarity
- feature-extraction
- generated_from_trainer
- dataset_size:9729
- loss:MultipleNegativesRankingLoss
widget:
- source_sentence: Does the clock stop during the drop-off in Touch Rugby?
sentences:
- 12. 2 if a player from the defending team deliberately makes contact with the
ball in flight and the ball is retrieved by an attacking player, without touching
the ground, play continues and the next touch is zero ( 0 ) touch. 12. 3 if a
player from the defending team deliberately makes contact with the ball in flight,
propelling it forward and an attacking player, in an attempt to regain possession,
drops the ball, the attacking team retains possession and the fit playing rules
- 5th edition 10 copyright © touch football australia 2020 touch count restarts
as zero ( 0 ) touch. 12. 4 if a player from the defending team deliberately makes
contact with the ball in flight, propelling it towards the defending team ’ s
dead ball line and an attacking player, in an attempt to regain possession drops
the ball, a change of possession occurs. 12. 5 if a player from the defending
team unintentionally makes contact with the ball in flight and the ball goes to
ground, a change of possession occurs. 12. 6 if a player from the defending team
unintentionally makes contact with the ball in flight and the ball is retrieved
by an attacking player, play and the touch count continues.
- fit playing rules - 5th edition copyright © touch football australia 2020 9 10.
11 if a touch is made on a player in possession while the player is juggling the
ball in an attempt to maintain control of it, the touch counts if the attacking
player following the touch retains possession. 10. 12 if a player in possession
is touched and subsequently makes contact with either the sideline, a field marker
or the ground outside the field of play, the touch counts and play continues with
a rollball at the mark where the touch occurred. 10. 13 when a player from the
defending team enters its defensive seven metre zone, the defending team must
move forward at a reasonable pace until a touch is imminent or made. ruling =
a penalty to the attacking team at the point of the infringement. 10. 14 when
a player in possession enters the defending teams ’ seven metre zone the defending
team is not obliged to move forward but cannot retire back towards their try line
until a touch is imminent or made. ruling = a penalty to the attacking team at
the seven ( 7 ) metre line in line with the point of the infringement.
- 24. 1. 2 the drop - off commences with a tap from the centre of the halfway line
by the team that did not commence the match with possession. 24. 1. 3 the drop
- off will commence with a two ( 2 ) minute period of extra time. 24. 1. 4 should
a team be leading at the expiration of the two ( 2 ) minute period of extra time
then that team will be declared the winner and match complete. 24. 1. 5 should
neither team be leading at the expiration of two ( 2 ) minutes, a signal is given
and the match will pause at the next touch or dead ball. each team will then remove
another player from the field of play. 24. 1. 6 the match will recommence immediately
after the players have left the field at the same place where it paused ( i. e.
the team retains possession at the designated number of touches, or at change
of possession due to some infringement or the sixth touch ) and the match will
continue until a try is scored. 24. 1. 7 there is no time off during the drop
- off and the clock does not stop at the two ( 2 ) minute interval.
- source_sentence: What happens to the possession of the ball when a player is sent
to the sin bin?
sentences:
- 'fit playing rules - 5th edition copyright © touch football australia 2020 appendix
1 – field of play contents 01 i the field of play 5 02 i player registration 5
03 i the ball 6 04 i playing uniform 6 05 i team composition 6 06 i team coach
and team officials 7 07 i commencement and recommencement of play 7 08 i match
duration 8 09 i possession 8 10 i the touch 9 11 i passing 10 12 i ball touched
in flight 10 13 i the rollball 11 14 i scoring 13 15 i offside 13 16 i obstruction
14 17 i interchange 14 18 i penalty 15 19 i advantage 16 20 i misconduct 16 21
i forced interchange 16 22 i sin bin 16 23 i dismissal 17 24 i drop - off 17 25
i match officials 18 fit playing rules - 5th edition copyright © touch football
australia 2020 fit playing rules - 5th edition copyright © touch football australia
2020 definitions and terminology unless the contrary intention appears, the following
definitions and terminology apply to the game of touch : term / phrase definition
/ description advantage the period of time after an infringement in which the
non - offending side has the opportunity to gain advantage either territorial,
tactical or in the form of a try. attacking try line the line on or over which
a player has to place the ball to score a try.'
- 21 forced interchange 21. 1 where the referee deems it necessary to implement
a forced interchange following an infringement, the referee is to stop the match,
direct the ball to be placed on the mark, advise the offending player of the reason
for the forced interchange, direct that player to return to the interchange area,
display the relevant signal and award a penalty to the non - offending team. 22
sin bin 22. 1 the on - field referee is required to indicate the commencement
and the end of the sin bin time. 22. 2 any player sent to the sin bin must stand
in the sin bin area at the opposition ’ s end of the field of play and on the
same side as their interchange area. 22. 3 any player sent to the sin bin must
return to the interchange area prior to re - entering the field of play. 22. 4
any action that causes the touch count to restart will result in a continuation
of that possession. for the avoidance of doubt, should a defender knock the ball
down or give away a penalty, this does not mean that the possession has been completed,
but rather the possession continues.
- 10. 8 if a touch is made in the in - goal area before the ball is grounded, the
player in possession is to perform a rollball seven ( 7 ) metres from the team
’ s attacking try line, provided it is not the sixth touch and the player is not
half. 10. 9 if a player in possession is touched while on or behind their defending
try line, the touch counts and once the referee sets the mark seven ( 7 ) metres
directly forward of the contact point from the defending team ’ s try line, a
rollball is performed. 10. 10 if a player in possession intentionally makes a
touch on an offside defender who is making every effort to retire and remain out
of play, the touch counts. fit playing rules - 5th edition copyright © touch football
australia 2020 9 10. 11 if a touch is made on a player in possession while the
player is juggling the ball in an attempt to maintain control of it, the touch
counts if the attacking player following the touch retains possession.
- source_sentence: Under what circumstances is a penalty try awarded in Touch Rugby?
sentences:
- 13. 14 after a touch is made between the dead ball line and the seven ( 7 ) metre
line, an attacking team is permitted to rollball on the seven ( 7 ) metre line
at a point directly in line with where the touch was made. fit playing rules -
5th edition 12 copyright © touch football australia 2020 14 scoring 14. 1 a try
is worth one ( 1 ) point. 14. 2 a try is awarded when a player, other than the
half, places the ball on or over the try line without being touched. 14. 3 in
attempting to score a try, a player must have control of the ball prior to placing
it on or over the try line. 14. 4 if a player places the ball on the ground and
releases it short of the try line while attempting to score a try, the player
is required to perform a rollball to restart play and a touch is counted. if a
player does not release the ball from their hands, the match continues and no
touch is counted. 14. 5 at the end of play the team that has scored the most tries
is declared the winner.
- fit playing rules - 5th edition 8 copyright © touch football australia 2020 9.
6 if a player mishandles the ball and even if in an effort to gain control, the
ball is accidentally knocked forward into any other player, a change of possession
results. 10 the touch 10. 1 a touch may be made by either a defending player or
a player in possession. 10. 2 a defending player may not claim a touch if contact
has not been made. if a player claims a touch has been made, but the referee is
unsure the touch will count. ruling = a penalty to the attacking team at the point
of the infringement and the offending player sent to the sin bin. 10. 3 players
of both defending and attacking teams are to use the minimum force necessary to
make a touch. players must ensure that the method employed in making a touch does
not pose an unnecessary risk to player safety. ruling = a penalty to the non -
offending team at the point of the infringement. 10. 4 if the ball is accidentally
knocked from the hands of a player in possession during a touch, the touch counts
and the attacking team retains possession.
- 18. 7 a player may perform a rollball instead of a penalty tap and the player
who receives the ball does not become the half. 18. 8 if the defending team is
penalised three ( 3 ) times upon entering their seven metre zone during a single
possession, the last offending player will be given an exclusion until the end
of that possession. 18. 9 a penalty try is awarded if any action by a player,
team official or spectator, deemed by the referee to be contrary to the rules
or spirit of the game clearly prevents the attacking team from scoring a try.
fit playing rules - 5th edition copyright © touch football australia 2020 15 19
advantage 19. 1 where a defending team player is offside at a tap or rollball
and attempts to interfere with play, the referee will allow advantage or award
a penalty, whichever is of greater advantage to the attacking team. 19. 2 should
the attacking team in the act of taking the advantage subsequently infringe, the
ruling on the initial infringement will apply.
- source_sentence: What is the maximum distance the ball can move after a tap in Touch
Rugby?
sentences:
- tap and tap penalty the method of commencing the match, recommencing the match
after half time and after a try has been scored. the tap is also the method of
recommencing play when a penalty is awarded. the tap is taken by placing the ball
on the ground at or behind the mark, releasing both hands from the ball, tapping
the ball gently with either foot or touching the foot on the ball. the ball must
not roll or move more than one ( 1 ) metre in any direction and must be retrieved
cleanly, without touching the ground again. the player may face any direction
and use either foot. provided it is at the mark, the ball does not have to be
lifted from the ground prior to a tap being taken. team a group of players constituting
one ( 1 ) side in a competition match. tfa touch football australia limited touch
any contact between the player in possession and a defending player. a touch includes
contact on the ball, hair or clothing and may be made by a defending player or
by the player in possession. touch count the progressive number of touches that
each team has before a change of possession, from zero ( 0 ) to six ( 6 ).
- a player with both feet on or behind their defending try line. pass the act of
changing possession between individual attacking players by propelling the ball
laterally and / or backwards and may include a flick, knock or throw. perimeter
a border not less than five ( 5 ) metres from the boundary of the field of play.
see appendix 1. penalty the ruling by a referee to award a tap when a player or
team infringes the rules of the game. possession refers to the player or team
that has control of the ball. providing other rules do not apply, the team with
the ball is entitled to six ( 6 ) touches. referee the match official ( s ) appointed
to make rulings during the conduct of a match. rollball the act of bringing the
ball into play following a touch or a change of possession. ruck / rollball area
the area, not exceeding one ( 1 ) metre in distance, between the player performing
a rollball and the half. ruling the decision made by a referee as a result of
particular circumstance and may result in a play on, a tap penalty, a discipline
option, change of possession or a try. seven metre zone the area between the seven
( 7 ) metre line and the try line.
- 5th edition rules touch football tion rules touch football touch football australia
( tfa ) undertook an extensive internal review of their domestic playing rules
throughout 2018 and 2019. the review was led by an vastly experienced group of
current and past players, coaches, referees and administrators of the sport from
community competitions to the elite international game. this group consulted broadly
within the australian community to develop a set of playing rules that could be
applied across all levels of the sport. the result was the tfa 8th edition playing
rules. at the federation of international touch paris convention held in october
2019 touch football australia presented the tfa 8th edition playing rules and
subsequently offered fit and all national touch associations ( ntas ) royalty
free rights to use the newly developed rules. consequently, the fit board resolved
to adopt the tfa 8th edition playing rules as the 5th edition fit playing rules
to be used across all levels of the game internationally. fit and its members
acknowledge and thank touch football australia for the rights to use these rules.
whilst consistency in the application of the rules of the game is important, fit
encourages its members to offer features in local competition rules to ensure
that all participants enjoy a high quality experience.
- source_sentence: What is the minimum number of digits allowed for identifying numbers
according to clause 4.3.1?
sentences:
- 9. 2 on the change of possession due to an intercept, the first touch will be
zero ( 0 ) touch. 9. 3 following the sixth touch or a loss of possession due to
any other means, the ball must be returned to the mark without delay. ruling =
a deliberate delay in the changeover procedure will result in a penalty awarded
to the non - offending team ten ( 10 ) metres forward of the mark for the change
of possession. 9. 4 if the ball is dropped or passed and goes to ground during
play, a change of possession results. ruling = the mark for the change of possession
is where the ball makes initial contact with the ground. 9. 5 if the ball, while
still under the control of the half, contacts the ground in the in - goal area,
possession is lost. ruling = play will restart with a rollball at the nearest
point on the seven ( 7 ) metre line. fit playing rules - 5th edition 8 copyright
© touch football australia 2020 9. 6 if a player mishandles the ball and even
if in an effort to gain control, the ball is accidentally knocked forward into
any other player, a change of possession results.
- 2. 2 teams playing unregistered players are liable to forfeit any match in which
unregistered players have competed. fit playing rules - 5th edition copyright
© touch football australia 2020 5 3 the ball 3. 1 the game is played with an oval,
inflated ball of a shape, colour and size approved by fit or the nta. 3. 2 the
ball shall be inflated to the manufacturers ’ recommended air pressure. 3. 3 the
referee shall immediately pause the match if the size and shape of the ball no
longer complies with clauses 3. 1 or 3. 2 to allow for the ball to replaced or
the issue rectified. 3. 4 the ball must not be hidden under player attire. 4 playing
uniform 4. 1 participating players are to be correctly attired in matching team
uniforms 4. 2 playing uniforms consist of shirt, singlet or other item as approved
by the nta or nta competition provider, shorts and / or tights and socks. 4. 3
all players are to wear a unique identifying number not less than 16cm in height,
clearly displayed on the rear of the playing top. 4. 3. 1 identifying numbers
must feature no more than two ( 2 ) digits.
- '24. 5 for the avoidance of doubt for clauses 24. 3 and 24. 4 the non - offending
team will retain a numerical advantage on the field of play during the drop -
off. 25 match officials 25. 1 the referee is the sole judge on all match related
matters inside the perimeter for the duration of a match, has jurisdiction over
all players, coaches and officials and is required to : 25. 1. 1 inspect the field
of play, line markings and markers prior to the commencement of the match to ensure
the safety of all participants. 25. 1. 2 adjudicate on the rules of the game ;
25. 1. 3 impose any sanction necessary to control the match ; 25. 1. 4 award tries
and record the progressive score ; 25. 1. 5 maintain a count of touches during
each possession ; 25. 1. 6 award penalties for infringements against the rules
; and 25. 1. 7 report to the relevant competition administration any sin bins,
dismissals or injuries to any participant sustained during a match. 25. 2 only
team captains are permitted to seek clarification of a decision directly from
the referee. an approach may only be made during a break in play or at the discretion
of the referee.'
---
# SentenceTransformer based on cross-encoder/ms-marco-MiniLM-L-6-v2
This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [cross-encoder/ms-marco-MiniLM-L-6-v2](https://huggingface.co/cross-encoder/ms-marco-MiniLM-L-6-v2). It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
## Model Details
### Model Description
- **Model Type:** Sentence Transformer
- **Base model:** [cross-encoder/ms-marco-MiniLM-L-6-v2](https://huggingface.co/cross-encoder/ms-marco-MiniLM-L-6-v2) <!-- at revision b2cfda50a1a9fc7919e7444afbb52610d268af92 -->
- **Maximum Sequence Length:** 512 tokens
- **Output Dimensionality:** 384 tokens
- **Similarity Function:** Cosine Similarity
<!-- - **Training Dataset:** Unknown -->
<!-- - **Language:** Unknown -->
<!-- - **License:** Unknown -->
### Model Sources
- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
### Full Model Architecture
```
SentenceTransformer(
(0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel
(1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)
```
## Usage
### Direct Usage (Sentence Transformers)
First install the Sentence Transformers library:
```bash
pip install -U sentence-transformers
```
Then you can load this model and run inference.
```python
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("Trelis/ms-marco-MiniLM-L-6-v2-2-cst-ep-MNRLtriplets-2e-5-batch32-gpu-overlap")
# Run inference
sentences = [
'What is the minimum number of digits allowed for identifying numbers according to clause 4.3.1?',
'2. 2 teams playing unregistered players are liable to forfeit any match in which unregistered players have competed. fit playing rules - 5th edition copyright © touch football australia 2020 5 3 the ball 3. 1 the game is played with an oval, inflated ball of a shape, colour and size approved by fit or the nta. 3. 2 the ball shall be inflated to the manufacturers ’ recommended air pressure. 3. 3 the referee shall immediately pause the match if the size and shape of the ball no longer complies with clauses 3. 1 or 3. 2 to allow for the ball to replaced or the issue rectified. 3. 4 the ball must not be hidden under player attire. 4 playing uniform 4. 1 participating players are to be correctly attired in matching team uniforms 4. 2 playing uniforms consist of shirt, singlet or other item as approved by the nta or nta competition provider, shorts and / or tights and socks. 4. 3 all players are to wear a unique identifying number not less than 16cm in height, clearly displayed on the rear of the playing top. 4. 3. 1 identifying numbers must feature no more than two ( 2 ) digits.',
'24. 5 for the avoidance of doubt for clauses 24. 3 and 24. 4 the non - offending team will retain a numerical advantage on the field of play during the drop - off. 25 match officials 25. 1 the referee is the sole judge on all match related matters inside the perimeter for the duration of a match, has jurisdiction over all players, coaches and officials and is required to : 25. 1. 1 inspect the field of play, line markings and markers prior to the commencement of the match to ensure the safety of all participants. 25. 1. 2 adjudicate on the rules of the game ; 25. 1. 3 impose any sanction necessary to control the match ; 25. 1. 4 award tries and record the progressive score ; 25. 1. 5 maintain a count of touches during each possession ; 25. 1. 6 award penalties for infringements against the rules ; and 25. 1. 7 report to the relevant competition administration any sin bins, dismissals or injuries to any participant sustained during a match. 25. 2 only team captains are permitted to seek clarification of a decision directly from the referee. an approach may only be made during a break in play or at the discretion of the referee.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 384]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]
```
<!--
### Direct Usage (Transformers)
<details><summary>Click to see the direct usage in Transformers</summary>
</details>
-->
<!--
### Downstream Usage (Sentence Transformers)
You can finetune this model on your own dataset.
<details><summary>Click to expand</summary>
</details>
-->
<!--
### Out-of-Scope Use
*List how the model may foreseeably be misused and address what users ought not to do with the model.*
-->
<!--
## Bias, Risks and Limitations
*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
-->
<!--
### Recommendations
*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
-->
## Training Details
### Training Hyperparameters
#### Non-Default Hyperparameters
- `eval_strategy`: steps
- `per_device_train_batch_size`: 32
- `per_device_eval_batch_size`: 32
- `learning_rate`: 2e-05
- `num_train_epochs`: 2
- `lr_scheduler_type`: constant
- `warmup_ratio`: 0.3
- `bf16`: True
#### All Hyperparameters
<details><summary>Click to expand</summary>
- `overwrite_output_dir`: False
- `do_predict`: False
- `eval_strategy`: steps
- `prediction_loss_only`: True
- `per_device_train_batch_size`: 32
- `per_device_eval_batch_size`: 32
- `per_gpu_train_batch_size`: None
- `per_gpu_eval_batch_size`: None
- `gradient_accumulation_steps`: 1
- `eval_accumulation_steps`: None
- `learning_rate`: 2e-05
- `weight_decay`: 0.0
- `adam_beta1`: 0.9
- `adam_beta2`: 0.999
- `adam_epsilon`: 1e-08
- `max_grad_norm`: 1.0
- `num_train_epochs`: 2
- `max_steps`: -1
- `lr_scheduler_type`: constant
- `lr_scheduler_kwargs`: {}
- `warmup_ratio`: 0.3
- `warmup_steps`: 0
- `log_level`: passive
- `log_level_replica`: warning
- `log_on_each_node`: True
- `logging_nan_inf_filter`: True
- `save_safetensors`: True
- `save_on_each_node`: False
- `save_only_model`: False
- `restore_callback_states_from_checkpoint`: False
- `no_cuda`: False
- `use_cpu`: False
- `use_mps_device`: False
- `seed`: 42
- `data_seed`: None
- `jit_mode_eval`: False
- `use_ipex`: False
- `bf16`: True
- `fp16`: False
- `fp16_opt_level`: O1
- `half_precision_backend`: auto
- `bf16_full_eval`: False
- `fp16_full_eval`: False
- `tf32`: None
- `local_rank`: 0
- `ddp_backend`: None
- `tpu_num_cores`: None
- `tpu_metrics_debug`: False
- `debug`: []
- `dataloader_drop_last`: False
- `dataloader_num_workers`: 0
- `dataloader_prefetch_factor`: None
- `past_index`: -1
- `disable_tqdm`: False
- `remove_unused_columns`: True
- `label_names`: None
- `load_best_model_at_end`: False
- `ignore_data_skip`: False
- `fsdp`: []
- `fsdp_min_num_params`: 0
- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
- `fsdp_transformer_layer_cls_to_wrap`: None
- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
- `deepspeed`: None
- `label_smoothing_factor`: 0.0
- `optim`: adamw_torch
- `optim_args`: None
- `adafactor`: False
- `group_by_length`: False
- `length_column_name`: length
- `ddp_find_unused_parameters`: None
- `ddp_bucket_cap_mb`: None
- `ddp_broadcast_buffers`: False
- `dataloader_pin_memory`: True
- `dataloader_persistent_workers`: False
- `skip_memory_metrics`: True
- `use_legacy_prediction_loop`: False
- `push_to_hub`: False
- `resume_from_checkpoint`: None
- `hub_model_id`: None
- `hub_strategy`: every_save
- `hub_private_repo`: False
- `hub_always_push`: False
- `gradient_checkpointing`: False
- `gradient_checkpointing_kwargs`: None
- `include_inputs_for_metrics`: False
- `eval_do_concat_batches`: True
- `fp16_backend`: auto
- `push_to_hub_model_id`: None
- `push_to_hub_organization`: None
- `mp_parameters`:
- `auto_find_batch_size`: False
- `full_determinism`: False
- `torchdynamo`: None
- `ray_scope`: last
- `ddp_timeout`: 1800
- `torch_compile`: False
- `torch_compile_backend`: None
- `torch_compile_mode`: None
- `dispatch_batches`: None
- `split_batches`: None
- `include_tokens_per_second`: False
- `include_num_input_tokens_seen`: False
- `neftune_noise_alpha`: None
- `optim_target_modules`: None
- `batch_eval_metrics`: False
- `eval_on_start`: False
- `batch_sampler`: batch_sampler
- `multi_dataset_batch_sampler`: proportional
</details>
### Training Logs
<details><summary>Click to expand</summary>
| Epoch | Step | Training Loss | loss |
|:------:|:----:|:-------------:|:------:|
| 0.0066 | 2 | 4.4256 | - |
| 0.0131 | 4 | 4.1504 | - |
| 0.0197 | 6 | 4.0494 | - |
| 0.0262 | 8 | 4.0447 | - |
| 0.0328 | 10 | 3.9851 | - |
| 0.0393 | 12 | 3.9284 | - |
| 0.0459 | 14 | 3.9155 | - |
| 0.0525 | 16 | 3.8791 | - |
| 0.0590 | 18 | 3.8663 | - |
| 0.0656 | 20 | 3.9012 | - |
| 0.0721 | 22 | 3.8999 | - |
| 0.0787 | 24 | 3.7895 | - |
| 0.0852 | 26 | 3.7235 | - |
| 0.0918 | 28 | 3.7938 | - |
| 0.0984 | 30 | 3.5057 | - |
| 0.1049 | 32 | 3.5776 | - |
| 0.1115 | 34 | 3.5092 | - |
| 0.1180 | 36 | 3.7226 | - |
| 0.1246 | 38 | 3.5426 | - |
| 0.1311 | 40 | 3.7318 | - |
| 0.1377 | 42 | 3.529 | - |
| 0.1443 | 44 | 3.5977 | - |
| 0.1508 | 46 | 3.6484 | - |
| 0.1574 | 48 | 3.5026 | - |
| 0.1639 | 50 | 3.4568 | - |
| 0.1705 | 52 | 3.6119 | - |
| 0.1770 | 54 | 3.4206 | - |
| 0.1836 | 56 | 3.3701 | - |
| 0.1902 | 58 | 3.3232 | - |
| 0.1967 | 60 | 3.3398 | - |
| 0.2033 | 62 | 3.333 | - |
| 0.2098 | 64 | 3.3587 | - |
| 0.2164 | 66 | 3.1304 | - |
| 0.2230 | 68 | 3.0618 | - |
| 0.2295 | 70 | 3.145 | - |
| 0.2361 | 72 | 3.2074 | - |
| 0.2426 | 74 | 3.0436 | - |
| 0.2492 | 76 | 3.0572 | - |
| 0.2525 | 77 | - | 3.0810 |
| 0.2557 | 78 | 3.1225 | - |
| 0.2623 | 80 | 2.8197 | - |
| 0.2689 | 82 | 2.8979 | - |
| 0.2754 | 84 | 2.7827 | - |
| 0.2820 | 86 | 2.9472 | - |
| 0.2885 | 88 | 2.918 | - |
| 0.2951 | 90 | 2.7035 | - |
| 0.3016 | 92 | 2.6876 | - |
| 0.3082 | 94 | 2.8322 | - |
| 0.3148 | 96 | 2.6335 | - |
| 0.3213 | 98 | 2.3754 | - |
| 0.3279 | 100 | 3.0978 | - |
| 0.3344 | 102 | 2.4946 | - |
| 0.3410 | 104 | 2.5085 | - |
| 0.3475 | 106 | 2.7456 | - |
| 0.3541 | 108 | 2.3934 | - |
| 0.3607 | 110 | 2.3222 | - |
| 0.3672 | 112 | 2.4773 | - |
| 0.3738 | 114 | 2.6684 | - |
| 0.3803 | 116 | 2.2435 | - |
| 0.3869 | 118 | 2.243 | - |
| 0.3934 | 120 | 2.228 | - |
| 0.4 | 122 | 2.4652 | - |
| 0.4066 | 124 | 2.2113 | - |
| 0.4131 | 126 | 2.0805 | - |
| 0.4197 | 128 | 2.5041 | - |
| 0.4262 | 130 | 2.4489 | - |
| 0.4328 | 132 | 2.2474 | - |
| 0.4393 | 134 | 2.0252 | - |
| 0.4459 | 136 | 2.257 | - |
| 0.4525 | 138 | 1.9381 | - |
| 0.4590 | 140 | 2.0183 | - |
| 0.4656 | 142 | 2.1021 | - |
| 0.4721 | 144 | 2.1508 | - |
| 0.4787 | 146 | 1.9669 | - |
| 0.4852 | 148 | 1.7468 | - |
| 0.4918 | 150 | 1.8776 | - |
| 0.4984 | 152 | 1.8081 | - |
| 0.5049 | 154 | 1.6799 | 1.6088 |
| 0.5115 | 156 | 1.9628 | - |
| 0.5180 | 158 | 1.8253 | - |
| 0.5246 | 160 | 1.7791 | - |
| 0.5311 | 162 | 1.8463 | - |
| 0.5377 | 164 | 1.6357 | - |
| 0.5443 | 166 | 1.6531 | - |
| 0.5508 | 168 | 1.6747 | - |
| 0.5574 | 170 | 1.5666 | - |
| 0.5639 | 172 | 1.7272 | - |
| 0.5705 | 174 | 1.6045 | - |
| 0.5770 | 176 | 1.3786 | - |
| 0.5836 | 178 | 1.6547 | - |
| 0.5902 | 180 | 1.6416 | - |
| 0.5967 | 182 | 1.4796 | - |
| 0.6033 | 184 | 1.4595 | - |
| 0.6098 | 186 | 1.4106 | - |
| 0.6164 | 188 | 1.4844 | - |
| 0.6230 | 190 | 1.4581 | - |
| 0.6295 | 192 | 1.4922 | - |
| 0.6361 | 194 | 1.2978 | - |
| 0.6426 | 196 | 1.2612 | - |
| 0.6492 | 198 | 1.4725 | - |
| 0.6557 | 200 | 1.3162 | - |
| 0.6623 | 202 | 1.3736 | - |
| 0.6689 | 204 | 1.4553 | - |
| 0.6754 | 206 | 1.4011 | - |
| 0.6820 | 208 | 1.2523 | - |
| 0.6885 | 210 | 1.3732 | - |
| 0.6951 | 212 | 1.3721 | - |
| 0.7016 | 214 | 1.5262 | - |
| 0.7082 | 216 | 1.2631 | - |
| 0.7148 | 218 | 1.6174 | - |
| 0.7213 | 220 | 1.4252 | - |
| 0.7279 | 222 | 1.3527 | - |
| 0.7344 | 224 | 1.1969 | - |
| 0.7410 | 226 | 1.2901 | - |
| 0.7475 | 228 | 1.4379 | - |
| 0.7541 | 230 | 1.1332 | - |
| 0.7574 | 231 | - | 1.0046 |
| 0.7607 | 232 | 1.3693 | - |
| 0.7672 | 234 | 1.3097 | - |
| 0.7738 | 236 | 1.2314 | - |
| 0.7803 | 238 | 1.0873 | - |
| 0.7869 | 240 | 1.2882 | - |
| 0.7934 | 242 | 1.1723 | - |
| 0.8 | 244 | 1.1748 | - |
| 0.8066 | 246 | 1.2916 | - |
| 0.8131 | 248 | 1.0894 | - |
| 0.8197 | 250 | 1.2299 | - |
| 0.8262 | 252 | 1.207 | - |
| 0.8328 | 254 | 1.1361 | - |
| 0.8393 | 256 | 1.1323 | - |
| 0.8459 | 258 | 1.0927 | - |
| 0.8525 | 260 | 1.1433 | - |
| 0.8590 | 262 | 1.1088 | - |
| 0.8656 | 264 | 1.1384 | - |
| 0.8721 | 266 | 1.0962 | - |
| 0.8787 | 268 | 1.1878 | - |
| 0.8852 | 270 | 1.0113 | - |
| 0.8918 | 272 | 1.1411 | - |
| 0.8984 | 274 | 1.0289 | - |
| 0.9049 | 276 | 1.0163 | - |
| 0.9115 | 278 | 1.2859 | - |
| 0.9180 | 280 | 0.9449 | - |
| 0.9246 | 282 | 1.0941 | - |
| 0.9311 | 284 | 1.0908 | - |
| 0.9377 | 286 | 1.1028 | - |
| 0.9443 | 288 | 1.0633 | - |
| 0.9508 | 290 | 1.1004 | - |
| 0.9574 | 292 | 1.0483 | - |
| 0.9639 | 294 | 1.0064 | - |
| 0.9705 | 296 | 1.0088 | - |
| 0.9770 | 298 | 1.0068 | - |
| 0.9836 | 300 | 1.1903 | - |
| 0.9902 | 302 | 0.9401 | - |
| 0.9967 | 304 | 0.8369 | - |
| 1.0033 | 306 | 0.5046 | - |
| 1.0098 | 308 | 1.0626 | 0.8660 |
| 1.0164 | 310 | 0.9587 | - |
| 1.0230 | 312 | 1.0565 | - |
| 1.0295 | 314 | 1.1329 | - |
| 1.0361 | 316 | 1.1857 | - |
| 1.0426 | 318 | 0.9777 | - |
| 1.0492 | 320 | 0.9883 | - |
| 1.0557 | 322 | 0.9076 | - |
| 1.0623 | 324 | 0.7942 | - |
| 1.0689 | 326 | 1.1952 | - |
| 1.0754 | 328 | 0.9726 | - |
| 1.0820 | 330 | 1.0663 | - |
| 1.0885 | 332 | 1.0337 | - |
| 1.0951 | 334 | 0.9522 | - |
| 1.1016 | 336 | 0.9813 | - |
| 1.1082 | 338 | 0.9057 | - |
| 1.1148 | 340 | 1.0076 | - |
| 1.1213 | 342 | 0.8557 | - |
| 1.1279 | 344 | 0.9341 | - |
| 1.1344 | 346 | 0.9188 | - |
| 1.1410 | 348 | 1.091 | - |
| 1.1475 | 350 | 0.8205 | - |
| 1.1541 | 352 | 1.0509 | - |
| 1.1607 | 354 | 0.9201 | - |
| 1.1672 | 356 | 1.0741 | - |
| 1.1738 | 358 | 0.8662 | - |
| 1.1803 | 360 | 0.9468 | - |
| 1.1869 | 362 | 0.8604 | - |
| 1.1934 | 364 | 0.8141 | - |
| 1.2 | 366 | 0.9475 | - |
| 1.2066 | 368 | 0.8407 | - |
| 1.2131 | 370 | 0.764 | - |
| 1.2197 | 372 | 0.798 | - |
| 1.2262 | 374 | 0.8205 | - |
| 1.2328 | 376 | 0.7995 | - |
| 1.2393 | 378 | 0.9305 | - |
| 1.2459 | 380 | 0.858 | - |
| 1.2525 | 382 | 0.8465 | - |
| 1.2590 | 384 | 0.7691 | - |
| 1.2623 | 385 | - | 0.7879 |
| 1.2656 | 386 | 1.0073 | - |
| 1.2721 | 388 | 0.8026 | - |
| 1.2787 | 390 | 0.8108 | - |
| 1.2852 | 392 | 0.7783 | - |
| 1.2918 | 394 | 0.8766 | - |
| 1.2984 | 396 | 0.8576 | - |
| 1.3049 | 398 | 0.884 | - |
| 1.3115 | 400 | 0.9547 | - |
| 1.3180 | 402 | 0.9231 | - |
| 1.3246 | 404 | 0.8027 | - |
| 1.3311 | 406 | 0.9117 | - |
| 1.3377 | 408 | 0.7743 | - |
| 1.3443 | 410 | 0.8257 | - |
| 1.3508 | 412 | 0.8738 | - |
| 1.3574 | 414 | 0.972 | - |
| 1.3639 | 416 | 0.8297 | - |
| 1.3705 | 418 | 0.8941 | - |
| 1.3770 | 420 | 0.8513 | - |
| 1.3836 | 422 | 0.7588 | - |
| 1.3902 | 424 | 0.8332 | - |
| 1.3967 | 426 | 0.7682 | - |
| 1.4033 | 428 | 0.7916 | - |
| 1.4098 | 430 | 0.9519 | - |
| 1.4164 | 432 | 1.0526 | - |
| 1.4230 | 434 | 0.8724 | - |
| 1.4295 | 436 | 0.8267 | - |
| 1.4361 | 438 | 0.7672 | - |
| 1.4426 | 440 | 0.7977 | - |
| 1.4492 | 442 | 0.6947 | - |
| 1.4557 | 444 | 0.9042 | - |
| 1.4623 | 446 | 0.8971 | - |
| 1.4689 | 448 | 0.9655 | - |
| 1.4754 | 450 | 0.8512 | - |
| 1.4820 | 452 | 0.9421 | - |
| 1.4885 | 454 | 0.9501 | - |
| 1.4951 | 456 | 0.8214 | - |
| 1.5016 | 458 | 0.9335 | - |
| 1.5082 | 460 | 0.7617 | - |
| 1.5148 | 462 | 0.8601 | 0.7855 |
| 1.5213 | 464 | 0.757 | - |
| 1.5279 | 466 | 0.7389 | - |
| 1.5344 | 468 | 0.8146 | - |
| 1.5410 | 470 | 0.9235 | - |
| 1.5475 | 472 | 0.9901 | - |
| 1.5541 | 474 | 0.9624 | - |
| 1.5607 | 476 | 0.8909 | - |
| 1.5672 | 478 | 0.7276 | - |
| 1.5738 | 480 | 0.9444 | - |
| 1.5803 | 482 | 0.874 | - |
| 1.5869 | 484 | 0.7985 | - |
| 1.5934 | 486 | 0.9335 | - |
| 1.6 | 488 | 0.8108 | - |
| 1.6066 | 490 | 0.7779 | - |
| 1.6131 | 492 | 0.8807 | - |
| 1.6197 | 494 | 0.8146 | - |
| 1.6262 | 496 | 0.9218 | - |
| 1.6328 | 498 | 0.8439 | - |
| 1.6393 | 500 | 0.7348 | - |
| 1.6459 | 502 | 0.8533 | - |
| 1.6525 | 504 | 0.7695 | - |
| 1.6590 | 506 | 0.7911 | - |
| 1.6656 | 508 | 0.837 | - |
| 1.6721 | 510 | 0.731 | - |
| 1.6787 | 512 | 0.911 | - |
| 1.6852 | 514 | 0.7963 | - |
| 1.6918 | 516 | 0.7719 | - |
| 1.6984 | 518 | 0.8011 | - |
| 1.7049 | 520 | 0.7428 | - |
| 1.7115 | 522 | 0.8159 | - |
| 1.7180 | 524 | 0.7833 | - |
| 1.7246 | 526 | 0.7934 | - |
| 1.7311 | 528 | 0.7854 | - |
| 1.7377 | 530 | 0.8398 | - |
| 1.7443 | 532 | 0.7875 | - |
| 1.7508 | 534 | 0.7282 | - |
| 1.7574 | 536 | 0.8269 | - |
| 1.7639 | 538 | 0.8033 | - |
| 1.7672 | 539 | - | 0.7595 |
| 1.7705 | 540 | 0.9471 | - |
| 1.7770 | 542 | 0.941 | - |
| 1.7836 | 544 | 0.725 | - |
| 1.7902 | 546 | 0.8978 | - |
| 1.7967 | 548 | 0.8361 | - |
| 1.8033 | 550 | 0.7092 | - |
| 1.8098 | 552 | 0.809 | - |
| 1.8164 | 554 | 0.9399 | - |
| 1.8230 | 556 | 0.769 | - |
| 1.8295 | 558 | 0.7381 | - |
| 1.8361 | 560 | 0.7554 | - |
| 1.8426 | 562 | 0.8553 | - |
| 1.8492 | 564 | 0.919 | - |
| 1.8557 | 566 | 0.7479 | - |
| 1.8623 | 568 | 0.8381 | - |
| 1.8689 | 570 | 0.7911 | - |
| 1.8754 | 572 | 0.8076 | - |
| 1.8820 | 574 | 0.7868 | - |
| 1.8885 | 576 | 0.9147 | - |
| 1.8951 | 578 | 0.7271 | - |
| 1.9016 | 580 | 0.7201 | - |
| 1.9082 | 582 | 0.7538 | - |
| 1.9148 | 584 | 0.7522 | - |
| 1.9213 | 586 | 0.7737 | - |
| 1.9279 | 588 | 0.7187 | - |
| 1.9344 | 590 | 0.8713 | - |
| 1.9410 | 592 | 0.7971 | - |
| 1.9475 | 594 | 0.8226 | - |
| 1.9541 | 596 | 0.7074 | - |
| 1.9607 | 598 | 0.804 | - |
| 1.9672 | 600 | 0.7259 | - |
| 1.9738 | 602 | 0.7758 | - |
| 1.9803 | 604 | 0.8209 | - |
| 1.9869 | 606 | 0.7918 | - |
| 1.9934 | 608 | 0.7467 | - |
| 2.0 | 610 | 0.4324 | - |
</details>
### Framework Versions
- Python: 3.10.12
- Sentence Transformers: 3.0.1
- Transformers: 4.42.3
- PyTorch: 2.1.1+cu121
- Accelerate: 0.31.0
- Datasets: 2.17.1
- Tokenizers: 0.19.1
## Citation
### BibTeX
#### Sentence Transformers
```bibtex
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}
```
#### MultipleNegativesRankingLoss
```bibtex
@misc{henderson2017efficient,
title={Efficient Natural Language Response Suggestion for Smart Reply},
author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
year={2017},
eprint={1705.00652},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```
<!--
## Glossary
*Clearly define terms in order to be accessible across audiences.*
-->
<!--
## Model Card Authors
*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
-->
<!--
## Model Card Contact
*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
--> |