|
--- |
|
base_model: sentence-transformers/multi-qa-MiniLM-L6-dot-v1 |
|
datasets: [] |
|
language: [] |
|
library_name: sentence-transformers |
|
pipeline_tag: sentence-similarity |
|
tags: |
|
- sentence-transformers |
|
- sentence-similarity |
|
- feature-extraction |
|
- generated_from_trainer |
|
- dataset_size:188 |
|
- loss:MultipleNegativesRankingLoss |
|
widget: |
|
- source_sentence: What is the minimum force that players of both defending and attacking |
|
teams should use when making a touch? |
|
sentences: |
|
- 'touch football australia 2020 11 13. 5. 5 when possession changes after the half |
|
is touched or when the half places the ball on or over the try line ; or 13. 5. |
|
6 in replacement of a penalty tap ; or 13. 5. 7 when so directed by the referee. |
|
13. 6 a player is to perform a rollball seven ( 7 ) metres in - field under the |
|
following circumstances : 13. 6. 1 when a change of possession takes place due |
|
to a player in possession making contact with the sideline or any ground outside |
|
the field of play, prior to a touch being made ; or 13. 6. 2 when the ball not |
|
in possession of a player makes contact with the sideline or any ground outside |
|
the field of play. 13. 7 a player may not perform a tap in replacement of a rollball. |
|
ruling = the offending team must return to the mark and perform the rollball. |
|
13. 8 an attacking player, other than the player performing the rollball, may |
|
receive the ball at the rollball and shall do so without delay. that player is |
|
referred to as the half. 13. 9 the half may control the ball with a foot prior |
|
to picking up the ball. 13. 10 a player' |
|
- or passed and goes to ground during play, a change of possession results. ruling |
|
= the mark for the change of possession is where the ball makes initial contact |
|
with the ground. 9. 5 if the ball, while still under the control of the half, |
|
contacts the ground in the in - goal area, possession is lost. ruling = play will |
|
restart with a rollball at the nearest point on the seven ( 7 ) metre line. fit |
|
playing rules - 5th edition 8 copyright © touch football australia 2020 9. 6 if |
|
a player mishandles the ball and even if in an effort to gain control, the ball |
|
is accidentally knocked forward into any other player, a change of possession |
|
results. 10 the touch 10. 1 a touch may be made by either a defending player or |
|
a player in possession. 10. 2 a defending player may not claim a touch if contact |
|
has not been made. if a player claims a touch has been made, but the referee is |
|
unsure the touch will count. ruling = a penalty to the attacking team at the point |
|
of the infringement and the offending player sent to the sin bin. 10. 3 players |
|
of both defending and attacking teams are to use the minimum force necessary to |
|
make a touch. players must ensure that the |
|
- is normally forty - five minutes, inclusive of a five ( 5 ) minute half time. |
|
end of play when the referee indicates completion of the match. exclusion when |
|
a player is sent to the nearest sin bin area following three ( 3 ) penalties by |
|
the defending team upon entering their seven metre zone. the player is counted |
|
as a player on the field of play and cannot be replaced or interchanged. fit playing |
|
rules - 5th edition copyright © touch football australia 2020 1 fit federation |
|
of international touch field of play the playing area bounded by the sidelines |
|
and dead ball lines, both of which are out of bounds. see appendix 1. forced interchange |
|
when a player is required to undertake a compulsory interchange for an infringement |
|
ruled more serious than a penalty but less serious than a permanent interchange, |
|
sin bin or dismissal. forward a position or direction towards the dead ball line |
|
beyond the team ’ s attacking try line. full time the expiration of the second |
|
period of time allowed for play. half the player who takes possession following |
|
a rollball. half time the break in play between the two halves of a match. imminent |
|
about to occur, it is almost certain to occur. infringement the action of a player |
|
contrary to the rules of the game. in - goal area the area |
|
- source_sentence: What was the name of the convention where TFA presented the TFA |
|
8th edition playing rules? |
|
sentences: |
|
- 5th edition rules touch football tion rules touch football touch football australia |
|
( tfa ) undertook an extensive internal review of their domestic playing rules |
|
throughout 2018 and 2019. the review was led by an vastly experienced group of |
|
current and past players, coaches, referees and administrators of the sport from |
|
community competitions to the elite international game. this group consulted broadly |
|
within the australian community to develop a set of playing rules that could be |
|
applied across all levels of the sport. the result was the tfa 8th edition playing |
|
rules. at the federation of international touch paris convention held in october |
|
2019 touch football australia presented the tfa 8th edition playing rules and |
|
subsequently offered fit and all national touch associations ( ntas ) royalty |
|
free rights to use the newly developed rules. consequently, the fit board resolved |
|
to adopt the tfa 8th edition playing rules as the 5th edition fit playing rules |
|
to be used across all levels of the game internationally. fit and its members |
|
acknowledge and thank touch football australia for the rights to use these rules. |
|
whilst consistency in the application of the rules of the game is important, fit |
|
encourages its members to offer features in local competition rules to ensure |
|
that all participants enjoy a high quality experience. these rules in no way restrict |
|
any nta or their authorised competition providers from having |
|
- dead ball and end of play is signaled by the referee. 8. 3. 1 should a penalty |
|
be awarded during this period, the penalty is to be taken. 8. 4 if a match is |
|
abandoned in any circumstances other than those referred to in clause 24. 1. 6 |
|
the nta or nta competition provider in its sole discretion shall determine the |
|
result of the match. 9 possession 9. 1 the team with the ball is entitled to six |
|
( 6 ) touches prior to a change of possession. 9. 2 on the change of possession |
|
due to an intercept, the first touch will be zero ( 0 ) touch. 9. 3 following |
|
the sixth touch or a loss of possession due to any other means, the ball must |
|
be returned to the mark without delay. ruling = a deliberate delay in the changeover |
|
procedure will result in a penalty awarded to the non - offending team ten ( 10 |
|
) metres forward of the mark for the change of possession. 9. 4 if the ball is |
|
dropped or passed and goes to ground during play, a change of possession results. |
|
ruling = the mark for the change of possession is where the ball makes initial |
|
contact with the ground. 9. 5 if the ball, while still under the control of the |
|
half |
|
- ( 1 ). 6 team coach and team officials 6. 1 the team coach ( s ) and team officials |
|
may be permitted inside the perimeter but shall be required to be positioned either |
|
in the interchange area or at the end of the field of play for the duration of |
|
the match. 6. 2 the team coach ( s ) and team officials may move from one position |
|
to the other but shall do so without delay. while in a position at the end of |
|
the field of play, the team coach ( s ) or team official must remain no closer |
|
than five ( 5 ) metres from the dead ball line and must not coach or communicate |
|
( verbal or non - verbal ) with either team or the referees. 7 commencement and |
|
recommencement of play 7. 1 team captains are to toss a coin in the presence of |
|
the referee ( s ) with the winning captain ’ s team having the choice of the direction |
|
the team wishes to run in the first half ; the choice of interchange areas for |
|
the duration of the match, including any extra time ; and the choice of which |
|
team will commence the match in possession. 7. 2 a player of the attacking team |
|
is to commence the match with a tap at the centre of the halfway line following |
|
the indication to |
|
- source_sentence: What is the minimum number of defending players required to be |
|
in an onside position for a tap to be taken? |
|
sentences: |
|
- ( 4 ) defending players are in an onside position or unless directed to so by |
|
the referee. where the number of players on the field from the defending team |
|
falls below four ( 4 ), all players must be in an onside position for a tap to |
|
be taken unless directed to do so by the referee. ruling = the player will be |
|
directed to return to the mark and to take the tap again. 7. 7 the tap to commence |
|
or recommence play must be performed without delay. ruling = a penalty to the |
|
non - offending team at the centre of the halfway line. 8 match duration 8. 1 |
|
a match is 40 minutes in duration, consisting of two ( 2 ) x 20 minute halves |
|
with a half time break. 8. 1. 1 there is no time off for injury during a match. |
|
8. 2 local competition and tournament conditions may vary the duration of a match. |
|
8. 3 when time expires, play is to continue until the next touch or dead ball |
|
and end of play is signaled by the referee. 8. 3. 1 should a penalty be awarded |
|
during this period, the penalty is to be taken. 8. 4 if a match is abandoned in |
|
any circumstances other than those referred to in |
|
- players from the defending team must retire a distance of ten ( 10 ) metres from |
|
the mark or to the defending try line as indicated by the referee. ruling = a |
|
penalty to the attacking team at the point of the infringement or on the ten ( |
|
10 ) metre line directly forward of the infringement. 15. 3 at a rollball or tap, |
|
players from the defending team must not retire an unreasonable distance beyond |
|
the defending try line. ruling = a penalty to the attacking team at the point |
|
of the infringement or on the seven ( 7 ) metre line directly forward of the infringement. |
|
15. 4 when a rollball occurs within defending team ’ s seven metre zone or a penalty |
|
tap within ten ( 10 ) metres of the defending team ’ s try line, all players from |
|
the defending team must have both feet on or behind their try line and no other |
|
part of the body in contact with the ground forward of their try line. ruling |
|
= a penalty to the attacking team at the seven ( 7 ) metre line directly forward |
|
of the point of the infringement. 15. 5 after effecting the touch, the defending |
|
player must retire the required seven ( 7 ) metres or to the defending try line |
|
as indicated by the referee without interfering with the attacking team. ruling |
|
= |
|
- '##s as zero ( 0 ) touch. 12. 2 if a player from the defending team deliberately |
|
makes contact with the ball in flight and the ball is retrieved by an attacking |
|
player, without touching the ground, play continues and the next touch is zero |
|
( 0 ) touch. 12. 3 if a player from the defending team deliberately makes contact |
|
with the ball in flight, propelling it forward and an attacking player, in an |
|
attempt to regain possession, drops the ball, the attacking team retains possession |
|
and the fit playing rules - 5th edition 10 copyright © touch football australia |
|
2020 touch count restarts as zero ( 0 ) touch. 12. 4 if a player from the defending |
|
team deliberately makes contact with the ball in flight, propelling it towards |
|
the defending team ’ s dead ball line and an attacking player, in an attempt to |
|
regain possession drops the ball, a change of possession occurs. 12. 5 if a player |
|
from the defending team unintentionally makes contact with the ball in flight |
|
and the ball goes to ground, a change of possession occurs. 12. 6 if a player |
|
from the defending team unintentionally makes contact with the ball in flight |
|
and the ball is retrieved by an attacking player, play and the touch count continues.' |
|
- source_sentence: How many times can a player interchange during a match? |
|
sentences: |
|
- ( 7 ) metre line. 10. 7 the half may pass or run with the ball but cannot get |
|
touched while in possession of the ball. ruling = a change of possession occurs |
|
at the point of the touch, or if in - goal the nearest point on the seven ( 7 |
|
) metre line. 10. 8 if a touch is made in the in - goal area before the ball is |
|
grounded, the player in possession is to perform a rollball seven ( 7 ) metres |
|
from the team ’ s attacking try line, provided it is not the sixth touch and the |
|
player is not half. 10. 9 if a player in possession is touched while on or behind |
|
their defending try line, the touch counts and once the referee sets the mark |
|
seven ( 7 ) metres directly forward of the contact point from the defending team |
|
’ s try line, a rollball is performed. 10. 10 if a player in possession intentionally |
|
makes a touch on an offside defender who is making every effort to retire and |
|
remain out of play, the touch counts. fit playing rules - 5th edition copyright |
|
© touch football australia 2020 9 10. 11 if a touch is made on a player in possession |
|
while the player is juggling the ball in an attempt to maintain control of it, |
|
- '##ommencement of play 7 08 i match duration 8 09 i possession 8 10 i the touch |
|
9 11 i passing 10 12 i ball touched in flight 10 13 i the rollball 11 14 i scoring |
|
13 15 i offside 13 16 i obstruction 14 17 i interchange 14 18 i penalty 15 19 |
|
i advantage 16 20 i misconduct 16 21 i forced interchange 16 22 i sin bin 16 23 |
|
i dismissal 17 24 i drop - off 17 25 i match officials 18 fit playing rules - |
|
5th edition copyright © touch football australia 2020 fit playing rules - 5th |
|
edition copyright © touch football australia 2020 definitions and terminology |
|
unless the contrary intention appears, the following definitions and terminology |
|
apply to the game of touch : term / phrase definition / description advantage |
|
the period of time after an infringement in which the non - offending side has |
|
the opportunity to gain advantage either territorial, tactical or in the form |
|
of a try. attacking try line the line on or over which a player has to place the |
|
ball to score a try. attacking team the team which has or is gaining possession. |
|
behind a position or direction towards a team ’ s defending try line. change of |
|
possession the act of moving control of the ball from one team to the other. dead |
|
/ dead ball when the' |
|
- at the mark where the interference occurred and the touch count remains unchanged. |
|
17 interchange 17. 1 players may interchange at any time. 17. 2 there is no limit |
|
to the number of times a player may interchange. 17. 3 interchange players must |
|
remain in their interchange area for the duration of the match. 17. 4 interchanges |
|
may only occur after the player leaving the field of play has entered the interchange |
|
area. 17. 5 players leaving or entering the field of play shall not hinder or |
|
obstruct play. ruling = a penalty to the non - offending team at the point of |
|
the infringement. 17. 6 players entering the field of play must take up an onside |
|
position before becoming involved in play. fit playing rules - 5th edition 14 |
|
copyright © touch football australia 2020 ruling = a penalty to the non - offending |
|
team at the point of the infringement. 17. 7 when an intercept has occurred or |
|
a line break made, players are not permitted to interchange until the next touch |
|
has been made or ball becomes dead. ruling a = if a player enters the field of |
|
play and prevents the scoring of a try, a penalty try will be awarded and the |
|
offending player sent to the sin bin. ruling b = if a player |
|
- source_sentence: What is the ruling if a player in possession holds or impedes a |
|
defending player? |
|
sentences: |
|
- required in drawn matches, the following drop - off procedure is used to determine |
|
a winner. 24. 1. 1 each team will reduce their on - field team to four ( 4 ) players |
|
and within 60 seconds take up a position to restart play from the halfway line, |
|
defending the same end of the field as at the end of play. 24. 1. 2 the drop - |
|
off commences with a tap from the centre of the halfway line by the team that |
|
did not commence the match with possession. 24. 1. 3 the drop - off will commence |
|
with a two ( 2 ) minute period of extra time. 24. 1. 4 should a team be leading |
|
at the expiration of the two ( 2 ) minute period of extra time then that team |
|
will be declared the winner and match complete. 24. 1. 5 should neither team be |
|
leading at the expiration of two ( 2 ) minutes, a signal is given and the match |
|
will pause at the next touch or dead ball. each team will then remove another |
|
player from the field of play. 24. 1. 6 the match will recommence immediately |
|
after the players have left the field at the same place where it paused ( i. e. |
|
the team retains possession at the |
|
- . attacking team the team which has or is gaining possession. behind a position |
|
or direction towards a team ’ s defending try line. change of possession the act |
|
of moving control of the ball from one team to the other. dead / dead ball when |
|
the ball is out of play including the period following a try and until the match |
|
is recommenced and when the ball goes to ground and / or outside the boundaries |
|
of the field of play prior to the subsequent rollball. dead ball line the end |
|
boundaries of the field of play. there is one at each end of the field of play. |
|
see appendix 1. defending try line the line which a team has to defend to prevent |
|
a try. defending team the team without or which is losing possession. dismissal |
|
when a player is sent from the field of play for the rest of the match. drop - |
|
off a procedure used to determine a winner following equal scores at the expiration |
|
of normal duration. duration the length of time a competition match lasts, which |
|
is normally forty - five minutes, inclusive of a five ( 5 ) minute half time. |
|
end of play when the referee indicates completion of the match. exclusion when |
|
a player is sent to the nearest sin bin area following three ( 3 ) penalties by |
|
the |
|
- directly forward of the point of the infringement. 15. 5 after effecting the touch, |
|
the defending player must retire the required seven ( 7 ) metres or to the defending |
|
try line as indicated by the referee without interfering with the attacking team. |
|
ruling = a penalty to the attacking team ten ( 10 ) metres forward of the infringement |
|
or if on the defensive try line, on the seven ( 7 ) metre line. fit playing rules |
|
- 5th edition copyright © touch football australia 2020 13 16 obstruction 16. |
|
1 a player in possession must not run or otherwise move behind other attacking |
|
players or the referee in an attempt to avoid an imminent touch. ruling = a penalty |
|
to the non - offending team at the point of the infringement. 16. 2 the player |
|
in possession is not to hold or otherwise impede a defending player in any way. |
|
ruling = a penalty to the non - offending team at the point of the infringement. |
|
16. 3 an attacking player in support of the player in possession may move as necessary |
|
to achieve a supporting position but must not grab, hold, push or otherwise deliberately |
|
interfere with a defending player attempting to make a touch ruling = a penalty |
|
to the non - offending team at the point of the infringement or on the seven ( |
|
7 |
|
--- |
|
|
|
# SentenceTransformer based on sentence-transformers/multi-qa-MiniLM-L6-dot-v1 |
|
|
|
This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [sentence-transformers/multi-qa-MiniLM-L6-dot-v1](https://huggingface.co/sentence-transformers/multi-qa-MiniLM-L6-dot-v1). It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more. |
|
|
|
## Model Details |
|
|
|
### Model Description |
|
- **Model Type:** Sentence Transformer |
|
- **Base model:** [sentence-transformers/multi-qa-MiniLM-L6-dot-v1](https://huggingface.co/sentence-transformers/multi-qa-MiniLM-L6-dot-v1) <!-- at revision c3bdeb02464bc83f9b85156a3386a50bfbf3e6a8 --> |
|
- **Maximum Sequence Length:** 512 tokens |
|
- **Output Dimensionality:** 384 tokens |
|
- **Similarity Function:** Dot Product |
|
<!-- - **Training Dataset:** Unknown --> |
|
<!-- - **Language:** Unknown --> |
|
<!-- - **License:** Unknown --> |
|
|
|
### Model Sources |
|
|
|
- **Documentation:** [Sentence Transformers Documentation](https://sbert.net) |
|
- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers) |
|
- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers) |
|
|
|
### Full Model Architecture |
|
|
|
``` |
|
SentenceTransformer( |
|
(0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel |
|
(1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True}) |
|
) |
|
``` |
|
|
|
## Usage |
|
|
|
### Direct Usage (Sentence Transformers) |
|
|
|
First install the Sentence Transformers library: |
|
|
|
```bash |
|
pip install -U sentence-transformers |
|
``` |
|
|
|
Then you can load this model and run inference. |
|
```python |
|
from sentence_transformers import SentenceTransformer |
|
|
|
# Download from the 🤗 Hub |
|
model = SentenceTransformer("Trelis/multi-qa-MiniLM-L6-dot-v1-ft-pairs") |
|
# Run inference |
|
sentences = [ |
|
'What is the ruling if a player in possession holds or impedes a defending player?', |
|
'directly forward of the point of the infringement. 15. 5 after effecting the touch, the defending player must retire the required seven ( 7 ) metres or to the defending try line as indicated by the referee without interfering with the attacking team. ruling = a penalty to the attacking team ten ( 10 ) metres forward of the infringement or if on the defensive try line, on the seven ( 7 ) metre line. fit playing rules - 5th edition copyright © touch football australia 2020 13 16 obstruction 16. 1 a player in possession must not run or otherwise move behind other attacking players or the referee in an attempt to avoid an imminent touch. ruling = a penalty to the non - offending team at the point of the infringement. 16. 2 the player in possession is not to hold or otherwise impede a defending player in any way. ruling = a penalty to the non - offending team at the point of the infringement. 16. 3 an attacking player in support of the player in possession may move as necessary to achieve a supporting position but must not grab, hold, push or otherwise deliberately interfere with a defending player attempting to make a touch ruling = a penalty to the non - offending team at the point of the infringement or on the seven ( 7', |
|
'. attacking team the team which has or is gaining possession. behind a position or direction towards a team ’ s defending try line. change of possession the act of moving control of the ball from one team to the other. dead / dead ball when the ball is out of play including the period following a try and until the match is recommenced and when the ball goes to ground and / or outside the boundaries of the field of play prior to the subsequent rollball. dead ball line the end boundaries of the field of play. there is one at each end of the field of play. see appendix 1. defending try line the line which a team has to defend to prevent a try. defending team the team without or which is losing possession. dismissal when a player is sent from the field of play for the rest of the match. drop - off a procedure used to determine a winner following equal scores at the expiration of normal duration. duration the length of time a competition match lasts, which is normally forty - five minutes, inclusive of a five ( 5 ) minute half time. end of play when the referee indicates completion of the match. exclusion when a player is sent to the nearest sin bin area following three ( 3 ) penalties by the', |
|
] |
|
embeddings = model.encode(sentences) |
|
print(embeddings.shape) |
|
# [3, 384] |
|
|
|
# Get the similarity scores for the embeddings |
|
similarities = model.similarity(embeddings, embeddings) |
|
print(similarities.shape) |
|
# [3, 3] |
|
``` |
|
|
|
<!-- |
|
### Direct Usage (Transformers) |
|
|
|
<details><summary>Click to see the direct usage in Transformers</summary> |
|
|
|
</details> |
|
--> |
|
|
|
<!-- |
|
### Downstream Usage (Sentence Transformers) |
|
|
|
You can finetune this model on your own dataset. |
|
|
|
<details><summary>Click to expand</summary> |
|
|
|
</details> |
|
--> |
|
|
|
<!-- |
|
### Out-of-Scope Use |
|
|
|
*List how the model may foreseeably be misused and address what users ought not to do with the model.* |
|
--> |
|
|
|
<!-- |
|
## Bias, Risks and Limitations |
|
|
|
*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.* |
|
--> |
|
|
|
<!-- |
|
### Recommendations |
|
|
|
*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.* |
|
--> |
|
|
|
## Training Details |
|
|
|
### Training Hyperparameters |
|
#### Non-Default Hyperparameters |
|
|
|
- `eval_strategy`: steps |
|
- `per_device_train_batch_size`: 16 |
|
- `per_device_eval_batch_size`: 16 |
|
- `learning_rate`: 0.0001 |
|
- `num_train_epochs`: 1 |
|
- `lr_scheduler_type`: constant |
|
- `warmup_ratio`: 0.3 |
|
|
|
#### All Hyperparameters |
|
<details><summary>Click to expand</summary> |
|
|
|
- `overwrite_output_dir`: False |
|
- `do_predict`: False |
|
- `eval_strategy`: steps |
|
- `prediction_loss_only`: True |
|
- `per_device_train_batch_size`: 16 |
|
- `per_device_eval_batch_size`: 16 |
|
- `per_gpu_train_batch_size`: None |
|
- `per_gpu_eval_batch_size`: None |
|
- `gradient_accumulation_steps`: 1 |
|
- `eval_accumulation_steps`: None |
|
- `learning_rate`: 0.0001 |
|
- `weight_decay`: 0.0 |
|
- `adam_beta1`: 0.9 |
|
- `adam_beta2`: 0.999 |
|
- `adam_epsilon`: 1e-08 |
|
- `max_grad_norm`: 1.0 |
|
- `num_train_epochs`: 1 |
|
- `max_steps`: -1 |
|
- `lr_scheduler_type`: constant |
|
- `lr_scheduler_kwargs`: {} |
|
- `warmup_ratio`: 0.3 |
|
- `warmup_steps`: 0 |
|
- `log_level`: passive |
|
- `log_level_replica`: warning |
|
- `log_on_each_node`: True |
|
- `logging_nan_inf_filter`: True |
|
- `save_safetensors`: True |
|
- `save_on_each_node`: False |
|
- `save_only_model`: False |
|
- `restore_callback_states_from_checkpoint`: False |
|
- `no_cuda`: False |
|
- `use_cpu`: False |
|
- `use_mps_device`: False |
|
- `seed`: 42 |
|
- `data_seed`: None |
|
- `jit_mode_eval`: False |
|
- `use_ipex`: False |
|
- `bf16`: False |
|
- `fp16`: False |
|
- `fp16_opt_level`: O1 |
|
- `half_precision_backend`: auto |
|
- `bf16_full_eval`: False |
|
- `fp16_full_eval`: False |
|
- `tf32`: None |
|
- `local_rank`: 0 |
|
- `ddp_backend`: None |
|
- `tpu_num_cores`: None |
|
- `tpu_metrics_debug`: False |
|
- `debug`: [] |
|
- `dataloader_drop_last`: False |
|
- `dataloader_num_workers`: 0 |
|
- `dataloader_prefetch_factor`: None |
|
- `past_index`: -1 |
|
- `disable_tqdm`: False |
|
- `remove_unused_columns`: True |
|
- `label_names`: None |
|
- `load_best_model_at_end`: False |
|
- `ignore_data_skip`: False |
|
- `fsdp`: [] |
|
- `fsdp_min_num_params`: 0 |
|
- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False} |
|
- `fsdp_transformer_layer_cls_to_wrap`: None |
|
- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None} |
|
- `deepspeed`: None |
|
- `label_smoothing_factor`: 0.0 |
|
- `optim`: adamw_torch |
|
- `optim_args`: None |
|
- `adafactor`: False |
|
- `group_by_length`: False |
|
- `length_column_name`: length |
|
- `ddp_find_unused_parameters`: None |
|
- `ddp_bucket_cap_mb`: None |
|
- `ddp_broadcast_buffers`: False |
|
- `dataloader_pin_memory`: True |
|
- `dataloader_persistent_workers`: False |
|
- `skip_memory_metrics`: True |
|
- `use_legacy_prediction_loop`: False |
|
- `push_to_hub`: False |
|
- `resume_from_checkpoint`: None |
|
- `hub_model_id`: None |
|
- `hub_strategy`: every_save |
|
- `hub_private_repo`: False |
|
- `hub_always_push`: False |
|
- `gradient_checkpointing`: False |
|
- `gradient_checkpointing_kwargs`: None |
|
- `include_inputs_for_metrics`: False |
|
- `eval_do_concat_batches`: True |
|
- `fp16_backend`: auto |
|
- `push_to_hub_model_id`: None |
|
- `push_to_hub_organization`: None |
|
- `mp_parameters`: |
|
- `auto_find_batch_size`: False |
|
- `full_determinism`: False |
|
- `torchdynamo`: None |
|
- `ray_scope`: last |
|
- `ddp_timeout`: 1800 |
|
- `torch_compile`: False |
|
- `torch_compile_backend`: None |
|
- `torch_compile_mode`: None |
|
- `dispatch_batches`: None |
|
- `split_batches`: None |
|
- `include_tokens_per_second`: False |
|
- `include_num_input_tokens_seen`: False |
|
- `neftune_noise_alpha`: None |
|
- `optim_target_modules`: None |
|
- `batch_eval_metrics`: False |
|
- `eval_on_start`: False |
|
- `batch_sampler`: batch_sampler |
|
- `multi_dataset_batch_sampler`: proportional |
|
|
|
</details> |
|
|
|
### Training Logs |
|
| Epoch | Step | Training Loss | loss | |
|
|:------:|:----:|:-------------:|:------:| |
|
| 0.1667 | 2 | 1.5903 | 1.1222 | |
|
| 0.3333 | 4 | 1.3817 | 1.1956 | |
|
| 0.5 | 6 | 0.8451 | 1.1244 | |
|
| 0.6667 | 8 | 1.4958 | 1.1055 | |
|
| 0.8333 | 10 | 1.3135 | 1.0260 | |
|
| 1.0 | 12 | 1.7283 | 0.9734 | |
|
|
|
|
|
### Framework Versions |
|
- Python: 3.10.12 |
|
- Sentence Transformers: 3.0.1 |
|
- Transformers: 4.42.3 |
|
- PyTorch: 2.1.1+cu121 |
|
- Accelerate: 0.31.0 |
|
- Datasets: 2.17.1 |
|
- Tokenizers: 0.19.1 |
|
|
|
## Citation |
|
|
|
### BibTeX |
|
|
|
#### Sentence Transformers |
|
```bibtex |
|
@inproceedings{reimers-2019-sentence-bert, |
|
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks", |
|
author = "Reimers, Nils and Gurevych, Iryna", |
|
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing", |
|
month = "11", |
|
year = "2019", |
|
publisher = "Association for Computational Linguistics", |
|
url = "https://arxiv.org/abs/1908.10084", |
|
} |
|
``` |
|
|
|
#### MultipleNegativesRankingLoss |
|
```bibtex |
|
@misc{henderson2017efficient, |
|
title={Efficient Natural Language Response Suggestion for Smart Reply}, |
|
author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil}, |
|
year={2017}, |
|
eprint={1705.00652}, |
|
archivePrefix={arXiv}, |
|
primaryClass={cs.CL} |
|
} |
|
``` |
|
|
|
<!-- |
|
## Glossary |
|
|
|
*Clearly define terms in order to be accessible across audiences.* |
|
--> |
|
|
|
<!-- |
|
## Model Card Authors |
|
|
|
*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.* |
|
--> |
|
|
|
<!-- |
|
## Model Card Contact |
|
|
|
*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.* |
|
--> |