Add new SentenceTransformer model.

ed7766e verified 5 months ago

30.3 kB

	---
	base_model: sentence-transformers/multi-qa-MiniLM-L6-cos-v1
	datasets: []
	language: []
	library_name: sentence-transformers
	pipeline_tag: sentence-similarity
	tags:
	- sentence-transformers
	- sentence-similarity
	- feature-extraction
	- generated_from_trainer
	- dataset_size:211
	- loss:MultipleNegativesRankingLoss
	widget:
	- source_sentence: How long is the initial period of extra time in the drop-off procedure?
	sentences:
	- required in drawn matches, the following drop - off procedure is used to determine
	a winner. 24. 1. 1 each team will reduce their on - field team to four ( 4 ) players
	and within 60 seconds take up a position to restart play from the halfway line,
	defending the same end of the field as at the end of play. 24. 1. 2 the drop -
	off commences with a tap from the centre of the halfway line by the team that
	did not commence the match with possession. 24. 1. 3 the drop - off will commence
	with a two ( 2 ) minute period of extra time. 24. 1. 4 should a team be leading
	at the expiration of the two ( 2 ) minute period of extra time then that team
	will be declared the winner and match complete. 24. 1. 5 should neither team be
	leading at the expiration of two ( 2 ) minutes, a signal is given and the match
	will pause at the next touch or dead ball. each team will then remove another
	player from the field of play. 24. 1. 6 the match will recommence immediately
	after the players have left the field at the same place where it paused ( i. e.
	the team retains possession at the
	- made but must be included in relevant competition, event or tournament conditions
	1. 2 line markings should be 4cm in width but must be no less than 2. 5cm. line
	markings are to be laid out as shown in appendix 1 - the field of play. sidelines
	extend seven ( 7 ) metres beyond the try lines to join the dead ball lines and
	define the in - goal areas which measure fifty ( 50 ) metres wide by seven ( 7
	) metres in length. 1. 3 the interchange areas are located no closer than one
	( 1 ) metre from each sideline. 1. 4 suitably sized markers, cones or corner posts
	of a distinguishing colour and made from safe and pliable material should be positioned
	at the intersections of the sideline and halfway line and the sideline and the
	try line. 1. 4. 1 markers, cones or corner posts placed on the junction of the
	sideline and try line are deemed to be in the field of play. 1. 4. 2 all other
	markers or cones are deemed to be out of the field of play. 1. 5 the standard
	playing surface is grass. other surfaces including synthetic grass may be used
	but shall be subject to nta approved standards. 1. 6 the field of play
	- required in drawn matches, the following drop - off procedure is used to determine
	a winner. 24. 1. 1 each team will reduce their on - field team to four ( 4 ) players
	and within 60 seconds take up a position to restart play from the halfway line,
	defending the same end of the field as at the end of play. 24. 1. 2 the drop -
	off commences with a tap from the centre of the halfway line by the team that
	did not commence the match with possession. 24. 1. 3 the drop - off will commence
	with a two ( 2 ) minute period of extra time. 24. 1. 4 should a team be leading
	at the expiration of the two ( 2 ) minute period of extra time then that team
	will be declared the winner and match complete. 24. 1. 5 should neither team be
	leading at the expiration of two ( 2 ) minutes, a signal is given and the match
	will pause at the next touch or dead ball. each team will then remove another
	player from the field of play. 24. 1. 6 the match will recommence immediately
	after the players have left the field at the same place where it paused ( i. e.
	the team retains possession at the
	- source_sentence: What happens to the touch count if a player from the defending
	team deliberately makes contact with the ball in flight, propelling it towards
	the defending team's dead ball line and an attacking player drops the ball?
	sentences:
	- '##s as zero ( 0 ) touch. 12. 2 if a player from the defending team deliberately
	makes contact with the ball in flight and the ball is retrieved by an attacking
	player, without touching the ground, play continues and the next touch is zero
	( 0 ) touch. 12. 3 if a player from the defending team deliberately makes contact
	with the ball in flight, propelling it forward and an attacking player, in an
	attempt to regain possession, drops the ball, the attacking team retains possession
	and the fit playing rules - 5th edition 10 copyright © touch football australia
	2020 touch count restarts as zero ( 0 ) touch. 12. 4 if a player from the defending
	team deliberately makes contact with the ball in flight, propelling it towards
	the defending team ’ s dead ball line and an attacking player, in an attempt to
	regain possession drops the ball, a change of possession occurs. 12. 5 if a player
	from the defending team unintentionally makes contact with the ball in flight
	and the ball goes to ground, a change of possession occurs. 12. 6 if a player
	from the defending team unintentionally makes contact with the ball in flight
	and the ball is retrieved by an attacking player, play and the touch count continues.'
	- made but must be included in relevant competition, event or tournament conditions
	1. 2 line markings should be 4cm in width but must be no less than 2. 5cm. line
	markings are to be laid out as shown in appendix 1 - the field of play. sidelines
	extend seven ( 7 ) metres beyond the try lines to join the dead ball lines and
	define the in - goal areas which measure fifty ( 50 ) metres wide by seven ( 7
	) metres in length. 1. 3 the interchange areas are located no closer than one
	( 1 ) metre from each sideline. 1. 4 suitably sized markers, cones or corner posts
	of a distinguishing colour and made from safe and pliable material should be positioned
	at the intersections of the sideline and halfway line and the sideline and the
	try line. 1. 4. 1 markers, cones or corner posts placed on the junction of the
	sideline and try line are deemed to be in the field of play. 1. 4. 2 all other
	markers or cones are deemed to be out of the field of play. 1. 5 the standard
	playing surface is grass. other surfaces including synthetic grass may be used
	but shall be subject to nta approved standards. 1. 6 the field of play
	- ( 4 ) defending players are in an onside position or unless directed to so by
	the referee. where the number of players on the field from the defending team
	falls below four ( 4 ), all players must be in an onside position for a tap to
	be taken unless directed to do so by the referee. ruling = the player will be
	directed to return to the mark and to take the tap again. 7. 7 the tap to commence
	or recommence play must be performed without delay. ruling = a penalty to the
	non - offending team at the centre of the halfway line. 8 match duration 8. 1
	a match is 40 minutes in duration, consisting of two ( 2 ) x 20 minute halves
	with a half time break. 8. 1. 1 there is no time off for injury during a match.
	8. 2 local competition and tournament conditions may vary the duration of a match.
	8. 3 when time expires, play is to continue until the next touch or dead ball
	and end of play is signaled by the referee. 8. 3. 1 should a penalty be awarded
	during this period, the penalty is to be taken. 8. 4 if a match is abandoned in
	any circumstances other than those referred to in
	- source_sentence: What happens if an attacking player fails to perform a rollball
	on the mark?
	sentences:
	- 'ball goes to ground, a change of possession occurs. 12. 6 if a player from the
	defending team unintentionally makes contact with the ball in flight and the ball
	is retrieved by an attacking player, play and the touch count continues. 12. 7
	a player from the attacking team cannot pass the ball into a defending player
	intentionally seeking a rebound or a restart of the touch count. ruling = a penalty
	to the defending team at the point of the pass. 13 the rollball 13. 1 the attacking
	player is to position on the mark, face the opponent ’ s try line, make a genuine
	attempt to stand parallel to the sidelines, place the ball on the ground between
	the feet in a controlled manner and : 13. 1. 1 step forward over the ball ; or
	13. 1. 2 roll the ball back between the feet no more than one ( 1 ) metre ; or
	13. 1. 3 pass a foot over the ball. ruling = a change of possession to the defending
	team at the point of the infringement. 13. 2 a player must perform the rollball
	on the mark. ruling = a penalty to the defending team at the point of the infringement.
	13. 3 a player must not perform a voluntary rollball'
	- dead ball and end of play is signaled by the referee. 8. 3. 1 should a penalty
	be awarded during this period, the penalty is to be taken. 8. 4 if a match is
	abandoned in any circumstances other than those referred to in clause 24. 1. 6
	the nta or nta competition provider in its sole discretion shall determine the
	result of the match. 9 possession 9. 1 the team with the ball is entitled to six
	( 6 ) touches prior to a change of possession. 9. 2 on the change of possession
	due to an intercept, the first touch will be zero ( 0 ) touch. 9. 3 following
	the sixth touch or a loss of possession due to any other means, the ball must
	be returned to the mark without delay. ruling = a deliberate delay in the changeover
	procedure will result in a penalty awarded to the non - offending team ten ( 10
	) metres forward of the mark for the change of possession. 9. 4 if the ball is
	dropped or passed and goes to ground during play, a change of possession results.
	ruling = the mark for the change of possession is where the ball makes initial
	contact with the ground. 9. 5 if the ball, while still under the control of the
	half
	- ( 7 ) metre line. 10. 7 the half may pass or run with the ball but cannot get
	touched while in possession of the ball. ruling = a change of possession occurs
	at the point of the touch, or if in - goal the nearest point on the seven ( 7
	) metre line. 10. 8 if a touch is made in the in - goal area before the ball is
	grounded, the player in possession is to perform a rollball seven ( 7 ) metres
	from the team ’ s attacking try line, provided it is not the sixth touch and the
	player is not half. 10. 9 if a player in possession is touched while on or behind
	their defending try line, the touch counts and once the referee sets the mark
	seven ( 7 ) metres directly forward of the contact point from the defending team
	’ s try line, a rollball is performed. 10. 10 if a player in possession intentionally
	makes a touch on an offside defender who is making every effort to retire and
	remain out of play, the touch counts. fit playing rules - 5th edition copyright
	© touch football australia 2020 9 10. 11 if a touch is made on a player in possession
	while the player is juggling the ball in an attempt to maintain control of it,
	- source_sentence: What is the result of a match if it is abandoned in circumstances
	other than those specified in clause 24.1.6?
	sentences:
	- 'touch football australia 2020 11 13. 5. 5 when possession changes after the half
	is touched or when the half places the ball on or over the try line ; or 13. 5.
	6 in replacement of a penalty tap ; or 13. 5. 7 when so directed by the referee.
	13. 6 a player is to perform a rollball seven ( 7 ) metres in - field under the
	following circumstances : 13. 6. 1 when a change of possession takes place due
	to a player in possession making contact with the sideline or any ground outside
	the field of play, prior to a touch being made ; or 13. 6. 2 when the ball not
	in possession of a player makes contact with the sideline or any ground outside
	the field of play. 13. 7 a player may not perform a tap in replacement of a rollball.
	ruling = the offending team must return to the mark and perform the rollball.
	13. 8 an attacking player, other than the player performing the rollball, may
	receive the ball at the rollball and shall do so without delay. that player is
	referred to as the half. 13. 9 the half may control the ball with a foot prior
	to picking up the ball. 13. 10 a player'
	- a rollball. half time the break in play between the two halves of a match. imminent
	about to occur, it is almost certain to occur. infringement the action of a player
	contrary to the rules of the game. in - goal area the area in the field of play
	bounded by the sidelines, the try lines and the dead ball lines. there are two
	( 2 ), one ( 1 ) at each end of the field of play. see appendix 1. interchange
	the act of an on - field player leaving the field of play to be replaced by an
	off - field player entering the field of play. interchange area a marked rectangle
	for each team on opposite sides of the field of play usually measuring 20 metres
	long by no more than five ( 5 ) metres wide, extending ten ( 10 ) metres either
	side of the halfway line and not less than one ( 1 ) metre from the sideline.
	it is the area in which all off - field players must remain until an interchange
	is initiated. see appendix 1. kick strike or propel forcibly with the foot, a
	blow or forceful thrust with the foot to the ball. a tap to commence or recommence
	play or a penalty tap is not defined as a kick. line markings
	- dead ball and end of play is signaled by the referee. 8. 3. 1 should a penalty
	be awarded during this period, the penalty is to be taken. 8. 4 if a match is
	abandoned in any circumstances other than those referred to in clause 24. 1. 6
	the nta or nta competition provider in its sole discretion shall determine the
	result of the match. 9 possession 9. 1 the team with the ball is entitled to six
	( 6 ) touches prior to a change of possession. 9. 2 on the change of possession
	due to an intercept, the first touch will be zero ( 0 ) touch. 9. 3 following
	the sixth touch or a loss of possession due to any other means, the ball must
	be returned to the mark without delay. ruling = a deliberate delay in the changeover
	procedure will result in a penalty awarded to the non - offending team ten ( 10
	) metres forward of the mark for the change of possession. 9. 4 if the ball is
	dropped or passed and goes to ground during play, a change of possession results.
	ruling = the mark for the change of possession is where the ball makes initial
	contact with the ground. 9. 5 if the ball, while still under the control of the
	half
	- source_sentence: What is the ruling if an attacking player intentionally passes
	the ball to a defending player seeking a rebound or restart of the touch count?
	sentences:
	- 'ball goes to ground, a change of possession occurs. 12. 6 if a player from the
	defending team unintentionally makes contact with the ball in flight and the ball
	is retrieved by an attacking player, play and the touch count continues. 12. 7
	a player from the attacking team cannot pass the ball into a defending player
	intentionally seeking a rebound or a restart of the touch count. ruling = a penalty
	to the defending team at the point of the pass. 13 the rollball 13. 1 the attacking
	player is to position on the mark, face the opponent ’ s try line, make a genuine
	attempt to stand parallel to the sidelines, place the ball on the ground between
	the feet in a controlled manner and : 13. 1. 1 step forward over the ball ; or
	13. 1. 2 roll the ball back between the feet no more than one ( 1 ) metre ; or
	13. 1. 3 pass a foot over the ball. ruling = a change of possession to the defending
	team at the point of the infringement. 13. 2 a player must perform the rollball
	on the mark. ruling = a penalty to the defending team at the point of the infringement.
	13. 3 a player must not perform a voluntary rollball'
	- . see appendix 1. kick strike or propel forcibly with the foot, a blow or forceful
	thrust with the foot to the ball. a tap to commence or recommence play or a penalty
	tap is not defined as a kick. line markings markings of the field of play. see
	appendix 1. link the player beside the wing player. mark ( for a tap ) the centre
	of the halfway line for the commencement or recommencement of play, or the position
	where a penalty tap is awarded as a result of an infringement. mark ( for a touch
	) the position in the field of play where the player in possession was at the
	time the touch was made. fit playing rules - 5th edition 2 copyright © touch football
	australia 2020 middle the player inside the link player. nta national touch association
	as defined in the fit constitution. obstruction a deliberate attempt by either
	an attacking or defending player to gain an unfair advantage by interfering with
	the opposition to prevent them from gaining a rightful advantage. offside ( attacker
	) an attacking player in a position forward of the ball. offside ( defender )
	a defending player in a position closer than seven ( 7 ) metres from the mark
	of the rollball ; or ten ( 10 ) metres from the mark
	- or passed and goes to ground during play, a change of possession results. ruling
	= the mark for the change of possession is where the ball makes initial contact
	with the ground. 9. 5 if the ball, while still under the control of the half,
	contacts the ground in the in - goal area, possession is lost. ruling = play will
	restart with a rollball at the nearest point on the seven ( 7 ) metre line. fit
	playing rules - 5th edition 8 copyright © touch football australia 2020 9. 6 if
	a player mishandles the ball and even if in an effort to gain control, the ball
	is accidentally knocked forward into any other player, a change of possession
	results. 10 the touch 10. 1 a touch may be made by either a defending player or
	a player in possession. 10. 2 a defending player may not claim a touch if contact
	has not been made. if a player claims a touch has been made, but the referee is
	unsure the touch will count. ruling = a penalty to the attacking team at the point
	of the infringement and the offending player sent to the sin bin. 10. 3 players
	of both defending and attacking teams are to use the minimum force necessary to
	make a touch. players must ensure that the
	---

	# SentenceTransformer based on sentence-transformers/multi-qa-MiniLM-L6-cos-v1

	This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [sentence-transformers/multi-qa-MiniLM-L6-cos-v1](https://huggingface.co/sentence-transformers/multi-qa-MiniLM-L6-cos-v1). It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

	## Model Details

	### Model Description
	- Model Type: Sentence Transformer
	- Base model: [sentence-transformers/multi-qa-MiniLM-L6-cos-v1](https://huggingface.co/sentence-transformers/multi-qa-MiniLM-L6-cos-v1) <!-- at revision 2430568290bb832d22ad5064f44dd86cf0240142 -->
	- Maximum Sequence Length: 512 tokens
	- Output Dimensionality: 384 tokens
	- Similarity Function: Cosine Similarity
	<!-- - Training Dataset: Unknown -->
	<!-- - Language: Unknown -->
	<!-- - License: Unknown -->

	### Model Sources

	- Documentation: [Sentence Transformers Documentation](https://sbert.net)
	- Repository: [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
	- Hugging Face: [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)

	### Full Model Architecture

	```
	SentenceTransformer(
	(0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel
	(1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
	(2): Normalize()
	)
	```

	## Usage

	### Direct Usage (Sentence Transformers)

	First install the Sentence Transformers library:

	```bash
	pip install -U sentence-transformers
	```

	Then you can load this model and run inference.
	```python
	from sentence_transformers import SentenceTransformer

	# Download from the 🤗 Hub
	model = SentenceTransformer("Trelis/multi-qa-MiniLM-L6-cos-v1-ft-pairs-1-epoch-scale-20")
	# Run inference
	sentences = [
	'What is the ruling if an attacking player intentionally passes the ball to a defending player seeking a rebound or restart of the touch count?',
	'ball goes to ground, a change of possession occurs. 12. 6 if a player from the defending team unintentionally makes contact with the ball in flight and the ball is retrieved by an attacking player, play and the touch count continues. 12. 7 a player from the attacking team cannot pass the ball into a defending player intentionally seeking a rebound or a restart of the touch count. ruling = a penalty to the defending team at the point of the pass. 13 the rollball 13. 1 the attacking player is to position on the mark, face the opponent ’ s try line, make a genuine attempt to stand parallel to the sidelines, place the ball on the ground between the feet in a controlled manner and : 13. 1. 1 step forward over the ball ; or 13. 1. 2 roll the ball back between the feet no more than one ( 1 ) metre ; or 13. 1. 3 pass a foot over the ball. ruling = a change of possession to the defending team at the point of the infringement. 13. 2 a player must perform the rollball on the mark. ruling = a penalty to the defending team at the point of the infringement. 13. 3 a player must not perform a voluntary rollball',
	'. see appendix 1. kick strike or propel forcibly with the foot, a blow or forceful thrust with the foot to the ball. a tap to commence or recommence play or a penalty tap is not defined as a kick. line markings markings of the field of play. see appendix 1. link the player beside the wing player. mark ( for a tap ) the centre of the halfway line for the commencement or recommencement of play, or the position where a penalty tap is awarded as a result of an infringement. mark ( for a touch ) the position in the field of play where the player in possession was at the time the touch was made. fit playing rules - 5th edition 2 copyright © touch football australia 2020 middle the player inside the link player. nta national touch association as defined in the fit constitution. obstruction a deliberate attempt by either an attacking or defending player to gain an unfair advantage by interfering with the opposition to prevent them from gaining a rightful advantage. offside ( attacker ) an attacking player in a position forward of the ball. offside ( defender ) a defending player in a position closer than seven ( 7 ) metres from the mark of the rollball ; or ten ( 10 ) metres from the mark',
	]
	embeddings = model.encode(sentences)
	print(embeddings.shape)
	# [3, 384]

	# Get the similarity scores for the embeddings
	similarities = model.similarity(embeddings, embeddings)
	print(similarities.shape)
	# [3, 3]
	```

	<!--
	### Direct Usage (Transformers)

	<details><summary>Click to see the direct usage in Transformers</summary>

	</details>
	-->

	<!--
	### Downstream Usage (Sentence Transformers)

	You can finetune this model on your own dataset.

	<details><summary>Click to expand</summary>

	</details>
	-->

	<!--
	### Out-of-Scope Use

	List how the model may foreseeably be misused and address what users ought not to do with the model.
	-->

	<!--
	## Bias, Risks and Limitations

	What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.
	-->

	<!--
	### Recommendations

	What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.
	-->

	## Training Details

	### Training Hyperparameters
	#### Non-Default Hyperparameters

	- `eval_strategy`: steps
	- `per_device_train_batch_size`: 16
	- `per_device_eval_batch_size`: 16
	- `learning_rate`: 0.0001
	- `num_train_epochs`: 2
	- `lr_scheduler_type`: constant
	- `warmup_ratio`: 0.3

	#### All Hyperparameters
	<details><summary>Click to expand</summary>

	- `overwrite_output_dir`: False
	- `do_predict`: False
	- `eval_strategy`: steps
	- `prediction_loss_only`: True
	- `per_device_train_batch_size`: 16
	- `per_device_eval_batch_size`: 16
	- `per_gpu_train_batch_size`: None
	- `per_gpu_eval_batch_size`: None
	- `gradient_accumulation_steps`: 1
	- `eval_accumulation_steps`: None
	- `learning_rate`: 0.0001
	- `weight_decay`: 0.0
	- `adam_beta1`: 0.9
	- `adam_beta2`: 0.999
	- `adam_epsilon`: 1e-08
	- `max_grad_norm`: 1.0
	- `num_train_epochs`: 2
	- `max_steps`: -1
	- `lr_scheduler_type`: constant
	- `lr_scheduler_kwargs`: {}
	- `warmup_ratio`: 0.3
	- `warmup_steps`: 0
	- `log_level`: passive
	- `log_level_replica`: warning
	- `log_on_each_node`: True
	- `logging_nan_inf_filter`: True
	- `save_safetensors`: True
	- `save_on_each_node`: False
	- `save_only_model`: False
	- `restore_callback_states_from_checkpoint`: False
	- `no_cuda`: False
	- `use_cpu`: False
	- `use_mps_device`: False
	- `seed`: 42
	- `data_seed`: None
	- `jit_mode_eval`: False
	- `use_ipex`: False
	- `bf16`: False
	- `fp16`: False
	- `fp16_opt_level`: O1
	- `half_precision_backend`: auto
	- `bf16_full_eval`: False
	- `fp16_full_eval`: False
	- `tf32`: None
	- `local_rank`: 0
	- `ddp_backend`: None
	- `tpu_num_cores`: None
	- `tpu_metrics_debug`: False
	- `debug`: []
	- `dataloader_drop_last`: False
	- `dataloader_num_workers`: 0
	- `dataloader_prefetch_factor`: None
	- `past_index`: -1
	- `disable_tqdm`: False
	- `remove_unused_columns`: True
	- `label_names`: None
	- `load_best_model_at_end`: False
	- `ignore_data_skip`: False
	- `fsdp`: []
	- `fsdp_min_num_params`: 0
	- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
	- `fsdp_transformer_layer_cls_to_wrap`: None
	- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
	- `deepspeed`: None
	- `label_smoothing_factor`: 0.0
	- `optim`: adamw_torch
	- `optim_args`: None
	- `adafactor`: False
	- `group_by_length`: False
	- `length_column_name`: length
	- `ddp_find_unused_parameters`: None
	- `ddp_bucket_cap_mb`: None
	- `ddp_broadcast_buffers`: False
	- `dataloader_pin_memory`: True
	- `dataloader_persistent_workers`: False
	- `skip_memory_metrics`: True
	- `use_legacy_prediction_loop`: False
	- `push_to_hub`: False
	- `resume_from_checkpoint`: None
	- `hub_model_id`: None
	- `hub_strategy`: every_save
	- `hub_private_repo`: False
	- `hub_always_push`: False
	- `gradient_checkpointing`: False
	- `gradient_checkpointing_kwargs`: None
	- `include_inputs_for_metrics`: False
	- `eval_do_concat_batches`: True
	- `fp16_backend`: auto
	- `push_to_hub_model_id`: None
	- `push_to_hub_organization`: None
	- `mp_parameters`:
	- `auto_find_batch_size`: False
	- `full_determinism`: False
	- `torchdynamo`: None
	- `ray_scope`: last
	- `ddp_timeout`: 1800
	- `torch_compile`: False
	- `torch_compile_backend`: None
	- `torch_compile_mode`: None
	- `dispatch_batches`: None
	- `split_batches`: None
	- `include_tokens_per_second`: False
	- `include_num_input_tokens_seen`: False
	- `neftune_noise_alpha`: None
	- `optim_target_modules`: None
	- `batch_eval_metrics`: False
	- `eval_on_start`: False
	- `batch_sampler`: batch_sampler
	- `multi_dataset_batch_sampler`: proportional

	</details>

	### Training Logs
	\| Epoch \| Step \| Training Loss \| loss \|
	\|:------:\|:----:\|:-------------:\|:------:\|
	\| 0.1429 \| 2 \| 1.0352 \| - \|
	\| 0.2857 \| 4 \| 0.983 \| 1.0554 \|
	\| 0.4286 \| 6 \| 1.0573 \| - \|
	\| 0.5714 \| 8 \| 1.5167 \| 1.1372 \|
	\| 0.7143 \| 10 \| 1.4807 \| - \|
	\| 0.8571 \| 12 \| 1.0505 \| 1.1214 \|
	\| 1.0 \| 14 \| 1.1143 \| - \|
	\| 1.1429 \| 16 \| 0.7394 \| 1.1747 \|
	\| 1.2857 \| 18 \| 0.4551 \| - \|
	\| 1.4286 \| 20 \| 0.6974 \| 1.2331 \|
	\| 1.5714 \| 22 \| 0.5394 \| - \|
	\| 1.7143 \| 24 \| 0.7328 \| 1.3571 \|
	\| 1.8571 \| 26 \| 0.5923 \| - \|
	\| 2.0 \| 28 \| 0.6218 \| 1.2917 \|


	### Framework Versions
	- Python: 3.10.12
	- Sentence Transformers: 3.0.1
	- Transformers: 4.42.3
	- PyTorch: 2.1.1+cu121
	- Accelerate: 0.31.0
	- Datasets: 2.17.1
	- Tokenizers: 0.19.1

	## Citation

	### BibTeX

	#### Sentence Transformers
	```bibtex
	@inproceedings{reimers-2019-sentence-bert,
	title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
	author = "Reimers, Nils and Gurevych, Iryna",
	booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
	month = "11",
	year = "2019",
	publisher = "Association for Computational Linguistics",
	url = "https://arxiv.org/abs/1908.10084",
	}
	```

	#### MultipleNegativesRankingLoss
	```bibtex
	@misc{henderson2017efficient,
	title={Efficient Natural Language Response Suggestion for Smart Reply},
	author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
	year={2017},
	eprint={1705.00652},
	archivePrefix={arXiv},
	primaryClass={cs.CL}
	}
	```

	<!--
	## Glossary

	Clearly define terms in order to be accessible across audiences.
	-->

	<!--
	## Model Card Authors

	Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.
	-->

	<!--
	## Model Card Contact

	Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.
	-->