RonanMcGovern's picture
Add new SentenceTransformer model.
e59e080 verified
metadata
base_model: sentence-transformers/multi-qa-MiniLM-L6-dot-v1
datasets: []
language: []
library_name: sentence-transformers
pipeline_tag: sentence-similarity
tags:
  - sentence-transformers
  - sentence-similarity
  - feature-extraction
  - generated_from_trainer
  - dataset_size:180
  - loss:MultipleNegativesRankingLoss
widget:
  - source_sentence: >-
      What is the penalty awarded to the non-offending team if a player in
      possession holds or impedes a defending player?
    sentences:
      - >-
        15. 5 after effecting the touch, the defending player must retire the
        required seven ( 7 ) metres or to the defending try line as indicated by
        the referee without interfering with the attacking team. ruling = a
        penalty to the attacking team ten ( 10 ) metres forward of the
        infringement or if on the defensive try line, on the seven ( 7 ) metre
        line. fit playing rules - 5th edition copyright © touch football
        australia 2020 13 16 obstruction 16. 1 a player in possession must not
        run or otherwise move behind other attacking players or the referee in
        an attempt to avoid an imminent touch. ruling = a penalty to the non -
        offending team at the point of the infringement. 16. 2 the player in
        possession is not to hold or otherwise impede a defending player in any
        way. ruling = a penalty to the non - offending team at the point of the
        infringement.
      - >-
        these rules in no way restrict any nta or their authorised competition
        providers from having different match conditions to these rules. any
        adaptation of or alterations to the rules for local competitions should
        be clearly articulated in relevant competition guidelines and be readily
        available for players, coaches and referees alike preamble copyright ©
        touch football australia 2020 all rights reserved. these touch football
        rules are protected by copyright laws. except as permitted under the
        copyright act, these rules must not be reproduced by any process,
        electronic or otherwise, without the written permission of touch
        football australia. fit playing rules - 5th edition copyright © touch
        football australia 2020 appendix 1 – field of play contents 01 i the
        field of play 5 02 i player registration 5 03 i the ball 6 04 i playing
        uniform 6 05 i team composition 6 06 i team coach and team officials 7
        07 i commencement and recommencement of play 7 08 i match duration 8 09
        i possession 8 10 i the touch 9 11 i passing 10 12 i ball touched in
        flight 10 13 i the rollball 11 14 i scoring 13 15 i offside 13 16 i
        obstruction 14 17 i interchange 14 18 i penalty 15 19 i advantage 16 20
        i misconduct 16 21 i forced interchange 16 22 i sin bin 16 23 i
        dismissal 17 24 i drop - off 17 25 i match officials 18 fit playing
        rules - 5th edition copyright © touch football australia 2020 fit
        playing rules - 5th edition copyright © touch football australia 2020
        definitions and terminology unless the contrary intention appears, the
        following definitions and terminology apply to the game of touch : term /
        phrase definition / description advantage the period of time after an
        infringement in which the non - offending side has the opportunity to
        gain advantage either territorial, tactical or in the form of a try.
      - >-
        fit playing rules - 5th edition copyright © touch football australia
        2020 3 sin bin area the area between the dead ball line and the
        perimeter where players are sent for either a sin bin period or
        exclusion for repeated seven metre zone infringements. there are four (
        4 ) sin bin areas. see appendix 1. spirit of the game the act of good
        sportsmanship and fair play. substitute player the player who replaces
        another player during interchange. there is a maximum of eight ( 8 )
        substitute players in any team and except when interchanging, in the sin
        bin, dismissed or on the field of play, they must remain in the
        substitution box. tap and tap penalty the method of commencing the
        match, recommencing the match after half time and after a try has been
        scored. the tap is also the method of recommencing play when a penalty
        is awarded. the tap is taken by placing the ball on the ground at or
        behind the mark, releasing both hands from the ball, tapping the ball
        gently with either foot or touching the foot on the ball. the ball must
        not roll or move more than one ( 1 ) metre in any direction and must be
        retrieved cleanly, without touching the ground again.
  - source_sentence: What is the consequence for teams playing unregistered players?
    sentences:
      - >-
        12. 2 if a player from the defending team deliberately makes contact
        with the ball in flight and the ball is retrieved by an attacking
        player, without touching the ground, play continues and the next touch
        is zero ( 0 ) touch. 12. 3 if a player from the defending team
        deliberately makes contact with the ball in flight, propelling it
        forward and an attacking player, in an attempt to regain possession,
        drops the ball, the attacking team retains possession and the fit
        playing rules - 5th edition 10 copyright © touch football australia 2020
        touch count restarts as zero ( 0 ) touch. 12. 4 if a player from the
        defending team deliberately makes contact with the ball in flight,
        propelling it towards the defending team ’ s dead ball line and an
        attacking player, in an attempt to regain possession drops the ball, a
        change of possession occurs. 12. 5 if a player from the defending team
        unintentionally makes contact with the ball in flight and the ball goes
        to ground, a change of possession occurs. 12. 6 if a player from the
        defending team unintentionally makes contact with the ball in flight and
        the ball is retrieved by an attacking player, play and the touch count
        continues.
      - >-
        8. 3. 1 should a penalty be awarded during this period, the penalty is
        to be taken. 8. 4 if a match is abandoned in any circumstances other
        than those referred to in clause 24. 1. 6 the nta or nta competition
        provider in its sole discretion shall determine the result of the match.
        9 possession 9. 1 the team with the ball is entitled to six ( 6 )
        touches prior to a change of possession. 9. 2 on the change of
        possession due to an intercept, the first touch will be zero ( 0 )
        touch. 9. 3 following the sixth touch or a loss of possession due to any
        other means, the ball must be returned to the mark without delay. ruling
        = a deliberate delay in the changeover procedure will result in a
        penalty awarded to the non - offending team ten ( 10 ) metres forward of
        the mark for the change of possession. 9. 4 if the ball is dropped or
        passed and goes to ground during play, a change of possession results.
        ruling = the mark for the change of possession is where the ball makes
        initial contact with the ground.
      - >-
        2 player registration 2. 1 participating players are to be registered
        with a nta or with an approved nta competition provider. 2. 2 teams
        playing unregistered players are liable to forfeit any match in which
        unregistered players have competed. fit playing rules - 5th edition
        copyright © touch football australia 2020 5 3 the ball 3. 1 the game is
        played with an oval, inflated ball of a shape, colour and size approved
        by fit or the nta. 3. 2 the ball shall be inflated to the manufacturers
        ’ recommended air pressure. 3. 3 the referee shall immediately pause the
        match if the size and shape of the ball no longer complies with clauses
        3. 1 or 3. 2 to allow for the ball to replaced or the issue rectified.
        3. 4 the ball must not be hidden under player attire. 4 playing uniform
        4. 1 participating players are to be correctly attired in matching team
        uniforms 4. 2 playing uniforms consist of shirt, singlet or other item
        as approved by the nta or nta competition provider, shorts and / or
        tights and socks.
  - source_sentence: What is the length of the field of play from try line to try line?
    sentences:
      - >-
        fit playing rules - 5th edition 4 copyright © touch football australia
        2020 rules of play mode of play the object of the game of touch is for
        each team to score tries and to prevent the opposition from scoring. the
        ball may be passed, knocked or handed between players of the attacking
        team who may in turn run or otherwise move with the ball in an attempt
        to gain territorial advantage and to score tries. defending players
        prevent the attacking team from gaining a territorial advantage by
        touching the ball carrier. 1 the field of play 1. 1 the field of play is
        rectangular in shape measuring 70 metres in length from try line to try
        line, excluding the in - goal areas and 50 metres in width from sideline
        to sideline excluding the interchange areas. 1. 1. 1 variations to the
        dimensions of the field of play may be made but must be included in
        relevant competition, event or tournament conditions 1. 2 line markings
        should be 4cm in width but must be no less than 2. 5cm. line markings
        are to be laid out as shown in appendix 1 - the field of play.
      - >-
        22 sin bin 22. 1 the on - field referee is required to indicate the
        commencement and the end of the sin bin time. 22. 2 any player sent to
        the sin bin must stand in the sin bin area at the opposition ’ s end of
        the field of play and on the same side as their interchange area. 22. 3
        any player sent to the sin bin must return to the interchange area prior
        to re - entering the field of play. 22. 4 any action that causes the
        touch count to restart will result in a continuation of that possession.
        for the avoidance of doubt, should a defender knock the ball down or
        give away a penalty, this does not mean that the possession has been
        completed, but rather the possession continues. fit playing rules - 5th
        edition 16 copyright © touch football australia 2020 23 dismissal 23. 1
        a player or official dismissed for misconduct is to take no further part
        in that match and is to move to and remain outside the perimeter for the
        remainder of the match. 23. 2 the dismissed player or official cannot be
        replaced and, in accordance with nta disciplinary regulations, that
        player shall receive an automatic two ( 2 ) match suspension.
      - >-
        25. 1. 2 adjudicate on the rules of the game ; 25. 1. 3 impose any
        sanction necessary to control the match ; 25. 1. 4 award tries and
        record the progressive score ; 25. 1. 5 maintain a count of touches
        during each possession ; 25. 1. 6 award penalties for infringements
        against the rules ; and 25. 1. 7 report to the relevant competition
        administration any sin bins, dismissals or injuries to any participant
        sustained during a match. 25. 2 only team captains are permitted to seek
        clarification of a decision directly from the referee. an approach may
        only be made during a break in play or at the discretion of the referee.
        fit playing rules - 5th edition 18 copyright © touch football australia
        2020 halfway line sin bin areas in - goal area try line 7 m zone dead
        ball line perimeter interchange area 20m 10m 10m 1m 5m 7 m 7 m 7 m 7 m
        50m 3m 70m interchange area appendix 1 – field of play fit playing rules
        - 5th edition copyright © touch football australia 2020 19 federation of
        international touch
  - source_sentence: >-
      What is the distance from the point of infringement where a penalty can be
      taken, according to rule 15.2 and 15.3?
    sentences:
      - >-
        15. 2 at a tap, all players from the defending team must retire a
        distance of ten ( 10 ) metres from the mark or to the defending try line
        as indicated by the referee. ruling = a penalty to the attacking team at
        the point of the infringement or on the ten ( 10 ) metre line directly
        forward of the infringement. 15. 3 at a rollball or tap, players from
        the defending team must not retire an unreasonable distance beyond the
        defending try line. ruling = a penalty to the attacking team at the
        point of the infringement or on the seven ( 7 ) metre line directly
        forward of the infringement. 15. 4 when a rollball occurs within
        defending team ’ s seven metre zone or a penalty tap within ten ( 10 )
        metres of the defending team ’ s try line, all players from the
        defending team must have both feet on or behind their try line and no
        other part of the body in contact with the ground forward of their try
        line. ruling = a penalty to the attacking team at the seven ( 7 ) metre
        line directly forward of the point of the infringement.
      - >-
        fit playing rules - 5th edition copyright © touch football australia
        2020 17 24. 3 at the commencement of the drop - off, if there is a
        player serving time in the sin bin and is yet to complete the required
        time, their team commences the drop - off with one ( 1 ) less player on
        the field than their opposition and continues to play with one ( 1 )
        player less until the sin bin period has been completed. 24. 4 at the
        commencement of the drop - off, if a team has had a player dismissed for
        the remainder of the match that team continues to play with one ( 1 )
        player less than the opposition team for the duration of the drop - off.
        24. 5 for the avoidance of doubt for clauses 24. 3 and 24. 4 the non -
        offending team will retain a numerical advantage on the field of play
        during the drop - off. 25 match officials 25. 1 the referee is the sole
        judge on all match related matters inside the perimeter for the duration
        of a match, has jurisdiction over all players, coaches and officials and
        is required to : 25. 1. 1 inspect the field of play, line markings and
        markers prior to the commencement of the match to ensure the safety of
        all participants.
      - >-
        these rules in no way restrict any nta or their authorised competition
        providers from having different match conditions to these rules. any
        adaptation of or alterations to the rules for local competitions should
        be clearly articulated in relevant competition guidelines and be readily
        available for players, coaches and referees alike preamble copyright ©
        touch football australia 2020 all rights reserved. these touch football
        rules are protected by copyright laws. except as permitted under the
        copyright act, these rules must not be reproduced by any process,
        electronic or otherwise, without the written permission of touch
        football australia. fit playing rules - 5th edition copyright © touch
        football australia 2020 appendix 1 – field of play contents 01 i the
        field of play 5 02 i player registration 5 03 i the ball 6 04 i playing
        uniform 6 05 i team composition 6 06 i team coach and team officials 7
        07 i commencement and recommencement of play 7 08 i match duration 8 09
        i possession 8 10 i the touch 9 11 i passing 10 12 i ball touched in
        flight 10 13 i the rollball 11 14 i scoring 13 15 i offside 13 16 i
        obstruction 14 17 i interchange 14 18 i penalty 15 19 i advantage 16 20
        i misconduct 16 21 i forced interchange 16 22 i sin bin 16 23 i
        dismissal 17 24 i drop - off 17 25 i match officials 18 fit playing
        rules - 5th edition copyright © touch football australia 2020 fit
        playing rules - 5th edition copyright © touch football australia 2020
        definitions and terminology unless the contrary intention appears, the
        following definitions and terminology apply to the game of touch : term /
        phrase definition / description advantage the period of time after an
        infringement in which the non - offending side has the opportunity to
        gain advantage either territorial, tactical or in the form of a try.
  - source_sentence: >-
      What is the consequence if a defending team is penalized three times in
      their seven-meter zone during a single possession?
    sentences:
      - >-
        5th edition rules touch football tion rules touch football touch
        football australia ( tfa ) undertook an extensive internal review of
        their domestic playing rules throughout 2018 and 2019. the review was
        led by an vastly experienced group of current and past players, coaches,
        referees and administrators of the sport from community competitions to
        the elite international game. this group consulted broadly within the
        australian community to develop a set of playing rules that could be
        applied across all levels of the sport. the result was the tfa 8th
        edition playing rules. at the federation of international touch paris
        convention held in october 2019 touch football australia presented the
        tfa 8th edition playing rules and subsequently offered fit and all
        national touch associations ( ntas ) royalty free rights to use the
        newly developed rules. consequently, the fit board resolved to adopt the
        tfa 8th edition playing rules as the 5th edition fit playing rules to be
        used across all levels of the game internationally. fit and its members
        acknowledge and thank touch football australia for the rights to use
        these rules. whilst consistency in the application of the rules of the
        game is important, fit encourages its members to offer features in local
        competition rules to ensure that all participants enjoy a high quality
        experience.
      - >-
        17. 2 there is no limit to the number of times a player may interchange.
        17. 3 interchange players must remain in their interchange area for the
        duration of the match. 17. 4 interchanges may only occur after the
        player leaving the field of play has entered the interchange area. 17. 5
        players leaving or entering the field of play shall not hinder or
        obstruct play. ruling = a penalty to the non - offending team at the
        point of the infringement. 17. 6 players entering the field of play must
        take up an onside position before becoming involved in play. fit playing
        rules - 5th edition 14 copyright © touch football australia 2020 ruling
        = a penalty to the non - offending team at the point of the
        infringement. 17. 7 when an intercept has occurred or a line break made,
        players are not permitted to interchange until the next touch has been
        made or ball becomes dead. ruling a = if a player enters the field of
        play and prevents the scoring of a try, a penalty try will be awarded
        and the offending player sent to the sin bin.
      - >-
        18. 5 the mark must be indicated by the referee before a penalty tap is
        taken. 18. 6 the penalty tap must be performed without delay after the
        referee indicates the mark. ruling = a penalty to the non - offending
        team at the point of infringement. 18. 7 a player may perform a rollball
        instead of a penalty tap and the player who receives the ball does not
        become the half. 18. 8 if the defending team is penalised three ( 3 )
        times upon entering their seven metre zone during a single possession,
        the last offending player will be given an exclusion until the end of
        that possession. 18. 9 a penalty try is awarded if any action by a
        player, team official or spectator, deemed by the referee to be contrary
        to the rules or spirit of the game clearly prevents the attacking team
        from scoring a try. fit playing rules - 5th edition copyright © touch
        football australia 2020 15 19 advantage 19. 1 where a defending team
        player is offside at a tap or rollball and attempts to interfere with
        play, the referee will allow advantage or award a penalty, whichever is
        of greater advantage to the attacking team.

SentenceTransformer based on sentence-transformers/multi-qa-MiniLM-L6-dot-v1

This is a sentence-transformers model finetuned from sentence-transformers/multi-qa-MiniLM-L6-dot-v1. It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

Model Sources

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
  (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("Trelis/multi-qa-MiniLM-L6-dot-v1-ft-pairs-4-cst-epoch-s1")
# Run inference
sentences = [
    'What is the consequence if a defending team is penalized three times in their seven-meter zone during a single possession?',
    '18. 5 the mark must be indicated by the referee before a penalty tap is taken. 18. 6 the penalty tap must be performed without delay after the referee indicates the mark. ruling = a penalty to the non - offending team at the point of infringement. 18. 7 a player may perform a rollball instead of a penalty tap and the player who receives the ball does not become the half. 18. 8 if the defending team is penalised three ( 3 ) times upon entering their seven metre zone during a single possession, the last offending player will be given an exclusion until the end of that possession. 18. 9 a penalty try is awarded if any action by a player, team official or spectator, deemed by the referee to be contrary to the rules or spirit of the game clearly prevents the attacking team from scoring a try. fit playing rules - 5th edition copyright © touch football australia 2020 15 19 advantage 19. 1 where a defending team player is offside at a tap or rollball and attempts to interfere with play, the referee will allow advantage or award a penalty, whichever is of greater advantage to the attacking team.',
    '5th edition rules touch football tion rules touch football touch football australia ( tfa ) undertook an extensive internal review of their domestic playing rules throughout 2018 and 2019. the review was led by an vastly experienced group of current and past players, coaches, referees and administrators of the sport from community competitions to the elite international game. this group consulted broadly within the australian community to develop a set of playing rules that could be applied across all levels of the sport. the result was the tfa 8th edition playing rules. at the federation of international touch paris convention held in october 2019 touch football australia presented the tfa 8th edition playing rules and subsequently offered fit and all national touch associations ( ntas ) royalty free rights to use the newly developed rules. consequently, the fit board resolved to adopt the tfa 8th edition playing rules as the 5th edition fit playing rules to be used across all levels of the game internationally. fit and its members acknowledge and thank touch football australia for the rights to use these rules. whilst consistency in the application of the rules of the game is important, fit encourages its members to offer features in local competition rules to ensure that all participants enjoy a high quality experience.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 384]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]

Training Details

Training Hyperparameters

Non-Default Hyperparameters

  • eval_strategy: steps
  • per_device_train_batch_size: 32
  • per_device_eval_batch_size: 32
  • learning_rate: 2e-05
  • num_train_epochs: 4
  • lr_scheduler_type: constant
  • warmup_ratio: 0.3

All Hyperparameters

Click to expand
  • overwrite_output_dir: False
  • do_predict: False
  • eval_strategy: steps
  • prediction_loss_only: True
  • per_device_train_batch_size: 32
  • per_device_eval_batch_size: 32
  • per_gpu_train_batch_size: None
  • per_gpu_eval_batch_size: None
  • gradient_accumulation_steps: 1
  • eval_accumulation_steps: None
  • learning_rate: 2e-05
  • weight_decay: 0.0
  • adam_beta1: 0.9
  • adam_beta2: 0.999
  • adam_epsilon: 1e-08
  • max_grad_norm: 1.0
  • num_train_epochs: 4
  • max_steps: -1
  • lr_scheduler_type: constant
  • lr_scheduler_kwargs: {}
  • warmup_ratio: 0.3
  • warmup_steps: 0
  • log_level: passive
  • log_level_replica: warning
  • log_on_each_node: True
  • logging_nan_inf_filter: True
  • save_safetensors: True
  • save_on_each_node: False
  • save_only_model: False
  • restore_callback_states_from_checkpoint: False
  • no_cuda: False
  • use_cpu: False
  • use_mps_device: False
  • seed: 42
  • data_seed: None
  • jit_mode_eval: False
  • use_ipex: False
  • bf16: False
  • fp16: False
  • fp16_opt_level: O1
  • half_precision_backend: auto
  • bf16_full_eval: False
  • fp16_full_eval: False
  • tf32: None
  • local_rank: 0
  • ddp_backend: None
  • tpu_num_cores: None
  • tpu_metrics_debug: False
  • debug: []
  • dataloader_drop_last: False
  • dataloader_num_workers: 0
  • dataloader_prefetch_factor: None
  • past_index: -1
  • disable_tqdm: False
  • remove_unused_columns: True
  • label_names: None
  • load_best_model_at_end: False
  • ignore_data_skip: False
  • fsdp: []
  • fsdp_min_num_params: 0
  • fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
  • fsdp_transformer_layer_cls_to_wrap: None
  • accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
  • deepspeed: None
  • label_smoothing_factor: 0.0
  • optim: adamw_torch
  • optim_args: None
  • adafactor: False
  • group_by_length: False
  • length_column_name: length
  • ddp_find_unused_parameters: None
  • ddp_bucket_cap_mb: None
  • ddp_broadcast_buffers: False
  • dataloader_pin_memory: True
  • dataloader_persistent_workers: False
  • skip_memory_metrics: True
  • use_legacy_prediction_loop: False
  • push_to_hub: False
  • resume_from_checkpoint: None
  • hub_model_id: None
  • hub_strategy: every_save
  • hub_private_repo: False
  • hub_always_push: False
  • gradient_checkpointing: False
  • gradient_checkpointing_kwargs: None
  • include_inputs_for_metrics: False
  • eval_do_concat_batches: True
  • fp16_backend: auto
  • push_to_hub_model_id: None
  • push_to_hub_organization: None
  • mp_parameters:
  • auto_find_batch_size: False
  • full_determinism: False
  • torchdynamo: None
  • ray_scope: last
  • ddp_timeout: 1800
  • torch_compile: False
  • torch_compile_backend: None
  • torch_compile_mode: None
  • dispatch_batches: None
  • split_batches: None
  • include_tokens_per_second: False
  • include_num_input_tokens_seen: False
  • neftune_noise_alpha: None
  • optim_target_modules: None
  • batch_eval_metrics: False
  • eval_on_start: False
  • batch_sampler: batch_sampler
  • multi_dataset_batch_sampler: proportional

Training Logs

Epoch Step Training Loss loss
0.3333 2 1.7279 -
0.5 3 - 1.3621
0.6667 4 1.4819 -
1.0 6 1.5272 1.2755
1.3333 8 1.2528 -
1.5 9 - 1.2600
1.6667 10 1.421 -
2.0 12 1.1836 1.2422
2.3333 14 1.2527 -
2.5 15 - 1.2317
2.6667 16 1.485 -
3.0 18 0.8239 1.1883
3.3333 20 1.1028 -
3.5 21 - 1.1533
3.6667 22 0.9746 -
4.0 24 0.816 1.1237

Framework Versions

  • Python: 3.10.12
  • Sentence Transformers: 3.0.1
  • Transformers: 4.42.3
  • PyTorch: 2.1.1+cu121
  • Accelerate: 0.31.0
  • Datasets: 2.17.1
  • Tokenizers: 0.19.1

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

MultipleNegativesRankingLoss

@misc{henderson2017efficient,
    title={Efficient Natural Language Response Suggestion for Smart Reply}, 
    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
    year={2017},
    eprint={1705.00652},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}