Hugging Face's logo

rjnClarke
/
bgem3-shakespeare_st_3

Sentence Similarity
sentence-transformers
Safetensors
xlm-roberta
feature-extraction
Generated from Trainer
dataset_size:10352
loss:MultipleNegativesRankingLoss
Eval Results
text-embeddings-inference
Inference Endpoints
Model card Files Community
bgem3-shakespeare_st_3 / README.md
rjnClarke's picture
rjnClarke
Add new SentenceTransformer model.
3f71b3b verified
preview code
|
raw
history blame contribute delete
52.3 kB
---
base_model: BAAI/bge-m3
datasets: []
language: []
library_name: sentence-transformers
metrics:
- cosine_accuracy@1
- cosine_accuracy@3
- cosine_accuracy@5
- cosine_accuracy@10
- cosine_precision@1
- cosine_precision@3
- cosine_precision@5
- cosine_precision@10
- cosine_recall@1
- cosine_recall@3
- cosine_recall@5
- cosine_recall@10
- cosine_ndcg@10
- cosine_mrr@10
- cosine_map@100
- dot_accuracy@1
- dot_accuracy@3
- dot_accuracy@5
- dot_accuracy@10
- dot_precision@1
- dot_precision@3
- dot_precision@5
- dot_precision@10
- dot_recall@1
- dot_recall@3
- dot_recall@5
- dot_recall@10
- dot_ndcg@10
- dot_mrr@10
- dot_map@100
pipeline_tag: sentence-similarity
tags:
- sentence-transformers
- sentence-similarity
- feature-extraction
- generated_from_trainer
- dataset_size:10352
- loss:MultipleNegativesRankingLoss
widget:
- source_sentence: Othello requests for Desdemona to be brought to the Sagittary to
speak on his behalf in front of the Duke.
sentences:
- "Or with some dram conjured to this effect,\n He wrought upon her. DUKE. \
\ To vouch this is no proof, Without more certain and more\
\ overt test Than these thin habits and poor likelihoods Of modern seeming\
\ do prefer against him. FIRST SENATOR. But, Othello, speak. Did you by indirect\
\ and forced courses Subdue and poison this young maid's affections? Or\
\ came it by request, and such fair question As soul to soul affordeth? OTHELLO.\
\ I do beseech you, Send for the lady to the Sagittary,\
\ And let her speak of me before her father. If you do find me foul in her\
\ report, The trust, the office I do hold of you, Not only take away,\
\ but let your sentence Even fall upon my life. DUKE. \
\ Fetch Desdemona hither. OTHELLO. Ancient, conduct them; you best know the place.\
\ Exeunt Iago and Attendants. And\
\ till she come, as truly as to heaven I do confess the vices of my blood,\
\ So justly to your grave ears I'll present How I did thrive in this fair\
\ lady's love And she in mine. DUKE. Say it, Othello. OTHELLO. Her father\
\ loved me, oft invited me, Still question'd me the story of my life From\
\ year to year, the battles, sieges, fortunes, That I have pass'd. I ran\
\ it through, even from my boyish days To the very moment that he bade me tell\
\ it: Wherein I spake of most disastrous chances,\n Of moving accidents\
\ by flood and field,\n"
- "Enter Lodovico, Desdemona, and Attendants. LODOVICO. God save the worthy general!\n\
\ OTHELLO. With all my heart, sir. LODOVICO.\
\ The Duke and Senators of Venice greet you. \
\ Gives him a letter. OTHELLO. I kiss the instrument of their\
\ pleasures. Opens the letter, and reads.\
\ DESDEMONA. And what's the news, good cousin Lodovico? IAGO. I am very glad\
\ to see you, signior; Welcome to Cyprus. LODOVICO. I thank you. How does\
\ Lieutenant Cassio? IAGO. Lives, sir. DESDEMONA. Cousin, there's fall'n between\
\ him and my lord An unkind breech; but you shall make all well. OTHELLO.\
\ Are you sure of that? DESDEMONA. My lord? OTHELLO. [Reads.] \"This fail you\
\ not to do, as you will-\" LODOVICO. He did not call; he's busy in the paper.\
\ Is there division 'twixt my lord and Cassio? DESDEMONA. A most unhappy one.\
\ I would do much To atone them, for the love I bear to Cassio. OTHELLO. Fire\
\ and brimstone! DESDEMONA. My lord? OTHELLO. Are you wise? DESDEMONA. What,\
\ is he angry? LODOVICO. May be the letter moved him; \
\ For, as I think, they do command him home, Deputing Cassio in his government.\
\ DESDEMONA. By my troth, I am glad on't. OTHELLO. \
\ Indeed! DESDEMONA. My lord?\n \
\ OTHELLO. I am glad to see you mad.\n"
- "HORTENSIO. Would all the world but he had quite forsworn!\n For me, that I\
\ may surely keep mine oath, I will be married to a wealtlly widow Ere three\
\ days pass, which hath as long lov'd me As I have lov'd this proud disdainful\
\ haggard. And so farewell, Signior Lucentio. Kindness in women, not their\
\ beauteous looks, Shall win my love; and so I take my leave, In resolution\
\ as I swore before. Exit TRANIO. Mistress Bianca, bless\
\ you with such grace As 'longeth to a lover's blessed case! Nay, I have\
\ ta'en you napping, gentle love, And have forsworn you with Hortensio. BIANCA.\
\ Tranio, you jest; but have you both forsworn me? TRANIO. Mistress, we have.\
\ LUCENTIO. Then we are rid of Licio. TRANIO. I' faith, he'll have a lusty widow\
\ now, That shall be woo'd and wedded in a day. BIANCA. God give him joy!\
\ TRANIO. Ay, and he'll tame her. BIANCA. He says so, Tranio. TRANIO. Faith,\
\ he is gone unto the taming-school. BIANCA. The taming-school! What, is there\
\ such a place? TRANIO. Ay, mistress; and Petruchio is the master, That teacheth\
\ tricks eleven and twenty long, To tame a shrew and charm her chattering tongue.\n\
\ Enter BIONDELLO BIONDELLO. O master, master, have watch'd\
\ so long\n That I am dog-weary; but at last I spied An ancient angel coming\
\ down the hill Will serve the turn. TRANIO. What is he, Biondello? BIONDELLO.\
\ Master, a mercatante or a pedant,\n I know not what; but formal in apparel,\n\
\ In gait and countenance surely like a father. LUCENTIO. And what of him,\
\ Tranio? TRANIO. If he be credulous and trust my tale, I'll make him glad\
\ to seem Vincentio, And give assurance to Baptista Minola As if he were\
\ the right Vincentio. Take in your love, and then let me alone. \
\ Exeunt LUCENTIO and BIANCA\n \
\ Enter a PEDANT PEDANT. God save you, sir!\n"
- source_sentence: In "King Lear," characters are embroiled in a war, with shifting
loyalties and power struggles, leading to complex relationships and betrayals.
sentences:
- "III.\nA churchyard.\nEnter Claudio, Don Pedro, and three or four with tapers,\n\
[followed by Musicians].\n Claud. Is this the monument of Leonato?\n Lord. It\
\ is, my lord.\n Claud. [reads from a scroll]\n Epitaph.\
\ Done to death by slanderous tongues\n Was the Hero that here\
\ lies. Death, in guerdon of her wrongs, Gives her fame which\
\ never dies. So the life that died with shame Lives in death with\
\ glorious fame.\n Hang thou there upon the tomb,\n \
\ [Hangs up the scroll.] Praising her when I am dumb. \
\ Now, music, sound, and sing your solemn hymn.\n Song.\
\ Pardon, goddess of the night,\n Those that slew thy virgin knight;\
\ For the which, with songs of woe, Round about her tomb they go.\
\ Midnight, assist our moan, Help us to sigh and groan \
\ Heavily, heavily, Graves, yawn and yield your dead, Till death\
\ be uttered Heavily, heavily.\n Claud. Now unto thy bones good night!\n\
\ Yearly will I do this rite. Pedro. Good morrow, masters. Put your torches\
\ out. The wolves have prey'd, and look, the gentle day, Before the wheels\
\ of Phoebus, round about Dapples the drowsy east with spots of grey.\n \
\ Thanks to you all, and leave us. Fare you well.\n Claud. Good morrow, masters.\
\ Each his several way. Pedro. Come, let us hence and put on other weeds, \
\ And then to Leonato's we will go. Claud. And Hymen now with luckier issue speeds\
\ Than this for whom we rend'red up this woe. Exeunt.\n"
- "And fortune led you well. You have the captives Who were the opposites of\
\ this day's strife. We do require them of you, so to use them As we shall\
\ find their merits and our safety May equally determine. Edm. Sir, I thought\
\ it fit To send the old and miserable King To some retention and appointed\
\ guard; Whose age has charms in it, whose title more, To pluck the\
\ common bosom on his side And turn our impress'd lances in our eyes Which\
\ do command them. With him I sent the Queen, My reason all the same; and\
\ they are ready To-morrow, or at further space, t' appear Where you shall\
\ hold your session. At this time We sweat and bleed: the friend hath lost\
\ his friend; And the best quarrels, in the heat, are curs'd By those\
\ that feel their sharpness. The question of Cordelia and her father Requires\
\ a fitter place. Alb. Sir, by your patience, I hold you but a subject of\
\ this war, Not as a brother. Reg. That's as we list to grace him. Methinks\
\ our pleasure might have been demanded Ere you had spoke so far. He led our\
\ powers, Bore the commission of my place and person, The which immediacy\
\ may well stand up\n And call itself your brother.\n"
- "Her infinite cunning with her modern grace\n Subdu'd me to her rate. She got\
\ the ring; And I had that which any inferior might At market-price have\
\ bought. DIANA. I must be patient. You that have turn'd off a first so noble\
\ wife May justly diet me. I pray you yet- Since you lack virtue, I will\
\ lose a husband- Send for your ring, I will return it home, And give me\
\ mine again. BERTRAM. I have it not. KING. What ring was yours, I pray you?\
\ DIANA. Sir, much like The same upon your finger. KING. Know you this ring?\
\ This ring was his of late. DIANA. And this was it I gave him, being abed. \
\ KING. The story, then, goes false you threw it him Out of a casement. DIANA.\
\ I have spoke the truth.\n Enter PAROLLES\n BERTRAM.\
\ My lord, I do confess the ring was hers. KING. You boggle shrewdly; every feather\
\ starts you. Is this the man you speak of? DIANA. Ay, my lord. KING. Tell\
\ me, sirrah-but tell me true I charge you, Not fearing the displeasure of\
\ your master, Which, on your just proceeding, I'll keep off- By him and\
\ by this woman here what know you? PAROLLES. So please your Majesty, my master\
\ hath been an honourable gentleman; tricks he hath had in him, which gentlemen\
\ have. KING. Come, come, to th' purpose. Did he love this woman? PAROLLES.\
\ Faith, sir, he did love her; but how? KING. How, I pray you?\n PAROLLES.\
\ He did love her, sir, as a gentleman loves a woman.\n"
- source_sentence: King Edward expresses a desire for peace and reconciliation with
all those present, including Queen Elizabeth, Lord Rivers, and Dorset.
sentences:
- "But what is not.\n BANQUO. Look, how our partner's rapt. MACBETH. [Aside.]\
\ If chance will have me King, why, chance may crown me Without my stir.\
\ BANQUO. New honors come upon him, Like our strange garments, cleave not\
\ to their mould But with the aid of use. MACBETH. [Aside.] Come what come\
\ may, Time and the hour runs through the roughest day. BANQUO. Worthy Macbeth,\
\ we stay upon your leisure. MACBETH. Give me your favor; my dull brain was wrought\
\ With things forgotten. Kind gentlemen, your pains Are register'd where\
\ every day I turn The leaf to read them. Let us toward the King. Think\
\ upon what hath chanced, and at more time, The interim having weigh'd it,\
\ let us speak Our free hearts each to other. BANQUO. Very gladly. MACBETH.\
\ Till then, enough. Come, friends. Exeunt.\n"
- "Have aught committed that is hardly borne\n To any in this presence, I desire\
\ To reconcile me to his friendly peace: 'Tis death to me to be at enmity;\
\ I hate it, and desire all good men's love. First, madam, I entreat true\
\ peace of you, Which I will purchase with my duteous service; Of you, my\
\ noble cousin Buckingham, If ever any grudge were lodg'd between us; \
\ Of you, and you, Lord Rivers, and of Dorset, That all without desert have\
\ frown'd on me; Of you, Lord Woodville, and, Lord Scales, of you; Dukes,\
\ earls, lords, gentlemen-indeed, of all. I do not know that Englishman alive\
\ With whom my soul is any jot at odds More than the infant that is born\
\ to-night. I thank my God for my humility. QUEEN ELIZABETH. A holy day shall\
\ this be kept hereafter. I would to God all strifes were well compounded.\
\ My sovereign lord, I do beseech your Highness To take our brother Clarence\
\ to your grace. GLOUCESTER. Why, madam, have I off'red love for this, To\
\ be so flouted in this royal presence? Who knows not that the gentle Duke\
\ is dead? [They all start] \
\ You do him injury to scorn his corse. KING EDWARD. Who knows not he is dead!\
\ Who knows he is? QUEEN ELIZABETH. All-seeing heaven, what a world is this!\
\ BUCKINGHAM. Look I so pale, Lord Dorset, as the rest? DORSET. Ay, my good\
\ lord; and no man in the presence But his red colour hath forsook his cheeks.\
\ KING EDWARD. Is Clarence dead? The order was revers'd. GLOUCESTER. But he,\
\ poor man, by your first order died, And that a winged Mercury did bear;\n\
\ Some tardy cripple bare the countermand\n That came too lag to see him\
\ buried. God grant that some, less noble and less loyal, Nearer in bloody\
\ thoughts, an not in blood, Deserve not worse than wretched Clarence did,\
\ And yet go current from suspicion!\n"
- "OTHELLO. Amen to that, sweet powers!\n I cannot speak enough\
\ of this content; It stops me here; it is too much of joy. And this, and\
\ this, the greatest discords be Kisses her. That e'er our hearts\
\ shall make! IAGO. [Aside.] O, you are well tuned now! \
\ But I'll set down the pegs that make this music, As honest as I am. OTHELLO.\
\ Come, let us to the castle. News, friends: our wars are done,\
\ the Turks are drown'd. How does my old acquaintance of this isle? Honey,\
\ you shall be well desired in Cyprus; I have found great love amongst them.\
\ O my sweet, I prattle out of fashion, and I dote In mine own comforts.\
\ I prithee, good Iago, Go to the bay and disembark my coffers. Bring thou\
\ the master to the citadel; He is a good one, and his worthiness Does challenge\
\ much respect. Come, Desdemona, Once more well met at Cyprus. \
\ Exeunt all but Iago and Roderigo. IAGO. Do thou meet\
\ me presently at the harbor. Come hither. If thou be'st valiant- as they say\
\ base men being in love have then a nobility in their natures more than is\
\ native to them- list me. The lieutenant tonight watches on the court of guard.\
\ First, I must tell thee this: Desdemona is directly in love with him. RODERIGO.\
\ With him? Why, 'tis not possible. IAGO. Lay thy finger thus, and let thy soul\
\ be instructed. Mark me with what violence she first loved the Moor, but for\
\ bragging and telling her fantastical lies. And will she love him still\
\ for prating? Let not thy discreet heart think it. Her eye must be fed;\
\ and what delight shall she have to look on the devil? When the blood is made\
\ dull with the act of sport, there should be, again to inflame it and to give\
\ satiety a fresh appetite,\n loveliness in favor, sympathy in years, manners,\
\ and beauties-\n"
- source_sentence: How does the character in the excerpt feel about being dishonored
openly?
sentences:
- "Where the dead corpse of Bassianus lay;\n I wrote the letter that thy father\
\ found, And hid the gold within that letter mention'd, Confederate with\
\ the Queen and her two sons; And what not done, that thou hast cause to rue,\
\ Wherein I had no stroke of mischief in it? I play'd the cheater for thy\
\ father's hand, And, when I had it, drew myself apart And almost broke\
\ my heart with extreme laughter. I pried me through the crevice of a wall,\
\ When, for his hand, he had his two sons' heads; Beheld his tears, and\
\ laugh'd so heartily That both mine eyes were rainy like to his; And when\
\ I told the Empress of this sport, She swooned almost at my pleasing tale,\
\ And for my tidings gave me twenty kisses. GOTH. What, canst thou say all\
\ this and never blush? AARON. Ay, like a black dog, as the saying is. LUCIUS.\
\ Art thou not sorry for these heinous deeds? AARON. Ay, that I had not done\
\ a thousand more. Even now I curse the day- and yet, I think, Few come\
\ within the compass of my curse- Wherein I did not some notorious ill; \
\ As kill a man, or else devise his death; Ravish a maid, or plot the way to\
\ do it; Accuse some innocent, and forswear myself; Set deadly enmity between\
\ two friends; Make poor men's cattle break their necks; Set fire on barns\
\ and hay-stacks in the night, And bid the owners quench them with their tears.\
\ Oft have I digg'd up dead men from their graves, And set them upright\
\ at their dear friends' door Even when their sorrows almost was forgot, \
\ And on their skins, as on the bark of trees,\n Have with my knife carved\
\ in Roman letters\n"
- "MESSALA. Lo, yonder, and Titinius mourning it.\n BRUTUS. Titinius' face is\
\ upward.\n CATO. He is slain. BRUTUS. O Julius Caesar, thou art mighty yet!\
\ Thy spirit walks abroad, and turns our swords In our own proper entrails.\
\ Low alarums. CATO. Brave Titinius! Look whe'er he have\
\ not crown'd dead Cassius! BRUTUS. Are yet two Romans living such as these?\
\ The last of all the Romans, fare thee well! It is impossible that ever\
\ Rome Should breed thy fellow. Friends, I owe moe tears To this dead man\
\ than you shall see me pay. I shall find time, Cassius, I shall find time.\
\ Come therefore, and to Thasos send his body; His funerals shall not be\
\ in our camp, Lest it discomfort us. Lucilius, come, And come, young Cato;\
\ let us to the field. Labio and Flavio, set our battles on. 'Tis three\
\ o'clock, and Romans, yet ere night We shall try fortune in a second fight.\
\ Exeunt.\n"
- "TITUS. Prince Bassianus, leave to plead my deeds.\n 'Tis thou and those that\
\ have dishonoured me. Rome and the righteous heavens be my judge How I\
\ have lov'd and honoured Saturnine! TAMORA. My worthy lord, if ever Tamora \
\ Were gracious in those princely eyes of thine, Then hear me speak indifferently\
\ for all; And at my suit, sweet, pardon what is past. SATURNINUS. What, madam!\
\ be dishonoured openly, And basely put it up without revenge? TAMORA. Not\
\ so, my lord; the gods of Rome forfend I should be author to dishonour you!\
\ But on mine honour dare I undertake For good Lord Titus' innocence in\
\ all, Whose fury not dissembled speaks his griefs. Then at my suit look\
\ graciously on him; Lose not so noble a friend on vain suppose, Nor with\
\ sour looks afflict his gentle heart. [Aside to SATURNINUS] My lord, be rul'd\
\ by me, be won at last; Dissemble all your griefs and discontents. \
\ You are but newly planted in your throne; Lest, then, the people, and patricians\
\ too, Upon a just survey take Titus' part, And so supplant you for ingratitude,\
\ Which Rome reputes to be a heinous sin, Yield at entreats, and then\
\ let me alone: I'll find a day to massacre them all, And raze their faction\
\ and their family, The cruel father and his traitorous sons, To whom I\
\ sued for my dear son's life; And make them know what 'tis to let a queen\
\ Kneel in the streets and beg for grace in vain.- Come, come, sweet Emperor;\
\ come, Andronicus. Take up this good old man, and cheer the heart\n That\
\ dies in tempest of thy angry frown.\n"
- source_sentence: King Henry V is preparing for an expedition to France to seek revenge
on the Dauphin for mocking him, and he urges his lords to quickly gather resources
and support for the impending war.
sentences:
- "LEWIS. The sun of heaven, methought, was loath to set,\n But stay'd and made\
\ the western welkin blush, When English measure backward their own ground\
\ In faint retire. O, bravely came we off, When with a volley of our needless\
\ shot, After such bloody toil, we bid good night; And wound our tott'ring\
\ colours clearly up, Last in the field and almost lords of it!\n \
\ Enter a MESSENGER MESSENGER. Where is my prince, the Dauphin?\n LEWIS.\
\ Here; what news? MESSENGER. The Count Melun is slain; the English lords \
\ By his persuasion are again fall'n off, And your supply, which you have wish'd\
\ so long, Are cast away and sunk on Goodwin Sands. LEWIS. Ah, foul shrewd\
\ news! Beshrew thy very heart!\n I did not think to be so sad to-night\n\
\ As this hath made me. Who was he that said King John did fly an hour or\
\ two before The stumbling night did part our weary pow'rs? MESSENGER. Whoever\
\ spoke it, it is true, my lord. LEWIS. keep good quarter and good care to-night;\
\ The day shall not be up so soon as I To try the fair adventure of to-morrow.\
\ Exeunt\n"
- "And that great minds, of partial indulgence\n To their benumbed wills, resist\
\ the same; There is a law in each well-order'd nation To curb those raging\
\ appetites that are Most disobedient and refractory. If Helen, then, be\
\ wife to Sparta's king- As it is known she is-these moral laws Of nature\
\ and of nations speak aloud To have her back return'd. Thus to persist \
\ In doing wrong extenuates not wrong, But makes it much more heavy. Hector's\
\ opinion Is this, in way of truth. Yet, ne'er the less, My spritely brethren,\
\ I propend to you In resolution to keep Helen still; For 'tis a cause that\
\ hath no mean dependence Upon our joint and several dignities. TROILUS. Why,\
\ there you touch'd the life of our design. Were it not glory that we more\
\ affected Than the performance of our heaving spleens, I would not wish\
\ a drop of Troyan blood Spent more in her defence. But, worthy Hector, \
\ She is a theme of honour and renown, A spur to valiant and magnanimous deeds,\
\ Whose present courage may beat down our foes, And fame in time to come\
\ canonize us; For I presume brave Hector would not lose So rich advantage\
\ of a promis'd glory As smiles upon the forehead of this action For the\
\ wide world's revenue. HECTOR. I am yours, You valiant offspring of great\
\ Priamus. I have a roisting challenge sent amongst The dull and factious\
\ nobles of the Greeks Will strike amazement to their drowsy spirits. I\
\ was advertis'd their great general slept,\n Whilst emulation in the army\
\ crept.\n This, I presume, will wake him. Exeunt\n"
- "That shall fly with them; for many a thousand widows\n Shall this his mock\
\ mock of their dear husbands; Mock mothers from their sons, mock castles down;\
\ And some are yet ungotten and unborn That shall have cause to curse the\
\ Dauphin's scorn. But this lies all within the will of God, To whom I do\
\ appeal; and in whose name, Tell you the Dauphin, I am coming on, To venge\
\ me as I may and to put forth My rightful hand in a well-hallow'd cause. \
\ So get you hence in peace; and tell the Dauphin His jest will savour but\
\ of shallow wit, When thousands weep more than did laugh at it. Convey\
\ them with safe conduct. Fare you well. \
\ Exeunt AMBASSADORS EXETER. This was a merry message. KING HENRY. We\
\ hope to make the sender blush at it. Therefore, my lords, omit no happy hour\
\ That may give furth'rance to our expedition; For we have now no thought\
\ in us but France, Save those to God, that run before our business. Therefore\
\ let our proportions for these wars Be soon collected, and all things thought\
\ upon That may with reasonable swiftness ad More feathers to our wings;\
\ for, God before, We'll chide this Dauphin at his father's door. Therefore\
\ let every man now task his thought That this fair action may on foot be brought.\
\ Exeunt\n"
model-index:
- name: SentenceTransformer based on BAAI/bge-m3
results:
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: Unknown
type: unknown
metrics:
- type: cosine_accuracy@1
value: 0.3822762814943527
name: Cosine Accuracy@1
- type: cosine_accuracy@3
value: 0.5234578627280626
name: Cosine Accuracy@3
- type: cosine_accuracy@5
value: 0.5825369244135534
name: Cosine Accuracy@5
- type: cosine_accuracy@10
value: 0.656385751520417
name: Cosine Accuracy@10
- type: cosine_precision@1
value: 0.3822762814943527
name: Cosine Precision@1
- type: cosine_precision@3
value: 0.1744859542426875
name: Cosine Precision@3
- type: cosine_precision@5
value: 0.11650738488271069
name: Cosine Precision@5
- type: cosine_precision@10
value: 0.06563857515204169
name: Cosine Precision@10
- type: cosine_recall@1
value: 0.3822762814943527
name: Cosine Recall@1
- type: cosine_recall@3
value: 0.5234578627280626
name: Cosine Recall@3
- type: cosine_recall@5
value: 0.5825369244135534
name: Cosine Recall@5
- type: cosine_recall@10
value: 0.656385751520417
name: Cosine Recall@10
- type: cosine_ndcg@10
value: 0.5142429769745347
name: Cosine Ndcg@10
- type: cosine_mrr@10
value: 0.46940583067863767
name: Cosine Mrr@10
- type: cosine_map@100
value: 0.4766478781892753
name: Cosine Map@100
- type: dot_accuracy@1
value: 0.3822762814943527
name: Dot Accuracy@1
- type: dot_accuracy@3
value: 0.5234578627280626
name: Dot Accuracy@3
- type: dot_accuracy@5
value: 0.5825369244135534
name: Dot Accuracy@5
- type: dot_accuracy@10
value: 0.656385751520417
name: Dot Accuracy@10
- type: dot_precision@1
value: 0.3822762814943527
name: Dot Precision@1
- type: dot_precision@3
value: 0.1744859542426875
name: Dot Precision@3
- type: dot_precision@5
value: 0.11650738488271069
name: Dot Precision@5
- type: dot_precision@10
value: 0.06563857515204169
name: Dot Precision@10
- type: dot_recall@1
value: 0.3822762814943527
name: Dot Recall@1
- type: dot_recall@3
value: 0.5234578627280626
name: Dot Recall@3
- type: dot_recall@5
value: 0.5825369244135534
name: Dot Recall@5
- type: dot_recall@10
value: 0.656385751520417
name: Dot Recall@10
- type: dot_ndcg@10
value: 0.5142429769745347
name: Dot Ndcg@10
- type: dot_mrr@10
value: 0.46940583067863767
name: Dot Mrr@10
- type: dot_map@100
value: 0.4766478781892753
name: Dot Map@100
---
# SentenceTransformer based on BAAI/bge-m3
This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [BAAI/bge-m3](https://huggingface.co/BAAI/bge-m3). It maps sentences & paragraphs to a 1024-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
## Model Details
### Model Description
- **Model Type:** Sentence Transformer
- **Base model:** [BAAI/bge-m3](https://huggingface.co/BAAI/bge-m3) <!-- at revision 5617a9f61b028005a4858fdac845db406aefb181 -->
- **Maximum Sequence Length:** 8192 tokens
- **Output Dimensionality:** 1024 tokens
- **Similarity Function:** Cosine Similarity
<!-- - **Training Dataset:** Unknown -->
<!-- - **Language:** Unknown -->
<!-- - **License:** Unknown -->
### Model Sources
- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
### Full Model Architecture
```
SentenceTransformer(
(0): Transformer({'max_seq_length': 8192, 'do_lower_case': False}) with Transformer model: XLMRobertaModel
(1): Pooling({'word_embedding_dimension': 1024, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
(2): Normalize()
)
```
## Usage
### Direct Usage (Sentence Transformers)
First install the Sentence Transformers library:
```bash
pip install -U sentence-transformers
```
Then you can load this model and run inference.
```python
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("rjnClarke/bgem3-shakespeare_st_3")
# Run inference
sentences = [
'King Henry V is preparing for an expedition to France to seek revenge on the Dauphin for mocking him, and he urges his lords to quickly gather resources and support for the impending war.',
"That shall fly with them; for many a thousand widows\n Shall this his mock mock of their dear husbands; Mock mothers from their sons, mock castles down; And some are yet ungotten and unborn That shall have cause to curse the Dauphin's scorn. But this lies all within the will of God, To whom I do appeal; and in whose name, Tell you the Dauphin, I am coming on, To venge me as I may and to put forth My rightful hand in a well-hallow'd cause. So get you hence in peace; and tell the Dauphin His jest will savour but of shallow wit, When thousands weep more than did laugh at it. Convey them with safe conduct. Fare you well. Exeunt AMBASSADORS EXETER. This was a merry message. KING HENRY. We hope to make the sender blush at it. Therefore, my lords, omit no happy hour That may give furth'rance to our expedition; For we have now no thought in us but France, Save those to God, that run before our business. Therefore let our proportions for these wars Be soon collected, and all things thought upon That may with reasonable swiftness ad More feathers to our wings; for, God before, We'll chide this Dauphin at his father's door. Therefore let every man now task his thought That this fair action may on foot be brought. Exeunt\n",
"And that great minds, of partial indulgence\n To their benumbed wills, resist the same; There is a law in each well-order'd nation To curb those raging appetites that are Most disobedient and refractory. If Helen, then, be wife to Sparta's king- As it is known she is-these moral laws Of nature and of nations speak aloud To have her back return'd. Thus to persist In doing wrong extenuates not wrong, But makes it much more heavy. Hector's opinion Is this, in way of truth. Yet, ne'er the less, My spritely brethren, I propend to you In resolution to keep Helen still; For 'tis a cause that hath no mean dependence Upon our joint and several dignities. TROILUS. Why, there you touch'd the life of our design. Were it not glory that we more affected Than the performance of our heaving spleens, I would not wish a drop of Troyan blood Spent more in her defence. But, worthy Hector, She is a theme of honour and renown, A spur to valiant and magnanimous deeds, Whose present courage may beat down our foes, And fame in time to come canonize us; For I presume brave Hector would not lose So rich advantage of a promis'd glory As smiles upon the forehead of this action For the wide world's revenue. HECTOR. I am yours, You valiant offspring of great Priamus. I have a roisting challenge sent amongst The dull and factious nobles of the Greeks Will strike amazement to their drowsy spirits. I was advertis'd their great general slept,\n Whilst emulation in the army crept.\n This, I presume, will wake him. Exeunt\n",
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 1024]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]
```
<!--
### Direct Usage (Transformers)
<details><summary>Click to see the direct usage in Transformers</summary>
</details>
-->
<!--
### Downstream Usage (Sentence Transformers)
You can finetune this model on your own dataset.
<details><summary>Click to expand</summary>
</details>
-->
<!--
### Out-of-Scope Use
*List how the model may foreseeably be misused and address what users ought not to do with the model.*
-->
## Evaluation
### Metrics
#### Information Retrieval
* Evaluated with [<code>InformationRetrievalEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.InformationRetrievalEvaluator)
| Metric | Value |
|:--------------------|:-----------|
| cosine_accuracy@1 | 0.3823 |
| cosine_accuracy@3 | 0.5235 |
| cosine_accuracy@5 | 0.5825 |
| cosine_accuracy@10 | 0.6564 |
| cosine_precision@1 | 0.3823 |
| cosine_precision@3 | 0.1745 |
| cosine_precision@5 | 0.1165 |
| cosine_precision@10 | 0.0656 |
| cosine_recall@1 | 0.3823 |
| cosine_recall@3 | 0.5235 |
| cosine_recall@5 | 0.5825 |
| cosine_recall@10 | 0.6564 |
| cosine_ndcg@10 | 0.5142 |
| cosine_mrr@10 | 0.4694 |
| **cosine_map@100** | **0.4766** |
| dot_accuracy@1 | 0.3823 |
| dot_accuracy@3 | 0.5235 |
| dot_accuracy@5 | 0.5825 |
| dot_accuracy@10 | 0.6564 |
| dot_precision@1 | 0.3823 |
| dot_precision@3 | 0.1745 |
| dot_precision@5 | 0.1165 |
| dot_precision@10 | 0.0656 |
| dot_recall@1 | 0.3823 |
| dot_recall@3 | 0.5235 |
| dot_recall@5 | 0.5825 |
| dot_recall@10 | 0.6564 |
| dot_ndcg@10 | 0.5142 |
| dot_mrr@10 | 0.4694 |
| dot_map@100 | 0.4766 |
<!--
## Bias, Risks and Limitations
*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
-->
<!--
### Recommendations
*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
-->
## Training Details
### Training Dataset
#### Unnamed Dataset
* Size: 10,352 training samples
* Columns: <code>sentence_0</code> and <code>sentence_1</code>
* Approximate statistics based on the first 1000 samples:
| | sentence_0 | sentence_1 |
|:--------|:-----------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|
| type | string | string |
| details | <ul><li>min: 10 tokens</li><li>mean: 26.13 tokens</li><li>max: 71 tokens</li></ul> | <ul><li>min: 19 tokens</li><li>mean: 408.21 tokens</li><li>max: 610 tokens</li></ul> |
* Samples:
| sentence_0 | sentence_1 |
|:---------------------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| <code>Who is trying to convince Coriolanus to have mercy on Rome and its citizens?</code> | <code>Enter CORIOLANUS with AUFIDIUS CORIOLANUS. What's the matter?<br> MENENIUS. Now, you companion, I'll say an errand for you; you shall know now that I am in estimation; you shall perceive that a Jack guardant cannot office me from my son Coriolanus. Guess but by my entertainment with him if thou stand'st not i' th' state of hanging, or of some death more long in spectatorship and crueller in suffering; behold now presently, and swoon for what's to come upon thee. The glorious gods sit in hourly synod about thy particular prosperity, and love thee no worse than thy old father Menenius does! O my son! my son! thou art preparing fire for us; look thee, here's water to quench it. I was hardly moved to come to thee; but being assured none but myself could move thee, I have been blown out of your gates with sighs, and conjure thee to pardon Rome and thy petitionary countrymen. The good gods assuage thy wrath, and turn the dregs of it upon this varlet here; this, who, like a block, hath denied my access to thee. CORIOLANUS. Away! MENENIUS. How! away! CORIOLANUS. Wife, mother, child, I know not. My affairs Are servanted to others. Though I owe My revenge properly, my remission lies In Volscian breasts. That we have been familiar, Ingrate forgetfulness shall poison rather Than pity note how much. Therefore be gone. Mine ears against your suits are stronger than Your gates against my force. Yet, for I lov'd thee, Take this along; I writ it for thy sake [Gives a letter] And would have sent it. Another word, Menenius,<br> I will not hear thee speak. This man, Aufidius,<br></code> |
| <code>The English nobility receive sad tidings of losses in France and the need for action.</code> | <code>Sad tidings bring I to you out of France,<br> Of loss, of slaughter, and discomfiture: Guienne, Champagne, Rheims, Orleans, Paris, Guysors, Poictiers, are all quite lost. BEDFORD. What say'st thou, man, before dead Henry's corse? Speak softly, or the loss of those great towns Will make him burst his lead and rise from death. GLOUCESTER. Is Paris lost? Is Rouen yielded up? If Henry were recall'd to life again, These news would cause him once more yield the ghost. EXETER. How were they lost? What treachery was us'd? MESSENGER. No treachery, but want of men and money. Amongst the soldiers this is muttered That here you maintain several factions; And whilst a field should be dispatch'd and fought, You are disputing of your generals: One would have ling'ring wars, with little cost; Another would fly swift, but wanteth wings; A third thinks, without expense at all, By guileful fair words peace may be obtain'd. Awake, awake, English nobility! Let not sloth dim your honours, new-begot. Cropp'd are the flower-de-luces in your arms; Of England's coat one half is cut away. EXETER. Were our tears wanting to this funeral, These tidings would call forth their flowing tides. BEDFORD. Me they concern; Regent I am of France. Give me my steeled coat; I'll fight for France. Away with these disgraceful wailing robes! Wounds will I lend the French instead of eyes, To weep their intermissive miseries.<br> Enter a second MESSENGER SECOND MESSENGER. Lords, view these letters full of bad<br> mischance.<br></code> |
| <code>What are the main locations where the characters are headed for battle?</code> | <code>I may dispose of him.<br> King. With all my heart. Prince. Then brother John of Lancaster, to you This honourable bounty shall belong. Go to the Douglas and deliver him Up to his pleasure, ransomless and free. His valour shown upon our crests today Hath taught us how to cherish such high deeds, Even in the bosom of our adversaries. John. I thank your Grace for this high courtesy, Which I shall give away immediately. King. Then this remains, that we divide our power. You, son John, and my cousin Westmoreland, Towards York shall bend you with your dearest speed To meet Northumberland and the prelate Scroop, Who, as we hear, are busily in arms. Myself and you, son Harry, will towards Wales To fight with Glendower and the Earl of March. Rebellion in this laud shall lose his sway, Meeting the check of such another day; And since this business so fair is done, Let us not leave till all our own be won. Exeunt.<br></code> |
* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
```json
{
"scale": 20.0,
"similarity_fct": "cos_sim"
}
```
### Training Hyperparameters
#### Non-Default Hyperparameters
- `batch_sampler`: no_duplicates
- `multi_dataset_batch_sampler`: round_robin
#### All Hyperparameters
<details><summary>Click to expand</summary>
- `overwrite_output_dir`: False
- `do_predict`: False
- `eval_strategy`: no
- `prediction_loss_only`: True
- `per_device_train_batch_size`: 8
- `per_device_eval_batch_size`: 8
- `per_gpu_train_batch_size`: None
- `per_gpu_eval_batch_size`: None
- `gradient_accumulation_steps`: 1
- `eval_accumulation_steps`: None
- `learning_rate`: 5e-05
- `weight_decay`: 0.0
- `adam_beta1`: 0.9
- `adam_beta2`: 0.999
- `adam_epsilon`: 1e-08
- `max_grad_norm`: 1
- `num_train_epochs`: 3
- `max_steps`: -1
- `lr_scheduler_type`: linear
- `lr_scheduler_kwargs`: {}
- `warmup_ratio`: 0.0
- `warmup_steps`: 0
- `log_level`: passive
- `log_level_replica`: warning
- `log_on_each_node`: True
- `logging_nan_inf_filter`: True
- `save_safetensors`: True
- `save_on_each_node`: False
- `save_only_model`: False
- `restore_callback_states_from_checkpoint`: False
- `no_cuda`: False
- `use_cpu`: False
- `use_mps_device`: False
- `seed`: 42
- `data_seed`: None
- `jit_mode_eval`: False
- `use_ipex`: False
- `bf16`: False
- `fp16`: False
- `fp16_opt_level`: O1
- `half_precision_backend`: auto
- `bf16_full_eval`: False
- `fp16_full_eval`: False
- `tf32`: None
- `local_rank`: 0
- `ddp_backend`: None
- `tpu_num_cores`: None
- `tpu_metrics_debug`: False
- `debug`: []
- `dataloader_drop_last`: False
- `dataloader_num_workers`: 0
- `dataloader_prefetch_factor`: None
- `past_index`: -1
- `disable_tqdm`: False
- `remove_unused_columns`: True
- `label_names`: None
- `load_best_model_at_end`: False
- `ignore_data_skip`: False
- `fsdp`: []
- `fsdp_min_num_params`: 0
- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
- `fsdp_transformer_layer_cls_to_wrap`: None
- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
- `deepspeed`: None
- `label_smoothing_factor`: 0.0
- `optim`: adamw_torch
- `optim_args`: None
- `adafactor`: False
- `group_by_length`: False
- `length_column_name`: length
- `ddp_find_unused_parameters`: None
- `ddp_bucket_cap_mb`: None
- `ddp_broadcast_buffers`: False
- `dataloader_pin_memory`: True
- `dataloader_persistent_workers`: False
- `skip_memory_metrics`: True
- `use_legacy_prediction_loop`: False
- `push_to_hub`: False
- `resume_from_checkpoint`: None
- `hub_model_id`: None
- `hub_strategy`: every_save
- `hub_private_repo`: False
- `hub_always_push`: False
- `gradient_checkpointing`: False
- `gradient_checkpointing_kwargs`: None
- `include_inputs_for_metrics`: False
- `eval_do_concat_batches`: True
- `fp16_backend`: auto
- `push_to_hub_model_id`: None
- `push_to_hub_organization`: None
- `mp_parameters`:
- `auto_find_batch_size`: False
- `full_determinism`: False
- `torchdynamo`: None
- `ray_scope`: last
- `ddp_timeout`: 1800
- `torch_compile`: False
- `torch_compile_backend`: None
- `torch_compile_mode`: None
- `dispatch_batches`: None
- `split_batches`: None
- `include_tokens_per_second`: False
- `include_num_input_tokens_seen`: False
- `neftune_noise_alpha`: None
- `optim_target_modules`: None
- `batch_eval_metrics`: False
- `eval_on_start`: False
- `batch_sampler`: no_duplicates
- `multi_dataset_batch_sampler`: round_robin
</details>
### Training Logs
| Epoch | Step | Training Loss | cosine_map@100 |
|:------:|:----:|:-------------:|:--------------:|
| 0.3864 | 500 | 0.5974 | - |
| 0.7728 | 1000 | 0.5049 | - |
| 1.0 | 1294 | - | 0.4475 |
| 1.1592 | 1500 | 0.4202 | - |
| 1.5456 | 2000 | 0.2689 | - |
| 1.9320 | 2500 | 0.2452 | - |
| 2.0 | 2588 | - | 0.4758 |
| 2.3184 | 3000 | 0.17 | - |
| 2.7048 | 3500 | 0.1301 | - |
| 3.0 | 3882 | - | 0.4766 |
### Framework Versions
- Python: 3.10.12
- Sentence Transformers: 3.0.1
- Transformers: 4.42.4
- PyTorch: 2.3.1+cu121
- Accelerate: 0.32.1
- Datasets: 2.19.1
- Tokenizers: 0.19.1
## Citation
### BibTeX
#### Sentence Transformers
```bibtex
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}
```
#### MultipleNegativesRankingLoss
```bibtex
@misc{henderson2017efficient,
title={Efficient Natural Language Response Suggestion for Smart Reply},
author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
year={2017},
eprint={1705.00652},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```
<!--
## Glossary
*Clearly define terms in order to be accessible across audiences.*
-->
<!--
## Model Card Authors
*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
-->
<!--
## Model Card Contact
*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
-->