Add new SentenceTransformer model

README.md

@@ -12,53 +12,51 @@ tags:
 - retrieval
 - reranking
 - generated_from_trainer
-- dataset_size:13667
+- dataset_size:9233417
 - loss:ArcFaceInBatchLoss
 base_model: sentence-transformers/all-MiniLM-L6-v2
 widget:
-- source_sentence: It was mobilized in December 2014 from elements of the dissolved
-    51st Mechanized Brigade and newly formed units .
+- source_sentence: Hayley Vaughan portrayed Ripa on the ABC daytime soap opera , ``
+    All My Children `` , between 1990 and 2002 .
   sentences:
-  - This North-South route falls entirely in the Belgian territory and runs together
-    with the Belgian roads N31 and A17 .
-  - It was mobilized in December 2014 from elements of the disbanded 51st Mechanized
-    Brigade and newly formed units .
-  - All windows are double wood , hung up with a single light .
-- source_sentence: It is located at Ellison Bay , in the town of Liberty Grove , Wisconsin
-    .
+  - Traxxpad is a music application for Sony 's PlayStation Portable published by
+    Definitive Studios and developed by Eidos Interactive .
+  - Between 1990 and 2002 , Hayley Vaughan Ripa portrayed in the ABC soap opera ``
+    All My Children `` .
+  - Between 1990 and 2002 , Ripa Hayley portrayed Vaughan in the ABC soap opera ``
+    All My Children `` .
+- source_sentence: Olivella monilifera is a species of dwarf sea snail , small gastropod
+    mollusk in the family Olivellidae , the marine olives .
   sentences:
-  - It is located in Ellison Bay , in the town of Liberty Grove , Wisconsin .
-  - It is located in Liberty Grove , Wisconsin , in the town of Ellison Bay .
-  - 'The Hadejia River ( Hausa : `` kogin Haɗeja `` ) is a river in northern Nigeria
-    and is a tributary of the Yobe River ( Komadugu Yobe ) .'
-- source_sentence: Both long and short vowels can be nasalized ( differentiation between
-    `` acces `` and `` Ä cces `` below ) , but long nasal vowels are more common .
+  - Olivella monilifera is a species of the dwarf - sea snail , small gastropod mollusk
+    in the Olivellidae family , the marine olives .
+  - He was cut by the Browns after being signed by the Bills in 2013 . He was later
+    released .
+  - Olivella monilifera is a kind of sea snail , marine gastropod mollusk in the Olivellidae
+    family , the dwarf olives .
+- source_sentence: Hayashi said that Mackey `` is a sort of `` of the original model
+    for Tenchi .
   sentences:
-  - Both long and short vowels can be nasalized ( the distinction between `` acces
-    `` and `` ącces `` below ) , but long nasal vowels are more common .
-  - Wilson was a member of the Senate from 1844 to 1846 and 1850 to 1852 . From 1851
-    to 1852 he was the Massachusetts State Senate 's President .
-  - Both long vowels can be nasalized ( the distinction between `` acces `` and ``
-    ącces `` below ) , but long and short nasal vowels are more common .
-- source_sentence: At that time , on June 22 , 1754 , Edward Bentham married Bentham
-    Elizabeth Bates ( d . 1790 ) from Hampshire in the nearby county of Alton .
+  - In the summer of 2009 , Ellick shot a documentary about Malala Yousafzai .
+  - Hayashi said that Mackey is `` sort of `` the original model for Tenchi .
+  - Mackey said that Hayashi is `` sort of `` the original model for Tenchi .
+- source_sentence: Much of the film was shot on location in Los Angeles and in nearby
+    Burbank and Glendale .
   sentences:
-  - The Department of Criminal Justice developed the first certificate program in
-    forensic science in North Carolina and sponsors a summer comparative studies program
-    based in Europe .
-  - At that time , on June 22 , 1754 , Edward Bentham married Bentham Elizabeth Bates
-    ( d . 1790 ) from Hampshire in the nearby county of Alton .
-  - It was at this time , on 22 June 1754 , that Edward Bentham married Elizabeth
-    Bates ( d 1790 ) from Alton in the nearby county of Hampshire .
-- source_sentence: In 1973 Michels ' apos broke ; Barcelona the world transfer record
-    to bring Cruyff to Catalonia .
+  - Much of the film was shot on location in Los Angeles and in nearby Burbank and
+    Glendale .
+  - Much of the film was shot on site in Burbank and Glendale and in the nearby Los
+    Angeles .
+  - Traxxpad is a music application for the Sony PlayStation Portable developed by
+    the Definitive Studios and published by Eidos Interactive .
+- source_sentence: According to him , the earth is the carrier of his artistic work
+    , which is only integrated into the creative process by minimal changes .
   sentences:
-  - In 1973 , Cruyff 'Barcelona broke the world transfer record to bring Michels to
-    Catalonia .
-  - Amalric then marched to Cairo , where Shawar offered Amalric two million pieces
-    of gold .
-  - In 1973 Michels ' apos broke ; Barcelona the world transfer record to bring Cruyff
-    to Catalonia .
+  - National players are Bold players .
+  - According to him , earth is the carrier of his artistic work being integrated
+    into the creative process only by minimal changes .
+  - According to him , earth is the carrier of his creative work being integrated
+    into the artistic process only by minimal changes .
 datasets:
 - redis/langcache-sentencepairs-v2
 pipeline_tag: sentence-similarity
@@ -159,9 +157,9 @@ from sentence_transformers import SentenceTransformer
 model = SentenceTransformer("redis/langcache-embed-experimental")
 # Run inference
 sentences = [
-    "In 1973 Michels ' apos broke ; Barcelona the world transfer record to bring Cruyff to Catalonia .",
-    "In 1973 Michels ' apos broke ; Barcelona the world transfer record to bring Cruyff to Catalonia .",
-    "In 1973 , Cruyff 'Barcelona broke the world transfer record to bring Michels to Catalonia .",
+    'According to him , the earth is the carrier of his artistic work , which is only integrated into the creative process by minimal changes .',
+    'According to him , earth is the carrier of his artistic work being integrated into the creative process only by minimal changes .',
+    'According to him , earth is the carrier of his creative work being integrated into the artistic process only by minimal changes .',
 ]
 embeddings = model.encode(sentences)
 print(embeddings.shape)
@@ -170,9 +168,9 @@ print(embeddings.shape)
 # Get the similarity scores for the embeddings
 similarities = model.similarity(embeddings, embeddings)
 print(similarities)
-# tensor([[1.0000, 1.0000, 0.9219],
-#         [1.0000, 1.0000, 0.9219],
-#         [0.9219, 0.9219, 1.0078]], dtype=torch.bfloat16)
+# tensor([[1.0000, 0.9844, 0.9844],
+#         [0.9844, 1.0000, 1.0000],
+#         [0.9844, 1.0000, 1.0078]], dtype=torch.bfloat16)
 ```
 
 <!--
@@ -238,18 +236,18 @@ You can finetune this model on your own dataset.
 #### LangCache Sentence Pairs (all)
 
 * Dataset: [LangCache Sentence Pairs (all)](https://huggingface.co/datasets/redis/langcache-sentencepairs-v2)
-* Size: 6,780 training samples
+* Size: 126,938 training samples
 * Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
 * Approximate statistics based on the first 1000 samples:
   |         | anchor                                                                            | positive                                                                          | negative                                                                          |
   |:--------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|
   | type    | string                                                                            | string                                                                            | string                                                                            |
-  | details | <ul><li>min: 8 tokens</li><li>mean: 26.28 tokens</li><li>max: 47 tokens</li></ul> | <ul><li>min: 8 tokens</li><li>mean: 26.27 tokens</li><li>max: 47 tokens</li></ul> | <ul><li>min: 8 tokens</li><li>mean: 26.25 tokens</li><li>max: 47 tokens</li></ul> |
+  | details | <ul><li>min: 8 tokens</li><li>mean: 26.28 tokens</li><li>max: 47 tokens</li></ul> | <ul><li>min: 8 tokens</li><li>mean: 26.28 tokens</li><li>max: 47 tokens</li></ul> | <ul><li>min: 7 tokens</li><li>mean: 25.69 tokens</li><li>max: 65 tokens</li></ul> |
 * Samples:
   | anchor                                                                                                                                      | positive                                                                                                                                      | negative                                                                                                                                      |
   |:--------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------|
-  | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                           | <code>This marine species occurs in the eastern Indian Ocean and before the Maldives and New Caledonia .</code>                               |
-  | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                         | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                          | <code>Both young people burn with love really , for both , but without being able to say it to himself , admitting him always .</code>        |
+  | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                           | <code>how can I get financial freedom as soon as possible?</code>                                                                             |
+  | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                         | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                          | <code>The older Punts are still very much in existence today and race in the same fleets as the newer boats .</code>                          |
   | <code>Turner Valley , was at the Turner Valley Bar N Ranch Airport , southwest of the Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley , , was located at Turner Valley Bar N Ranch Airport , southwest of Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley Bar N Ranch Airport , , was located at Turner Valley Bar N Ranch , southwest of Turner Valley , Alberta , Canada .</code> |
 * Loss: <code>losses.ArcFaceInBatchLoss</code> with these parameters:
   ```json
@@ -265,18 +263,18 @@ You can finetune this model on your own dataset.
 #### LangCache Sentence Pairs (all)
 
 * Dataset: [LangCache Sentence Pairs (all)](https://huggingface.co/datasets/redis/langcache-sentencepairs-v2)
-* Size: 6,780 evaluation samples
+* Size: 126,938 evaluation samples
 * Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
 * Approximate statistics based on the first 1000 samples:
   |         | anchor                                                                            | positive                                                                          | negative                                                                          |
   |:--------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|
   | type    | string                                                                            | string                                                                            | string                                                                            |
-  | details | <ul><li>min: 8 tokens</li><li>mean: 26.28 tokens</li><li>max: 47 tokens</li></ul> | <ul><li>min: 8 tokens</li><li>mean: 26.27 tokens</li><li>max: 47 tokens</li></ul> | <ul><li>min: 8 tokens</li><li>mean: 26.25 tokens</li><li>max: 47 tokens</li></ul> |
+  | details | <ul><li>min: 8 tokens</li><li>mean: 26.28 tokens</li><li>max: 47 tokens</li></ul> | <ul><li>min: 8 tokens</li><li>mean: 26.28 tokens</li><li>max: 47 tokens</li></ul> | <ul><li>min: 7 tokens</li><li>mean: 25.69 tokens</li><li>max: 65 tokens</li></ul> |
 * Samples:
   | anchor                                                                                                                                      | positive                                                                                                                                      | negative                                                                                                                                      |
   |:--------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------|
-  | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                           | <code>This marine species occurs in the eastern Indian Ocean and before the Maldives and New Caledonia .</code>                               |
-  | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                         | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                          | <code>Both young people burn with love really , for both , but without being able to say it to himself , admitting him always .</code>        |
+  | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                           | <code>how can I get financial freedom as soon as possible?</code>                                                                             |
+  | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                         | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                          | <code>The older Punts are still very much in existence today and race in the same fleets as the newer boats .</code>                          |
   | <code>Turner Valley , was at the Turner Valley Bar N Ranch Airport , southwest of the Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley , , was located at Turner Valley Bar N Ranch Airport , southwest of Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley Bar N Ranch Airport , , was located at Turner Valley Bar N Ranch , southwest of Turner Valley , Alberta , Canada .</code> |
 * Loss: <code>losses.ArcFaceInBatchLoss</code> with these parameters:
   ```json

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e8afa2d5537827c6d1a9fcda9f205aa3101495b1a7687a881a257ed4227c38a1
+oid sha256:2d7e72835b966eaeabd3532bf9069d0626fc4f4ef5fef0f6eac90c7402f42d6f
 size 45437864