vidric commited on
Commit
918d302
1 Parent(s): 6d50c13

Add BERTopic model

Browse files
Files changed (4) hide show
  1. README.md +107 -0
  2. config.json +15 -0
  3. topic_embeddings.safetensors +3 -0
  4. topics.json +0 -0
README.md ADDED
@@ -0,0 +1,107 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ ---
3
+ tags:
4
+ - bertopic
5
+ library_name: bertopic
6
+ pipeline_tag: text-classification
7
+ ---
8
+
9
+ # bertopic_dcd_auto_final
10
+
11
+ This is a [BERTopic](https://github.com/MaartenGr/BERTopic) model.
12
+ BERTopic is a flexible and modular topic modeling framework that allows for the generation of easily interpretable topics from large datasets.
13
+
14
+ ## Usage
15
+
16
+ To use this model, please install BERTopic:
17
+
18
+ ```
19
+ pip install -U bertopic
20
+ ```
21
+
22
+ You can use the model as follows:
23
+
24
+ ```python
25
+ from bertopic import BERTopic
26
+ topic_model = BERTopic.load("vidric/bertopic_dcd_auto_final")
27
+
28
+ topic_model.get_topic_info()
29
+ ```
30
+
31
+ ## Topic overview
32
+
33
+ * Number of topics: 40
34
+ * Number of training documents: 22195
35
+
36
+ <details>
37
+ <summary>Click here for an overview of all topics.</summary>
38
+
39
+ | Topic ID | Topic Keywords | Topic Frequency | Label |
40
+ |----------|----------------|-----------------|-------|
41
+ | -1 | wangi - tidak - banget - parfum - hmns | 12 | -1_wangi_tidak_banget_parfum |
42
+ | 0 | wangi - mantap - banget - enak - suka | 7512 | 0_wangi_mantap_banget_enak |
43
+ | 1 | alpha - farhampton - beli - saya - sama | 12436 | 1_alpha_farhampton_beli_saya |
44
+ | 2 | hari - sampai - kirim - minggu - pesan | 903 | 2_hari_sampai_kirim_minggu |
45
+ | 3 | order - repeat - kali - kesekian - bakal | 177 | 3_order_repeat_kali_kesekian |
46
+ | 4 | kalem - nyengat - wangi - enak - banget | 118 | 4_kalem_nyengat_wangi_enak |
47
+ | 5 | indonesia - bangga - produk - terus - harumkan | 70 | 5_indonesia_bangga_produk_terus |
48
+ | 6 | kualitas - bagus - produk - barang - baik | 63 | 6_kualitas_bagus_produk_barang |
49
+ | 7 | selamat - mendarat - dengan - barang - sampai | 61 | 7_selamat_mendarat_dengan_barang |
50
+ | 8 | respon - cepat - quick - good - jawab | 59 | 8_respon_cepat_quick_good |
51
+ | 9 | produk - bagus - sangat - penawaran - oke | 54 | 9_produk_bagus_sangat_penawaran |
52
+ | 10 | pokok - mantap - puas - jon - epic | 49 | 10_pokok_mantap_puas_jon |
53
+ | 11 | voucher - 50rb - 50k - dapat - 50 | 44 | 11_voucher_50rb_50k_dapat |
54
+ | 12 | hadiah - buat - semoga - dia - cocok | 39 | 12_hadiah_buat_semoga_dia |
55
+ | 13 | test - tester - mari - kita - coba | 35 | 13_test_tester_mari_kita |
56
+ | 14 | deskripsi - sesuai - barang - dengan - bagus | 34 | 14_deskripsi_sesuai_barang_dengan |
57
+ | 15 | worth - it - harga - sepadan - serius | 33 | 15_worth_it_harga_sepadan |
58
+ | 16 | chat - admin - barang - balas - respon | 33 | 16_chat_admin_barang_balas |
59
+ | 17 | 10ml - 10 - ml - 50ml - beli | 32 | 17_10ml_10_ml_50ml |
60
+ | 18 | layanan - service - baik - barang - oke | 31 | 18_layanan_service_baik_barang |
61
+ | 19 | 10 - silage - kedepanya - mayanlah - kemasin | 30 | 19_10_silage_kedepanya_mayanlah |
62
+ | 20 | kartu - card - tulis - greting - ucap | 30 | 20_kartu_card_tulis_greting |
63
+ | 21 | beli - 4x - bintang - kedua - pemesanan | 28 | 21_beli_4x_bintang_kedua |
64
+ | 22 | bicara - bintang - biar - nyang - limo | 28 | 22_bicara_bintang_biar_nyang |
65
+ | 23 | unik - istimewa - exceptional - addicted - cerita | 25 | 23_unik_istimewa_exceptional_addicted |
66
+ | 24 | buka - kotak - box - belum - unboxing | 25 | 24_buka_kotak_box_belum |
67
+ | 25 | akhirnya - bagi - dapat - juara - finaly | 21 | 25_akhirnya_bagi_dapat_juara |
68
+ | 26 | starterpacking - semakin - gara - bantu - merosot | 20 | 26_starterpacking_semakin_gara_bantu |
69
+ | 27 | review - orang - saja - zodiak - mag | 19 | 27_review_orang_saja_zodiak |
70
+ | 28 | ketiga - kali - memuaskan - beli - selalu | 18 | 28_ketiga_kali_memuaskan_beli |
71
+ | 29 | layanan - langsung - baru - cepat - service | 17 | 29_layanan_langsung_baru_cepat |
72
+ | 30 | admin - ramah - tersampaikan - mantap - layanan | 17 | 30_admin_ramah_tersampaikan_mantap |
73
+ | 31 | layanan - produk - bagus - service - terbaik | 17 | 31_layanan_produk_bagus_service |
74
+ | 32 | notes - note - midlle - base - mbak | 16 | 32_notes_note_midlle_base |
75
+ | 33 | bangga - lokal - pride - maszeh - kualitas | 16 | 33_bangga_lokal_pride_maszeh |
76
+ | 34 | bintang - harum - kasih - lima - hmns | 16 | 34_bintang_harum_kasih_lima |
77
+ | 35 | botol - kedua - tiga - sihir - ketiga | 15 | 35_botol_kedua_tiga_sihir |
78
+ | 36 | 10 - voucher - hari - november - tanggal | 15 | 36_10_voucher_hari_november |
79
+ | 37 | delta - team - deltanya - theta - senjata | 14 | 37_delta_team_deltanya_theta |
80
+ | 38 | travel - praktis - kecil - ukuran - tepa | 13 | 38_travel_praktis_kecil_ukuran |
81
+
82
+ </details>
83
+
84
+ ## Training hyperparameters
85
+
86
+ * calculate_probabilities: True
87
+ * language: None
88
+ * low_memory: False
89
+ * min_topic_size: 10
90
+ * n_gram_range: (1, 1)
91
+ * nr_topics: auto
92
+ * seed_topic_list: None
93
+ * top_n_words: 10
94
+ * verbose: False
95
+
96
+ ## Framework versions
97
+
98
+ * Numpy: 1.24.3
99
+ * HDBSCAN: 0.8.29
100
+ * UMAP: 0.5.3
101
+ * Pandas: 2.0.1
102
+ * Scikit-Learn: 1.2.2
103
+ * Sentence-transformers: 2.2.2
104
+ * Transformers: 4.29.2
105
+ * Numba: 0.57.0
106
+ * Plotly: 5.14.1
107
+ * Python: 3.10.10
config.json ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "calculate_probabilities": true,
3
+ "language": null,
4
+ "low_memory": false,
5
+ "min_topic_size": 10,
6
+ "n_gram_range": [
7
+ 1,
8
+ 1
9
+ ],
10
+ "nr_topics": "auto",
11
+ "seed_topic_list": null,
12
+ "top_n_words": 10,
13
+ "verbose": false,
14
+ "embedding_model": "distiluse-base-multilingual-cased"
15
+ }
topic_embeddings.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:384e303e83f39738a026b16e499a02f6c7152531b0d89f2a6dc06cc737886ec2
3
+ size 82008
topics.json ADDED
The diff for this file is too large to render. See raw diff