File size: 871 Bytes
d0f7650
 
 
 
 
 
 
ce0acd8
d0f7650
 
ce0acd8
d0f7650
ce0acd8
d0f7650
ce0acd8
 
 
 
d0f7650
 
 
ce0acd8
 
d0f7650
ce0acd8
88e66f5
ce0acd8
d0f7650
 
ce0acd8
d0f7650
ce0acd8
d0f7650
ce0acd8
 
 
 
d0f7650
ce0acd8
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
---
license: apache-2.0
tags:
- setfit
- sentence-transformers
- text-classification
pipeline_tag: text-classification
library_name: sentence-transformers
---

# splore/navigational-vs-transactional-vs-informational-classifier

Query classification model trained using Metaflow.

## Query types
1. Navigational
2. Transactional
3. Informational

## Usage

```python
from setfit import SetFitModel

model = SetFitModel.from_pretrained("splore/navigational-vs-transactional-vs-informational-classifier")
predictions = model.predict(["What type of query is this?"])
probabilities = model.predict_proba(["Predictions with probabilities"])
```

## Evaluation

Tests have only been done on a small dataset of 40 manually created queries.

|metric     |value|
|-----------|-----|
|accuracy   |0.942|
|exact match|0.875|

![ROC graph](roc.png)

![confusion matrix](confusion.png)