Francesco-A
commited on
Commit
•
f7848c8
1
Parent(s):
46a238d
Update README.md
Browse files
README.md
CHANGED
@@ -29,6 +29,4 @@ You can use the `code-search-net-tokenizer` to preprocess code snippets and conv
|
|
29 |
|
30 |
**Limitations:**
|
31 |
|
32 |
-
The `code-search-net-tokenizer` is specifically tailored to code-related text data and may not be suitable for general text tasks. It may not perform optimally for natural language text outside the programming context.
|
33 |
-
|
34 |
-
*This model card is provided for informational purposes only and does not guarantee specific performance or outcomes when using the "code-search-net-tokenizer" with other language models. Users are encouraged to refer to the Hugging Face documentation and model repository for detailed information and updates.*
|
|
|
29 |
|
30 |
**Limitations:**
|
31 |
|
32 |
+
The `code-search-net-tokenizer` is specifically tailored to code-related text data and may not be suitable for general text tasks. It may not perform optimally for natural language text outside the programming context.
|
|
|
|