Organizing a Privacy-preserving Hackathon
•
8
Régis Pierrard
regisss
AI & ML interests
None yet
Articles
Organizations
Posts
1
Post
1303
Interested in performing inference with an ONNX model?⚡️
The Optimum docs about model inference with ONNX Runtime is now much clearer and simpler!
You want to deploy your favorite model on the hub but you don't know how to export it to the ONNX format? You can do it in one line of code as follows:
Check out the whole guide 👉 https://huggingface.co/docs/optimum/onnxruntime/usage_guides/models
The Optimum docs about model inference with ONNX Runtime is now much clearer and simpler!
You want to deploy your favorite model on the hub but you don't know how to export it to the ONNX format? You can do it in one line of code as follows:
from optimum.onnxruntime import ORTModelForSequenceClassification
# Load the model from the hub and export it to the ONNX format
model_id = "distilbert-base-uncased-finetuned-sst-2-english"
model = ORTModelForSequenceClassification.from_pretrained(model_id, export=True)Check out the whole guide 👉 https://huggingface.co/docs/optimum/onnxruntime/usage_guides/models
Papers
1
models
9
regisss/llama2-70b-fused-qkv-mlperf
Text Generation
•
Updated
•
195
•
1
regisss/falcon-40b-lora
Updated
regisss/distilbert_xnli
Text Classification
•
Updated
•
13
regisss/distilbert_xnli_hpu
Text Classification
•
Updated
•
18
regisss/bridgetower-newyorker-a100-8x
Updated
•
32
•
1
regisss/bridgetower-newyorker-gaudi2-8x
Updated
•
4
regisss/t5-3b-summarization-gaudi-2
Text2Text Generation
•
Updated
•
15
regisss/bert-pretraining-gaudi-2-batch-size-64
Fill-Mask
•
Updated
•
6
regisss/bert-pretraining-gaudi-2-batch-size-32
Fill-Mask
•
Updated
•
7