| Enable BetterTransformer with the [PreTrainedModel.to_bettertransformer] method: | |
| from transformers import AutoModelForCausalLM | |
| model = AutoModelForCausalLM.from_pretrained("bigcode/starcoder") | |
| model.to_bettertransformer() | |
| TorchScript | |
| TorchScript is an intermediate PyTorch model representation that can be run in production environments where performance is important. |