| To learn how contrastive search | |
| works, check out this blog post. | |
| The two main parameters that enable and control the behavior of contrastive search are penalty_alpha and top_k: | |
| thon | |
| from transformers import AutoTokenizer, AutoModelForCausalLM | |
| checkpoint = "openai-community/gpt2-large" | |
| tokenizer = AutoTokenizer.from_pretrained(checkpoint) | |
| model = AutoModelForCausalLM.from_pretrained(checkpoint) | |
| prompt = "Hugging Face Company is" | |
| inputs = tokenizer(prompt, return_tensors="pt") | |
| outputs = model.generate(**inputs, penalty_alpha=0.6, top_k=4, max_new_tokens=100) | |
| tokenizer.batch_decode(outputs, skip_special_tokens=True) | |
| ['Hugging Face Company is a family owned and operated business. |