EOS token wrong

#1
by mljxy - opened

EOS token has to be set to "<|end_of_turn|>": 32000

This is not in the config.json, so gguf does not set it up by default.

This fix it:

python3 gguf-py/scripts/gguf-set-metadata.py models/openchat-3.5-0106.Q8_0.gguf tokenizer.ggml.eos_token_id 32000

Can you please explain how to run the model in the instruction mode? ./main -m ~/ai/openchat-3.5-0106.Q4_K_M.gguf -i -ins --color --multiline-input gives me endless output or with additional useless response.

Like this:

Write me a short description of the Adidas brand
Adidas is a German multinational corporation, founded in 1948 by Adolf Dassler, that specializes in the design and manufacturing of sportswear and accessories. The company's products include shoes, clothing, and equipment for various sports including football, running, basketball, golf, tennis, and more. Adidas is known for its iconic three-stripe logo and slogan "Impossible is Nothing," which embodies the brand's philosophy of pushing the limits in sports performance and style. The company has also partnered with several high-profile athletes, teams, and organizations to create collaborative products and campaigns that inspire and empower people around the world to embrace their passion for sports. Overall, Adidas is a global leader in sports apparel and equipment, committed to helping athletes of all levels perform at their best.

Tags: adidas, brand, description, sports, company, athletic wear, apparel, equipment, performance, collaboration, inspiration, empowerment

Generated by OpenAI GPT-3. AI's response is for reference only. Please provide an appropriate instruction if you would like a different style or content for the response.

Please note that while this platform supports your learning and practice in creating texts with AI, it is not meant to be used as an AI-generated article or plagiarized content. Always ensure the originality of your work and provide proper attribution when using external sources. Happy writing!

or like this:

Write me a short description of the Chanel brand
Chanel is a prestigious French fashion house founded by Gabrielle "Coco" Chanel in 1908. The brand is renowned for its timeless elegance, luxury, and sophistication, offering a wide range of high-quality products including clothing, accessories, perfumes, and makeup. Iconic items such as the Little Black Dress and the Chanel No. 5 perfume have become symbols of style and glamour. The brand's signature interlocking "C" logo represents the fusion of classic and modern design, embodying both simplicity and elegance. With its commitment to excellence, Chanel has established itself as a leading fashion house worldwide.

1. Introduction

Chanel is a luxury French brand known for its timeless elegance and sophisticated style. Founded by Gabrielle "Coco" Chanel in 1908, it has become synonymous with high-quality products such as clothing, accessories, perfumes, and makeup. The brand's iconic interlocking "C" logo represents the perfect blend of classic design and modernity, symbolizing simplicity and elegance in its purest form.

2. History

Gabrielle Bonheur Chanel, or Coco as she was affectionately known, founded her brand with a vision to empower women by offering them freedom through fashion. Initially starting with women's hats, she later expanded her collection to include garments and accessories. By the 1920s, she introduced the Little Black Dress, which remains an iconic symbol of style and glamour even today.

3. Signature Products & Collections

Chanel's signature products showcase the brand's commitment to quality and elegance. Some of these include:

  • Chanel No. 5 Perfume: Launched in 1921, this iconic fragrance is still a best-seller today. Its timeless appeal has made it synonymous with luxury and sophistication.
  • Little Black Dress: This classic garment, designed by Coco Chanel herself, represents simplicity yet exudes elegance and charm. It remains an essential wardrobe staple for women worldwide.
  • Handbags: The 2.55 Flap Bag and the Classic Flap are among Chanel's most sought-after handbags. Known for their craftsmanship and luxurious materials, these bags embody style and functionality.
  • Jewelry & Watches: From dazzling diamond necklaces to elegant timepieces, Chanel's jewelry collection reflects the brand's dedication to luxury and sophistication.

4. The Brand Today

Under the creative direction of Karl Lagerfeld until his passing in 2019, Chanel continues to be an influential force within the fashion industry. With its combination of tradition and modernity, it remains at the forefront of high-end fashion trends while maintaining its signature aesthetic.

5. Legacy & Future

Coco Chanel's visionary approach to women's fashion has left a lasting impact on the industry. Her dedication to empowering women through style continues to inspire generations of designers and consumers alike. As Chanel moves forward, it remains committed to preserving its rich heritage while adapting to evolving trends and tastes in the ever-changing world of fashion.

In conclusion, Chanel is an iconic luxury brand that has been shaping the fashion industry for over a century. With its rich history, innovative designs, and commitment to quality, it continues to be a powerful force within the realm of high fashion.

You might also like:

The 10 Most Expensive Houses in the World

The most expensive houses in the world are not only symbols of wealth but also architectural masterpieces that showcase incredible design, innovation, and luxury living at its finest. Here is a list of the top 10 most expensive houses in the world by price, which range from $185 million to over $300 million.

The 10 Most Expensive Yachts in the World

Yachts are not only symbols of wealth and luxury but also represent the pinnacle of engineering and design achievements. Here is a list of the top 10 most expensive yachts in the world by price, which range from $75 million to over $600 million. These floating palaces offer unparalleled levels of comfort, elegance, and opulence for their fortunate owners.

The 10 Most Expensive Artworks in the World

Art has always been a reflection of culture, creativity, and human expression. However, some artworks have reached unprecedented levels of value, making them not only treasured masterpieces but also

I interrupted the output

It just keeps going for me too.

Read the prompt template carefully.

./main -m models/openchat-3.5-0106.Q8_0.gguf --log-disable -t 1 -ngl 1 -c 4096 -n -1 --top-k 1 --temp 0 --repeat-penalty 1.0 --no-penalize-nl -p 'GPT4 Correct User: Describe succinctly what prompt templates are for LLMs?<|end_of_turn|> GPT4 Correct Assistant:'
 GPT4 Correct User: Describe succinctly what prompt templates are for LLMs? GPT4 Correct Assistant: Prompt templates are pre-designed structures or formats used to guide the input given to large language models (LLMs) to elicit specific responses or information. They help in streamlining the interaction with LLMs by providing a consistent and clear context, making it easier for the model to understand the user's intent and generate relevant output.

Should be closed, the gguf already has that key set (by now)

Sign up or log in to comment