Hugging Face's logo

homebrewltd
/
llama3-s-init

Text Generation
Transformers
Safetensors
English
llama
sound language model
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
Edit model card

Model Details

We have developed and released the family llama3-s. This family is natively understanding audio and text input.

We continue to expand Meta-Llama-3-8B-Instruct with sound understanding capabilities.

This is the initial checkpoint with average weight initialization applied only to new vocabulary.

Model developers Homebrew Research.

Input Text and sound.

Output Text.

Model Architecture Llama-3.

Language(s): English.

Intended Use

Intended Use Cases This family is primarily intended for research applications. This version aims to further improve the LLM on sound understanding capabilities.

Out-of-scope The use of Jan-Llama3-Sound in any manner that violates applicable laws or regulations is strictly prohibited.

Citation Information

BibTeX:

@article{Llama3-S: Sound Instruction Language Model 2024,
  title={Llama3-S},
  author={Homebrew Research},
  year=2024,
  month=July},
  url={https://huggingface.co/jan-hq/Jan-Llama3-0719}

Acknowledgement

Downloads last month
13
Safetensors
Model size
8.04B params
Tensor type
BF16
·
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.