Some weights of JinaCLIPModel were not initialized from the model checkpoint at jinaai/jina-clip-v1 and are newly initialized:

#18
by lxg123 - opened

When I run the example:

I'm having some problems.

Some weights of JinaCLIPModel were not initialized from the model checkpoint at jinaai/jina-clip-v1 and are newly initialized: ['vision_model.blocks.7.attn.rope.freqs_cos', 'vision_model.blocks.2.attn.rope.freqs_sin', 'vision_model.blocks.5.attn.rope.freqs_sin', 'vision_model.blocks.8.attn.rope.freqs_cos', 'vision_model.blocks.10.attn.rope.freqs_cos', 'vision_model.blocks.6.attn.rope.freqs_cos', 'vision_model.blocks.1.attn.rope.freqs_sin', 'vision_model.blocks.7.attn.rope.freqs_sin', 'vision_model.blocks.4.attn.rope.freqs_sin', 'vision_model.blocks.9.attn.rope.freqs_cos', 'vision_model.blocks.1.attn.rope.freqs_cos', 'vision_model.blocks.3.attn.rope.freqs_cos', 'vision_model.blocks.9.attn.rope.freqs_sin', 'vision_model.blocks.6.attn.rope.freqs_sin', 'vision_model.blocks.2.attn.rope.freqs_cos', 'vision_model.blocks.0.attn.rope.freqs_sin', 'vision_model.blocks.8.attn.rope.freqs_sin', 'vision_model.blocks.10.attn.rope.freqs_sin', 'vision_model.blocks.3.attn.rope.freqs_sin', 'vision_model.blocks.4.attn.rope.freqs_cos', 'vision_model.blocks.11.attn.rope.freqs_cos', 'vision_model.blocks.11.attn.rope.freqs_sin', 'vision_model.blocks.0.attn.rope.freqs_cos', 'vision_model.blocks.5.attn.rope.freqs_cos']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.

Jina AI org

please make sure trust_remote_codebeing set to true

please make sure trust_remote_codebeing set to true

In fact, I set it to true, but it doesn't seem to do anything.

Jina AI org

Hi @lxg123 , do you load the model from a local directory?

Anyway, these parameters are registered buffers, and not learnable, so if this is just a warning you can ignore it.

bwang0911 changed discussion status to closed

Sign up or log in to comment