Wrong position embedding size?

#1
by lanking - opened

Should that be 131072 as of 128k?

4k is 4096, 8k is 8192. Do powers of two and you get 131072 for 128k.

lanking changed discussion status to closed

Sign up or log in to comment