Rotary Scaling Factor of 4 for 8k context (Do not merge)

This is a revision that updates the "rotary_scaling_factor" to 4.0 which corresponds with a sequence length of 8192 tokens.

This PR should not be merged, as it is intended only for usage in TEI by specifying the revision argument.

config.json

@@ -38,7 +38,7 @@
   "rotary_emb_fraction": 1.0,
   "rotary_emb_interleaved": false,
   "rotary_emb_scale_base": null,
-  "rotary_scaling_factor": null,
+  "rotary_scaling_factor": 4.0,
   "scale_attn_by_inverse_layer_idx": false,
   "scale_attn_weights": true,
   "summary_activation": null,