static quants of https://huggingface.co/nvidia/Llama-3.1-Minitron-4B-Depth-Base