| library_name: transformers | |
| tags: | |
| - vlm | |
| - vision | |
| license: apache-2.0 | |
| base_model: | |
| - allenai/Molmo-7B-O-0924 | |
| # Molmo-7B-O BnB 4bit quant | |
| 30GB -> 7GB | |
| approx. 12GB VRAM required | |
| base model for more information: | |
| https://huggingface.co/allenai/Molmo-7B-O-0924 | |
| example code: | |
| https://github.com/cyan2k/molmo-7b-bnb-4bit | |
| performance metrics & benchmarks to compare with base will follow over the next week | |