Processing Parquets 102
•
1
hlky
hlky
AI & ML interests
DATA
Recent Activity
New activity
2 days ago
bigdata-pw/Flickr:Hard to download
updated
a Space
about 2 months ago
bigdata-pw/README
New activity
about 2 months ago
bigdata-pw/Flickr:Final Version
Articles
Organizations
Posts
3
Post
1816
florence-tool (https://github.com/bigdata-pw/florence-tool) now supports WebDataset! Check it out for efficient batch inference with Florence-2 models
microsoft/Florence-2-large
microsoft/Florence-2-base
Currently running it myself on A40 with
Currently running it myself on A40 with
CAPTION task and a streaming WebDataset @ 60k images/hour!
Post
2165
BIG update dropped for
bigdata-pw/Flickr - now ~515M images! Target for the next update: 1B
In case you missed them; other recent drops include bigdata-pw/Dinosaurs - a small set of BIG creatures 🦕🦖 and the first in a series of articles about the art of web scraping! https://huggingface.co/blog/hlky/web-scraping-101 https://huggingface.co/blog/hlky/web-scraping-102
Stay tuned for exciting datasets and models coming soon:
- PC and Console game screenshots
- TV/Film actors biographies and photos (think facial recognition and automatic captioning!)
- bigdata-pw/lyrics-gpt v2
- and more!
In case you missed them; other recent drops include bigdata-pw/Dinosaurs - a small set of BIG creatures 🦕🦖 and the first in a series of articles about the art of web scraping! https://huggingface.co/blog/hlky/web-scraping-101 https://huggingface.co/blog/hlky/web-scraping-102
Stay tuned for exciting datasets and models coming soon:
- PC and Console game screenshots
- TV/Film actors biographies and photos (think facial recognition and automatic captioning!)
- bigdata-pw/lyrics-gpt v2
- and more!
models
None public yet
datasets
None public yet