GPT2XL_RLLMv10-wd-001,003,010
Collection
Spin-off experiments eg. what will happen if the v10/layer10's weight decay got increased or decreased....so yeah all these attempts failed..
•
6 items
•
Updated
A failed experiment. Lowered v10's weight decay from .005 to .001.
Interested? see RLLM Virtual map for more context.
- Downloads last month
- 8
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.