burtenshaw
first refactored commit
9cc6120
|
raw
history blame
1.81 kB
metadata
title: Feel
emoji: πŸš€
colorFrom: blue
colorTo: gray
sdk: gradio
sdk_version: 5.8.0
app_file: app/app.py
pinned: false

Feel

This is a project to create a continuous training application.

Platform being developed at MIT in collaboration with HuggingFace. Aimed at improving performance of existing Large Language Models through real-time human feedback loop.

This repository hosts the development of an automated RLHF platform for Hugging Face, where the community can provide real-time feedback on language models. The feedback is automatically integrated into an RLHF pipeline to continuously fine-tune and improve the models.

What is Feel?

A community-driven project to improve Multilingual Vision-Language Models (VLMs). Leverages feedback from users and automated RLHF pipelines to continuously improve model performance.

Why Feel?

Feel is a platform that enables the community to provide real-time feedback on language models. The feedback is automatically integrated into an RLHF pipeline to continuously fine-tune and improve the models.

Repository Structure

The repository is organized as follows:

ml/                # Directory for machine learning code
β”œβ”€β”€ README.md      # Dataset schema and project structure
β”œβ”€β”€ data/          # Directory for dataset files
β”œβ”€β”€ models/        # Directory for model files
app/               # Directory for application code
β”œβ”€β”€ app.py         # Main application file

Installation

The repository uses uv for managing virtual environments. To install uv, go here.

To install the required dependencies, run the following commands:

ML Dependencies

uv install ml

App Dependencies

uv install app