TensorBoard
rave-models / README.md
no-op-ul-se's picture
Merge branch 'main' of hf.co:Intelligent-Instruments-Lab/rave-models
0ef4ee1
|
raw
history blame
4.48 kB
metadata
license: cc-by-nc-4.0

RAVE Models

This is a collection of RAVE models trained by the Intelligent Instruments Lab for various projects.

Most of these models are encoder-decoder only, no prior, and all use the --causal mode and are exported for streaming inference with nn~, NN.ar or rave-supercollider.

Musical Instruments

guitar_iil_b2048_r48000_z16.ts

Dataset: IILGuitarTimbre, a timbre-oriented collection of plucking, strumming, striking scraping and more recorded dry from an electric guitar.

Model: modified RAVE v1, 48kHz, block size 2048, 16 latent dimensions.

sax_soprano_franziskaschroeder_b2048_r48000_z20.ts

Dataset: Soprano sax improvisation by Franziska Schroeder.

Model: modified RAVE v1, 48kHz, block size 2048, 20 latent dimensions.

organ_archive_b2048_r48000_z16.ts

Dataset: various recordings of organ music sourced from archive.org. Small amounts of voice and other instruments were included, and vinyl record noises are prominent.

Model: modified RAVE v1, 48kHz, block size 2048, 16 latent dimensions.

organ_bach_b2048_sr48000_z16.ts

Dataset: various recordings of J.S. Bach music for church organ.

Model: modified RAVE v1, 48kHz, block size 2048, 16 latent dimensions.

Voice

voice_vocalset_b2048_r48000_z16.ts

Dataset: VocalSet singing voice dataset.

Model: modified RAVE v1, 48kHz, block size 2048, 16 latent dimensions.

voice_hifitts_b2048_r48000_z16.ts

Dataset: Hi-Fi TTS audiobooks dataset.

Model: modified RAVE v1, 48kHz, block size 2048, 16 latent dimensions.

voice_jvs_b2048_r44100_z16.ts

Dataset: Hi-Fi TTS speaker 9017 (John Van Stan).

Model: RAVE v3, 44.1kHz, block size 2048, 16 latent dimensions.

voice_vctk_b2048_r44100_z16.ts

Dataset: CSTR VCTK Corpus multispeaker read speech dataset.

Model: RAVE v3, 44.1kHz, block size 2048, 22 latent dimensions.

Birds

birds_motherbird_b2048_r48000_z16.ts

This model of bird sounds was curated by Manuel Cherep, Jessica Shand and Jack Armitage for their piece Motherbird, performed at TENOR 2023 in Boston, May 2023.

Dataset: bird sounds.

Model: RAVE v1, 48kHz, block size 2048, 16 latent dimensions.

birds_pluma_b2048_r48000_z12.ts

This model of bird sounds was curated by Giacomo Lepri for his instrument Pluma

Dataset: bird sounds.

Model: modified RAVE v1, 48kHz, block size 2048, 12 latent dimensions.

Pond Brain Marine Sounds

These models of marine sounds were trained for Jenna Sutela's Pond Brain installations at Copenhagen Contemporary and the Helsinki Biennial

Caution: these decoders sometimes produce a loud chirp on first initialization.

water_pondbrain_b2048_r48000_z16.ts

Dataset: water recordings from freesound.org.

list of freesound users inspectorj, inchadney, aesqe, vonfleisch, javetakami, atomediadesign, kolezan, zabuhailo, zaziesound, repdac3, al_sub, lgarrett, uzbazur, lydmakeren, frenkfurth, edo333, boredtoinsanity, owl, kaydinhamby, tliedes, ilmari_freesound, manoslindos, l3ardoc, alexbuk, s-light

Model: modified RAVE v1, 48kHz, block size 2048, 16 latent dimensions.

humpbacks_pondbrain_b2048_r48000_z20.ts

Dataset: humpback whale recordings from the Watkins database, MBARI, and BBC.

Model: modified RAVE v1, 48kHz, block size 2048, 20 latent dimensions.

marinemammals_pondbrain_b2048_r48000_z20.ts

Dataset: various marine mammal sounds from NOAA, the Watkins database, freesound users felixblume and geraldfiebig, and sound effects databases.

Model: modified RAVE v1, 48kHz, block size 2048, 20 latent dimensions.