Spaces:

Tonic
/

whisperspeech

Runtime error

App Files Files Community

GPU Device Not Used Error

by mrfakename - opened Jan 25

Discussion

mrfakename

Jan 25

I'm getting "GPU Device Not Used" on ZERO GPU

Tonic

Owner Jan 25

AttributeError: 'tuple' object has no attribute 'unsqueeze'
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/gradio/queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1561, in process_api
    result = await self.call_function(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1179, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "/home/user/.local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "/home/user/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2134, in run_sync_in_worker_thread
    return await future
  File "/home/user/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 851, in run
    result = context.run(func, *args)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/utils.py", line 678, in wrapper
    response = f(*args, **kwargs)
  File "/home/user/.local/lib/python3.10/site-packages/spaces/zero/wrappers.py", line 119, in gradio_handler
    raise res.value
AttributeError: 'tuple' object has no attribute 'unsqueeze'
/home/user/.local/lib/python3.10/site-packages/spaces/zero/client.py:126: RuntimeWarning: GPU device not used
  warnings.warn(UNUSED_MESSAGE, RuntimeWarning)
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/gradio/queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1570, in process_api
    data = self.postprocess_data(fn_index, result["prediction"], state)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1455, in postprocess_data
    prediction_value = block.postprocess(prediction_value)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/components/audio.py", line 251, in postprocess
    file_path = processing_utils.save_audio_to_cache(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/processing_utils.py", line 152, in save_audio_to_cache
    temp_dir = Path(cache_dir) / hash_bytes(data.tobytes())
AttributeError: 'str' object has no attribute 'tobytes'

i'll investigate this a bit further, but it seems from the ZeroGPU handler (no GPUs found)

Tonic

Owner Jan 25

hey there @mrfakename , so i checked it out with both functions, and seems it's a GPU availability issue, sometimes when the GPU doesnt become available different error messages turn up, i guess that's one of them .

sorry i can t do more to fix it , but i really appreciate you making this issue which i guess i'll keep open for reference :-)

mrfakename

Jan 25

Ok, thanks. Cc @sbrandeis @cbensimon

Doesn’t it usually say something like “No GPU available after 60s” ?

cbensimon

Jan 26

Hi @mrfakename thanks for reporting this
The "No GPU device have been used" warning simply means that despite the fact that the Space successfully acquired a GPU and ran the function without error, the attributed GPU device has not been used at all
(the point of ZeroGPU is to perform GPU-related task, hence the warning)
The Traceback seems to come from Gradio post-processing though and might not be related to ZeroGPU

Tonic

Owner Jan 27

@cbensimon , @mrfakename , so it seems the most likely explanation is that i was simply building / debugging and caught a request a bit early :-) i do believe that .

btw, the space has been updated for improved layout now, let me know what y'all think + if you see anything that might be improved

mrfakename

Jan 27

Unfortunately I'm still getting "GPU Device Not Used"

Tonic

Owner Jan 27

hmm have you tried just trying again, it can happen with ZeroGPU sometimes, hope this helps !

Tonic changed discussion status to closed Jan 27

Tonic changed discussion status to open Jan 27

Tonic

Owner Jan 27

ok, that was actually fantastic !

with more languages added, i had a problem that ZeroGPU would expire before the queu would end, leading to worse results , including shoddy audio .

this adding of the queu to the decorator also solved this issue.

i'm taking notes !

mrfakename

Jan 27

For some reason, it still isn't working for me. Maybe it's just me. Do you usually input an audio sample?

Tonic

Owner Jan 28

ok, i logged on to try it out, it did work, just the once, now i'm getting an error (??)


pytorch_model.bin:   0%|          | 0.00/40.4M [00:00<?, ?B/s]
pytorch_model.bin: 100%|██████████| 40.4M/40.4M [00:00<00:00, 82.9MB/s]
Downloading: "https://dl.fbaipublicfiles.com/encodec/v0/encodec_24khz-d7cc33bc.th" to /home/user/.cache/torch/hub/checkpoints/encodec_24khz-d7cc33bc.th

  0%|          | 0.00/88.9M [00:00<?, ?B/s]
100%|██████████| 88.9M/88.9M [00:00<00:00, 174MB/s]
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/gradio/queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1570, in process_api
    data = self.postprocess_data(fn_index, result["prediction"], state)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1455, in postprocess_data
    prediction_value = block.postprocess(prediction_value)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/components/audio.py", line 251, in postprocess
    file_path = processing_utils.save_audio_to_cache(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/processing_utils.py", line 152, in save_audio_to_cache
    temp_dir = Path(cache_dir) / hash_bytes(data.tobytes())
AttributeError: 'str' object has no attribute 'tobytes'
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/gradio/queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1570, in process_api
    data = self.postprocess_data(fn_index, result["prediction"], state)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1455, in postprocess_data
    prediction_value = block.postprocess(prediction_value)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/components/audio.py", line 251, in postprocess
    file_path = processing_utils.save_audio_to_cache(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/processing_utils.py", line 152, in save_audio_to_cache
    temp_dir = Path(cache_dir) / hash_bytes(data.tobytes())
AttributeError: 'str' object has no attribute 'tobytes'
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/gradio/queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1570, in process_api
    data = self.postprocess_data(fn_index, result["prediction"], state)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1455, in postprocess_data
    prediction_value = block.postprocess(prediction_value)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/components/audio.py", line 251, in postprocess
    file_path = processing_utils.save_audio_to_cache(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/processing_utils.py", line 152, in save_audio_to_cache
    temp_dir = Path(cache_dir) / hash_bytes(data.tobytes())
AttributeError: 'str' object has no attribute 'tobytes'
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/gradio/queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1570, in process_api
    data = self.postprocess_data(fn_index, result["prediction"], state)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1455, in postprocess_data
    prediction_value = block.postprocess(prediction_value)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/components/audio.py", line 251, in postprocess
    file_path = processing_utils.save_audio_to_cache(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/processing_utils.py", line 152, in save_audio_to_cache
    temp_dir = Path(cache_dir) / hash_bytes(data.tobytes())
AttributeError: 'str' object has no attribute 'tobytes'
/home/user/.local/lib/python3.10/site-packages/spaces/zero/client.py:124: RuntimeWarning: GPU device not used
  warnings.warn(UNUSED_MESSAGE, RuntimeWarning)
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/gradio/queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1570, in process_api
    data = self.postprocess_data(fn_index, result["prediction"], state)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1455, in postprocess_data
    prediction_value = block.postprocess(prediction_value)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/components/audio.py", line 251, in postprocess
    file_path = processing_utils.save_audio_to_cache(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/processing_utils.py", line 152, in save_audio_to_cache
    temp_dir = Path(cache_dir) / hash_bytes(data.tobytes())
AttributeError: 'str' object has no attribute 'tobytes'
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/spaces/zero/wrappers.py", line 170, in thread_wrapper
    res = future.result()
  File "/usr/local/lib/python3.10/concurrent/futures/_base.py", line 451, in result
    return self.__get_result()
  File "/usr/local/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result
    raise self._exception
  File "/usr/local/lib/python3.10/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/home/user/app/app.py", line 68, in whisper_speech_demo
    audio_np = generate_segment_audio(text_str, lang, speaker_url, pipe)
  File "/home/user/.local/lib/python3.10/site-packages/spaces/zero/wrappers.py", line 92, in gradio_handler
    return task(*args, **kwargs)
  File "/home/user/app/app.py", line 44, in generate_segment_audio
    audio_data = pipe.generate(text, speaker_url, lang)
  File "/home/user/app/whisperspeech/pipeline.py", line 87, in generate
    return self.vocoder.decode(self.generate_atoks(text, speaker, lang=lang, cps=cps, step_callback=step_callback))
  File "/home/user/app/whisperspeech/pipeline.py", line 83, in generate_atoks
    atoks = self.s2a.generate(stoks, speaker.unsqueeze(0), step=step_callback)
AttributeError: 'tuple' object has no attribute 'unsqueeze'
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/gradio/queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1561, in process_api
    result = await self.call_function(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1179, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "/home/user/.local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "/home/user/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2134, in run_sync_in_worker_thread
    return await future
  File "/home/user/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 851, in run
    result = context.run(func, *args)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/utils.py", line 678, in wrapper
    response = f(*args, **kwargs)
  File "/home/user/.local/lib/python3.10/site-packages/spaces/zero/wrappers.py", line 119, in gradio_handler
    raise res.value
AttributeError: 'tuple' object has no attribute 'unsqueeze'
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/spaces/zero/wrappers.py", line 170, in thread_wrapper
    res = future.result()
  File "/usr/local/lib/python3.10/concurrent/futures/_base.py", line 451, in result
    return self.__get_result()
  File "/usr/local/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result
    raise self._exception
  File "/usr/local/lib/python3.10/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/home/user/app/app.py", line 68, in whisper_speech_demo
    audio_np = generate_segment_audio(text_str, lang, speaker_url, pipe)
  File "/home/user/.local/lib/python3.10/site-packages/spaces/zero/wrappers.py", line 92, in gradio_handler
    return task(*args, **kwargs)
  File "/home/user/app/app.py", line 44, in generate_segment_audio
    audio_data = pipe.generate(text, speaker_url, lang)
  File "/home/user/app/whisperspeech/pipeline.py", line 87, in generate
    return self.vocoder.decode(self.generate_atoks(text, speaker, lang=lang, cps=cps, step_callback=step_callback))
  File "/home/user/app/whisperspeech/pipeline.py", line 83, in generate_atoks
    atoks = self.s2a.generate(stoks, speaker.unsqueeze(0), step=step_callback)
AttributeError: 'tuple' object has no attribute 'unsqueeze'
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/gradio/queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1561, in process_api
    result = await self.call_function(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1179, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "/home/user/.local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "/home/user/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2134, in run_sync_in_worker_thread
    return await future
  File "/home/user/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 851, in run
    result = context.run(func, *args)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/utils.py", line 678, in wrapper
    response = f(*args, **kwargs)
  File "/home/user/.local/lib/python3.10/site-packages/spaces/zero/wrappers.py", line 119, in gradio_handler
    raise res.value
AttributeError: 'tuple' object has no attribute 'unsqueeze'
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/spaces/zero/wrappers.py", line 170, in thread_wrapper
    res = future.result()
  File "/usr/local/lib/python3.10/concurrent/futures/_base.py", line 451, in result
    return self.__get_result()
  File "/usr/local/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result
    raise self._exception
  File "/usr/local/lib/python3.10/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/home/user/app/app.py", line 68, in whisper_speech_demo
    audio_np = generate_segment_audio(text_str, lang, speaker_url, pipe)
  File "/home/user/.local/lib/python3.10/site-packages/spaces/zero/wrappers.py", line 92, in gradio_handler
    return task(*args, **kwargs)
  File "/home/user/app/app.py", line 44, in generate_segment_audio
    audio_data = pipe.generate(text, speaker_url, lang)
  File "/home/user/app/whisperspeech/pipeline.py", line 87, in generate
    return self.vocoder.decode(self.generate_atoks(text, speaker, lang=lang, cps=cps, step_callback=step_callback))
  File "/home/user/app/whisperspeech/pipeline.py", line 83, in generate_atoks
    atoks = self.s2a.generate(stoks, speaker.unsqueeze(0), step=step_callback)
AttributeError: 'tuple' object has no attribute 'unsqueeze'
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/gradio/queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1561, in process_api
    result = await self.call_function(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1179, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "/home/user/.local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "/home/user/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2134, in run_sync_in_worker_thread
    return await future
  File "/home/user/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 851, in run
    result = context.run(func, *args)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/utils.py", line 678, in wrapper
    response = f(*args, **kwargs)
  File "/home/user/.local/lib/python3.10/site-packages/spaces/zero/wrappers.py", line 119, in gradio_handler
    raise res.value
AttributeError: 'tuple' object has no attribute 'unsqueeze'
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/gradio/queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1570, in process_api
    data = self.postprocess_data(fn_index, result["prediction"], state)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1455, in postprocess_data
    prediction_value = block.postprocess(prediction_value)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/components/audio.py", line 251, in postprocess
    file_path = processing_utils.save_audio_to_cache(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/processing_utils.py", line 152, in save_audio_to_cache
    temp_dir = Path(cache_dir) / hash_bytes(data.tobytes())
AttributeError: 'str' object has no attribute 'tobytes'
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/spaces/zero/wrappers.py", line 170, in thread_wrapper
    res = future.result()
  File "/usr/local/lib/python3.10/concurrent/futures/_base.py", line 451, in result
    return self.__get_result()
  File "/usr/local/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result
    raise self._exception
  File "/usr/local/lib/python3.10/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/home/user/app/app.py", line 68, in whisper_speech_demo
    audio_np = generate_segment_audio(text_str, lang, speaker_url, pipe)
  File "/home/user/.local/lib/python3.10/site-packages/spaces/zero/wrappers.py", line 92, in gradio_handler
    return task(*args, **kwargs)
  File "/home/user/app/app.py", line 44, in generate_segment_audio
    audio_data = pipe.generate(text, speaker_url, lang)
  File "/home/user/app/whisperspeech/pipeline.py", line 87, in generate
    return self.vocoder.decode(self.generate_atoks(text, speaker, lang=lang, cps=cps, step_callback=step_callback))
  File "/home/user/app/whisperspeech/pipeline.py", line 83, in generate_atoks
    atoks = self.s2a.generate(stoks, speaker.unsqueeze(0), step=step_callback)
AttributeError: 'tuple' object has no attribute 'unsqueeze'
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/gradio/queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1561, in process_api
    result = await self.call_function(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1179, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "/home/user/.local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "/home/user/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2134, in run_sync_in_worker_thread
    return await future
  File "/home/user/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 851, in run
    result = context.run(func, *args)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/utils.py", line 678, in wrapper
    response = f(*args, **kwargs)
  File "/home/user/.local/lib/python3.10/site-packages/spaces/zero/wrappers.py", line 119, in gradio_handler
    raise res.value
AttributeError: 'tuple' object has no attribute 'unsqueeze'

so these are rolling in after a ZeroGPU gets acquired.

like i said... it did work once before this ... so i'm flabbergasted & it's late here, so i will continue to investigate tomorrow :-)

Tonic

Owner Jan 28

•

edited Jan 28

ok... here's a clue : try longer voice uploads of 30 seconds @mrfakename

Tonic

Owner Jan 28

ok... here's a clue : try longer voice uploads of 30 seconds @mrfakename

ok, that didnt help, just tested it... i need to take a look, it might be the case something went awry when the whisperspeech library was updated (yesterday) , so i'll investigate this further.

mrfakename

Jan 28

Right now i'm not using a reference speaker

Tonic

Owner Jan 29

Right now i'm not using a reference speaker

would you kindly / generously try it now , i'm bug hunting think i got it going on both functions + some more work on the parser, and trying to find a final layout for the demo that looks sleeker and more enjoyable :-)

bugs, tips, tricks, and suggestions are very welcome.

i also mention this discussion on github and collabora where more contributors are working on it :-)

mrfakename

Jan 29

Yeah I'm still getting the GPU issue, seems to be an issue with ZERO GPUs

Tonic

Owner Jan 29

@mrfakename , first time i saw it for myself here, but i'm also getting the results(?)

complete stack trace where it sometimes works and sometimes doesnt :

===== Application Startup at 2024-01-29 14:49:41 =====

Running on local URL:  http://0.0.0.0:7860

To create a public link, set `share=True` in `launch()`.

t2s-small-en+pl.model:   0%|          | 0.00/856M [00:00<?, ?B/s]
t2s-small-en+pl.model:  18%|█▊        | 157M/856M [00:01<00:04, 153MB/s]
t2s-small-en+pl.model:  44%|████▎     | 374M/856M [00:02<00:02, 189MB/s]
t2s-small-en+pl.model:  67%|██████▋   | 573M/856M [00:05<00:03, 89.8MB/s]
t2s-small-en+pl.model: 100%|█████████▉| 856M/856M [00:05<00:00, 143MB/s] 

s2a-q4-small-en+pl.model:   0%|          | 0.00/874M [00:00<?, ?B/s]
s2a-q4-small-en+pl.model:  36%|███▌      | 315M/874M [00:01<00:01, 313MB/s]
s2a-q4-small-en+pl.model:  93%|█████████▎| 811M/874M [00:02<00:00, 415MB/s]
s2a-q4-small-en+pl.model: 100%|█████████▉| 874M/874M [00:05<00:00, 161MB/s]

config.yaml:   0%|          | 0.00/503 [00:00<?, ?B/s]
config.yaml: 100%|██████████| 503/503 [00:00<00:00, 2.92MB/s]

pytorch_model.bin:   0%|          | 0.00/40.4M [00:00<?, ?B/s]
pytorch_model.bin: 100%|██████████| 40.4M/40.4M [00:00<00:00, 68.5MB/s]
Downloading: "https://dl.fbaipublicfiles.com/encodec/v0/encodec_24khz-d7cc33bc.th" to /home/user/.cache/torch/hub/checkpoints/encodec_24khz-d7cc33bc.th

  0%|          | 0.00/88.9M [00:00<?, ?B/s]
100%|██████████| 88.9M/88.9M [00:00<00:00, 152MB/s]
█

 |----------------------------------------| 0.00% [0/749 00:00<?]

 |----------------------------------------| 0.13% [1/749 00:00<00:14]

 |----------------------------------------| 0.27% [2/749 00:00<00:14]

 |----------------------------------------| 0.40% [3/749 00:00<00:14]

 |----------------------------------------| 0.53% [4/749 00:00<00:14]

 |----------------------------------------| 0.67% [5/749 00:00<00:14]

 |----------------------------------------| 2.00% [15/749 00:00<00:13]

 |█---------------------------------------| 3.34% [25/749 00:00<00:13]

 |█---------------------------------------| 4.67% [35/749 00:00<00:13]

 |██--------------------------------------| 6.01% [45/749 00:00<00:12]
█

 |----------------------------------------| 0.00% [0/152 00:00<?]

 |----------------------------------------| 0.66% [1/152 00:00<00:04]

 |----------------------------------------| 1.32% [2/152 00:00<00:04]

 |----------------------------------------| 1.97% [3/152 00:00<00:04]

 |█---------------------------------------| 2.63% [4/152 00:00<00:04]

 |█---------------------------------------| 3.29% [5/152 00:00<00:04]

 |██--------------------------------------| 7.24% [11/152 00:00<00:04]

 |████------------------------------------| 11.18% [17/152 00:00<00:03]

 |██████----------------------------------| 15.13% [23/152 00:00<00:03]

 |███████---------------------------------| 19.08% [29/152 00:00<00:03]

 |█████████-------------------------------| 23.03% [35/152 00:01<00:03]

 |██████████------------------------------| 26.97% [41/152 00:01<00:03]

 |████████████----------------------------| 30.92% [47/152 00:01<00:03]

 |█████████████---------------------------| 34.87% [53/152 00:01<00:03]

 |███████████████-------------------------| 38.82% [59/152 00:01<00:02]

 |█████████████████-----------------------| 42.76% [65/152 00:01<00:02]

 |██████████████████----------------------| 46.71% [71/152 00:02<00:02]

 |████████████████████--------------------| 50.66% [77/152 00:02<00:02]

 |█████████████████████-------------------| 54.61% [83/152 00:02<00:02]

 |███████████████████████-----------------| 58.55% [89/152 00:02<00:01]

 |█████████████████████████---------------| 62.50% [95/152 00:02<00:01]

 |██████████████████████████--------------| 66.45% [101/152 00:03<00:01]

 |████████████████████████████------------| 70.39% [107/152 00:03<00:01]

 |█████████████████████████████-----------| 74.34% [113/152 00:03<00:01]

 |███████████████████████████████---------| 78.29% [119/152 00:03<00:00]

 |████████████████████████████████--------| 82.24% [125/152 00:03<00:00]

 |██████████████████████████████████------| 86.18% [131/152 00:03<00:00]

 |████████████████████████████████████----| 90.13% [137/152 00:04<00:00]

 |█████████████████████████████████████---| 94.08% [143/152 00:04<00:00]

 |███████████████████████████████████████-| 98.03% [149/152 00:04<00:00]

 |████████████████████████████████████████| 100.00% [152/152 00:04<00:00]
█

|----------------------------------------| 0.00% [0/749 00:00<?]

 |----------------------------------------| 0.13% [1/749 00:00<00:15]

 |----------------------------------------| 0.27% [2/749 00:00<00:15]

 |----------------------------------------| 0.40% [3/749 00:00<00:15]

 |----------------------------------------| 0.53% [4/749 00:00<00:15]

 |----------------------------------------| 0.67% [5/749 00:00<00:15]

 |----------------------------------------| 1.87% [14/749 00:00<00:14]

 |█---------------------------------------| 3.20% [24/749 00:00<00:13]

 |█---------------------------------------| 4.54% [34/749 00:00<00:12]

 |██--------------------------------------| 6.01% [45/749 00:00<00:12]
█

 |----------------------------------------| 0.00% [0/152 00:00<?]

 |----------------------------------------| 0.66% [1/152 00:00<00:04]

 |----------------------------------------| 1.32% [2/152 00:00<00:04]

 |----------------------------------------| 1.97% [3/152 00:00<00:04]

 |█---------------------------------------| 2.63% [4/152 00:00<00:04]

 |█---------------------------------------| 3.29% [5/152 00:00<00:04]

 |███-------------------------------------| 7.89% [12/152 00:00<00:04]

 |████------------------------------------| 11.84% [18/152 00:00<00:03]

 |██████----------------------------------| 15.79% [24/152 00:00<00:03]

 |███████---------------------------------| 19.74% [30/152 00:00<00:03]

 |█████████-------------------------------| 23.68% [36/152 00:01<00:03]

 |███████████-----------------------------| 27.63% [42/152 00:01<00:03]

 |████████████----------------------------| 31.58% [48/152 00:01<00:02]

 |██████████████--------------------------| 35.53% [54/152 00:01<00:02]

 |███████████████-------------------------| 39.47% [60/152 00:01<00:02]

 |█████████████████-----------------------| 43.42% [66/152 00:01<00:02]

 |██████████████████----------------------| 47.37% [72/152 00:02<00:02]

 |████████████████████--------------------| 51.32% [78/152 00:02<00:02]

 |██████████████████████------------------| 55.26% [84/152 00:02<00:01]

 |███████████████████████-----------------| 59.21% [90/152 00:02<00:01]

 |█████████████████████████---------------| 63.16% [96/152 00:02<00:01]

 |██████████████████████████--------------| 67.11% [102/152 00:02<00:01]

 |████████████████████████████------------| 71.05% [108/152 00:03<00:01]

 |██████████████████████████████----------| 75.00% [114/152 00:03<00:01]

 |███████████████████████████████---------| 78.95% [120/152 00:03<00:00]

 |█████████████████████████████████-------| 82.89% [126/152 00:03<00:00]

 |██████████████████████████████████------| 86.84% [132/152 00:03<00:00]

 |████████████████████████████████████----| 90.79% [138/152 00:03<00:00]

 |█████████████████████████████████████---| 94.74% [144/152 00:04<00:00]

 |███████████████████████████████████████-| 98.68% [150/152 00:04<00:00]

 |████████████████████████████████████████| 100.00% [152/152 00:04<00:00]
█

 |----------------------------------------| 0.00% [0/749 00:00<?]

 |----------------------------------------| 0.13% [1/749 00:00<00:14]

 |----------------------------------------| 0.27% [2/749 00:00<00:14]

 |----------------------------------------| 0.40% [3/749 00:00<00:14]

 |----------------------------------------| 0.53% [4/749 00:00<00:14]

 |----------------------------------------| 0.67% [5/749 00:00<00:13]

 |----------------------------------------| 2.00% [15/749 00:00<00:13]

 |█---------------------------------------| 3.34% [25/749 00:00<00:13]

 |█---------------------------------------| 4.67% [35/749 00:00<00:13]

 |██--------------------------------------| 6.01% [45/749 00:00<00:12]
█

 |----------------------------------------| 0.00% [0/152 00:00<?]

 |----------------------------------------| 0.66% [1/152 00:00<00:04]

 |----------------------------------------| 1.32% [2/152 00:00<00:04]

 |----------------------------------------| 1.97% [3/152 00:00<00:04]

 |█---------------------------------------| 2.63% [4/152 00:00<00:04]

 |█---------------------------------------| 3.29% [5/152 00:00<00:04]

 |██--------------------------------------| 7.24% [11/152 00:00<00:04]

 |████------------------------------------| 11.18% [17/152 00:00<00:04]

 |██████----------------------------------| 15.13% [23/152 00:00<00:03]

 |███████---------------------------------| 19.08% [29/152 00:00<00:03]

 |█████████-------------------------------| 23.03% [35/152 00:01<00:03]

 |██████████------------------------------| 26.97% [41/152 00:01<00:03]

 |████████████----------------------------| 30.92% [47/152 00:01<00:03]

 |█████████████---------------------------| 34.87% [53/152 00:01<00:02]

 |███████████████-------------------------| 38.82% [59/152 00:01<00:02]

 |█████████████████-----------------------| 42.76% [65/152 00:01<00:02]

 |██████████████████----------------------| 46.71% [71/152 00:02<00:02]

 |████████████████████--------------------| 50.66% [77/152 00:02<00:02]

 |█████████████████████-------------------| 54.61% [83/152 00:02<00:02]

 |███████████████████████-----------------| 58.55% [89/152 00:02<00:01]

 |█████████████████████████---------------| 62.50% [95/152 00:02<00:01]

 |██████████████████████████--------------| 66.45% [101/152 00:03<00:01]

 |████████████████████████████------------| 70.39% [107/152 00:03<00:01]

 |█████████████████████████████-----------| 74.34% [113/152 00:03<00:01]

 |███████████████████████████████---------| 78.29% [119/152 00:03<00:00]

 |████████████████████████████████--------| 82.24% [125/152 00:03<00:00]

 |██████████████████████████████████------| 86.18% [131/152 00:03<00:00]

 |████████████████████████████████████----| 90.13% [137/152 00:04<00:00]

 |█████████████████████████████████████---| 94.08% [143/152 00:04<00:00]

 |███████████████████████████████████████-| 98.03% [149/152 00:04<00:00]

 |████████████████████████████████████████| 100.00% [152/152 00:04<00:00]
█

 |----------------------------------------| 0.00% [0/749 00:00<?]

 |
0.13% [1/749 00:00<00:13]

 |----------------------------------------| 0.27% [2/749 00:00<00:13]

 |----------------------------------------| 0.40% [3/749 00:00<00:13]

 |----------------------------------------| 0.53% [4/749 00:00<00:13]

 |----------------------------------------| 0.67% [5/749 00:00<00:13]

 |----------------------------------------| 2.14% [16/749 00:00<00:13]

 |█---------------------------------------| 3.60% [27/749 00:00<00:12]

 |██--------------------------------------| 5.07% [38/749 00:00<00:12]

 |██--------------------------------------| 6.54% [49/749 00:00<00:12]
█

 |----------------------------------------| 0.00% [0/152 00:00<?]

 |----------------------------------------| 0.66% [1/152 00:00<00:04]

 |----------------------------------------| 1.32% [2/152 00:00<00:04]

 |----------------------------------------| 1.97% [3/152 00:00<00:04]

 |█---------------------------------------| 2.63% [4/152 00:00<00:04]

 |█---------------------------------------| 3.29% [5/152 00:00<00:04]

 |██--------------------------------------| 7.24% [11/152 00:00<00:04]

 |████------------------------------------| 11.18% [17/152 00:00<00:03]

 |██████----------------------------------| 15.13% [23/152 00:00<00:03]

 |███████---------------------------------| 19.08% [29/152 00:00<00:03]

 |█████████-------------------------------| 23.03% [35/152 00:01<00:03]

 |██████████------------------------------| 26.97% [41/152 00:01<00:03]

 |████████████----------------------------| 30.92% [47/152 00:01<00:03]

 |█████████████---------------------------| 34.87% [53/152 00:01<00:02]

 |███████████████-------------------------| 38.82% [59/152 00:01<00:02]

 |█████████████████-----------------------| 42.76% [65/152 00:01<00:02]

 |██████████████████----------------------| 46.71% [71/152 00:02<00:02]

 |████████████████████--------------------| 50.66% [77/152 00:02<00:02]

 |█████████████████████-------------------| 54.61% [83/152 00:02<00:02]

 |███████████████████████-----------------| 58.55% [89/152 00:02<00:01]

 |█████████████████████████---------------| 62.50% [95/152 00:02<00:01]

 |██████████████████████████--------------| 66.45% [101/152 00:02<00:01]

 |████████████████████████████------------| 70.39% [107/152 00:03<00:01]

 |█████████████████████████████-----------| 74.34% [113/152 00:03<00:01]

 |███████████████████████████████---------| 78.29% [119/152 00:03<00:00]

 |████████████████████████████████--------| 82.24% [125/152 00:03<00:00]

 |██████████████████████████████████------| 86.18% [131/152 00:03<00:00]

 |████████████████████████████████████----| 90.13% [137/152 00:04<00:00]

 |█████████████████████████████████████---| 94.08% [143/152 00:04<00:00]

 |███████████████████████████████████████-| 98.03% [149/152 00:04<00:00]

 |████████████████████████████████████████| 100.00% [152/152 00:04<00:00]
█

 |----------------------------------------| 0.00% [0/749 00:00<?]

 |----------------------------------------| 0.13% [1/749 00:00<00:14]

 |-----
(most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/gradio/queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1561, in process_api
    result = await self.call_function(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1179, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "/home/user/.local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "/home/user/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2134, in run_sync_in_worker_thread
    return await future
  File "/home/user/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 851, in run
    result = context.run(func, *args)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/utils.py", line 678, in wrapper
    response = f(*args, **kwargs)
  File "/home/user/.local/lib/python3.10/site-packages/spaces/zero/wrappers.py", line 95, in gradio_handler
    schedule_response = client.schedule(task_id, request, duration, enable_queue)
  File "/home/user/.local/lib/python3.10/site-packages/spaces/zero/client.py", line 86, in schedule
    raise gr.Error(NO_GPU_MESSAGE_INQUEUE)
gradio.exceptions.Error: 'No GPU is currently available for you after 60s'
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/gradio/queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1561, in process_api
    result = await self.call_function(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1179, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "/home/user/.local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "/home/user/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2134, in run_sync_in_worker_thread
    return await future
  File "/home/user/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 851, in run
    result = context.run(func, *args)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/utils.py", line 678, in wrapper
    response = f(*args, **kwargs)
  File "/home/user/.local/lib/python3.10/site-packages/spaces/zero/wrappers.py", line 95, in gradio_handler
    schedule_response = client.schedule(task_id, request, duration, enable_queue)
  File "/home/user/.local/lib/python3.10/site-packages/spaces/zero/client.py", line 86, in schedule
    raise gr.Error(NO_GPU_MESSAGE_INQUEUE)
gradio.exceptions.Error: 'No GPU is currently available for you after 60s'
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/gradio/queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1561, in process_api
    result = await self.call_function(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1179, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "/home/user/.local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "/home/user/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2134, in run_sync_in_worker_thread
    return await future
  File "/home/user/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 851, in run
    result = context.run(func, *args)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/utils.py", line 678, in wrapper
    response = f(*args, **kwargs)
  File "/home/user/.local/lib/python3.10/site-packages/spaces/zero/wrappers.py", line 95, in gradio_handler
    schedule_response = client.schedule(task_id, request, duration, enable_queue)
  File "/home/user/.local/lib/python3.10/site-packages/spaces/zero/client.py", line 86, in schedule
    raise gr.Error(NO_GPU_MESSAGE_INQUEUE)
gradio.exceptions.Error: 'No GPU is currently available for you after 60s'
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/gradio/queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1561, in process_api
    result = await self.call_function(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1179, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "/home/user/.local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "/home/user/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2134, in run_sync_in_worker_thread
    return await future
  File "/home/user/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 851, in run
    result = context.run(func, *args)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/utils.py", line 678, in wrapper
    response = f(*args, **kwargs)
  File "/home/user/.local/lib/python3.10/site-packages/spaces/zero/wrappers.py", line 95, in gradio_handler
    schedule_response = client.schedule(task_id, request, duration, enable_queue)
  File "/home/user/.local/lib/python3.10/site-packages/spaces/zero/client.py", line 86, in schedule
    raise gr.Error(NO_GPU_MESSAGE_INQUEUE)
gradio.exceptions.Error: 'No GPU is currently available for you after 60s'
-----------------------------------| 0.27% [2/749 00:00<00:14]

 |----------------------------------------| 0.40% [3/749 00:00<00:13]

 |----------------------------------------| 0.53% [4/749 00:00<00:13]

 |----------------------------------------| 0.67% [5/749 00:00<00:13]

 |----------------------------------------| 2.00% [15/749 00:00<00:13]

 |█---------------------------------------| 3.34% [25/749 00:00<00:13]

 |█---------------------------------------| 4.67% [35/749 00:00<00:13]

 |██--------------------------------------| 6.01% [45/749 00:00<00:12]
█

 |----------------------------------------| 0.00% [0/152 00:00<?]

 |----------------------------------------| 0.66% [1/152 00:00<00:04]

 |----------------------------------------| 1.32% [2/152 00:00<00:04]

 |----------------------------------------| 1.97% [3/152 00:00<00:04]

 |█---------------------------------------| 2.63% [4/152 00:00<00:04]

 |█---------------------------------------| 3.29% [5/152 00:00<00:04]

 |██--------------------------------------| 7.24% [11/152 00:00<00:04]

 |████------------------------------------| 11.18% [17/152 00:00<00:03]

 |██████----------------------------------| 15.13% [23/152 00:00<00:03]

 |███████---------------------------------| 19.08% [29/152 00:00<00:03]

 |█████████-------------------------------| 23.03% [35/152 00:01<00:03]

 |██████████------------------------------| 26.97% [41/152 00:01<00:03]

 |████████████----------------------------| 30.92% [47/152 00:01<00:03]

 |█████████████---------------------------| 34.87% [53/152 00:01<00:02]

 |███████████████-------------------------| 38.82% [59/152 00:01<00:02]

 |█████████████████-----------------------| 42.76% [65/152 00:01<00:02]

 |██████████████████----------------------| 46.71% [71/152 00:02<00:02]

 |████████████████████--------------------| 50.66% [77/152 00:02<00:02]

 |█████████████████████-------------------| 54.61% [83/152 00:02<00:01]

 |███████████████████████-----------------| 58.55% [89/152 00:02<00:01]

 |█████████████████████████---------------| 62.50% [95/152 00:02<00:01]

 |██████████████████████████--------------| 66.45% [101/152 00:02<00:01]

 |████████████████████████████------------| 70.39% [107/152 00:03<00:01]

 |█████████████████████████████-----------| 74.34% [113/152 00:03<00:01]

 |███████████████████████████████---------| 78.29% [119/152 00:03<00:00]

 |████████████████████████████████--------| 82.24% [125/152 00:03<00:00]

 |██████████████████████████████████------| 86.18% [131/152 00:03<00:00]

 |████████████████████████████████████----| 90.13% [137/152 00:03<00:00]

 |█████████████████████████████████████---| 94.08% [143/152 00:04<00:00]

 |███████████████████████████████████████-| 98.03% [149/152 00:04<00:00]

 |████████████████████████████████████████| 100.00% [152/152 00:04<00:00]
█

 |----------------------------------------| 0.00% [0/749 00:00<?]

 |----------------------------------------| 0.13% [1/749 00:00<00:13]

 |---------
0.27% [2/749 00:00<00:12]

 |----------------------------------------| 0.40% [3/749 00:00<00:12]

 |----------------------------------------| 0.53% [4/749 00:00<00:12]

 |----------------------------------------| 0.67% [5/749 00:00<00:12]

 |----------------------------------------| 2.14% [16/749 00:00<00:12]

 |█---------------------------------------| 3.60% [27/749 00:00<00:12]

 |██--------------------------------------| 5.07% [38/749 00:00<00:12]

 |██--------------------------------------| 6.54% [49/749 00:00<00:11]
█

 |----------------------------------------| 0.00% [0/152 00:00<?]

 |----------------------------------------| 0.66% [1/152 00:00<00:04]

 |----------------------------------------| 1.32% [2/152 00:00<00:04]

 |----------------------------------------| 1.97% [3/152 00:00<00:04]

 |█---------------------------------------| 2.63% [4/152 00:00<00:04]

 |█---------------------------------------| 3.29% [5/152 00:00<00:04]

 |███-------------------------------------| 7.89% [12/152 00:00<00:03]

 |█████-----------------------------------| 12.50% [19/152 00:00<00:03]

 |██████----------------------------------| 17.11% [26/152 00:00<00:03]

 |████████--------------------------------| 21.71% [33/152 00:00<00:03]

 |██████████------------------------------| 26.32% [40/152 00:01<00:03]

 |████████████----------------------------| 30.92% [47/152 00:01<00:02]

 |██████████████--------------------------| 35.53% [54/152 00:01<00:02]

 |████████████████------------------------| 40.13% [61/152 00:01<00:02]

 |█████████████████-----------------------| 44.74% [68/152 00:01<00:02]

 |███████████████████---------------------| 49.34% [75/152 00:02<00:02]

 |█████████████████████-------------------| 53.95% [82/152 00:02<00:01]

 |███████████████████████-----------------| 58.55% [89/152 00:02<00:01]

 |█████████████████████████---------------| 63.16% [96/152 00:02<00:01]

 |███████████████████████████-------------| 67.76% [103/152 00:02<00:01]

 |████████████████████████████------------| 72.37% [110/152 00:03<00:01]

 |██████████████████████████████----------| 76.97% [117/152 00:03<00:00]

 |████████████████████████████████--------| 81.58% [124/152 00:03<00:00]

 |██████████████████████████████████------| 86.18% [131/152 00:03<00:00]

 |████████████████████████████████████----| 90.79% [138/152 00:03<00:00]

 |██████████████████████████████████████--| 95.39% [145/152 00:04<00:00]

 |████████████████████████████████████████| 100.00% [152/152 00:04<00:00]
█

 |----------------------------------------| 0.00% [0/749 00:00<?]

 |----------------------------------------| 0.13% [1/749 00:00<00:14]

 |----------------------------------------| 0.27% [2/749 00:00<00:13]

 |----------------------------------------| 0.40% [3/749 00:00<00:13]

 |----------------------------------------| 0.53% [4/749 00:00<00:13]

 |----------------------------------------| 0.67% [5/749 00:00<00:13]

 |----------------------------------------| 2.00% [15/749 00:00<00:13]

 |█---------------------------------------| 3.47% [26/749 00:00<00:13]

 |█---------------------------------------| 4.94% [37/749 00:00<00:12]

 |██--------------------------------------| 6.41% [48/749 00:00<00:12]

 |███-------------------------------------| 7.88% [59/749 00:01<00:12]

 |███-------------------------------------| 9.35% [70/749 00:01<00:12]
█

 |----------------------------------------| 0.00% [0/227 00:00<?]

 |----------------------------------------| 0.44% [1/227 00:00<00:06]

 |----------------------------------------| 0.88% [2/227 00:00<00:06]

 |----------------------------------------| 1.32% [3/227 00:00<00:06]

 |----------------------------------------| 1.76% [4/227 00:00<00:06]

 |----------------------------------------| 2.20% [5/227 00:00<00:06]

 |█---------------------------------------| 4.85% [11/227 00:00<00:06]

 |██--------------------------------------| 7.49% [17/227 00:00<00:06]

 |████------------------------------------| 10.13% [23/227 00:00<00:05]

 |█████-----------------------------------| 12.78% [29/227 00:00<00:05]

 |██████----------------------------------| 15.42% [35/227 00:01<00:05]

 |███████---------------------------------| 18.06% [41/227 00:01<00:05]

 |████████--------------------------------| 20.70% [47/227 00:01<00:05]

 |█████████-------------------------------| 23.35% [53/227 00:01<00:05]

 |██████████------------------------------| 25.99% [59/227 00:01<00:04]

 |███████████-----------------------------| 28.63% [65/227 00:01<00:04]

 |████████████----------------------------| 31.28% [71/227 00:02<00:04]

 |█████████████---------------------------| 33.92% [77/227 00:02<00:04]

 |██████████████--------------------------| 36.56% [83/227 00:02<00:04]

 |███████████████-------------------------| 39.21% [89/227 00:02<00:04]

 |████████████████------------------------| 41.85% [95/227 00:02<00:03]

 |█████████████████-----------------------| 44.49% [101/227 00:02<00:03]

 |██████████████████----------------------| 47.14% [107/227 00:03<00:03]

 |███████████████████---------------------| 49.78% [113/227 00:03<00:03]

 |████████████████████--------------------| 52.42% [119/227 00:03<00:03]

 |██████████████████████------------------| 55.07% [125/227 00:03<00:02]

 |███████████████████████-----------------| 57.71% [131/227 00:03<00:02]

 |████████████████████████----------------| 60.35% [137/227 00:03<00:02]

 |█████████████████████████---------------| 63.00% [143/227 00:04<00:02]

 |██████████████████████████--------------| 65.64% [149/227 00:04<00:02]

 |███████████████████████████-------------| 68.28% [155/227 00:04<00:02]

 |████████████████████████████------------| 70.93% [161/227 00:04<00:01]

 |█████████████████████████████-----------| 73.57% [167/227 00:04<00:01]

 |██████████████████████████████----------| 76.21% [173/227 00:05<00:01]

 |███████████████████████████████---------| 78.85% [179/227 00:05<00:01]

 |████████████████████████████████--------| 81.50% [185/227 00:05<00:01]

 |█████████████████████████████████-------| 84.14% [191/227 00:05<00:01]

 |██████████████████████████████████------| 86.78% [197/227 00:05<00:00]

 |███████████████████████████████████-----| 89.43% [203/227 00:05<00:00]

 |████████████████████████████████████----| 92.07% [209/227 00:06<00:00]

 |█████████████████████████████████████---| 94.71% [215/227 00:06<00:00]

 |██████████████████████████████████████--| 97.36% [221/227 00:06<00:00]

 |████████████████████████████████████████| 100.00% [227/227 00:06<00:00]
█

 |----------------------------------------| 0.00% [0/749 00:00<?]

 |----------------------------------------| 0.13% [1/749 00:00<00:13]

 |----------------------------------------| 0.27% [2/749 00:00<00:13]

 |----------------------------------------| 0.40% [3/749 00:00<00:13]

 |----------------------------------------| 0.53% [4/749 00:00<00:13]

 |----------------------------------------| 0.67% [5/749 00:00<00:13]

 |----------------------------------------| 2.14% [16/749 00:00<00:12]

 |█---------------------------------------| 3.60% [27/749 00:00<00:12]

 |██--------------------------------------| 5.07% [38/749 00:00<00:12]

 |██--------------------------------------| 6.54% [49/749 00:00<00:12]

 |███-------------------------------------| 8.01% [60/749 00:01<00:11]

 |███-------------------------------------| 9.48% [71/749 00:01<00:11]

 |████------------------------------------| 10.95% [82/749 00:01<00:11]

 |████------------------------------------| 12.42% [93/749 00:01<00:11]
█

 |----------------------------------------| 0.00% [0/302 00:00<?]

 |----------------------------------------| 0.33% [1/302 00:00<00:08]

 |----------------------------------------| 0.66% [2/302 00:00<00:08]

 |----------------------------------------| 0.99% [3/302 00:00<00:08]

 |----------------------------------------| 1.32% [4/302 00:00<00:08]

 |----------------------------------------| 1.66% [5/302 00:00<00:08]

 |█---------------------------------------| 3.97% [12/302 00:00<00:08]

 |██--------------------------------------| 6.29% [19/302 00:00<00:07]

 |███-------------------------------------| 8.61% [26/302 00:00<00:07]

 |████------------------------------------| 10.93% [33/302 00:00<00:07]

 |████
13.25% [40/302 00:01<00:07]

 |██████----------------------------------| 15.56% [47/302 00:01<00:07]

 |███████---------------------------------| 17.88% [54/302 00:01<00:06]

 |████████--------------------------------| 20.20% [61/302 00:01<00:06]

 |█████████-------------------------------| 22.52% [68/302 00:01<00:06]

 |█████████-------------------------------| 24.83% [75/302 00:02<00:06]

 |██████████------------------------------| 27.15% [82/302 00:02<00:06]

 |███████████-----------------------------| 29.47% [89/302 00:02<00:05]

 |████████████----------------------------| 31.79% [96/302 00:02<00:05]

 |█████████████---------------------------| 34.11% [103/302 00:02<00:05]

 |██████████████--------------------------| 36.42% [110/302 00:03<00:05]

 |███████████████-------------------------| 38.74% [117/302 00:03<00:05]

 |████████████████------------------------| 41.06% [124/302 00:03<00:04]

 |█████████████████-----------------------| 43.38% [131/302 00:03<00:04]

 |██████████████████----------------------| 45.70% [138/302 00:03<00:04]

 |███████████████████---------------------| 48.01% [145/302 00:04<00:04]

 |███████�
(most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/gradio/queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1561, in process_api
    result = await self.call_function(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1179, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "/home/user/.local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "/home/user/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2134, in run_sync_in_worker_thread
    return await future
  File "/home/user/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 851, in run
    result = context.run(func, *args)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/utils.py", line 678, in wrapper
    response = f(*args, **kwargs)
  File "/home/user/.local/lib/python3.10/site-packages/spaces/zero/wrappers.py", line 95, in gradio_handler
    schedule_response = client.schedule(task_id, request, duration, enable_queue)
  File "/home/user/.local/lib/python3.10/site-packages/spaces/zero/client.py", line 86, in schedule
    raise gr.Error(NO_GPU_MESSAGE_INQUEUE)
gradio.exceptions.Error: 'No GPU is currently available for you after 60s'
/home/user/.local/lib/python3.10/site-packages/spaces/zero/client.py:124: RuntimeWarning: GPU device not used
  warnings.warn(UNUSED_MESSAGE, RuntimeWarning)
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/gradio/queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1570, in process_api
    data = self.postprocess_data(fn_index, result["prediction"], state)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1455, in postprocess_data
    prediction_value = block.postprocess(prediction_value)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/components/audio.py", line 251, in postprocess
    file_path = processing_utils.save_audio_to_cache(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/processing_utils.py", line 152, in save_audio_to_cache
    temp_dir = Path(cache_dir) / hash_bytes(data.tobytes())
AttributeError: 'str' object has no attribute 'tobytes'
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/gradio/queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1570, in process_api
    data = self.postprocess_data(fn_index, result["prediction"], state)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1455, in postprocess_data
    prediction_value = block.postprocess(prediction_value)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/components/audio.py", line 251, in postprocess
    file_path = processing_utils.save_audio_to_cache(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/processing_utils.py", line 152, in save_audio_to_cache
    temp_dir = Path(cache_dir) / hash_bytes(data.tobytes())
AttributeError: 'str' object has no attribute 'tobytes'
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/gradio/queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1570, in process_api
    data = self.postprocess_data(fn_index, result["prediction"], state)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1455, in postprocess_data
    prediction_value = block.postprocess(prediction_value)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/components/audio.py", line 251, in postprocess
    file_path = processing_utils.save_audio_to_cache(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/processing_utils.py", line 152, in save_audio_to_cache
    temp_dir = Path(cache_dir) / hash_bytes(data.tobytes())
AttributeError: 'str' object has no attribute 'tobytes'

i think the root of the problem could be because it "barely needs" GPU ... headscratcher

mrfakename

Jan 29

Very strange. When I'm getting the message I'm getting it pretty quickly (not after 60s) so I don't think the 60s is related. Could you try replacing


    with tempfile.NamedTemporaryFile(suffix='.wav', delete=False) as tmp_file:
        sf.write(tmp_file.name, concatenated_audio.T, 24000, format='WAV', subtype='PCM_16')
        return tmp_file.name

with

return (24000, concatenated_audio.T)

Since Gradio supports a direct NumPy array as audio, and it seems to be an issue with the filesystem?
Thanks!

Tonic

Owner Jan 30

You, sir , are a gentleman and a scholar.

thanks for this, makes sense !

it causes a small series of warning in the logs , including the GPU not used warning, but it does not show the GPU not used error, and i noticed both performance and quality improvements (once again!) - so thank you for the suggestion , it's actually great !

i've attached the logs below , from building + running just a multilingual text to speech. by the way it's also fixed my parsing issue , i really shouldn't gush so much, i know, but i love this feeling of community support that really does help :-)

===== Application Startup at 2024-01-30 08:28:04 =====

Running on local URL:  http://0.0.0.0:7860

To create a public link, set `share=True` in `launch()`.
/home/user/.local/lib/python3.10/site-packages/spaces/zero/client.py:124: RuntimeWarning: GPU device not used
  warnings.warn(UNUSED_MESSAGE, RuntimeWarning)
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/gradio/queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1570, in process_api
    data = self.postprocess_data(fn_index, result["prediction"], state)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1455, in postprocess_data
    prediction_value = block.postprocess(prediction_value)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/components/audio.py", line 251, in postprocess
    file_path = processing_utils.save_audio_to_cache(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/processing_utils.py", line 152, in save_audio_to_cache
    temp_dir = Path(cache_dir) / hash_bytes(data.tobytes())
AttributeError: 'str' object has no attribute 'tobytes'
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/gradio/queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1570, in process_api
    data = self.postprocess_data(fn_index, result["prediction"], state)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1455, in postprocess_data
    prediction_value = block.postprocess(prediction_value)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/components/audio.py", line 251, in postprocess
    file_path = processing_utils.save_audio_to_cache(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/processing_utils.py", line 152, in save_audio_to_cache
    temp_dir = Path(cache_dir) / hash_bytes(data.tobytes())
AttributeError: 'str' object has no attribute 'tobytes'
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/gradio/queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1570, in process_api
    data = self.postprocess_data(fn_index, result["prediction"], state)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1455, in postprocess_data
    prediction_value = block.postprocess(prediction_value)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/components/audio.py", line 251, in postprocess
    file_path = processing_utils.save_audio_to_cache(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/processing_utils.py", line 152, in save_audio_to_cache
    temp_dir = Path(cache_dir) / hash_bytes(data.tobytes())
AttributeError: 'str' object has no attribute 'tobytes'
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/gradio/queueing.py", line 495, in call_prediction
    output = await route_utils.call_process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1570, in process_api
    data = self.postprocess_data(fn_index, result["prediction"], state)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1455, in postprocess_data
    prediction_value = block.postprocess(prediction_value)
  File "/home/user/.local/lib/python3.10/site-packages/gradio/components/audio.py", line 251, in postprocess
    file_path = processing_utils.save_audio_to_cache(
  File "/home/user/.local/lib/python3.10/site-packages/gradio/processing_utils.py", line 152, in save_audio_to_cache
    temp_dir = Path(cache_dir) / hash_bytes(data.tobytes())
AttributeError: 'str' object has no attribute 'tobytes'

t2s-small-en+pl.model:   0%|          | 0.00/856M [00:00<?, ?B/s]
t2s-small-en+pl.model:  27%|██▋       | 231M/856M [00:01<00:02, 229MB/s]
t2s-small-en+pl.model: 100%|█████████▉| 856M/856M [00:01<00:00, 450MB/s]

s2a-q4-small-en+pl.model:   0%|          | 0.00/874M [00:00<?, ?B/s]
s2a-q4-small-en+pl.model:  13%|█▎        | 115M/874M [00:01<00:07, 102MB/s]
s2a-q4-small-en+pl.model:  98%|█████████▊| 853M/874M [00:02<00:00, 435MB/s]
s2a-q4-small-en+pl.model: 100%|█████████▉| 874M/874M [00:02<00:00, 369MB/s]

config.yaml:   0%|          | 0.00/503 [00:00<?, ?B/s]
config.yaml: 100%|██████████| 503/503 [00:00<00:00, 3.08MB/s]

pytorch_model.bin:   0%|          | 0.00/40.4M [00:00<?, ?B/s]
pytorch_model.bin: 100%|██████████| 40.4M/40.4M [00:00<00:00, 47.1MB/s]
Downloading: "https://dl.fbaipublicfiles.com/encodec/v0/encodec_24khz-d7cc33bc.th" to /home/user/.cache/torch/hub/checkpoints/encodec_24khz-d7cc33bc.th

  0%|          | 0.00/88.9M [00:00<?, ?B/s]
100%|██████████| 88.9M/88.9M [00:00<00:00, 199MB/s]
/home/user/.local/lib/python3.10/site-packages/gradio/processing_utils.py:340: UserWarning: Trying to convert audio automatically from float32 to 16-bit int format.
  warnings.warn(warning.format(data.dtype))

having basically fixed this now, i do want to ask you : do you think that this demo is simply not commensurate with the ZeroGPU in that it requires much less compute/memory than available ?

Kaiden423

Feb 3

oh jesus a runtime error and just when i woke up

Tonic

Owner Feb 3

sorry @Kaiden423 , basically this was the community build , there's an official demo now here , which should work (and cost a lot less in compute!) https://huggingface.co/spaces/collabora/WhisperSpeech hope you like it !

cbensimon

Feb 7

I think that we have several issues here.
Regarding ZeroGPU and the "No GPU device have been used" warning, it might have been a bug on ZeroGPU infrastructure side during the previous weeks (especially if it sometimes showed up, and sometimes not with the same inputs). This part should now be fixed

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment