2024-02-26 22:29:27 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40000, worker_address='http://localhost:40000', controller_address='http://localhost:10000', model_path='MBZUAI/MobiLlama-05B-Chat', revision='main', device='cuda', gpus=None, num_gpus=1, max_gpu_memory=None, dtype=None, load_8bit=False, cpu_offloading=False, gptq_ckpt=None, gptq_wbits=16, gptq_groupsize=-1, gptq_act_order=False, awq_ckpt=None, awq_wbits=16, awq_groupsize=-1, enable_exllama=False, exllama_max_seq_len=4096, exllama_gpu_split=None, exllama_cache_8bit=False, enable_xft=False, xft_max_seq_len=4096, xft_dtype=None, model_names=None, conv_template=None, embed_in_truncate=False, limit_worker_concurrency=5, stream_interval=2, no_register=False, seed=None, debug=False, ssl=False)
2024-02-26 22:29:27 | INFO | model_worker | Loading the model ['MobiLlama-05B-Chat'] on worker c55289b4 ...
2024-02-26 22:29:31 | INFO | model_worker | Register to controller
2024-02-26 22:29:31 | ERROR | stderr | INFO:     Started server process [1177966]
2024-02-26 22:29:31 | ERROR | stderr | INFO:     Waiting for application startup.
2024-02-26 22:29:31 | ERROR | stderr | INFO:     Application startup complete.
2024-02-26 22:29:31 | ERROR | stderr | INFO:     Uvicorn running on http://0.0.0.0:40000 (Press CTRL+C to quit)
2024-02-26 22:30:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: None. call_ct: 0. worker_id: c55289b4. 
2024-02-26 22:31:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: None. call_ct: 0. worker_id: c55289b4. 
2024-02-26 22:31:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: None. call_ct: 0. worker_id: c55289b4. 
2024-02-26 22:32:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: None. call_ct: 0. worker_id: c55289b4. 
2024-02-26 22:33:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: None. call_ct: 0. worker_id: c55289b4. 
2024-02-26 22:34:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: None. call_ct: 0. worker_id: c55289b4. 
2024-02-26 22:34:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: None. call_ct: 0. worker_id: c55289b4. 
2024-02-26 22:35:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: None. call_ct: 0. worker_id: c55289b4. 
2024-02-26 22:36:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: None. call_ct: 0. worker_id: c55289b4. 
2024-02-26 22:37:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: None. call_ct: 0. worker_id: c55289b4. 
2024-02-26 22:37:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: None. call_ct: 0. worker_id: c55289b4. 
2024-02-26 22:38:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: None. call_ct: 0. worker_id: c55289b4. 
2024-02-26 22:39:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: None. call_ct: 0. worker_id: c55289b4. 
2024-02-26 22:40:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: None. call_ct: 0. worker_id: c55289b4. 
2024-02-26 22:40:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: None. call_ct: 0. worker_id: c55289b4. 
2024-02-26 22:41:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: None. call_ct: 0. worker_id: c55289b4. 
2024-02-26 22:42:12 | INFO | stdout | INFO:     127.0.0.1:45906 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-26 22:42:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: None. call_ct: 0. worker_id: c55289b4. 
2024-02-26 22:42:29 | INFO | stdout | INFO:     127.0.0.1:34870 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-26 22:42:43 | INFO | stdout | INFO:     127.0.0.1:35140 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-26 22:43:01 | INFO | stdout | INFO:     127.0.0.1:37308 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-26 22:43:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=4, locked=False). call_ct: 2. worker_id: c55289b4. 
2024-02-26 22:43:37 | INFO | stdout | INFO:     127.0.0.1:56564 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-26 22:43:46 | INFO | stdout | INFO:     127.0.0.1:46668 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-26 22:43:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=4, locked=False). call_ct: 4. worker_id: c55289b4. 
2024-02-26 22:44:11 | INFO | stdout | INFO:     127.0.0.1:45788 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-26 22:44:32 | INFO | stdout | INFO:     127.0.0.1:59006 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-26 22:44:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=4, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 22:45:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 22:46:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 22:46:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 22:47:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 22:48:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 22:49:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 22:49:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 22:50:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 22:51:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 22:52:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 22:52:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 22:53:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 22:54:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 22:55:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 22:55:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 22:56:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 22:57:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 22:58:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 22:58:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 22:59:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:00:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:01:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:01:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:02:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:03:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:04:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:04:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:05:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:06:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:07:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:07:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:08:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:09:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:10:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:10:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:11:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:12:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:13:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:13:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:14:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:15:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:16:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:16:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:17:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:18:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:19:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:19:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:20:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:21:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:22:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:22:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:23:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:24:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:25:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:25:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:26:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:27:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:28:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:28:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:29:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:30:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:31:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:31:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:32:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:33:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:34:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:34:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:35:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:36:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:37:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:37:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:38:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:39:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:40:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:40:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:41:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:42:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:43:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:43:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:44:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:45:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:46:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:46:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:47:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:48:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:49:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:49:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:50:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:51:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:52:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:52:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:53:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:54:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:55:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:55:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:56:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:57:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:58:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:58:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-26 23:59:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:00:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:01:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:01:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:02:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:03:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:04:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:04:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:05:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:06:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:07:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:07:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:08:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:09:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:10:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:10:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:11:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:12:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:13:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:13:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:14:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:15:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:16:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:16:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:17:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:18:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:19:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:19:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:20:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:21:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:22:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:22:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:23:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:24:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:25:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:25:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:26:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:27:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:28:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:28:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:29:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:30:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:31:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:31:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:32:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:33:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:34:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:34:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:35:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:36:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:37:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:37:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:38:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:39:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:40:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:40:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:41:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:42:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:43:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:43:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:44:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:45:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:46:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:46:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:47:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:48:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:49:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:49:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:50:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:51:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:52:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:52:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:53:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:54:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:55:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:55:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:56:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:57:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:58:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:58:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 00:59:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:00:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:01:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:01:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:02:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:03:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:04:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:04:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:05:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:06:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:07:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:07:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:08:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:09:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:10:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:10:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:11:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:12:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:13:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:13:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:14:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:15:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:16:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:16:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:17:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:18:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:19:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:19:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:20:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:21:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:22:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:22:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:23:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:24:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:25:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:25:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:26:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:27:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:28:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:28:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:29:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:30:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:31:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:31:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:32:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:33:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:34:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:34:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:35:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:36:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:37:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:37:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:38:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:39:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:40:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:41:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:41:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:42:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:43:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:44:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:44:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:45:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:46:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:47:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:47:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:48:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:49:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:50:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:50:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:51:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:52:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:53:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:53:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:54:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:55:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:56:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:56:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:57:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:58:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:59:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 01:59:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:00:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:01:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:02:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:02:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:03:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:04:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:05:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:05:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:06:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:07:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:08:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:08:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:09:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:10:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:11:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:11:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:12:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:13:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:14:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:14:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:15:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:16:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:17:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:17:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:18:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:19:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:20:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:20:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:21:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:22:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:23:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:23:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:24:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:25:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:26:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:26:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:27:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:28:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:29:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:29:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:30:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:31:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:32:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:32:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:33:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:34:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:35:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:35:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:36:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:37:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:38:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:38:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:39:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:40:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:41:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:41:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:42:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:43:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:44:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:44:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:45:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:46:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:47:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:47:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:48:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:49:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:50:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:50:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:51:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:52:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:53:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:53:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:54:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:55:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:56:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:56:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:57:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:58:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:59:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 02:59:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:00:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:01:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:02:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:02:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:03:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:04:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:05:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:05:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:06:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:07:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:08:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:08:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:09:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:10:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:11:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:11:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:12:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:13:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:14:03 | INFO | stdout | INFO:     127.0.0.1:49912 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 03:14:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:14:20 | INFO | stdout | INFO:     127.0.0.1:55536 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 03:14:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:15:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:16:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:17:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:17:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:18:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:19:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:20:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:20:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:21:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:22:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:23:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:23:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:24:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:25:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:26:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:26:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:27:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:28:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:29:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:29:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:30:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:31:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:32:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:32:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:33:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:34:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:35:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:35:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:36:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:37:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:38:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:38:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:39:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:40:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:41:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:41:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:42:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:43:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:44:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:44:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:45:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:46:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:47:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:47:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:48:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:49:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:50:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:50:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:51:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:52:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:53:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:53:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:54:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:55:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:56:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:56:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:57:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:58:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:59:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 03:59:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:00:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:01:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:02:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:02:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:03:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:04:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:05:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:05:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:06:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:07:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:08:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:08:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:09:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:10:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:11:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:11:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:12:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:13:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:14:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:14:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:15:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:16:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:17:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:17:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:18:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:19:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:20:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:20:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:21:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:22:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:23:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:23:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:24:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:25:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:26:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:26:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:27:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:28:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:29:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:29:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:30:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:31:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:32:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:32:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:33:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:34:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:35:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:35:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:36:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:37:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:38:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:38:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:39:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:40:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:41:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:41:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:42:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:43:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:44:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:44:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:45:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:46:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:47:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:47:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:48:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:49:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:50:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:50:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:51:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:52:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:53:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:53:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:54:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:55:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:56:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:56:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:57:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:58:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:59:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 04:59:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:00:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:01:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:02:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:02:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:03:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:04:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:05:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:05:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:06:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:07:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:08:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:08:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:09:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:10:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:11:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:11:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:12:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:13:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:14:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:15:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:15:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:16:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:17:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:18:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:18:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:19:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:20:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:21:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:21:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:22:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:23:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:24:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:24:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:25:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:26:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:27:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:27:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:28:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:29:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:30:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:30:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:31:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:32:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:33:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:33:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:34:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:35:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:36:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:36:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:37:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:38:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:39:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:39:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:40:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:41:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:42:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:42:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:43:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:44:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:45:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:45:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:46:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:47:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:48:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:48:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:49:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:50:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:51:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:51:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:52:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:53:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:54:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:54:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:55:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:56:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:57:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:57:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:58:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 05:59:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:00:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:00:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:01:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:02:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:03:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:03:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:04:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:05:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:06:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:06:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:07:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:08:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:09:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:09:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:10:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:11:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:12:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:12:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:13:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:14:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:15:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:16:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:16:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:17:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:18:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:19:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:19:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:20:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:21:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:22:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:22:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:23:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:24:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:25:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:25:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:26:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:27:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:28:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:28:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:29:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:30:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:31:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:31:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:32:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:33:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:34:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:34:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:35:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:36:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:37:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:37:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:38:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:39:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:40:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:40:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:41:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:42:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:43:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:43:30 | INFO | stdout | INFO:     127.0.0.1:37662 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 06:43:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:44:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:45:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:46:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:46:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:47:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:48:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:49:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:49:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:50:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:51:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:52:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:52:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:53:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:54:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:55:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:55:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:56:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:57:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:58:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:58:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 06:59:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 07:00:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 07:01:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 07:01:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 07:02:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 07:03:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 07:04:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 07:04:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 07:05:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 07:06:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 07:07:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 07:07:42 | INFO | stdout | INFO:     127.0.0.1:59080 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 07:07:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: c55289b4. 
2024-02-27 07:08:14 | INFO | stdout | INFO:     127.0.0.1:49880 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 07:08:24 | INFO | stdout | INFO:     127.0.0.1:50416 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 07:08:39 | INFO | stdout | INFO:     127.0.0.1:53896 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 07:08:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=4, locked=False). call_ct: 9. worker_id: c55289b4. 
2024-02-27 07:08:55 | INFO | stdout | INFO:     127.0.0.1:43082 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 07:09:10 | INFO | stdout | INFO:     127.0.0.1:58330 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 07:09:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 11. worker_id: c55289b4. 
2024-02-27 07:09:41 | INFO | stdout | INFO:     127.0.0.1:51016 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 07:10:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:10:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:11:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:12:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:13:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:13:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:14:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:15:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:16:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:16:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:17:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:18:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:19:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:19:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:20:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:21:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:22:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:22:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:23:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:24:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:25:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:25:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:26:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:27:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:28:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:28:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:29:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:30:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:31:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:31:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:32:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:33:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:34:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:34:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:35:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:36:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:37:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:37:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:38:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:39:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:40:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:40:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:41:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:42:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:43:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:43:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:44:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:45:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:46:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:46:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:47:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:48:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:49:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:49:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:50:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:51:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:52:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:52:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:53:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:54:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:55:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:55:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:56:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:57:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:58:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:58:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 07:59:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:00:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:01:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:01:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:02:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:03:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:04:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:04:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:05:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:06:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:07:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:07:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:08:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:09:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:10:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:10:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:11:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:12:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:13:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:13:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:14:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:15:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:16:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:16:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:17:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:18:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:19:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:19:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:20:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:21:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:22:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:22:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:23:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:24:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:25:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:26:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:26:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:27:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:28:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:29:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:29:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:30:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:31:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:32:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:32:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:33:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:34:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:35:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:35:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:36:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:37:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:38:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:38:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:39:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:40:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:41:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:41:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:42:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:43:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:44:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:44:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:45:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:46:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:47:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:47:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:48:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:49:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:50:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:50:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:51:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:52:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:53:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:53:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:54:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:55:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:56:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:56:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:57:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:58:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:59:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 08:59:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:00:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:01:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:02:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:02:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:03:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:04:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:05:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:05:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:06:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:07:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:08:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:08:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:09:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:10:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:11:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:11:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:12:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:13:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:14:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:14:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:15:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:16:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:17:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:17:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:18:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:19:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:20:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:20:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:21:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:22:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:23:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:23:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:24:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:25:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:26:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:26:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:27:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:28:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:29:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:29:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:30:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:31:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:32:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:32:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:33:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:34:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:35:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:35:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:36:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:37:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:38:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:38:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:39:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:40:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:41:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:41:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:42:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:43:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:44:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:44:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:45:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:46:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:47:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:47:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:48:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:49:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:50:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:50:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:51:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:52:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:53:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:53:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:54:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:55:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:56:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:56:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:57:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:58:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:59:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 09:59:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:00:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:01:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:02:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:02:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:03:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:04:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:05:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:05:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:06:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:07:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:08:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:08:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:09:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:10:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:11:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:11:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:12:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:13:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:14:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:14:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:15:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:16:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:17:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:17:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:18:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:19:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:20:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:20:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:21:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:22:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:23:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:23:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:24:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:25:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:26:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:26:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:27:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:28:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:29:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:29:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:30:00 | INFO | stdout | INFO:     127.0.0.1:33660 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 10:30:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:31:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:32:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:32:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:33:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:34:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:35:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:35:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:36:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:37:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:38:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:38:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:39:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:40:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:41:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:41:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:42:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:42:39 | INFO | stdout | INFO:     127.0.0.1:48808 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 10:43:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:44:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:44:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 12. worker_id: c55289b4. 
2024-02-27 10:45:24 | INFO | stdout | INFO:     127.0.0.1:50682 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 10:45:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: c55289b4. 
2024-02-27 10:46:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: c55289b4. 
2024-02-27 10:46:47 | INFO | stdout | INFO:     127.0.0.1:48438 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 10:47:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 14. worker_id: c55289b4. 
2024-02-27 10:47:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 14. worker_id: c55289b4. 
2024-02-27 10:48:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 14. worker_id: c55289b4. 
2024-02-27 10:49:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 14. worker_id: c55289b4. 
2024-02-27 10:50:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 14. worker_id: c55289b4. 
2024-02-27 10:50:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 14. worker_id: c55289b4. 
2024-02-27 10:51:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 14. worker_id: c55289b4. 
2024-02-27 10:52:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 14. worker_id: c55289b4. 
2024-02-27 10:53:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 14. worker_id: c55289b4. 
2024-02-27 10:53:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 14. worker_id: c55289b4. 
2024-02-27 10:54:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 14. worker_id: c55289b4. 
2024-02-27 10:55:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 14. worker_id: c55289b4. 
2024-02-27 10:56:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 14. worker_id: c55289b4. 
2024-02-27 10:56:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 14. worker_id: c55289b4. 
2024-02-27 10:57:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 14. worker_id: c55289b4. 
2024-02-27 10:58:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 14. worker_id: c55289b4. 
2024-02-27 10:59:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 14. worker_id: c55289b4. 
2024-02-27 10:59:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 14. worker_id: c55289b4. 
2024-02-27 11:00:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 14. worker_id: c55289b4. 
2024-02-27 11:01:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 14. worker_id: c55289b4. 
2024-02-27 11:01:58 | INFO | stdout | INFO:     127.0.0.1:34022 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 11:02:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 14. worker_id: c55289b4. 
2024-02-27 11:02:11 | INFO | stdout | INFO:     127.0.0.1:49694 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 11:02:11 | INFO | stdout | INFO:     127.0.0.1:49706 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 11:02:27 | INFO | stdout | INFO:     127.0.0.1:57372 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 11:02:36 | INFO | stdout | INFO:     127.0.0.1:60978 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 11:02:46 | INFO | stdout | INFO:     127.0.0.1:33500 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 11:02:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 18. worker_id: c55289b4. 
2024-02-27 11:03:00 | INFO | stdout | INFO:     127.0.0.1:38222 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 11:03:13 | INFO | stdout | INFO:     127.0.0.1:44944 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 11:03:23 | INFO | stdout | INFO:     127.0.0.1:56548 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 11:03:38 | INFO | stdout | INFO:     127.0.0.1:40758 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 11:03:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=4, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:04:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:05:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:05:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:06:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:07:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:08:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:08:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:09:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:10:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:11:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:11:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:12:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:13:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:14:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:14:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:15:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:16:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:17:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:17:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:18:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:19:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:20:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:20:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:21:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:22:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:23:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:23:20 | INFO | stdout | INFO:     127.0.0.1:52896 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 11:23:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:24:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:25:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:26:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:26:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:27:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:28:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:29:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:29:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:30:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:31:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:32:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 22. worker_id: c55289b4. 
2024-02-27 11:32:29 | INFO | stdout | INFO:     127.0.0.1:51828 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 11:32:47 | INFO | stdout | INFO:     127.0.0.1:43700 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 11:32:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 23. worker_id: c55289b4. 
2024-02-27 11:33:20 | INFO | stdout | INFO:     127.0.0.1:42996 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 11:33:40 | INFO | stdout | INFO:     127.0.0.1:53484 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 11:33:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:34:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:35:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:35:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:36:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:37:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:38:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:38:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:39:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:40:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:41:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:41:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:42:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:43:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:44:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:44:50 | INFO | stdout | INFO:     127.0.0.1:37072 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 11:44:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:45:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:46:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:47:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:47:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:48:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:49:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:50:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:50:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:51:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:52:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:53:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:53:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:54:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:55:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:56:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:56:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:57:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:58:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:59:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 11:59:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 12:00:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 12:01:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 12:01:54 | INFO | stdout | INFO:     127.0.0.1:42590 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 12:02:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 25. worker_id: c55289b4. 
2024-02-27 12:02:16 | INFO | stdout | INFO:     127.0.0.1:56996 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 12:02:22 | INFO | stdout | INFO:     127.0.0.1:57000 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 12:02:29 | INFO | stdout | INFO:     127.0.0.1:59650 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 12:02:38 | INFO | stdout | INFO:     127.0.0.1:50406 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 12:02:40 | INFO | stdout | INFO:     127.0.0.1:50420 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 12:02:57 | INFO | stdout | INFO:     127.0.0.1:51948 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 12:02:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 29. worker_id: c55289b4. 
2024-02-27 12:03:03 | INFO | stdout | INFO:     127.0.0.1:51952 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 12:03:30 | INFO | stdout | INFO:     127.0.0.1:49588 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 12:03:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 31. worker_id: c55289b4. 
2024-02-27 12:04:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 31. worker_id: c55289b4. 
2024-02-27 12:04:51 | INFO | stdout | INFO:     127.0.0.1:43130 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 12:05:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 31. worker_id: c55289b4. 
2024-02-27 12:05:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 31. worker_id: c55289b4. 
2024-02-27 12:06:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 31. worker_id: c55289b4. 
2024-02-27 12:07:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 31. worker_id: c55289b4. 
2024-02-27 12:08:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 31. worker_id: c55289b4. 
2024-02-27 12:08:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 31. worker_id: c55289b4. 
2024-02-27 12:09:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 31. worker_id: c55289b4. 
2024-02-27 12:10:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 31. worker_id: c55289b4. 
2024-02-27 12:11:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 31. worker_id: c55289b4. 
2024-02-27 12:11:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 31. worker_id: c55289b4. 
2024-02-27 12:12:12 | INFO | stdout | INFO:     127.0.0.1:57308 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 12:12:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 31. worker_id: c55289b4. 
2024-02-27 12:13:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 31. worker_id: c55289b4. 
2024-02-27 12:14:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 31. worker_id: c55289b4. 
2024-02-27 12:14:17 | INFO | stdout | INFO:     127.0.0.1:33202 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 12:14:36 | INFO | stdout | INFO:     127.0.0.1:59794 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 12:15:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 32. worker_id: c55289b4. 
2024-02-27 12:15:31 | INFO | stdout | INFO:     127.0.0.1:33060 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 12:15:35 | INFO | stdout | INFO:     127.0.0.1:50024 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 12:15:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 33. worker_id: c55289b4. 
2024-02-27 12:15:46 | INFO | stdout | INFO:     127.0.0.1:49224 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 12:16:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 34. worker_id: c55289b4. 
2024-02-27 12:17:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 34. worker_id: c55289b4. 
2024-02-27 12:18:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 34. worker_id: c55289b4. 
2024-02-27 12:18:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 34. worker_id: c55289b4. 
2024-02-27 12:19:23 | INFO | stdout | INFO:     127.0.0.1:57836 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 12:19:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 34. worker_id: c55289b4. 
2024-02-27 12:19:44 | INFO | stdout | INFO:     127.0.0.1:57976 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 12:19:56 | INFO | stdout | INFO:     127.0.0.1:54708 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 12:20:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 36. worker_id: c55289b4. 
2024-02-27 12:21:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 36. worker_id: c55289b4. 
2024-02-27 12:21:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 36. worker_id: c55289b4. 
2024-02-27 12:21:59 | INFO | stdout | INFO:     127.0.0.1:57474 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 12:22:11 | INFO | stdout | INFO:     127.0.0.1:49788 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 12:22:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 38. worker_id: c55289b4. 
2024-02-27 12:23:09 | INFO | stdout | INFO:     127.0.0.1:58526 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 12:23:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 39. worker_id: c55289b4. 
2024-02-27 12:23:27 | INFO | stdout | INFO:     127.0.0.1:33076 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 12:23:44 | INFO | stdout | INFO:     127.0.0.1:45898 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 12:24:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 41. worker_id: c55289b4. 
2024-02-27 12:24:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 41. worker_id: c55289b4. 
2024-02-27 12:25:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 41. worker_id: c55289b4. 
2024-02-27 12:26:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 41. worker_id: c55289b4. 
2024-02-27 12:27:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 41. worker_id: c55289b4. 
2024-02-27 12:27:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 41. worker_id: c55289b4. 
2024-02-27 12:28:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 41. worker_id: c55289b4. 
2024-02-27 12:29:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 41. worker_id: c55289b4. 
2024-02-27 12:30:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 41. worker_id: c55289b4. 
2024-02-27 12:30:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 41. worker_id: c55289b4. 
2024-02-27 12:31:25 | INFO | stdout | INFO:     127.0.0.1:57344 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 12:31:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 42. worker_id: c55289b4. 
2024-02-27 12:31:48 | INFO | stdout | INFO:     127.0.0.1:56710 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 12:32:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 43. worker_id: c55289b4. 
2024-02-27 12:33:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 43. worker_id: c55289b4. 
2024-02-27 12:33:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 43. worker_id: c55289b4. 
2024-02-27 12:33:46 | INFO | stdout | INFO:     127.0.0.1:54100 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 12:34:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:35:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:36:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:36:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:37:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:38:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:39:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:39:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:40:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:41:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:42:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:42:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:43:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:44:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:45:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:45:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:46:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:47:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:48:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:48:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:49:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:50:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:51:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:51:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:52:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:53:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:54:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:54:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:55:24 | INFO | stdout | INFO:     127.0.0.1:45880 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 12:55:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 44. worker_id: c55289b4. 
2024-02-27 12:55:44 | INFO | stdout | INFO:     127.0.0.1:40482 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 12:56:07 | INFO | stdout | INFO:     127.0.0.1:49792 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 12:56:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 46. worker_id: c55289b4. 
2024-02-27 12:56:23 | INFO | stdout | INFO:     127.0.0.1:40220 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 12:57:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 47. worker_id: c55289b4. 
2024-02-27 12:57:04 | INFO | stdout | INFO:     127.0.0.1:36334 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 12:57:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 47. worker_id: c55289b4. 
2024-02-27 12:58:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 47. worker_id: c55289b4. 
2024-02-27 12:59:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 47. worker_id: c55289b4. 
2024-02-27 13:00:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 47. worker_id: c55289b4. 
2024-02-27 13:00:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 47. worker_id: c55289b4. 
2024-02-27 13:00:50 | INFO | stdout | INFO:     127.0.0.1:50980 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 13:00:59 | INFO | stdout | INFO:     127.0.0.1:32844 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 13:01:32 | INFO | stdout | INFO:     127.0.0.1:48732 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 13:01:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 48. worker_id: c55289b4. 
2024-02-27 13:02:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 48. worker_id: c55289b4. 
2024-02-27 13:02:18 | INFO | stdout | INFO:     127.0.0.1:48454 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 13:03:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 49. worker_id: c55289b4. 
2024-02-27 13:03:34 | INFO | stdout | INFO:     127.0.0.1:43838 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 13:03:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:04:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:05:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:05:34 | INFO | stdout | INFO:     127.0.0.1:57564 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 13:06:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:06:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:07:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:08:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:09:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:09:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:10:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:11:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:12:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:12:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:13:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:14:08 | INFO | stdout | INFO:     127.0.0.1:57188 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 13:14:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:15:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:15:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:16:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:17:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:18:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:18:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:19:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:20:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:21:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:21:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:22:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:23:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:24:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:24:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:25:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:26:12 | INFO | stdout | INFO:     127.0.0.1:59534 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 13:26:15 | INFO | stdout | INFO:     127.0.0.1:58042 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 13:26:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 50. worker_id: c55289b4. 
2024-02-27 13:26:24 | INFO | stdout | INFO:     127.0.0.1:58048 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 13:26:31 | INFO | stdout | INFO:     127.0.0.1:59370 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 13:26:36 | INFO | stdout | INFO:     127.0.0.1:47546 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 13:26:45 | INFO | stdout | INFO:     127.0.0.1:47948 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 13:27:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 54. worker_id: c55289b4. 
2024-02-27 13:27:10 | INFO | stdout | INFO:     127.0.0.1:57176 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 13:27:45 | INFO | stdout | INFO:     127.0.0.1:53180 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 13:27:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 55. worker_id: c55289b4. 
2024-02-27 13:27:56 | INFO | stdout | INFO:     127.0.0.1:50492 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 13:28:03 | INFO | stdout | INFO:     127.0.0.1:50506 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 13:28:03 | INFO | stdout | INFO:     127.0.0.1:50508 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 13:28:19 | INFO | stdout | INFO:     127.0.0.1:32934 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 13:28:31 | INFO | stdout | INFO:     127.0.0.1:50750 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 13:28:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 59. worker_id: c55289b4. 
2024-02-27 13:29:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 59. worker_id: c55289b4. 
2024-02-27 13:30:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 59. worker_id: c55289b4. 
2024-02-27 13:30:17 | INFO | stdout | INFO:     127.0.0.1:57774 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 13:30:32 | INFO | stdout | INFO:     127.0.0.1:57102 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 13:30:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 60. worker_id: c55289b4. 
2024-02-27 13:30:52 | INFO | stdout | INFO:     127.0.0.1:36594 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 13:31:12 | INFO | stdout | INFO:     127.0.0.1:38494 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 13:31:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 61. worker_id: c55289b4. 
2024-02-27 13:32:18 | INFO | stdout | INFO:     127.0.0.1:45266 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 13:32:19 | INFO | stdout | INFO:     127.0.0.1:45274 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 13:32:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 61. worker_id: c55289b4. 
2024-02-27 13:32:30 | INFO | stdout | INFO:     127.0.0.1:42158 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 13:33:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 62. worker_id: c55289b4. 
2024-02-27 13:33:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 62. worker_id: c55289b4. 
2024-02-27 13:34:07 | INFO | stdout | INFO:     127.0.0.1:59532 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 13:34:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 62. worker_id: c55289b4. 
2024-02-27 13:34:40 | INFO | stdout | INFO:     127.0.0.1:58924 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 13:35:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 62. worker_id: c55289b4. 
2024-02-27 13:35:30 | INFO | stdout | INFO:     127.0.0.1:57618 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 13:35:34 | INFO | stdout | INFO:     127.0.0.1:57634 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 13:36:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 63. worker_id: c55289b4. 
2024-02-27 13:36:32 | INFO | stdout | INFO:     127.0.0.1:35190 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 13:36:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 63. worker_id: c55289b4. 
2024-02-27 13:37:22 | INFO | stdout | INFO:     127.0.0.1:49174 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 13:37:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 64. worker_id: c55289b4. 
2024-02-27 13:37:40 | INFO | stdout | INFO:     127.0.0.1:52670 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 13:37:57 | INFO | stdout | INFO:     127.0.0.1:35232 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 13:38:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 65. worker_id: c55289b4. 
2024-02-27 13:39:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 65. worker_id: c55289b4. 
2024-02-27 13:39:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 65. worker_id: c55289b4. 
2024-02-27 13:40:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 65. worker_id: c55289b4. 
2024-02-27 13:41:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 65. worker_id: c55289b4. 
2024-02-27 13:42:03 | INFO | stdout | INFO:     127.0.0.1:45014 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 13:42:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 65. worker_id: c55289b4. 
2024-02-27 13:42:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 65. worker_id: c55289b4. 
2024-02-27 13:43:02 | INFO | stdout | INFO:     127.0.0.1:36162 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 13:43:30 | INFO | stdout | INFO:     127.0.0.1:42798 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 13:43:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 66. worker_id: c55289b4. 
2024-02-27 13:44:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 66. worker_id: c55289b4. 
2024-02-27 13:44:46 | INFO | stdout | INFO:     127.0.0.1:59562 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 13:45:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 67. worker_id: c55289b4. 
2024-02-27 13:45:46 | INFO | stdout | INFO:     127.0.0.1:60350 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 13:45:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 13:46:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 13:47:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 13:48:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 13:48:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 13:49:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 13:50:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 13:50:34 | INFO | stdout | INFO:     127.0.0.1:51964 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 13:51:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 13:51:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 13:52:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 13:53:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 13:54:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 13:54:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 13:55:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 13:56:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 13:57:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 13:57:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 13:58:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 13:59:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 14:00:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 14:00:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 14:01:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 14:02:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 14:03:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 14:03:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 14:04:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 14:05:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 14:06:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 14:06:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 68. worker_id: c55289b4. 
2024-02-27 14:07:21 | INFO | stdout | INFO:     127.0.0.1:47048 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 14:07:33 | INFO | stdout | INFO:     127.0.0.1:36042 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:07:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 69. worker_id: c55289b4. 
2024-02-27 14:08:08 | INFO | stdout | INFO:     127.0.0.1:36482 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:08:22 | INFO | stdout | INFO:     127.0.0.1:48874 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:08:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=4, locked=False). call_ct: 71. worker_id: c55289b4. 
2024-02-27 14:09:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 71. worker_id: c55289b4. 
2024-02-27 14:09:41 | INFO | stdout | INFO:     127.0.0.1:47986 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 14:09:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 71. worker_id: c55289b4. 
2024-02-27 14:10:09 | INFO | stdout | INFO:     127.0.0.1:58784 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 14:10:32 | INFO | stdout | INFO:     127.0.0.1:42930 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:10:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 72. worker_id: c55289b4. 
2024-02-27 14:10:41 | INFO | stdout | INFO:     127.0.0.1:59748 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:10:57 | INFO | stdout | INFO:     127.0.0.1:59842 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:11:14 | INFO | stdout | INFO:     127.0.0.1:36122 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:11:16 | INFO | stdout | INFO:     127.0.0.1:55236 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 14:11:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 75. worker_id: c55289b4. 
2024-02-27 14:11:29 | INFO | stdout | INFO:     127.0.0.1:41778 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:11:42 | INFO | stdout | INFO:     127.0.0.1:44708 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:11:59 | INFO | stdout | INFO:     127.0.0.1:38508 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:12:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 78. worker_id: c55289b4. 
2024-02-27 14:12:44 | INFO | stdout | INFO:     127.0.0.1:48910 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 14:12:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 78. worker_id: c55289b4. 
2024-02-27 14:13:25 | INFO | stdout | INFO:     127.0.0.1:35034 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:13:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 79. worker_id: c55289b4. 
2024-02-27 14:13:57 | INFO | stdout | INFO:     127.0.0.1:44330 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:14:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 80. worker_id: c55289b4. 
2024-02-27 14:15:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 80. worker_id: c55289b4. 
2024-02-27 14:15:08 | INFO | stdout | INFO:     127.0.0.1:52244 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 14:15:51 | INFO | stdout | INFO:     127.0.0.1:58344 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:15:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 81. worker_id: c55289b4. 
2024-02-27 14:16:37 | INFO | stdout | INFO:     127.0.0.1:35664 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:16:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 82. worker_id: c55289b4. 
2024-02-27 14:16:54 | INFO | stdout | INFO:     127.0.0.1:54008 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:17:10 | INFO | stdout | INFO:     127.0.0.1:46878 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:17:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 84. worker_id: c55289b4. 
2024-02-27 14:18:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 84. worker_id: c55289b4. 
2024-02-27 14:18:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 84. worker_id: c55289b4. 
2024-02-27 14:18:54 | INFO | stdout | INFO:     127.0.0.1:36690 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 14:19:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 84. worker_id: c55289b4. 
2024-02-27 14:20:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 84. worker_id: c55289b4. 
2024-02-27 14:21:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 84. worker_id: c55289b4. 
2024-02-27 14:21:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 84. worker_id: c55289b4. 
2024-02-27 14:22:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 84. worker_id: c55289b4. 
2024-02-27 14:22:43 | INFO | stdout | INFO:     127.0.0.1:37808 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 14:23:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 84. worker_id: c55289b4. 
2024-02-27 14:24:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 84. worker_id: c55289b4. 
2024-02-27 14:24:27 | INFO | stdout | INFO:     127.0.0.1:58298 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:24:51 | INFO | stdout | INFO:     127.0.0.1:53030 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:24:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 86. worker_id: c55289b4. 
2024-02-27 14:25:01 | INFO | stdout | INFO:     127.0.0.1:52606 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:25:20 | INFO | stdout | INFO:     127.0.0.1:34684 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:25:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 88. worker_id: c55289b4. 
2024-02-27 14:25:44 | INFO | stdout | INFO:     127.0.0.1:55896 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:25:47 | INFO | stdout | INFO:     127.0.0.1:44600 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 14:26:05 | INFO | stdout | INFO:     127.0.0.1:60612 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:26:23 | INFO | stdout | INFO:     127.0.0.1:54536 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:26:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=4, locked=False). call_ct: 91. worker_id: c55289b4. 
2024-02-27 14:26:45 | INFO | stdout | INFO:     127.0.0.1:49636 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:26:56 | INFO | stdout | INFO:     127.0.0.1:48738 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 14:27:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 92. worker_id: c55289b4. 
2024-02-27 14:27:10 | INFO | stdout | INFO:     127.0.0.1:36412 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:27:10 | INFO | stdout | INFO:     127.0.0.1:36426 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:27:22 | INFO | stdout | INFO:     127.0.0.1:55274 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:27:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 95. worker_id: c55289b4. 
2024-02-27 14:28:24 | INFO | stdout | INFO:     127.0.0.1:34562 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:28:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 96. worker_id: c55289b4. 
2024-02-27 14:28:51 | INFO | stdout | INFO:     127.0.0.1:47910 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:29:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 97. worker_id: c55289b4. 
2024-02-27 14:29:30 | INFO | stdout | INFO:     127.0.0.1:57048 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:30:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 98. worker_id: c55289b4. 
2024-02-27 14:30:16 | INFO | stdout | INFO:     127.0.0.1:35326 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 14:30:54 | INFO | stdout | INFO:     127.0.0.1:53854 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 14:30:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 98. worker_id: c55289b4. 
2024-02-27 14:31:07 | INFO | stdout | INFO:     127.0.0.1:59126 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:31:17 | INFO | stdout | INFO:     127.0.0.1:50414 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:31:26 | INFO | stdout | INFO:     127.0.0.1:35272 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:31:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 101. worker_id: c55289b4. 
2024-02-27 14:31:42 | INFO | stdout | INFO:     127.0.0.1:54622 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:31:55 | INFO | stdout | INFO:     127.0.0.1:55736 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:32:05 | INFO | stdout | INFO:     127.0.0.1:60826 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:32:06 | INFO | stdout | INFO:     127.0.0.1:60832 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:32:21 | INFO | stdout | INFO:     127.0.0.1:59266 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:32:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 106. worker_id: c55289b4. 
2024-02-27 14:32:35 | INFO | stdout | INFO:     127.0.0.1:48018 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:32:44 | INFO | stdout | INFO:     127.0.0.1:48028 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:32:51 | INFO | stdout | INFO:     127.0.0.1:38360 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 14:32:55 | INFO | stdout | INFO:     127.0.0.1:54662 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:33:01 | INFO | stdout | INFO:     127.0.0.1:54672 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:33:06 | INFO | stdout | INFO:     127.0.0.1:53942 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:33:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=4, locked=False). call_ct: 111. worker_id: c55289b4. 
2024-02-27 14:33:21 | INFO | stdout | INFO:     127.0.0.1:42502 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:33:26 | INFO | stdout | INFO:     127.0.0.1:34232 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:33:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 113. worker_id: c55289b4. 
2024-02-27 14:34:30 | INFO | stdout | INFO:     127.0.0.1:53826 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:34:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 114. worker_id: c55289b4. 
2024-02-27 14:35:03 | INFO | stdout | INFO:     127.0.0.1:36356 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:35:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 115. worker_id: c55289b4. 
2024-02-27 14:36:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 115. worker_id: c55289b4. 
2024-02-27 14:36:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 115. worker_id: c55289b4. 
2024-02-27 14:37:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 115. worker_id: c55289b4. 
2024-02-27 14:37:56 | INFO | stdout | INFO:     127.0.0.1:47586 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 14:38:12 | INFO | stdout | INFO:     127.0.0.1:33434 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 14:38:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 115. worker_id: c55289b4. 
2024-02-27 14:38:27 | INFO | stdout | INFO:     127.0.0.1:59644 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:38:42 | INFO | stdout | INFO:     127.0.0.1:60550 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:38:58 | INFO | stdout | INFO:     127.0.0.1:33356 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 14:39:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 117. worker_id: c55289b4. 
2024-02-27 14:39:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 117. worker_id: c55289b4. 
2024-02-27 14:40:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 117. worker_id: c55289b4. 
2024-02-27 14:41:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 117. worker_id: c55289b4. 
2024-02-27 14:42:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 117. worker_id: c55289b4. 
2024-02-27 14:42:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 117. worker_id: c55289b4. 
2024-02-27 14:43:01 | INFO | stdout | INFO:     127.0.0.1:37356 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 14:43:02 | INFO | stdout | INFO:     127.0.0.1:37366 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 14:43:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 117. worker_id: c55289b4. 
2024-02-27 14:43:54 | INFO | stdout | INFO:     127.0.0.1:44378 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:44:10 | INFO | stdout | INFO:     127.0.0.1:46780 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:44:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 119. worker_id: c55289b4. 
2024-02-27 14:44:38 | INFO | stdout | INFO:     127.0.0.1:44118 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:45:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 120. worker_id: c55289b4. 
2024-02-27 14:45:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 120. worker_id: c55289b4. 
2024-02-27 14:46:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 120. worker_id: c55289b4. 
2024-02-27 14:47:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 120. worker_id: c55289b4. 
2024-02-27 14:47:54 | INFO | stdout | INFO:     127.0.0.1:50694 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 14:48:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 120. worker_id: c55289b4. 
2024-02-27 14:48:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 120. worker_id: c55289b4. 
2024-02-27 14:49:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 120. worker_id: c55289b4. 
2024-02-27 14:50:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 120. worker_id: c55289b4. 
2024-02-27 14:51:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 120. worker_id: c55289b4. 
2024-02-27 14:51:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 120. worker_id: c55289b4. 
2024-02-27 14:52:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 120. worker_id: c55289b4. 
2024-02-27 14:53:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 120. worker_id: c55289b4. 
2024-02-27 14:54:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 120. worker_id: c55289b4. 
2024-02-27 14:54:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 120. worker_id: c55289b4. 
2024-02-27 14:55:32 | INFO | stdout | INFO:     127.0.0.1:57498 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 14:55:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 120. worker_id: c55289b4. 
2024-02-27 14:55:57 | INFO | stdout | INFO:     127.0.0.1:54598 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:56:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 121. worker_id: c55289b4. 
2024-02-27 14:57:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 121. worker_id: c55289b4. 
2024-02-27 14:57:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 121. worker_id: c55289b4. 
2024-02-27 14:58:12 | INFO | stdout | INFO:     127.0.0.1:55166 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:58:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 122. worker_id: c55289b4. 
2024-02-27 14:58:53 | INFO | stdout | INFO:     127.0.0.1:50320 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 14:59:15 | INFO | stdout | INFO:     127.0.0.1:42312 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 14:59:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 123. worker_id: c55289b4. 
2024-02-27 15:00:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 123. worker_id: c55289b4. 
2024-02-27 15:00:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 123. worker_id: c55289b4. 
2024-02-27 15:01:26 | INFO | stdout | INFO:     127.0.0.1:41050 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 15:01:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 123. worker_id: c55289b4. 
2024-02-27 15:01:47 | INFO | stdout | INFO:     127.0.0.1:48980 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 15:02:09 | INFO | stdout | INFO:     127.0.0.1:33728 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 15:02:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 125. worker_id: c55289b4. 
2024-02-27 15:02:27 | INFO | stdout | INFO:     127.0.0.1:49166 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 15:03:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 126. worker_id: c55289b4. 
2024-02-27 15:03:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 126. worker_id: c55289b4. 
2024-02-27 15:04:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 126. worker_id: c55289b4. 
2024-02-27 15:05:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 126. worker_id: c55289b4. 
2024-02-27 15:06:04 | INFO | stdout | INFO:     127.0.0.1:55006 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 15:06:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 126. worker_id: c55289b4. 
2024-02-27 15:06:38 | INFO | stdout | INFO:     127.0.0.1:38576 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 15:06:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 127. worker_id: c55289b4. 
2024-02-27 15:07:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 127. worker_id: c55289b4. 
2024-02-27 15:08:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 127. worker_id: c55289b4. 
2024-02-27 15:09:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 127. worker_id: c55289b4. 
2024-02-27 15:09:40 | INFO | stdout | INFO:     127.0.0.1:35222 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 15:09:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 128. worker_id: c55289b4. 
2024-02-27 15:10:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 128. worker_id: c55289b4. 
2024-02-27 15:11:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 128. worker_id: c55289b4. 
2024-02-27 15:12:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 128. worker_id: c55289b4. 
2024-02-27 15:12:20 | INFO | stdout | INFO:     127.0.0.1:38902 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 15:12:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 128. worker_id: c55289b4. 
2024-02-27 15:13:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 128. worker_id: c55289b4. 
2024-02-27 15:14:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 128. worker_id: c55289b4. 
2024-02-27 15:14:55 | INFO | stdout | INFO:     127.0.0.1:43868 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 15:15:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 128. worker_id: c55289b4. 
2024-02-27 15:15:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 128. worker_id: c55289b4. 
2024-02-27 15:16:03 | INFO | stdout | INFO:     127.0.0.1:43090 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 15:16:13 | INFO | stdout | INFO:     127.0.0.1:50586 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 15:16:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 128. worker_id: c55289b4. 
2024-02-27 15:16:51 | INFO | stdout | INFO:     127.0.0.1:33500 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 15:17:03 | INFO | stdout | INFO:     127.0.0.1:48842 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 15:17:03 | INFO | stdout | INFO:     127.0.0.1:48854 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 15:17:17 | INFO | stdout | INFO:     127.0.0.1:41748 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 15:17:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 129. worker_id: c55289b4. 
2024-02-27 15:17:30 | INFO | stdout | INFO:     127.0.0.1:60476 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 15:17:42 | INFO | stdout | INFO:     127.0.0.1:51772 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 15:17:53 | INFO | stdout | INFO:     127.0.0.1:45680 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 15:18:00 | INFO | stdout | INFO:     127.0.0.1:55408 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 15:18:11 | INFO | stdout | INFO:     127.0.0.1:45880 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 15:18:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=4, locked=False). call_ct: 134. worker_id: c55289b4. 
2024-02-27 15:18:54 | INFO | stdout | INFO:     127.0.0.1:48698 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 15:18:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 135. worker_id: c55289b4. 
2024-02-27 15:19:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 135. worker_id: c55289b4. 
2024-02-27 15:20:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 135. worker_id: c55289b4. 
2024-02-27 15:20:34 | INFO | stdout | INFO:     127.0.0.1:50930 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 15:21:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 135. worker_id: c55289b4. 
2024-02-27 15:21:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 135. worker_id: c55289b4. 
2024-02-27 15:22:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 135. worker_id: c55289b4. 
2024-02-27 15:23:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 135. worker_id: c55289b4. 
2024-02-27 15:24:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 135. worker_id: c55289b4. 
2024-02-27 15:24:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 135. worker_id: c55289b4. 
2024-02-27 15:25:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 135. worker_id: c55289b4. 
2024-02-27 15:26:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 135. worker_id: c55289b4. 
2024-02-27 15:27:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 135. worker_id: c55289b4. 
2024-02-27 15:27:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 135. worker_id: c55289b4. 
2024-02-27 15:28:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 135. worker_id: c55289b4. 
2024-02-27 15:29:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 135. worker_id: c55289b4. 
2024-02-27 15:30:02 | INFO | stdout | INFO:     127.0.0.1:46512 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 15:30:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 135. worker_id: c55289b4. 
2024-02-27 15:30:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 135. worker_id: c55289b4. 
2024-02-27 15:31:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 135. worker_id: c55289b4. 
2024-02-27 15:32:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 135. worker_id: c55289b4. 
2024-02-27 15:33:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 135. worker_id: c55289b4. 
2024-02-27 15:33:27 | INFO | stdout | INFO:     127.0.0.1:47062 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 15:33:47 | INFO | stdout | INFO:     127.0.0.1:59548 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 15:33:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 136. worker_id: c55289b4. 
2024-02-27 15:34:28 | INFO | stdout | INFO:     127.0.0.1:56548 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 15:34:28 | INFO | stdout | INFO:     127.0.0.1:56556 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 15:34:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 137. worker_id: c55289b4. 
2024-02-27 15:34:51 | INFO | stdout | INFO:     127.0.0.1:44090 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 15:35:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 138. worker_id: c55289b4. 
2024-02-27 15:35:32 | INFO | stdout | INFO:     127.0.0.1:37048 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 15:36:01 | INFO | stdout | INFO:     127.0.0.1:36140 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 15:36:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 140. worker_id: c55289b4. 
2024-02-27 15:36:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 140. worker_id: c55289b4. 
2024-02-27 15:37:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 140. worker_id: c55289b4. 
2024-02-27 15:38:04 | INFO | stdout | INFO:     127.0.0.1:42118 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 15:38:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 140. worker_id: c55289b4. 
2024-02-27 15:39:03 | INFO | stdout | INFO:     127.0.0.1:44024 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 15:39:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 141. worker_id: c55289b4. 
2024-02-27 15:39:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 141. worker_id: c55289b4. 
2024-02-27 15:40:22 | INFO | stdout | INFO:     127.0.0.1:36084 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 15:40:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 141. worker_id: c55289b4. 
2024-02-27 15:41:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 141. worker_id: c55289b4. 
2024-02-27 15:42:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 141. worker_id: c55289b4. 
2024-02-27 15:42:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 141. worker_id: c55289b4. 
2024-02-27 15:43:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 141. worker_id: c55289b4. 
2024-02-27 15:44:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 141. worker_id: c55289b4. 
2024-02-27 15:45:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 141. worker_id: c55289b4. 
2024-02-27 15:45:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 141. worker_id: c55289b4. 
2024-02-27 15:46:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 141. worker_id: c55289b4. 
2024-02-27 15:47:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 141. worker_id: c55289b4. 
2024-02-27 15:48:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 141. worker_id: c55289b4. 
2024-02-27 15:49:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 141. worker_id: c55289b4. 
2024-02-27 15:49:45 | INFO | stdout | INFO:     127.0.0.1:36316 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 15:49:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 141. worker_id: c55289b4. 
2024-02-27 15:50:02 | INFO | stdout | INFO:     127.0.0.1:53592 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 15:50:19 | INFO | stdout | INFO:     127.0.0.1:48176 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 15:50:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 143. worker_id: c55289b4. 
2024-02-27 15:51:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 143. worker_id: c55289b4. 
2024-02-27 15:52:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 143. worker_id: c55289b4. 
2024-02-27 15:52:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 143. worker_id: c55289b4. 
2024-02-27 15:53:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 143. worker_id: c55289b4. 
2024-02-27 15:54:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 143. worker_id: c55289b4. 
2024-02-27 15:54:22 | INFO | stdout | INFO:     127.0.0.1:48434 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 15:54:23 | INFO | stdout | INFO:     127.0.0.1:48440 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 15:55:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 143. worker_id: c55289b4. 
2024-02-27 15:55:16 | INFO | stdout | INFO:     127.0.0.1:52810 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 15:55:41 | INFO | stdout | INFO:     127.0.0.1:57168 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 15:55:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 145. worker_id: c55289b4. 
2024-02-27 15:55:50 | INFO | stdout | INFO:     127.0.0.1:56402 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 15:56:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 145. worker_id: c55289b4. 
2024-02-27 15:57:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 145. worker_id: c55289b4. 
2024-02-27 15:57:31 | INFO | stdout | INFO:     127.0.0.1:42490 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 15:58:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 145. worker_id: c55289b4. 
2024-02-27 15:58:10 | INFO | stdout | INFO:     127.0.0.1:59792 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 15:58:26 | INFO | stdout | INFO:     127.0.0.1:37724 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 15:58:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 147. worker_id: c55289b4. 
2024-02-27 15:59:08 | INFO | stdout | INFO:     127.0.0.1:57946 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 15:59:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 148. worker_id: c55289b4. 
2024-02-27 15:59:37 | INFO | stdout | INFO:     127.0.0.1:49574 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:00:09 | INFO | stdout | INFO:     127.0.0.1:53984 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 16:00:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 149. worker_id: c55289b4. 
2024-02-27 16:00:45 | INFO | stdout | INFO:     127.0.0.1:48778 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 16:01:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 149. worker_id: c55289b4. 
2024-02-27 16:01:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 149. worker_id: c55289b4. 
2024-02-27 16:02:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 149. worker_id: c55289b4. 
2024-02-27 16:03:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 149. worker_id: c55289b4. 
2024-02-27 16:04:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 149. worker_id: c55289b4. 
2024-02-27 16:04:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 149. worker_id: c55289b4. 
2024-02-27 16:05:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 149. worker_id: c55289b4. 
2024-02-27 16:06:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 149. worker_id: c55289b4. 
2024-02-27 16:06:28 | INFO | stdout | INFO:     127.0.0.1:36826 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 16:06:36 | INFO | stdout | INFO:     127.0.0.1:38972 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:06:53 | INFO | stdout | INFO:     127.0.0.1:39202 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:07:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 151. worker_id: c55289b4. 
2024-02-27 16:07:03 | INFO | stdout | INFO:     127.0.0.1:58378 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:07:19 | INFO | stdout | INFO:     127.0.0.1:53888 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:07:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 153. worker_id: c55289b4. 
2024-02-27 16:07:50 | INFO | stdout | INFO:     127.0.0.1:50374 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:08:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 154. worker_id: c55289b4. 
2024-02-27 16:09:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 154. worker_id: c55289b4. 
2024-02-27 16:09:27 | INFO | stdout | INFO:     127.0.0.1:52106 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:09:42 | INFO | stdout | INFO:     127.0.0.1:46964 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:10:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 156. worker_id: c55289b4. 
2024-02-27 16:10:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 156. worker_id: c55289b4. 
2024-02-27 16:11:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 156. worker_id: c55289b4. 
2024-02-27 16:12:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 156. worker_id: c55289b4. 
2024-02-27 16:13:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 156. worker_id: c55289b4. 
2024-02-27 16:13:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 156. worker_id: c55289b4. 
2024-02-27 16:14:21 | INFO | stdout | INFO:     127.0.0.1:45394 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 16:14:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 156. worker_id: c55289b4. 
2024-02-27 16:14:41 | INFO | stdout | INFO:     127.0.0.1:58638 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 16:14:56 | INFO | stdout | INFO:     127.0.0.1:39526 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:15:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 157. worker_id: c55289b4. 
2024-02-27 16:15:22 | INFO | stdout | INFO:     127.0.0.1:40308 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:15:32 | INFO | stdout | INFO:     127.0.0.1:40530 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 16:15:50 | INFO | stdout | INFO:     127.0.0.1:37358 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:16:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 159. worker_id: c55289b4. 
2024-02-27 16:16:29 | INFO | stdout | INFO:     127.0.0.1:49774 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:16:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 160. worker_id: c55289b4. 
2024-02-27 16:17:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 160. worker_id: c55289b4. 
2024-02-27 16:18:04 | INFO | stdout | INFO:     127.0.0.1:43130 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 16:18:07 | INFO | stdout | INFO:     127.0.0.1:40466 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 16:18:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 160. worker_id: c55289b4. 
2024-02-27 16:18:23 | INFO | stdout | INFO:     127.0.0.1:41770 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:18:39 | INFO | stdout | INFO:     127.0.0.1:43296 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:19:01 | INFO | stdout | INFO:     127.0.0.1:51276 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 16:19:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 162. worker_id: c55289b4. 
2024-02-27 16:19:11 | INFO | stdout | INFO:     127.0.0.1:60990 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:19:45 | INFO | stdout | INFO:     127.0.0.1:53538 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:19:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=4, locked=False). call_ct: 164. worker_id: c55289b4. 
2024-02-27 16:20:07 | INFO | stdout | INFO:     127.0.0.1:43490 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 16:20:13 | INFO | stdout | INFO:     127.0.0.1:43496 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 16:20:28 | INFO | stdout | INFO:     127.0.0.1:47852 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:20:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 165. worker_id: c55289b4. 
2024-02-27 16:20:39 | INFO | stdout | INFO:     127.0.0.1:54014 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:20:43 | INFO | stdout | INFO:     127.0.0.1:54030 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:20:58 | INFO | stdout | INFO:     127.0.0.1:47334 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:21:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 168. worker_id: c55289b4. 
2024-02-27 16:21:28 | INFO | stdout | INFO:     127.0.0.1:35674 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:21:43 | INFO | stdout | INFO:     127.0.0.1:58034 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 16:21:50 | INFO | stdout | INFO:     127.0.0.1:45266 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:22:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 170. worker_id: c55289b4. 
2024-02-27 16:22:23 | INFO | stdout | INFO:     127.0.0.1:52034 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:22:41 | INFO | stdout | INFO:     127.0.0.1:34354 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:22:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 172. worker_id: c55289b4. 
2024-02-27 16:23:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 172. worker_id: c55289b4. 
2024-02-27 16:23:44 | INFO | stdout | INFO:     127.0.0.1:60848 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:23:59 | INFO | stdout | INFO:     127.0.0.1:56798 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:24:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 174. worker_id: c55289b4. 
2024-02-27 16:25:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 174. worker_id: c55289b4. 
2024-02-27 16:25:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 174. worker_id: c55289b4. 
2024-02-27 16:26:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 174. worker_id: c55289b4. 
2024-02-27 16:27:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 174. worker_id: c55289b4. 
2024-02-27 16:28:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 174. worker_id: c55289b4. 
2024-02-27 16:28:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 174. worker_id: c55289b4. 
2024-02-27 16:29:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 174. worker_id: c55289b4. 
2024-02-27 16:30:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 174. worker_id: c55289b4. 
2024-02-27 16:31:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 174. worker_id: c55289b4. 
2024-02-27 16:31:14 | INFO | stdout | INFO:     127.0.0.1:47304 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 16:31:33 | INFO | stdout | INFO:     127.0.0.1:41030 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:31:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 175. worker_id: c55289b4. 
2024-02-27 16:31:49 | INFO | stdout | INFO:     127.0.0.1:52422 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:32:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 176. worker_id: c55289b4. 
2024-02-27 16:33:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 176. worker_id: c55289b4. 
2024-02-27 16:34:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 176. worker_id: c55289b4. 
2024-02-27 16:34:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 176. worker_id: c55289b4. 
2024-02-27 16:35:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 176. worker_id: c55289b4. 
2024-02-27 16:36:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 176. worker_id: c55289b4. 
2024-02-27 16:37:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 176. worker_id: c55289b4. 
2024-02-27 16:37:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 176. worker_id: c55289b4. 
2024-02-27 16:38:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 176. worker_id: c55289b4. 
2024-02-27 16:39:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 176. worker_id: c55289b4. 
2024-02-27 16:40:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 176. worker_id: c55289b4. 
2024-02-27 16:40:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 176. worker_id: c55289b4. 
2024-02-27 16:41:06 | INFO | stdout | INFO:     127.0.0.1:42390 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 16:41:32 | INFO | stdout | INFO:     127.0.0.1:48662 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:41:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 177. worker_id: c55289b4. 
2024-02-27 16:42:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 177. worker_id: c55289b4. 
2024-02-27 16:43:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 177. worker_id: c55289b4. 
2024-02-27 16:43:23 | INFO | stdout | INFO:     127.0.0.1:35454 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:43:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 178. worker_id: c55289b4. 
2024-02-27 16:44:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 178. worker_id: c55289b4. 
2024-02-27 16:45:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 178. worker_id: c55289b4. 
2024-02-27 16:46:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 178. worker_id: c55289b4. 
2024-02-27 16:46:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 178. worker_id: c55289b4. 
2024-02-27 16:47:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 178. worker_id: c55289b4. 
2024-02-27 16:48:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 178. worker_id: c55289b4. 
2024-02-27 16:49:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 178. worker_id: c55289b4. 
2024-02-27 16:49:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 178. worker_id: c55289b4. 
2024-02-27 16:50:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 178. worker_id: c55289b4. 
2024-02-27 16:50:47 | INFO | stdout | INFO:     127.0.0.1:41158 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 16:51:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 178. worker_id: c55289b4. 
2024-02-27 16:51:39 | INFO | stdout | INFO:     127.0.0.1:43088 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 16:52:00 | INFO | stdout | INFO:     127.0.0.1:48948 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:52:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 179. worker_id: c55289b4. 
2024-02-27 16:52:31 | INFO | stdout | INFO:     127.0.0.1:54562 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:52:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 180. worker_id: c55289b4. 
2024-02-27 16:53:04 | INFO | stdout | INFO:     127.0.0.1:45782 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 16:53:23 | INFO | stdout | INFO:     127.0.0.1:48976 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:53:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 181. worker_id: c55289b4. 
2024-02-27 16:53:36 | INFO | stdout | INFO:     127.0.0.1:54108 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:53:53 | INFO | stdout | INFO:     127.0.0.1:51182 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:54:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 183. worker_id: c55289b4. 
2024-02-27 16:54:24 | INFO | stdout | INFO:     127.0.0.1:36810 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:54:44 | INFO | stdout | INFO:     127.0.0.1:41138 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 16:54:51 | INFO | stdout | INFO:     127.0.0.1:55024 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:55:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 185. worker_id: c55289b4. 
2024-02-27 16:55:05 | INFO | stdout | INFO:     127.0.0.1:54106 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:55:27 | INFO | stdout | INFO:     127.0.0.1:48118 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:55:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 187. worker_id: c55289b4. 
2024-02-27 16:56:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 187. worker_id: c55289b4. 
2024-02-27 16:57:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 187. worker_id: c55289b4. 
2024-02-27 16:58:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 187. worker_id: c55289b4. 
2024-02-27 16:58:34 | INFO | stdout | INFO:     127.0.0.1:55374 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 16:58:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 187. worker_id: c55289b4. 
2024-02-27 16:58:55 | INFO | stdout | INFO:     127.0.0.1:34936 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 16:59:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 188. worker_id: c55289b4. 
2024-02-27 16:59:51 | INFO | stdout | INFO:     127.0.0.1:59940 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 17:00:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 189. worker_id: c55289b4. 
2024-02-27 17:01:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 189. worker_id: c55289b4. 
2024-02-27 17:01:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 189. worker_id: c55289b4. 
2024-02-27 17:02:28 | INFO | stdout | INFO:     127.0.0.1:56142 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 17:02:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 189. worker_id: c55289b4. 
2024-02-27 17:03:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 189. worker_id: c55289b4. 
2024-02-27 17:04:02 | INFO | stdout | INFO:     127.0.0.1:50942 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 17:04:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 189. worker_id: c55289b4. 
2024-02-27 17:04:31 | INFO | stdout | INFO:     127.0.0.1:49802 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 17:04:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 190. worker_id: c55289b4. 
2024-02-27 17:04:51 | INFO | stdout | INFO:     127.0.0.1:52620 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 17:05:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:06:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:07:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:07:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:08:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:09:13 | INFO | stdout | INFO:     127.0.0.1:51798 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 17:09:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:10:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:10:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:11:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:12:02 | INFO | stdout | INFO:     127.0.0.1:36984 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 17:12:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:13:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:13:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:14:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:15:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:16:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:16:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:17:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:18:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:18:48 | INFO | stdout | INFO:     127.0.0.1:55686 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 17:19:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:19:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:20:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:21:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:22:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:22:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:23:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:24:06 | INFO | stdout | INFO:     127.0.0.1:37780 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 17:24:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:25:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:25:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:26:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:27:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:28:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:28:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:29:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 191. worker_id: c55289b4. 
2024-02-27 17:29:39 | INFO | stdout | INFO:     127.0.0.1:58962 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 17:29:51 | INFO | stdout | INFO:     127.0.0.1:52426 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 17:30:08 | INFO | stdout | INFO:     127.0.0.1:38486 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 17:30:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 192. worker_id: c55289b4. 
2024-02-27 17:30:31 | INFO | stdout | INFO:     127.0.0.1:49556 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 17:30:51 | INFO | stdout | INFO:     127.0.0.1:50492 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 17:31:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 194. worker_id: c55289b4. 
2024-02-27 17:31:17 | INFO | stdout | INFO:     127.0.0.1:39532 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 17:31:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 195. worker_id: c55289b4. 
2024-02-27 17:32:00 | INFO | stdout | INFO:     127.0.0.1:51886 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 17:32:22 | INFO | stdout | INFO:     127.0.0.1:44574 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 17:32:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 197. worker_id: c55289b4. 
2024-02-27 17:32:43 | INFO | stdout | INFO:     127.0.0.1:38308 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 17:32:57 | INFO | stdout | INFO:     127.0.0.1:37410 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 17:33:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 199. worker_id: c55289b4. 
2024-02-27 17:33:39 | INFO | stdout | INFO:     127.0.0.1:47224 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 17:34:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 200. worker_id: c55289b4. 
2024-02-27 17:34:12 | INFO | stdout | INFO:     127.0.0.1:48078 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 17:34:38 | INFO | stdout | INFO:     127.0.0.1:52682 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 17:34:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 201. worker_id: c55289b4. 
2024-02-27 17:35:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 201. worker_id: c55289b4. 
2024-02-27 17:36:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 201. worker_id: c55289b4. 
2024-02-27 17:36:39 | INFO | stdout | INFO:     127.0.0.1:51500 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 17:37:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 201. worker_id: c55289b4. 
2024-02-27 17:37:12 | INFO | stdout | INFO:     127.0.0.1:37322 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 17:37:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 202. worker_id: c55289b4. 
2024-02-27 17:38:28 | INFO | stdout | INFO:     127.0.0.1:36986 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 17:38:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 202. worker_id: c55289b4. 
2024-02-27 17:39:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 202. worker_id: c55289b4. 
2024-02-27 17:40:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 202. worker_id: c55289b4. 
2024-02-27 17:40:39 | INFO | stdout | INFO:     127.0.0.1:44202 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 17:40:47 | INFO | stdout | INFO:     127.0.0.1:55004 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 17:40:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 202. worker_id: c55289b4. 
2024-02-27 17:41:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 202. worker_id: c55289b4. 
2024-02-27 17:42:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 202. worker_id: c55289b4. 
2024-02-27 17:43:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 202. worker_id: c55289b4. 
2024-02-27 17:43:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 202. worker_id: c55289b4. 
2024-02-27 17:44:22 | INFO | stdout | INFO:     127.0.0.1:54094 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 17:44:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 202. worker_id: c55289b4. 
2024-02-27 17:44:43 | INFO | stdout | INFO:     127.0.0.1:44216 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 17:45:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 203. worker_id: c55289b4. 
2024-02-27 17:46:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 203. worker_id: c55289b4. 
2024-02-27 17:46:30 | INFO | stdout | INFO:     127.0.0.1:46614 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 17:46:39 | INFO | stdout | INFO:     127.0.0.1:37818 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 17:46:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 204. worker_id: c55289b4. 
2024-02-27 17:46:56 | INFO | stdout | INFO:     127.0.0.1:43554 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 17:47:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 17:48:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 17:49:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 17:49:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 17:50:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 17:51:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 17:52:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 17:52:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 17:53:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 17:54:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 17:55:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 17:55:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 17:56:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 17:57:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 17:58:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 17:58:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 17:59:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:00:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:01:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:01:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:02:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:03:08 | INFO | stdout | INFO:     127.0.0.1:41346 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 18:03:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:04:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:04:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:05:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:06:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:07:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:07:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:08:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:09:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:10:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:10:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:11:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:12:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:13:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:13:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:14:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:15:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:16:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:16:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:17:33 | INFO | stdout | INFO:     127.0.0.1:40800 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 18:17:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:18:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:19:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:19:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:20:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:21:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:22:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:22:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:23:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:24:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:25:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:25:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:26:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 205. worker_id: c55289b4. 
2024-02-27 18:27:02 | INFO | stdout | INFO:     127.0.0.1:34280 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 18:27:20 | INFO | stdout | INFO:     127.0.0.1:52138 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 18:27:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 206. worker_id: c55289b4. 
2024-02-27 18:27:57 | INFO | stdout | INFO:     127.0.0.1:58150 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 18:28:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 207. worker_id: c55289b4. 
2024-02-27 18:28:40 | INFO | stdout | INFO:     127.0.0.1:59302 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 18:28:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 208. worker_id: c55289b4. 
2024-02-27 18:29:36 | INFO | stdout | INFO:     127.0.0.1:60570 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 18:29:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 208. worker_id: c55289b4. 
2024-02-27 18:29:53 | INFO | stdout | INFO:     127.0.0.1:58802 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 18:30:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 209. worker_id: c55289b4. 
2024-02-27 18:31:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 209. worker_id: c55289b4. 
2024-02-27 18:31:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 209. worker_id: c55289b4. 
2024-02-27 18:32:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 209. worker_id: c55289b4. 
2024-02-27 18:33:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 209. worker_id: c55289b4. 
2024-02-27 18:34:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 209. worker_id: c55289b4. 
2024-02-27 18:34:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 209. worker_id: c55289b4. 
2024-02-27 18:35:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 209. worker_id: c55289b4. 
2024-02-27 18:36:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 209. worker_id: c55289b4. 
2024-02-27 18:37:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 209. worker_id: c55289b4. 
2024-02-27 18:37:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 209. worker_id: c55289b4. 
2024-02-27 18:38:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 209. worker_id: c55289b4. 
2024-02-27 18:39:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 209. worker_id: c55289b4. 
2024-02-27 18:40:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 209. worker_id: c55289b4. 
2024-02-27 18:40:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 209. worker_id: c55289b4. 
2024-02-27 18:41:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 209. worker_id: c55289b4. 
2024-02-27 18:42:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 209. worker_id: c55289b4. 
2024-02-27 18:43:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 209. worker_id: c55289b4. 
2024-02-27 18:43:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 209. worker_id: c55289b4. 
2024-02-27 18:44:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 209. worker_id: c55289b4. 
2024-02-27 18:45:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 209. worker_id: c55289b4. 
2024-02-27 18:46:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 209. worker_id: c55289b4. 
2024-02-27 18:46:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 209. worker_id: c55289b4. 
2024-02-27 18:47:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 209. worker_id: c55289b4. 
2024-02-27 18:48:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 209. worker_id: c55289b4. 
2024-02-27 18:48:35 | INFO | stdout | INFO:     127.0.0.1:34142 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 18:48:51 | INFO | stdout | INFO:     127.0.0.1:48942 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 18:49:08 | INFO | stdout | INFO:     127.0.0.1:49358 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 18:49:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 210. worker_id: c55289b4. 
2024-02-27 18:49:27 | INFO | stdout | INFO:     127.0.0.1:35864 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 18:49:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 211. worker_id: c55289b4. 
2024-02-27 18:50:14 | INFO | stdout | INFO:     127.0.0.1:39138 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 18:50:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 212. worker_id: c55289b4. 
2024-02-27 18:50:56 | INFO | stdout | INFO:     127.0.0.1:36468 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 18:51:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 212. worker_id: c55289b4. 
2024-02-27 18:51:32 | INFO | stdout | INFO:     127.0.0.1:56294 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 18:52:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 213. worker_id: c55289b4. 
2024-02-27 18:52:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 213. worker_id: c55289b4. 
2024-02-27 18:53:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 213. worker_id: c55289b4. 
2024-02-27 18:54:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 213. worker_id: c55289b4. 
2024-02-27 18:55:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 213. worker_id: c55289b4. 
2024-02-27 18:55:38 | INFO | stdout | INFO:     127.0.0.1:60208 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 18:55:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 213. worker_id: c55289b4. 
2024-02-27 18:56:30 | INFO | stdout | INFO:     127.0.0.1:49546 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 18:56:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 214. worker_id: c55289b4. 
2024-02-27 18:57:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 214. worker_id: c55289b4. 
2024-02-27 18:58:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 214. worker_id: c55289b4. 
2024-02-27 18:58:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 214. worker_id: c55289b4. 
2024-02-27 18:59:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 214. worker_id: c55289b4. 
2024-02-27 19:00:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 214. worker_id: c55289b4. 
2024-02-27 19:01:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 214. worker_id: c55289b4. 
2024-02-27 19:01:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 214. worker_id: c55289b4. 
2024-02-27 19:02:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 214. worker_id: c55289b4. 
2024-02-27 19:03:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 214. worker_id: c55289b4. 
2024-02-27 19:03:46 | INFO | stdout | INFO:     127.0.0.1:48510 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 19:04:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 214. worker_id: c55289b4. 
2024-02-27 19:04:35 | INFO | stdout | INFO:     127.0.0.1:60190 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 19:04:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 215. worker_id: c55289b4. 
2024-02-27 19:05:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 215. worker_id: c55289b4. 
2024-02-27 19:06:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 215. worker_id: c55289b4. 
2024-02-27 19:07:13 | INFO | stdout | INFO:     127.0.0.1:50300 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 19:07:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 215. worker_id: c55289b4. 
2024-02-27 19:07:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 215. worker_id: c55289b4. 
2024-02-27 19:08:05 | INFO | stdout | INFO:     127.0.0.1:47246 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 19:08:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 216. worker_id: c55289b4. 
2024-02-27 19:08:55 | INFO | stdout | INFO:     127.0.0.1:45410 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 19:09:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:09:40 | INFO | stdout | INFO:     127.0.0.1:45686 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 19:10:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:10:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:11:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:12:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:13:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:13:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:14:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:15:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:16:09 | INFO | stdout | INFO:     127.0.0.1:58938 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 19:16:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:17:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:17:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:18:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:19:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:20:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:20:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:21:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:22:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:23:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:23:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:24:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:25:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:26:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:26:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:27:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:28:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:29:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:29:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:30:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:31:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:32:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:32:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:33:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:34:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:35:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:35:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:36:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:37:10 | INFO | stdout | INFO:     127.0.0.1:41312 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 19:37:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 217. worker_id: c55289b4. 
2024-02-27 19:37:50 | INFO | stdout | INFO:     127.0.0.1:39836 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 19:38:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 218. worker_id: c55289b4. 
2024-02-27 19:38:03 | INFO | stdout | INFO:     127.0.0.1:58700 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 19:38:24 | INFO | stdout | INFO:     127.0.0.1:47118 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 19:38:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 220. worker_id: c55289b4. 
2024-02-27 19:39:10 | INFO | stdout | INFO:     127.0.0.1:34254 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 19:39:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 220. worker_id: c55289b4. 
2024-02-27 19:39:49 | INFO | stdout | INFO:     127.0.0.1:45734 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 19:40:08 | INFO | stdout | INFO:     127.0.0.1:35776 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 19:40:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 222. worker_id: c55289b4. 
2024-02-27 19:41:01 | INFO | stdout | INFO:     127.0.0.1:48672 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 19:41:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=4, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 19:41:17 | INFO | stdout | INFO:     127.0.0.1:41954 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 19:41:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 19:42:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 19:43:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 19:44:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 19:44:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 19:45:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 19:46:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 19:47:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 19:47:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 19:48:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 19:49:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 19:50:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 19:50:21 | INFO | stdout | INFO:     127.0.0.1:48254 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 19:50:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 19:51:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 19:52:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 19:53:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 19:53:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 19:54:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 19:55:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 19:56:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 19:56:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 19:57:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 19:58:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 19:59:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 19:59:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 20:00:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 20:01:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 20:02:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 20:02:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 20:03:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 20:04:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 20:05:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 20:05:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 20:06:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 20:07:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 20:08:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 20:08:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 20:09:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 20:10:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 20:11:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 20:11:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 20:12:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 20:13:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 20:14:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 20:14:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 223. worker_id: c55289b4. 
2024-02-27 20:14:53 | INFO | stdout | INFO:     127.0.0.1:49078 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 20:15:02 | INFO | stdout | INFO:     127.0.0.1:34900 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:15:15 | INFO | stdout | INFO:     127.0.0.1:54474 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:15:26 | INFO | stdout | INFO:     127.0.0.1:60290 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:15:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 226. worker_id: c55289b4. 
2024-02-27 20:15:44 | INFO | stdout | INFO:     127.0.0.1:58278 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:16:10 | INFO | stdout | INFO:     127.0.0.1:39012 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:16:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 228. worker_id: c55289b4. 
2024-02-27 20:16:45 | INFO | stdout | INFO:     127.0.0.1:39222 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:16:54 | INFO | stdout | INFO:     127.0.0.1:39228 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:17:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 230. worker_id: c55289b4. 
2024-02-27 20:17:40 | INFO | stdout | INFO:     127.0.0.1:51748 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:17:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 231. worker_id: c55289b4. 
2024-02-27 20:18:00 | INFO | stdout | INFO:     127.0.0.1:45134 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:18:12 | INFO | stdout | INFO:     127.0.0.1:51934 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:18:26 | INFO | stdout | INFO:     127.0.0.1:45488 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:18:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 234. worker_id: c55289b4. 
2024-02-27 20:18:35 | INFO | stdout | INFO:     127.0.0.1:43374 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:19:11 | INFO | stdout | INFO:     127.0.0.1:33426 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:19:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 236. worker_id: c55289b4. 
2024-02-27 20:19:43 | INFO | stdout | INFO:     127.0.0.1:46802 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:19:48 | INFO | stdout | INFO:     127.0.0.1:59842 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:19:57 | INFO | stdout | INFO:     127.0.0.1:48118 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:20:00 | INFO | stdout | INFO:     127.0.0.1:48122 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:20:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 240. worker_id: c55289b4. 
2024-02-27 20:20:19 | INFO | stdout | INFO:     127.0.0.1:36126 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:20:28 | INFO | stdout | INFO:     127.0.0.1:43232 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:20:39 | INFO | stdout | INFO:     127.0.0.1:49734 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:20:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 243. worker_id: c55289b4. 
2024-02-27 20:21:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 243. worker_id: c55289b4. 
2024-02-27 20:22:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 243. worker_id: c55289b4. 
2024-02-27 20:23:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 243. worker_id: c55289b4. 
2024-02-27 20:23:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 243. worker_id: c55289b4. 
2024-02-27 20:23:51 | INFO | stdout | INFO:     127.0.0.1:47628 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 20:24:12 | INFO | stdout | INFO:     127.0.0.1:43732 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:24:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 244. worker_id: c55289b4. 
2024-02-27 20:25:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 244. worker_id: c55289b4. 
2024-02-27 20:26:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 244. worker_id: c55289b4. 
2024-02-27 20:26:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 244. worker_id: c55289b4. 
2024-02-27 20:27:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 244. worker_id: c55289b4. 
2024-02-27 20:28:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 244. worker_id: c55289b4. 
2024-02-27 20:29:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 244. worker_id: c55289b4. 
2024-02-27 20:29:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 244. worker_id: c55289b4. 
2024-02-27 20:30:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 244. worker_id: c55289b4. 
2024-02-27 20:31:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 244. worker_id: c55289b4. 
2024-02-27 20:32:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 244. worker_id: c55289b4. 
2024-02-27 20:32:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 244. worker_id: c55289b4. 
2024-02-27 20:33:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 244. worker_id: c55289b4. 
2024-02-27 20:34:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 244. worker_id: c55289b4. 
2024-02-27 20:35:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 244. worker_id: c55289b4. 
2024-02-27 20:35:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 244. worker_id: c55289b4. 
2024-02-27 20:36:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 244. worker_id: c55289b4. 
2024-02-27 20:37:01 | INFO | stdout | INFO:     127.0.0.1:54114 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 20:37:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 244. worker_id: c55289b4. 
2024-02-27 20:37:42 | INFO | stdout | INFO:     127.0.0.1:45292 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 20:37:55 | INFO | stdout | INFO:     127.0.0.1:42522 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:38:05 | INFO | stdout | INFO:     127.0.0.1:57646 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:38:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 246. worker_id: c55289b4. 
2024-02-27 20:38:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 246. worker_id: c55289b4. 
2024-02-27 20:39:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 246. worker_id: c55289b4. 
2024-02-27 20:40:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 246. worker_id: c55289b4. 
2024-02-27 20:41:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 246. worker_id: c55289b4. 
2024-02-27 20:41:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 246. worker_id: c55289b4. 
2024-02-27 20:42:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 246. worker_id: c55289b4. 
2024-02-27 20:43:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 246. worker_id: c55289b4. 
2024-02-27 20:44:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 246. worker_id: c55289b4. 
2024-02-27 20:44:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 246. worker_id: c55289b4. 
2024-02-27 20:45:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 246. worker_id: c55289b4. 
2024-02-27 20:46:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 246. worker_id: c55289b4. 
2024-02-27 20:47:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 246. worker_id: c55289b4. 
2024-02-27 20:47:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 246. worker_id: c55289b4. 
2024-02-27 20:48:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 246. worker_id: c55289b4. 
2024-02-27 20:49:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 246. worker_id: c55289b4. 
2024-02-27 20:50:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 246. worker_id: c55289b4. 
2024-02-27 20:50:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 246. worker_id: c55289b4. 
2024-02-27 20:51:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 246. worker_id: c55289b4. 
2024-02-27 20:52:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 246. worker_id: c55289b4. 
2024-02-27 20:53:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 246. worker_id: c55289b4. 
2024-02-27 20:53:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 246. worker_id: c55289b4. 
2024-02-27 20:53:58 | INFO | stdout | INFO:     127.0.0.1:33754 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 20:54:14 | INFO | stdout | INFO:     127.0.0.1:44210 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:54:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 247. worker_id: c55289b4. 
2024-02-27 20:54:41 | INFO | stdout | INFO:     127.0.0.1:58918 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:55:01 | INFO | stdout | INFO:     127.0.0.1:53896 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:55:12 | INFO | stdout | INFO:     127.0.0.1:47862 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:55:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 250. worker_id: c55289b4. 
2024-02-27 20:55:23 | INFO | stdout | INFO:     127.0.0.1:36932 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:55:38 | INFO | stdout | INFO:     127.0.0.1:38014 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:55:48 | INFO | stdout | INFO:     127.0.0.1:51796 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:56:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 253. worker_id: c55289b4. 
2024-02-27 20:56:21 | INFO | stdout | INFO:     127.0.0.1:44516 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 20:56:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 20:57:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 20:58:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 20:59:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 20:59:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:00:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:01:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:02:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:02:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:03:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:04:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:05:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:05:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:06:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:07:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:08:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:08:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:09:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:10:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:11:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:11:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:12:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:13:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:14:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:14:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:15:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:16:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:16:40 | INFO | stdout | INFO:     127.0.0.1:50946 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 21:17:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:17:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:18:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:19:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:20:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:20:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:21:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:22:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:23:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:23:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:24:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:25:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:26:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:26:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:27:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:28:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:29:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:29:51 | INFO | stdout | INFO:     127.0.0.1:49802 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 21:29:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 254. worker_id: c55289b4. 
2024-02-27 21:30:20 | INFO | stdout | INFO:     127.0.0.1:33760 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:30:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 255. worker_id: c55289b4. 
2024-02-27 21:30:53 | INFO | stdout | INFO:     127.0.0.1:49008 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:31:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 256. worker_id: c55289b4. 
2024-02-27 21:31:55 | INFO | stdout | INFO:     127.0.0.1:44208 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:32:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 257. worker_id: c55289b4. 
2024-02-27 21:32:41 | INFO | stdout | INFO:     127.0.0.1:34040 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 21:32:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 257. worker_id: c55289b4. 
2024-02-27 21:32:56 | INFO | stdout | INFO:     127.0.0.1:43846 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 21:33:04 | INFO | stdout | INFO:     127.0.0.1:43854 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 21:33:05 | INFO | stdout | INFO:     127.0.0.1:56392 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:33:12 | INFO | stdout | INFO:     127.0.0.1:56406 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:33:15 | INFO | stdout | INFO:     127.0.0.1:33358 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:33:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 260. worker_id: c55289b4. 
2024-02-27 21:33:40 | INFO | stdout | INFO:     127.0.0.1:39800 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:34:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 261. worker_id: c55289b4. 
2024-02-27 21:35:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 261. worker_id: c55289b4. 
2024-02-27 21:35:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 261. worker_id: c55289b4. 
2024-02-27 21:36:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 261. worker_id: c55289b4. 
2024-02-27 21:37:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 261. worker_id: c55289b4. 
2024-02-27 21:37:52 | INFO | stdout | INFO:     127.0.0.1:37256 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 21:38:07 | INFO | stdout | INFO:     127.0.0.1:48734 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:38:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 262. worker_id: c55289b4. 
2024-02-27 21:38:33 | INFO | stdout | INFO:     127.0.0.1:44614 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:38:49 | INFO | stdout | INFO:     127.0.0.1:53112 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:38:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 264. worker_id: c55289b4. 
2024-02-27 21:38:55 | INFO | stdout | INFO:     127.0.0.1:51666 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 21:39:21 | INFO | stdout | INFO:     127.0.0.1:36052 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:39:35 | INFO | stdout | INFO:     127.0.0.1:44040 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 21:39:36 | INFO | stdout | INFO:     127.0.0.1:44046 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:39:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 266. worker_id: c55289b4. 
2024-02-27 21:40:12 | INFO | stdout | INFO:     127.0.0.1:54504 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:40:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 267. worker_id: c55289b4. 
2024-02-27 21:40:27 | INFO | stdout | INFO:     127.0.0.1:39076 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:41:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 268. worker_id: c55289b4. 
2024-02-27 21:41:14 | INFO | stdout | INFO:     127.0.0.1:57868 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:41:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 269. worker_id: c55289b4. 
2024-02-27 21:42:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 269. worker_id: c55289b4. 
2024-02-27 21:43:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 269. worker_id: c55289b4. 
2024-02-27 21:44:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 269. worker_id: c55289b4. 
2024-02-27 21:44:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 269. worker_id: c55289b4. 
2024-02-27 21:45:08 | INFO | stdout | INFO:     127.0.0.1:60976 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 21:45:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 269. worker_id: c55289b4. 
2024-02-27 21:46:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 269. worker_id: c55289b4. 
2024-02-27 21:47:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 269. worker_id: c55289b4. 
2024-02-27 21:47:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 269. worker_id: c55289b4. 
2024-02-27 21:48:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 269. worker_id: c55289b4. 
2024-02-27 21:49:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 269. worker_id: c55289b4. 
2024-02-27 21:50:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 269. worker_id: c55289b4. 
2024-02-27 21:50:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 269. worker_id: c55289b4. 
2024-02-27 21:51:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 269. worker_id: c55289b4. 
2024-02-27 21:52:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 269. worker_id: c55289b4. 
2024-02-27 21:53:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 269. worker_id: c55289b4. 
2024-02-27 21:53:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 269. worker_id: c55289b4. 
2024-02-27 21:54:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 269. worker_id: c55289b4. 
2024-02-27 21:54:47 | INFO | stdout | INFO:     127.0.0.1:34330 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:55:02 | INFO | stdout | INFO:     127.0.0.1:57738 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:55:09 | INFO | stdout | INFO:     127.0.0.1:59526 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:55:21 | INFO | stdout | INFO:     127.0.0.1:55104 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:55:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 273. worker_id: c55289b4. 
2024-02-27 21:55:55 | INFO | stdout | INFO:     127.0.0.1:33970 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:56:08 | INFO | stdout | INFO:     127.0.0.1:60334 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:56:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 275. worker_id: c55289b4. 
2024-02-27 21:56:26 | INFO | stdout | INFO:     127.0.0.1:50204 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:56:45 | INFO | stdout | INFO:     127.0.0.1:35310 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 21:56:55 | INFO | stdout | INFO:     127.0.0.1:58880 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 21:56:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 276. worker_id: c55289b4. 
2024-02-27 21:57:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 276. worker_id: c55289b4. 
2024-02-27 21:57:44 | INFO | stdout | INFO:     127.0.0.1:33378 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:58:03 | INFO | stdout | INFO:     127.0.0.1:39368 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:58:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 278. worker_id: c55289b4. 
2024-02-27 21:58:33 | INFO | stdout | INFO:     127.0.0.1:57884 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:58:45 | INFO | stdout | INFO:     127.0.0.1:48676 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 21:58:52 | INFO | stdout | INFO:     127.0.0.1:48692 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:59:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 280. worker_id: c55289b4. 
2024-02-27 21:59:51 | INFO | stdout | INFO:     127.0.0.1:33406 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 21:59:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 281. worker_id: c55289b4. 
2024-02-27 22:00:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 281. worker_id: c55289b4. 
2024-02-27 22:01:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 281. worker_id: c55289b4. 
2024-02-27 22:02:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 281. worker_id: c55289b4. 
2024-02-27 22:02:21 | INFO | stdout | INFO:     127.0.0.1:60908 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 22:02:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 281. worker_id: c55289b4. 
2024-02-27 22:03:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 281. worker_id: c55289b4. 
2024-02-27 22:04:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 281. worker_id: c55289b4. 
2024-02-27 22:05:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 281. worker_id: c55289b4. 
2024-02-27 22:05:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 281. worker_id: c55289b4. 
2024-02-27 22:06:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 281. worker_id: c55289b4. 
2024-02-27 22:07:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 281. worker_id: c55289b4. 
2024-02-27 22:08:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 281. worker_id: c55289b4. 
2024-02-27 22:08:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 281. worker_id: c55289b4. 
2024-02-27 22:09:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 281. worker_id: c55289b4. 
2024-02-27 22:10:01 | INFO | stdout | INFO:     127.0.0.1:50646 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 22:10:18 | INFO | stdout | INFO:     127.0.0.1:47598 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 22:10:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 282. worker_id: c55289b4. 
2024-02-27 22:10:44 | INFO | stdout | INFO:     127.0.0.1:48898 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 22:11:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:11:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:12:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:13:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:14:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:14:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:15:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:16:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:17:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:17:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:18:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:19:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:20:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:20:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:21:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:22:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:23:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:23:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:24:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:25:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:26:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:26:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:27:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:28:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:29:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4.