2024-02-27 22:29:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:30:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:31:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:32:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:32:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:33:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:34:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:35:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:35:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:36:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:37:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:38:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:38:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:39:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:40:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:41:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:41:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:42:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:43:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:44:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:44:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:45:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:46:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:47:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:47:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:48:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:49:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:50:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:51:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:51:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:52:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:53:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:54:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:54:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:55:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:56:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:57:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:57:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:58:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:59:12 | INFO | stdout | INFO:     127.0.0.1:56906 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 22:59:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 283. worker_id: c55289b4. 
2024-02-27 22:59:28 | INFO | stdout | INFO:     127.0.0.1:57616 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 22:59:36 | INFO | stdout | INFO:     127.0.0.1:56650 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 22:59:42 | INFO | stdout | INFO:     127.0.0.1:56666 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 22:59:45 | INFO | stdout | INFO:     127.0.0.1:38936 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 22:59:48 | INFO | stdout | INFO:     127.0.0.1:38940 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 23:00:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 288. worker_id: c55289b4. 
2024-02-27 23:00:24 | INFO | stdout | INFO:     127.0.0.1:38674 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 23:00:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 288. worker_id: c55289b4. 
2024-02-27 23:01:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 288. worker_id: c55289b4. 
2024-02-27 23:02:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 288. worker_id: c55289b4. 
2024-02-27 23:03:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 288. worker_id: c55289b4. 
2024-02-27 23:03:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 288. worker_id: c55289b4. 
2024-02-27 23:04:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 288. worker_id: c55289b4. 
2024-02-27 23:05:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 288. worker_id: c55289b4. 
2024-02-27 23:06:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 288. worker_id: c55289b4. 
2024-02-27 23:06:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 288. worker_id: c55289b4. 
2024-02-27 23:07:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 288. worker_id: c55289b4. 
2024-02-27 23:08:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 288. worker_id: c55289b4. 
2024-02-27 23:09:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 288. worker_id: c55289b4. 
2024-02-27 23:09:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 288. worker_id: c55289b4. 
2024-02-27 23:10:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 288. worker_id: c55289b4. 
2024-02-27 23:11:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 288. worker_id: c55289b4. 
2024-02-27 23:12:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 288. worker_id: c55289b4. 
2024-02-27 23:12:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 288. worker_id: c55289b4. 
2024-02-27 23:13:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 288. worker_id: c55289b4. 
2024-02-27 23:14:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 288. worker_id: c55289b4. 
2024-02-27 23:15:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 288. worker_id: c55289b4. 
2024-02-27 23:15:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 288. worker_id: c55289b4. 
2024-02-27 23:16:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 288. worker_id: c55289b4. 
2024-02-27 23:17:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 288. worker_id: c55289b4. 
2024-02-27 23:18:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 288. worker_id: c55289b4. 
2024-02-27 23:18:18 | INFO | stdout | INFO:     127.0.0.1:54524 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 23:18:32 | INFO | stdout | INFO:     127.0.0.1:59020 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 23:18:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 289. worker_id: c55289b4. 
2024-02-27 23:19:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 289. worker_id: c55289b4. 
2024-02-27 23:20:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 289. worker_id: c55289b4. 
2024-02-27 23:21:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 289. worker_id: c55289b4. 
2024-02-27 23:21:41 | INFO | stdout | INFO:     127.0.0.1:50850 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 23:21:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 289. worker_id: c55289b4. 
2024-02-27 23:22:07 | INFO | stdout | INFO:     127.0.0.1:55318 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 23:22:20 | INFO | stdout | INFO:     127.0.0.1:36182 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 23:22:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:23:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:24:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:24:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:25:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:26:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:27:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:27:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:28:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:29:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:30:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:30:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:31:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:32:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:33:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:33:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:34:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:35:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:36:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:36:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:37:06 | INFO | stdout | INFO:     127.0.0.1:33354 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 23:37:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:38:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:39:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:39:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:40:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:41:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:42:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:42:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:43:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:44:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:45:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 291. worker_id: c55289b4. 
2024-02-27 23:45:05 | INFO | stdout | INFO:     127.0.0.1:43454 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 23:45:25 | INFO | stdout | INFO:     127.0.0.1:34330 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 23:45:32 | INFO | stdout | INFO:     127.0.0.1:34338 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 23:45:36 | INFO | stdout | INFO:     127.0.0.1:36394 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 23:45:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 293. worker_id: c55289b4. 
2024-02-27 23:45:50 | INFO | stdout | INFO:     127.0.0.1:34538 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-27 23:46:09 | INFO | stdout | INFO:     127.0.0.1:55030 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 23:46:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-27 23:47:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-27 23:48:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-27 23:48:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-27 23:49:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-27 23:50:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-27 23:51:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-27 23:51:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-27 23:52:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-27 23:53:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-27 23:54:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-27 23:54:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-27 23:54:57 | INFO | stdout | INFO:     127.0.0.1:46640 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-27 23:55:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-27 23:56:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-27 23:57:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-27 23:57:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-27 23:58:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-27 23:59:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:00:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:00:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:01:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:02:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:03:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:03:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:04:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:05:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:06:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:06:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:07:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:08:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:09:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:09:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:10:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:11:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:12:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:12:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:13:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:14:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:15:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:15:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:16:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:17:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:18:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:18:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:19:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:20:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:21:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:21:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:22:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:23:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:24:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:24:49 | INFO | stdout | INFO:     127.0.0.1:45324 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 00:24:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 294. worker_id: c55289b4. 
2024-02-28 00:25:14 | INFO | stdout | INFO:     127.0.0.1:44186 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 00:25:30 | INFO | stdout | INFO:     127.0.0.1:57030 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 00:25:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 296. worker_id: c55289b4. 
2024-02-28 00:26:02 | INFO | stdout | INFO:     127.0.0.1:45630 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 00:26:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:27:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:27:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:28:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:29:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:30:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:30:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:31:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:32:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:33:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:33:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:34:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:35:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:36:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:36:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:37:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:38:05 | INFO | stdout | INFO:     127.0.0.1:36866 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 00:38:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:39:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:39:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:40:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:41:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:42:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:42:18 | INFO | stdout | INFO:     127.0.0.1:52664 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 00:42:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:43:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:44:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:45:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:45:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:46:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:47:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:48:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:48:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:49:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:49:43 | INFO | stdout | INFO:     127.0.0.1:39324 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 00:50:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:51:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 297. worker_id: c55289b4. 
2024-02-28 00:51:12 | INFO | stdout | INFO:     127.0.0.1:57538 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 00:51:49 | INFO | stdout | INFO:     127.0.0.1:39692 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 00:51:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 298. worker_id: c55289b4. 
2024-02-28 00:52:26 | INFO | stdout | INFO:     127.0.0.1:52298 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 00:52:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 299. worker_id: c55289b4. 
2024-02-28 00:52:45 | INFO | stdout | INFO:     127.0.0.1:39780 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 00:53:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 300. worker_id: c55289b4. 
2024-02-28 00:53:46 | INFO | stdout | INFO:     127.0.0.1:45986 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 00:54:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 301. worker_id: c55289b4. 
2024-02-28 00:54:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 301. worker_id: c55289b4. 
2024-02-28 00:54:59 | INFO | stdout | INFO:     127.0.0.1:35648 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 00:55:02 | INFO | stdout | INFO:     127.0.0.1:35662 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 00:55:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 302. worker_id: c55289b4. 
2024-02-28 00:55:44 | INFO | stdout | INFO:     127.0.0.1:36804 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 00:56:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 303. worker_id: c55289b4. 
2024-02-28 00:57:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 303. worker_id: c55289b4. 
2024-02-28 00:57:18 | INFO | stdout | INFO:     127.0.0.1:46256 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 00:57:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 304. worker_id: c55289b4. 
2024-02-28 00:58:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 304. worker_id: c55289b4. 
2024-02-28 00:59:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 304. worker_id: c55289b4. 
2024-02-28 00:59:41 | INFO | stdout | INFO:     127.0.0.1:54572 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 00:59:59 | INFO | stdout | INFO:     127.0.0.1:37184 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 01:00:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 305. worker_id: c55289b4. 
2024-02-28 01:00:44 | INFO | stdout | INFO:     127.0.0.1:39826 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 01:00:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 306. worker_id: c55289b4. 
2024-02-28 01:01:05 | INFO | stdout | INFO:     127.0.0.1:44000 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 01:01:21 | INFO | stdout | INFO:     127.0.0.1:38060 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 01:01:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:02:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:03:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:03:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:04:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:05:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:06:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:06:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:07:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:08:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:09:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:09:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:10:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:11:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:12:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:12:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:13:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:14:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:15:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:15:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:16:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:17:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:18:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:18:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:19:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:20:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 308. worker_id: c55289b4. 
2024-02-28 01:20:46 | INFO | stdout | INFO:     127.0.0.1:51814 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 01:21:01 | INFO | stdout | INFO:     127.0.0.1:55128 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 01:21:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 309. worker_id: c55289b4. 
2024-02-28 01:21:22 | INFO | stdout | INFO:     127.0.0.1:36126 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 01:21:22 | INFO | stdout | INFO:     127.0.0.1:36136 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 01:21:35 | INFO | stdout | INFO:     127.0.0.1:53090 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 01:21:51 | INFO | stdout | INFO:     127.0.0.1:49752 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 01:21:52 | INFO | stdout | INFO:     127.0.0.1:49768 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 01:21:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 313. worker_id: c55289b4. 
2024-02-28 01:22:04 | INFO | stdout | INFO:     127.0.0.1:39940 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 01:22:22 | INFO | stdout | INFO:     127.0.0.1:41872 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 01:22:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 315. worker_id: c55289b4. 
2024-02-28 01:22:46 | INFO | stdout | INFO:     127.0.0.1:50362 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 01:22:50 | INFO | stdout | INFO:     127.0.0.1:50376 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 01:23:03 | INFO | stdout | INFO:     127.0.0.1:55518 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 01:23:17 | INFO | stdout | INFO:     127.0.0.1:50900 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 01:23:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 317. worker_id: c55289b4. 
2024-02-28 01:24:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 317. worker_id: c55289b4. 
2024-02-28 01:24:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 317. worker_id: c55289b4. 
2024-02-28 01:25:36 | INFO | stdout | INFO:     127.0.0.1:36078 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 01:25:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 317. worker_id: c55289b4. 
2024-02-28 01:25:56 | INFO | stdout | INFO:     127.0.0.1:48060 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 01:26:23 | INFO | stdout | INFO:     127.0.0.1:48822 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 01:26:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 319. worker_id: c55289b4. 
2024-02-28 01:26:51 | INFO | stdout | INFO:     127.0.0.1:44208 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 01:27:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 320. worker_id: c55289b4. 
2024-02-28 01:27:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 320. worker_id: c55289b4. 
2024-02-28 01:28:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 320. worker_id: c55289b4. 
2024-02-28 01:29:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 320. worker_id: c55289b4. 
2024-02-28 01:30:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 320. worker_id: c55289b4. 
2024-02-28 01:30:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 320. worker_id: c55289b4. 
2024-02-28 01:31:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 320. worker_id: c55289b4. 
2024-02-28 01:32:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 320. worker_id: c55289b4. 
2024-02-28 01:33:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 320. worker_id: c55289b4. 
2024-02-28 01:33:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 320. worker_id: c55289b4. 
2024-02-28 01:34:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 320. worker_id: c55289b4. 
2024-02-28 01:35:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 320. worker_id: c55289b4. 
2024-02-28 01:36:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 320. worker_id: c55289b4. 
2024-02-28 01:36:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 320. worker_id: c55289b4. 
2024-02-28 01:37:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 320. worker_id: c55289b4. 
2024-02-28 01:38:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 320. worker_id: c55289b4. 
2024-02-28 01:39:02 | INFO | stdout | INFO:     127.0.0.1:60710 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 01:39:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 320. worker_id: c55289b4. 
2024-02-28 01:39:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 320. worker_id: c55289b4. 
2024-02-28 01:40:04 | INFO | stdout | INFO:     127.0.0.1:57860 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 01:40:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 320. worker_id: c55289b4. 
2024-02-28 01:41:05 | INFO | stdout | INFO:     127.0.0.1:46248 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 01:41:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 320. worker_id: c55289b4. 
2024-02-28 01:42:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 320. worker_id: c55289b4. 
2024-02-28 01:42:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 320. worker_id: c55289b4. 
2024-02-28 01:43:41 | INFO | stdout | INFO:     127.0.0.1:40488 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 01:43:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 320. worker_id: c55289b4. 
2024-02-28 01:44:05 | INFO | stdout | INFO:     127.0.0.1:46942 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 01:44:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 321. worker_id: c55289b4. 
2024-02-28 01:44:27 | INFO | stdout | INFO:     127.0.0.1:51622 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 01:45:04 | INFO | stdout | INFO:     127.0.0.1:55360 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 01:45:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 323. worker_id: c55289b4. 
2024-02-28 01:45:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 323. worker_id: c55289b4. 
2024-02-28 01:46:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 323. worker_id: c55289b4. 
2024-02-28 01:47:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 323. worker_id: c55289b4. 
2024-02-28 01:48:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 323. worker_id: c55289b4. 
2024-02-28 01:48:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 323. worker_id: c55289b4. 
2024-02-28 01:49:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 323. worker_id: c55289b4. 
2024-02-28 01:50:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 323. worker_id: c55289b4. 
2024-02-28 01:51:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 323. worker_id: c55289b4. 
2024-02-28 01:51:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 323. worker_id: c55289b4. 
2024-02-28 01:52:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 323. worker_id: c55289b4. 
2024-02-28 01:52:58 | INFO | stdout | INFO:     127.0.0.1:41376 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 01:53:12 | INFO | stdout | INFO:     127.0.0.1:54230 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 01:53:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 324. worker_id: c55289b4. 
2024-02-28 01:53:33 | INFO | stdout | INFO:     127.0.0.1:37110 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 01:54:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 324. worker_id: c55289b4. 
2024-02-28 01:54:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 324. worker_id: c55289b4. 
2024-02-28 01:55:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 324. worker_id: c55289b4. 
2024-02-28 01:56:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 324. worker_id: c55289b4. 
2024-02-28 01:57:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 324. worker_id: c55289b4. 
2024-02-28 01:57:16 | INFO | stdout | INFO:     127.0.0.1:38304 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 01:57:27 | INFO | stdout | INFO:     127.0.0.1:55938 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 01:57:48 | INFO | stdout | INFO:     127.0.0.1:45024 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 01:57:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 326. worker_id: c55289b4. 
2024-02-28 01:58:19 | INFO | stdout | INFO:     127.0.0.1:42842 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 01:58:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 327. worker_id: c55289b4. 
2024-02-28 01:58:44 | INFO | stdout | INFO:     127.0.0.1:43276 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 01:59:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 328. worker_id: c55289b4. 
2024-02-28 02:00:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 328. worker_id: c55289b4. 
2024-02-28 02:00:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 328. worker_id: c55289b4. 
2024-02-28 02:01:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 328. worker_id: c55289b4. 
2024-02-28 02:02:02 | INFO | stdout | INFO:     127.0.0.1:42352 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 02:02:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 328. worker_id: c55289b4. 
2024-02-28 02:02:53 | INFO | stdout | INFO:     127.0.0.1:53442 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 02:03:07 | INFO | stdout | INFO:     127.0.0.1:54290 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 02:03:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 329. worker_id: c55289b4. 
2024-02-28 02:03:22 | INFO | stdout | INFO:     127.0.0.1:52346 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 02:03:54 | INFO | stdout | INFO:     127.0.0.1:41356 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 02:03:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 331. worker_id: c55289b4. 
2024-02-28 02:04:27 | INFO | stdout | INFO:     127.0.0.1:42206 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 02:04:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 332. worker_id: c55289b4. 
2024-02-28 02:05:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 332. worker_id: c55289b4. 
2024-02-28 02:06:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 332. worker_id: c55289b4. 
2024-02-28 02:06:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 332. worker_id: c55289b4. 
2024-02-28 02:07:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 332. worker_id: c55289b4. 
2024-02-28 02:08:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 332. worker_id: c55289b4. 
2024-02-28 02:09:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 332. worker_id: c55289b4. 
2024-02-28 02:09:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 332. worker_id: c55289b4. 
2024-02-28 02:10:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 332. worker_id: c55289b4. 
2024-02-28 02:11:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 332. worker_id: c55289b4. 
2024-02-28 02:12:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 332. worker_id: c55289b4. 
2024-02-28 02:12:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 332. worker_id: c55289b4. 
2024-02-28 02:13:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 332. worker_id: c55289b4. 
2024-02-28 02:14:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 332. worker_id: c55289b4. 
2024-02-28 02:15:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 332. worker_id: c55289b4. 
2024-02-28 02:15:24 | INFO | stdout | INFO:     127.0.0.1:36106 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 02:15:51 | INFO | stdout | INFO:     127.0.0.1:45810 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 02:15:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 332. worker_id: c55289b4. 
2024-02-28 02:16:04 | INFO | stdout | INFO:     127.0.0.1:43606 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 02:16:14 | INFO | stdout | INFO:     127.0.0.1:36882 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 02:16:35 | INFO | stdout | INFO:     127.0.0.1:53624 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 02:16:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 335. worker_id: c55289b4. 
2024-02-28 02:16:58 | INFO | stdout | INFO:     127.0.0.1:43886 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 02:17:25 | INFO | stdout | INFO:     127.0.0.1:41180 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 02:17:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 336. worker_id: c55289b4. 
2024-02-28 02:17:47 | INFO | stdout | INFO:     127.0.0.1:36752 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 02:18:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 337. worker_id: c55289b4. 
2024-02-28 02:18:50 | INFO | stdout | INFO:     127.0.0.1:36030 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 02:18:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 338. worker_id: c55289b4. 
2024-02-28 02:19:12 | INFO | stdout | INFO:     127.0.0.1:50656 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 02:19:24 | INFO | stdout | INFO:     127.0.0.1:40130 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 02:19:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 339. worker_id: c55289b4. 
2024-02-28 02:20:07 | INFO | stdout | INFO:     127.0.0.1:56960 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 02:20:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 340. worker_id: c55289b4. 
2024-02-28 02:20:34 | INFO | stdout | INFO:     127.0.0.1:38022 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 02:21:11 | INFO | stdout | INFO:     127.0.0.1:40004 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 02:21:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 340. worker_id: c55289b4. 
2024-02-28 02:21:38 | INFO | stdout | INFO:     127.0.0.1:33848 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 02:21:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 341. worker_id: c55289b4. 
2024-02-28 02:22:32 | INFO | stdout | INFO:     127.0.0.1:50980 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 02:22:44 | INFO | stdout | INFO:     127.0.0.1:40744 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 02:22:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 343. worker_id: c55289b4. 
2024-02-28 02:23:15 | INFO | stdout | INFO:     127.0.0.1:42436 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 02:23:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:23:52 | INFO | stdout | INFO:     127.0.0.1:46590 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 02:24:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:24:31 | INFO | stdout | INFO:     127.0.0.1:54750 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 02:25:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:25:01 | INFO | stdout | INFO:     127.0.0.1:46376 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 02:25:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:26:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:27:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:28:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:28:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:29:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:30:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:31:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:31:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:32:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:33:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:34:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:34:15 | INFO | stdout | INFO:     127.0.0.1:47804 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 02:34:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:35:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:36:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:37:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:37:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:38:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:39:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:40:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:40:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:41:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:42:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:43:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:43:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:44:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:44:34 | INFO | stdout | INFO:     127.0.0.1:39922 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 02:45:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:46:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:46:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:47:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:48:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:48:49 | INFO | stdout | INFO:     127.0.0.1:37560 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 02:49:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:49:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:50:25 | INFO | stdout | INFO:     127.0.0.1:60934 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 02:50:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:51:06 | INFO | stdout | INFO:     127.0.0.1:38786 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 02:51:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:52:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:52:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:53:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:54:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 344. worker_id: c55289b4. 
2024-02-28 02:54:35 | INFO | stdout | INFO:     127.0.0.1:56220 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 02:54:46 | INFO | stdout | INFO:     127.0.0.1:56080 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 02:54:52 | INFO | stdout | INFO:     127.0.0.1:56090 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 02:55:01 | INFO | stdout | INFO:     127.0.0.1:50056 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 02:55:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=4, locked=False). call_ct: 347. worker_id: c55289b4. 
2024-02-28 02:55:06 | INFO | stdout | INFO:     127.0.0.1:36684 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 02:55:07 | INFO | stdout | INFO:     127.0.0.1:36700 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 02:55:14 | INFO | stdout | INFO:     127.0.0.1:36710 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 02:55:24 | INFO | stdout | INFO:     127.0.0.1:48388 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 02:55:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 350. worker_id: c55289b4. 
2024-02-28 02:56:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 350. worker_id: c55289b4. 
2024-02-28 02:57:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 350. worker_id: c55289b4. 
2024-02-28 02:58:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 350. worker_id: c55289b4. 
2024-02-28 02:58:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 350. worker_id: c55289b4. 
2024-02-28 02:59:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 350. worker_id: c55289b4. 
2024-02-28 03:00:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 350. worker_id: c55289b4. 
2024-02-28 03:00:19 | INFO | stdout | INFO:     127.0.0.1:51866 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:00:27 | INFO | stdout | INFO:     127.0.0.1:53730 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:00:36 | INFO | stdout | INFO:     127.0.0.1:40614 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:00:40 | INFO | stdout | INFO:     127.0.0.1:40624 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:00:51 | INFO | stdout | INFO:     127.0.0.1:52898 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:00:55 | INFO | stdout | INFO:     127.0.0.1:47682 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:01:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 353. worker_id: c55289b4. 
2024-02-28 03:01:08 | INFO | stdout | INFO:     127.0.0.1:33846 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:01:13 | INFO | stdout | INFO:     127.0.0.1:33854 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:01:23 | INFO | stdout | INFO:     127.0.0.1:44108 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:01:25 | INFO | stdout | INFO:     127.0.0.1:35178 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:01:43 | INFO | stdout | INFO:     127.0.0.1:33212 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:01:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 358. worker_id: c55289b4. 
2024-02-28 03:02:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 358. worker_id: c55289b4. 
2024-02-28 03:03:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 358. worker_id: c55289b4. 
2024-02-28 03:04:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 358. worker_id: c55289b4. 
2024-02-28 03:04:28 | INFO | stdout | INFO:     127.0.0.1:41114 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:04:40 | INFO | stdout | INFO:     127.0.0.1:42856 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:04:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 359. worker_id: c55289b4. 
2024-02-28 03:04:59 | INFO | stdout | INFO:     127.0.0.1:36992 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:05:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 360. worker_id: c55289b4. 
2024-02-28 03:05:33 | INFO | stdout | INFO:     127.0.0.1:48898 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:06:05 | INFO | stdout | INFO:     127.0.0.1:52032 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:06:16 | INFO | stdout | INFO:     127.0.0.1:45304 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:06:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=4, locked=False). call_ct: 363. worker_id: c55289b4. 
2024-02-28 03:06:38 | INFO | stdout | INFO:     127.0.0.1:34336 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:06:42 | INFO | stdout | INFO:     127.0.0.1:34344 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:07:01 | INFO | stdout | INFO:     127.0.0.1:56084 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:07:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=4, locked=False). call_ct: 365. worker_id: c55289b4. 
2024-02-28 03:07:18 | INFO | stdout | INFO:     127.0.0.1:59604 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:07:25 | INFO | stdout | INFO:     127.0.0.1:51576 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:07:31 | INFO | stdout | INFO:     127.0.0.1:51586 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:07:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 367. worker_id: c55289b4. 
2024-02-28 03:07:59 | INFO | stdout | INFO:     127.0.0.1:35228 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:08:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 368. worker_id: c55289b4. 
2024-02-28 03:08:34 | INFO | stdout | INFO:     127.0.0.1:34578 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:08:44 | INFO | stdout | INFO:     127.0.0.1:48750 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:08:48 | INFO | stdout | INFO:     127.0.0.1:45958 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:08:54 | INFO | stdout | INFO:     127.0.0.1:45974 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:09:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 370. worker_id: c55289b4. 
2024-02-28 03:09:56 | INFO | stdout | INFO:     127.0.0.1:38206 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:10:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 370. worker_id: c55289b4. 
2024-02-28 03:10:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 370. worker_id: c55289b4. 
2024-02-28 03:11:27 | INFO | stdout | INFO:     127.0.0.1:36612 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:11:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 370. worker_id: c55289b4. 
2024-02-28 03:12:01 | INFO | stdout | INFO:     127.0.0.1:42466 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:12:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 371. worker_id: c55289b4. 
2024-02-28 03:12:54 | INFO | stdout | INFO:     127.0.0.1:52540 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:13:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 371. worker_id: c55289b4. 
2024-02-28 03:13:33 | INFO | stdout | INFO:     127.0.0.1:55064 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:13:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 371. worker_id: c55289b4. 
2024-02-28 03:14:32 | INFO | stdout | INFO:     127.0.0.1:58184 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:14:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 372. worker_id: c55289b4. 
2024-02-28 03:15:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 372. worker_id: c55289b4. 
2024-02-28 03:15:40 | INFO | stdout | INFO:     127.0.0.1:41642 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:16:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 372. worker_id: c55289b4. 
2024-02-28 03:16:24 | INFO | stdout | INFO:     127.0.0.1:59378 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:16:45 | INFO | stdout | INFO:     127.0.0.1:43956 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:16:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 372. worker_id: c55289b4. 
2024-02-28 03:17:33 | INFO | stdout | INFO:     127.0.0.1:36420 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:17:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=4, locked=False). call_ct: 373. worker_id: c55289b4. 
2024-02-28 03:18:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 373. worker_id: c55289b4. 
2024-02-28 03:18:24 | INFO | stdout | INFO:     127.0.0.1:59382 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:19:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 374. worker_id: c55289b4. 
2024-02-28 03:19:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 374. worker_id: c55289b4. 
2024-02-28 03:19:53 | INFO | stdout | INFO:     127.0.0.1:39446 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:19:56 | INFO | stdout | INFO:     127.0.0.1:54488 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:20:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 375. worker_id: c55289b4. 
2024-02-28 03:21:04 | INFO | stdout | INFO:     127.0.0.1:45020 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:21:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 376. worker_id: c55289b4. 
2024-02-28 03:21:25 | INFO | stdout | INFO:     127.0.0.1:54788 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:21:42 | INFO | stdout | INFO:     127.0.0.1:50300 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:22:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 378. worker_id: c55289b4. 
2024-02-28 03:22:28 | INFO | stdout | INFO:     127.0.0.1:57676 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:22:48 | INFO | stdout | INFO:     127.0.0.1:37380 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:22:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 379. worker_id: c55289b4. 
2024-02-28 03:22:52 | INFO | stdout | INFO:     127.0.0.1:37384 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:23:21 | INFO | stdout | INFO:     127.0.0.1:59620 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:23:25 | INFO | stdout | INFO:     127.0.0.1:48548 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:23:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 381. worker_id: c55289b4. 
2024-02-28 03:23:52 | INFO | stdout | INFO:     127.0.0.1:49834 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:23:54 | INFO | stdout | INFO:     127.0.0.1:49842 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:24:16 | INFO | stdout | INFO:     127.0.0.1:43292 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:24:18 | INFO | stdout | INFO:     127.0.0.1:43302 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:24:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 382. worker_id: c55289b4. 
2024-02-28 03:24:23 | INFO | stdout | INFO:     127.0.0.1:43308 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:24:31 | INFO | stdout | INFO:     127.0.0.1:46036 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:24:53 | INFO | stdout | INFO:     127.0.0.1:52930 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:25:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 385. worker_id: c55289b4. 
2024-02-28 03:25:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 385. worker_id: c55289b4. 
2024-02-28 03:26:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 385. worker_id: c55289b4. 
2024-02-28 03:27:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 385. worker_id: c55289b4. 
2024-02-28 03:27:53 | INFO | stdout | INFO:     127.0.0.1:57564 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:28:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 386. worker_id: c55289b4. 
2024-02-28 03:28:33 | INFO | stdout | INFO:     127.0.0.1:34336 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:28:42 | INFO | stdout | INFO:     127.0.0.1:59498 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:28:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 387. worker_id: c55289b4. 
2024-02-28 03:28:56 | INFO | stdout | INFO:     127.0.0.1:45474 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:29:08 | INFO | stdout | INFO:     127.0.0.1:41856 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:29:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 389. worker_id: c55289b4. 
2024-02-28 03:30:06 | INFO | stdout | INFO:     127.0.0.1:38984 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:30:09 | INFO | stdout | INFO:     127.0.0.1:38994 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:30:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 390. worker_id: c55289b4. 
2024-02-28 03:30:27 | INFO | stdout | INFO:     127.0.0.1:49964 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:31:00 | INFO | stdout | INFO:     127.0.0.1:43716 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:31:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 392. worker_id: c55289b4. 
2024-02-28 03:31:26 | INFO | stdout | INFO:     127.0.0.1:58182 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:31:29 | INFO | stdout | INFO:     127.0.0.1:58194 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:31:43 | INFO | stdout | INFO:     127.0.0.1:58588 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:31:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 394. worker_id: c55289b4. 
2024-02-28 03:32:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 394. worker_id: c55289b4. 
2024-02-28 03:33:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 394. worker_id: c55289b4. 
2024-02-28 03:34:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 394. worker_id: c55289b4. 
2024-02-28 03:34:31 | INFO | stdout | INFO:     127.0.0.1:44030 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:34:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 394. worker_id: c55289b4. 
2024-02-28 03:35:23 | INFO | stdout | INFO:     127.0.0.1:51106 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:35:31 | INFO | stdout | INFO:     127.0.0.1:54784 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:35:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 394. worker_id: c55289b4. 
2024-02-28 03:36:12 | INFO | stdout | INFO:     127.0.0.1:41288 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:36:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 395. worker_id: c55289b4. 
2024-02-28 03:37:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 395. worker_id: c55289b4. 
2024-02-28 03:37:07 | INFO | stdout | INFO:     127.0.0.1:39388 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:37:30 | INFO | stdout | INFO:     127.0.0.1:33214 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:37:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 397. worker_id: c55289b4. 
2024-02-28 03:37:58 | INFO | stdout | INFO:     127.0.0.1:43316 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:38:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 398. worker_id: c55289b4. 
2024-02-28 03:38:40 | INFO | stdout | INFO:     127.0.0.1:33010 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:39:11 | INFO | stdout | INFO:     127.0.0.1:44002 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:39:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 400. worker_id: c55289b4. 
2024-02-28 03:39:41 | INFO | stdout | INFO:     127.0.0.1:58524 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 03:39:57 | INFO | stdout | INFO:     127.0.0.1:58078 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:40:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:40:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:41:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:41:40 | INFO | stdout | INFO:     127.0.0.1:57170 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:42:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:43:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:43:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:44:23 | INFO | stdout | INFO:     127.0.0.1:40876 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 03:44:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:45:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:46:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:46:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:47:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:48:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:49:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:49:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:50:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:51:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:52:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:52:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:53:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:54:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:55:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:55:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:56:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:57:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:58:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:58:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 03:59:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:00:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:01:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:01:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:02:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:03:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:04:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:04:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:05:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:06:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:07:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:07:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:08:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:09:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:10:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:10:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:11:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:12:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:13:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:13:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:14:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:15:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:16:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:16:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:17:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:18:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:19:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:19:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:20:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:21:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:22:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:22:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:23:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:24:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:25:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:25:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:26:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:27:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:28:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:28:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:29:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:30:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:31:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:31:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:32:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:33:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:34:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:34:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:35:35 | INFO | stdout | INFO:     127.0.0.1:41436 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 04:35:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 401. worker_id: c55289b4. 
2024-02-28 04:35:45 | INFO | stdout | INFO:     127.0.0.1:34478 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 04:36:01 | INFO | stdout | INFO:     127.0.0.1:39528 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 04:36:15 | INFO | stdout | INFO:     127.0.0.1:55984 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 04:36:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 402. worker_id: c55289b4. 
2024-02-28 04:36:29 | INFO | stdout | INFO:     127.0.0.1:38390 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 04:36:40 | INFO | stdout | INFO:     127.0.0.1:47176 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 04:37:05 | INFO | stdout | INFO:     127.0.0.1:45916 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 04:37:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 405. worker_id: c55289b4. 
2024-02-28 04:37:15 | INFO | stdout | INFO:     127.0.0.1:56544 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 04:37:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 406. worker_id: c55289b4. 
2024-02-28 04:38:15 | INFO | stdout | INFO:     127.0.0.1:52212 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 04:38:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 406. worker_id: c55289b4. 
2024-02-28 04:39:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 406. worker_id: c55289b4. 
2024-02-28 04:40:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 406. worker_id: c55289b4. 
2024-02-28 04:40:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 406. worker_id: c55289b4. 
2024-02-28 04:41:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 406. worker_id: c55289b4. 
2024-02-28 04:42:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 406. worker_id: c55289b4. 
2024-02-28 04:43:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 406. worker_id: c55289b4. 
2024-02-28 04:43:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 406. worker_id: c55289b4. 
2024-02-28 04:44:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 406. worker_id: c55289b4. 
2024-02-28 04:45:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 406. worker_id: c55289b4. 
2024-02-28 04:46:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 406. worker_id: c55289b4. 
2024-02-28 04:46:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 406. worker_id: c55289b4. 
2024-02-28 04:47:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 406. worker_id: c55289b4. 
2024-02-28 04:48:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 406. worker_id: c55289b4. 
2024-02-28 04:49:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 406. worker_id: c55289b4. 
2024-02-28 04:49:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 406. worker_id: c55289b4. 
2024-02-28 04:50:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 406. worker_id: c55289b4. 
2024-02-28 04:51:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 406. worker_id: c55289b4. 
2024-02-28 04:52:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 406. worker_id: c55289b4. 
2024-02-28 04:52:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 406. worker_id: c55289b4. 
2024-02-28 04:53:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 406. worker_id: c55289b4. 
2024-02-28 04:53:48 | INFO | stdout | INFO:     127.0.0.1:54130 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 04:54:25 | INFO | stdout | INFO:     127.0.0.1:45608 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 04:54:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 407. worker_id: c55289b4. 
2024-02-28 04:54:42 | INFO | stdout | INFO:     127.0.0.1:48240 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 04:55:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 408. worker_id: c55289b4. 
2024-02-28 04:55:23 | INFO | stdout | INFO:     127.0.0.1:46550 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 04:55:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 409. worker_id: c55289b4. 
2024-02-28 04:56:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 409. worker_id: c55289b4. 
2024-02-28 04:57:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 409. worker_id: c55289b4. 
2024-02-28 04:58:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 409. worker_id: c55289b4. 
2024-02-28 04:58:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 409. worker_id: c55289b4. 
2024-02-28 04:59:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 409. worker_id: c55289b4. 
2024-02-28 05:00:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 409. worker_id: c55289b4. 
2024-02-28 05:01:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 409. worker_id: c55289b4. 
2024-02-28 05:01:36 | INFO | stdout | INFO:     127.0.0.1:41542 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 05:01:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 409. worker_id: c55289b4. 
2024-02-28 05:01:59 | INFO | stdout | INFO:     127.0.0.1:40744 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 05:02:37 | INFO | stdout | INFO:     127.0.0.1:43718 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 05:02:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 410. worker_id: c55289b4. 
2024-02-28 05:02:57 | INFO | stdout | INFO:     127.0.0.1:48544 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 05:03:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 411. worker_id: c55289b4. 
2024-02-28 05:03:29 | INFO | stdout | INFO:     127.0.0.1:52760 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 05:04:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 412. worker_id: c55289b4. 
2024-02-28 05:04:21 | INFO | stdout | INFO:     127.0.0.1:54874 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 05:04:43 | INFO | stdout | INFO:     127.0.0.1:51734 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 05:04:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 413. worker_id: c55289b4. 
2024-02-28 05:05:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 413. worker_id: c55289b4. 
2024-02-28 05:06:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 413. worker_id: c55289b4. 
2024-02-28 05:07:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 413. worker_id: c55289b4. 
2024-02-28 05:07:18 | INFO | stdout | INFO:     127.0.0.1:49506 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 05:07:29 | INFO | stdout | INFO:     127.0.0.1:43630 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 05:07:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 414. worker_id: c55289b4. 
2024-02-28 05:07:58 | INFO | stdout | INFO:     127.0.0.1:34394 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 05:08:17 | INFO | stdout | INFO:     127.0.0.1:55844 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 05:08:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 416. worker_id: c55289b4. 
2024-02-28 05:09:01 | INFO | stdout | INFO:     127.0.0.1:56126 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 05:09:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 417. worker_id: c55289b4. 
2024-02-28 05:09:28 | INFO | stdout | INFO:     127.0.0.1:50376 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 05:09:53 | INFO | stdout | INFO:     127.0.0.1:34120 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 05:10:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 419. worker_id: c55289b4. 
2024-02-28 05:10:23 | INFO | stdout | INFO:     127.0.0.1:35122 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 05:10:49 | INFO | stdout | INFO:     127.0.0.1:53998 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 05:10:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 421. worker_id: c55289b4. 
2024-02-28 05:11:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 421. worker_id: c55289b4. 
2024-02-28 05:12:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 421. worker_id: c55289b4. 
2024-02-28 05:12:28 | INFO | stdout | INFO:     127.0.0.1:56648 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 05:12:45 | INFO | stdout | INFO:     127.0.0.1:47010 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 05:13:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:13:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:14:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:15:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:16:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:16:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:17:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:18:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:19:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:19:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:20:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:21:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:22:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:22:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:23:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:24:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:25:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:25:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:26:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:27:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:28:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:28:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:29:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:30:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:30:57 | INFO | stdout | INFO:     127.0.0.1:56738 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 05:31:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:31:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:32:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:33:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:34:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:34:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:35:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:36:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:37:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:37:32 | INFO | stdout | INFO:     127.0.0.1:57982 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 05:37:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:38:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:39:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:39:49 | INFO | stdout | INFO:     127.0.0.1:50580 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 05:40:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:40:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:41:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:42:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:43:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:43:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:44:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:45:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:46:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:46:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:47:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:48:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:49:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:49:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:50:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:51:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:52:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:52:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:53:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:54:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:55:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:56:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:56:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:57:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:58:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:59:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 05:59:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 06:00:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 06:01:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 06:02:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 06:02:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 06:03:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 06:04:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 06:05:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 06:05:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 06:06:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 06:07:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 06:08:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 06:08:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 06:09:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 06:10:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 06:11:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 06:11:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 06:12:17 | INFO | stdout | INFO:     127.0.0.1:38978 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 06:12:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 423. worker_id: c55289b4. 
2024-02-28 06:12:37 | INFO | stdout | INFO:     127.0.0.1:56440 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 06:13:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 424. worker_id: c55289b4. 
2024-02-28 06:14:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 424. worker_id: c55289b4. 
2024-02-28 06:14:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 424. worker_id: c55289b4. 
2024-02-28 06:15:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 424. worker_id: c55289b4. 
2024-02-28 06:16:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 424. worker_id: c55289b4. 
2024-02-28 06:17:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 424. worker_id: c55289b4. 
2024-02-28 06:17:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 424. worker_id: c55289b4. 
2024-02-28 06:18:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 424. worker_id: c55289b4. 
2024-02-28 06:19:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 424. worker_id: c55289b4. 
2024-02-28 06:20:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 424. worker_id: c55289b4. 
2024-02-28 06:20:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 424. worker_id: c55289b4. 
2024-02-28 06:21:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 424. worker_id: c55289b4. 
2024-02-28 06:22:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 424. worker_id: c55289b4. 
2024-02-28 06:23:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 424. worker_id: c55289b4. 
2024-02-28 06:23:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 424. worker_id: c55289b4. 
2024-02-28 06:24:01 | INFO | stdout | INFO:     127.0.0.1:43344 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 06:24:25 | INFO | stdout | INFO:     127.0.0.1:54912 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 06:24:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 425. worker_id: c55289b4. 
2024-02-28 06:24:39 | INFO | stdout | INFO:     127.0.0.1:60370 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 06:25:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 426. worker_id: c55289b4. 
2024-02-28 06:26:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 426. worker_id: c55289b4. 
2024-02-28 06:26:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 426. worker_id: c55289b4. 
2024-02-28 06:27:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 426. worker_id: c55289b4. 
2024-02-28 06:28:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 426. worker_id: c55289b4. 
2024-02-28 06:29:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 426. worker_id: c55289b4. 
2024-02-28 06:29:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 426. worker_id: c55289b4. 
2024-02-28 06:30:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 426. worker_id: c55289b4. 
2024-02-28 06:31:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 426. worker_id: c55289b4. 
2024-02-28 06:32:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 426. worker_id: c55289b4. 
2024-02-28 06:32:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 426. worker_id: c55289b4. 
2024-02-28 06:33:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 426. worker_id: c55289b4. 
2024-02-28 06:34:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 426. worker_id: c55289b4. 
2024-02-28 06:35:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 426. worker_id: c55289b4. 
2024-02-28 06:35:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 426. worker_id: c55289b4. 
2024-02-28 06:36:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 426. worker_id: c55289b4. 
2024-02-28 06:37:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 426. worker_id: c55289b4. 
2024-02-28 06:38:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 426. worker_id: c55289b4. 
2024-02-28 06:38:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 426. worker_id: c55289b4. 
2024-02-28 06:39:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 426. worker_id: c55289b4. 
2024-02-28 06:40:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 426. worker_id: c55289b4. 
2024-02-28 06:41:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 426. worker_id: c55289b4. 
2024-02-28 06:41:15 | INFO | stdout | INFO:     127.0.0.1:47884 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 06:41:27 | INFO | stdout | INFO:     127.0.0.1:53166 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 06:41:42 | INFO | stdout | INFO:     127.0.0.1:42490 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 06:41:44 | INFO | stdout | INFO:     127.0.0.1:42498 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 06:41:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 428. worker_id: c55289b4. 
2024-02-28 06:42:00 | INFO | stdout | INFO:     127.0.0.1:42388 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 06:42:18 | INFO | stdout | INFO:     127.0.0.1:59110 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 06:42:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 06:43:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 06:44:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 06:44:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 06:45:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 06:46:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 06:47:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 06:47:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 06:48:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 06:49:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 06:50:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 06:50:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 06:51:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 06:52:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 06:53:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 06:53:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 06:54:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 06:55:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 06:56:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 06:56:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 06:57:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 06:58:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 06:59:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 06:59:19 | INFO | stdout | INFO:     127.0.0.1:38392 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 06:59:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 07:00:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 07:01:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 07:02:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 07:02:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 07:03:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 07:04:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 07:05:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 07:05:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 07:06:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 07:07:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 07:08:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 07:08:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 07:09:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 07:10:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 07:11:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 07:11:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 07:12:17 | INFO | stdout | INFO:     127.0.0.1:44442 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 07:12:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 07:13:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 07:14:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 07:14:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 07:15:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 07:16:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 07:17:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 430. worker_id: c55289b4. 
2024-02-28 07:17:23 | INFO | stdout | INFO:     127.0.0.1:49420 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 07:17:34 | INFO | stdout | INFO:     127.0.0.1:46560 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 07:17:53 | INFO | stdout | INFO:     127.0.0.1:51672 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 07:17:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 432. worker_id: c55289b4. 
2024-02-28 07:18:27 | INFO | stdout | INFO:     127.0.0.1:32932 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 07:18:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:19:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:20:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:20:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:21:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:22:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:23:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:23:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:24:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:25:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:26:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:26:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:27:42 | INFO | stdout | INFO:     127.0.0.1:41080 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 07:27:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:28:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:29:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:29:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:30:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:31:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:32:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:32:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:33:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:34:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:35:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:35:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:36:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:37:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:38:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:39:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:39:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:40:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:41:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:42:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:42:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:43:21 | INFO | stdout | INFO:     127.0.0.1:55068 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 07:43:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:44:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:45:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:45:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:46:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 433. worker_id: c55289b4. 
2024-02-28 07:46:32 | INFO | stdout | INFO:     127.0.0.1:45112 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 07:46:56 | INFO | stdout | INFO:     127.0.0.1:52494 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 07:47:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 434. worker_id: c55289b4. 
2024-02-28 07:47:30 | INFO | stdout | INFO:     127.0.0.1:38452 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 07:48:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 435. worker_id: c55289b4. 
2024-02-28 07:48:18 | INFO | stdout | INFO:     127.0.0.1:60300 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 07:48:38 | INFO | stdout | INFO:     127.0.0.1:41174 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 07:48:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 437. worker_id: c55289b4. 
2024-02-28 07:48:50 | INFO | stdout | INFO:     127.0.0.1:56382 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 07:49:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 438. worker_id: c55289b4. 
2024-02-28 07:50:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 438. worker_id: c55289b4. 
2024-02-28 07:50:57 | INFO | stdout | INFO:     127.0.0.1:57812 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 07:51:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 438. worker_id: c55289b4. 
2024-02-28 07:51:43 | INFO | stdout | INFO:     127.0.0.1:46018 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 07:51:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 438. worker_id: c55289b4. 
2024-02-28 07:51:55 | INFO | stdout | INFO:     127.0.0.1:45352 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 07:52:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 439. worker_id: c55289b4. 
2024-02-28 07:52:52 | INFO | stdout | INFO:     127.0.0.1:36858 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 07:53:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 439. worker_id: c55289b4. 
2024-02-28 07:53:38 | INFO | stdout | INFO:     127.0.0.1:35868 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 07:53:48 | INFO | stdout | INFO:     127.0.0.1:43800 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 07:54:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 440. worker_id: c55289b4. 
2024-02-28 07:54:13 | INFO | stdout | INFO:     127.0.0.1:43808 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 07:54:46 | INFO | stdout | INFO:     127.0.0.1:41454 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 07:54:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 441. worker_id: c55289b4. 
2024-02-28 07:54:56 | INFO | stdout | INFO:     127.0.0.1:41244 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 07:55:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 07:56:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 07:56:49 | INFO | stdout | INFO:     127.0.0.1:37660 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 07:57:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 07:57:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 07:58:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 07:58:54 | INFO | stdout | INFO:     127.0.0.1:40876 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 07:59:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:00:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:00:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:01:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:02:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:03:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:03:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:04:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:05:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:06:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:06:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:07:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:08:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:09:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:09:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:10:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:11:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:12:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:12:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:13:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:14:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:15:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:15:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:16:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:17:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:18:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:18:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:19:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:20:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:21:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:21:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:22:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:23:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:24:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:24:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:25:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:26:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:27:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:27:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:28:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:29:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:30:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:30:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:31:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:32:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:33:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:33:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:34:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:35:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:36:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:36:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:37:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:38:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:39:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:39:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:40:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:41:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:42:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:42:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:43:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:44:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:45:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:45:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:46:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:47:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:48:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:48:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:49:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:50:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:51:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:51:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:52:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:53:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:54:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:54:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:55:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:56:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:57:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:57:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:58:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 08:59:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 09:00:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 09:00:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 09:01:09 | INFO | stdout | INFO:     127.0.0.1:54270 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 09:01:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 09:02:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 09:03:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 09:03:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 09:04:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 442. worker_id: c55289b4. 
2024-02-28 09:04:49 | INFO | stdout | INFO:     127.0.0.1:46012 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 09:05:08 | INFO | stdout | INFO:     127.0.0.1:45694 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 09:05:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:06:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:06:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:07:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:08:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:09:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:09:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:10:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:11:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:12:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:12:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:13:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:14:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:15:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:15:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:16:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:17:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:18:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:18:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:19:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:20:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:21:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:21:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:22:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:23:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:24:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:24:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:25:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:26:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:27:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:27:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:28:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:29:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:30:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:30:28 | INFO | stdout | INFO:     127.0.0.1:46972 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 09:30:34 | INFO | stdout | INFO:     127.0.0.1:46984 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 09:30:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:31:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:32:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:33:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:33:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:34:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:35:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:36:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:36:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:37:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:38:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:39:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:39:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:40:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:40:50 | INFO | stdout | INFO:     127.0.0.1:57238 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 09:41:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 443. worker_id: c55289b4. 
2024-02-28 09:42:01 | INFO | stdout | INFO:     127.0.0.1:38308 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 09:42:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 444. worker_id: c55289b4. 
2024-02-28 09:42:21 | INFO | stdout | INFO:     127.0.0.1:49768 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 09:42:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 445. worker_id: c55289b4. 
2024-02-28 09:43:17 | INFO | stdout | INFO:     127.0.0.1:39044 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 09:43:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 446. worker_id: c55289b4. 
2024-02-28 09:43:48 | INFO | stdout | INFO:     127.0.0.1:52038 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 09:44:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 447. worker_id: c55289b4. 
2024-02-28 09:45:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 447. worker_id: c55289b4. 
2024-02-28 09:45:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 447. worker_id: c55289b4. 
2024-02-28 09:46:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 447. worker_id: c55289b4. 
2024-02-28 09:47:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 447. worker_id: c55289b4. 
2024-02-28 09:48:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 447. worker_id: c55289b4. 
2024-02-28 09:48:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 447. worker_id: c55289b4. 
2024-02-28 09:49:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 447. worker_id: c55289b4. 
2024-02-28 09:50:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 447. worker_id: c55289b4. 
2024-02-28 09:51:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 447. worker_id: c55289b4. 
2024-02-28 09:51:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 447. worker_id: c55289b4. 
2024-02-28 09:52:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 447. worker_id: c55289b4. 
2024-02-28 09:53:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 447. worker_id: c55289b4. 
2024-02-28 09:54:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 447. worker_id: c55289b4. 
2024-02-28 09:54:18 | INFO | stdout | INFO:     127.0.0.1:46132 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 09:54:32 | INFO | stdout | INFO:     127.0.0.1:39556 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 09:54:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 448. worker_id: c55289b4. 
2024-02-28 09:55:27 | INFO | stdout | INFO:     127.0.0.1:44754 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 09:55:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 449. worker_id: c55289b4. 
2024-02-28 09:56:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 449. worker_id: c55289b4. 
2024-02-28 09:56:45 | INFO | stdout | INFO:     127.0.0.1:55650 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 09:57:00 | INFO | stdout | INFO:     127.0.0.1:58140 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 09:57:09 | INFO | stdout | INFO:     127.0.0.1:50992 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 09:57:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 450. worker_id: c55289b4. 
2024-02-28 09:57:15 | INFO | stdout | INFO:     127.0.0.1:46908 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 09:57:26 | INFO | stdout | INFO:     127.0.0.1:40986 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 09:57:42 | INFO | stdout | INFO:     127.0.0.1:47740 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 09:57:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 452. worker_id: c55289b4. 
2024-02-28 09:58:04 | INFO | stdout | INFO:     127.0.0.1:36154 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 09:58:12 | INFO | stdout | INFO:     127.0.0.1:38434 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 09:58:20 | INFO | stdout | INFO:     127.0.0.1:51464 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 09:58:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 454. worker_id: c55289b4. 
2024-02-28 09:58:49 | INFO | stdout | INFO:     127.0.0.1:46240 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 09:58:50 | INFO | stdout | INFO:     127.0.0.1:46252 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 09:59:00 | INFO | stdout | INFO:     127.0.0.1:42276 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 09:59:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 456. worker_id: c55289b4. 
2024-02-28 09:59:41 | INFO | stdout | INFO:     127.0.0.1:52612 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 09:59:48 | INFO | stdout | INFO:     127.0.0.1:36380 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 10:00:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:00:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:01:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:02:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:03:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:03:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:04:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:05:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:06:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:06:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:07:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:08:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:09:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:10:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:10:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:11:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:12:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:13:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:13:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:14:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:15:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:16:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:16:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:17:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:18:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:19:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:19:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:19:57 | INFO | stdout | INFO:     127.0.0.1:32916 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 10:20:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:21:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:22:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:22:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:23:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:24:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:25:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:25:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:26:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:27:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:27:32 | INFO | stdout | INFO:     127.0.0.1:50238 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 10:28:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:28:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:29:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:30:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:31:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 457. worker_id: c55289b4. 
2024-02-28 10:31:31 | INFO | stdout | INFO:     127.0.0.1:60738 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 10:31:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 458. worker_id: c55289b4. 
2024-02-28 10:31:51 | INFO | stdout | INFO:     127.0.0.1:51700 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 10:32:03 | INFO | stdout | INFO:     127.0.0.1:48180 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 10:32:20 | INFO | stdout | INFO:     127.0.0.1:32844 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 10:32:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:33:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:34:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:34:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:35:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:36:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:37:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:37:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:38:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:39:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:40:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:40:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:41:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:42:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:43:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:43:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:44:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:45:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:46:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:46:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:47:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:48:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:49:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:49:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:50:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:51:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:52:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:52:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:53:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:54:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:55:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:55:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:56:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:57:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 461. worker_id: c55289b4. 
2024-02-28 10:57:28 | INFO | stdout | INFO:     127.0.0.1:39016 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 10:57:37 | INFO | stdout | INFO:     127.0.0.1:43968 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 10:58:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 10:58:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 10:59:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 11:00:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 11:01:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 11:01:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 11:02:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 11:03:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 11:04:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 11:04:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 11:05:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 11:06:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 11:07:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 11:07:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 11:08:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 11:09:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 11:10:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 11:10:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 11:11:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 11:12:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 11:13:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 11:13:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 11:14:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 11:15:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 11:16:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 11:16:40 | INFO | stdout | INFO:     127.0.0.1:48082 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 11:16:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 462. worker_id: c55289b4. 
2024-02-28 11:16:53 | INFO | stdout | INFO:     127.0.0.1:48990 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 11:17:11 | INFO | stdout | INFO:     127.0.0.1:49820 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 11:17:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 464. worker_id: c55289b4. 
2024-02-28 11:18:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 464. worker_id: c55289b4. 
2024-02-28 11:19:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 464. worker_id: c55289b4. 
2024-02-28 11:19:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 464. worker_id: c55289b4. 
2024-02-28 11:20:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 464. worker_id: c55289b4. 
2024-02-28 11:21:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 464. worker_id: c55289b4. 
2024-02-28 11:22:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 464. worker_id: c55289b4. 
2024-02-28 11:22:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 464. worker_id: c55289b4. 
2024-02-28 11:23:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 464. worker_id: c55289b4. 
2024-02-28 11:24:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 464. worker_id: c55289b4. 
2024-02-28 11:25:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 464. worker_id: c55289b4. 
2024-02-28 11:25:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 464. worker_id: c55289b4. 
2024-02-28 11:26:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 464. worker_id: c55289b4. 
2024-02-28 11:26:50 | INFO | stdout | INFO:     127.0.0.1:41476 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 11:27:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 464. worker_id: c55289b4. 
2024-02-28 11:28:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 464. worker_id: c55289b4. 
2024-02-28 11:28:13 | INFO | stdout | INFO:     127.0.0.1:59984 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 11:28:32 | INFO | stdout | INFO:     127.0.0.1:57550 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 11:28:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 466. worker_id: c55289b4. 
2024-02-28 11:29:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 466. worker_id: c55289b4. 
2024-02-28 11:30:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 466. worker_id: c55289b4. 
2024-02-28 11:31:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 466. worker_id: c55289b4. 
2024-02-28 11:31:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 466. worker_id: c55289b4. 
2024-02-28 11:32:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 466. worker_id: c55289b4. 
2024-02-28 11:33:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 466. worker_id: c55289b4. 
2024-02-28 11:34:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 466. worker_id: c55289b4. 
2024-02-28 11:34:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 466. worker_id: c55289b4. 
2024-02-28 11:35:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 466. worker_id: c55289b4. 
2024-02-28 11:36:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 466. worker_id: c55289b4. 
2024-02-28 11:37:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 466. worker_id: c55289b4. 
2024-02-28 11:37:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 466. worker_id: c55289b4. 
2024-02-28 11:38:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 466. worker_id: c55289b4. 
2024-02-28 11:39:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 466. worker_id: c55289b4. 
2024-02-28 11:40:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 466. worker_id: c55289b4. 
2024-02-28 11:40:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 466. worker_id: c55289b4. 
2024-02-28 11:41:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 466. worker_id: c55289b4. 
2024-02-28 11:42:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 466. worker_id: c55289b4. 
2024-02-28 11:43:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 466. worker_id: c55289b4. 
2024-02-28 11:43:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 466. worker_id: c55289b4. 
2024-02-28 11:44:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 466. worker_id: c55289b4. 
2024-02-28 11:45:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 466. worker_id: c55289b4. 
2024-02-28 11:46:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 466. worker_id: c55289b4. 
2024-02-28 11:46:13 | INFO | stdout | INFO:     127.0.0.1:48768 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 11:46:39 | INFO | stdout | INFO:     127.0.0.1:51378 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 11:46:53 | INFO | stdout | INFO:     127.0.0.1:37886 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 11:46:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 468. worker_id: c55289b4. 
2024-02-28 11:47:17 | INFO | stdout | INFO:     127.0.0.1:59900 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 11:47:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 469. worker_id: c55289b4. 
2024-02-28 11:47:47 | INFO | stdout | INFO:     127.0.0.1:48382 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 11:48:16 | INFO | stdout | INFO:     127.0.0.1:57444 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 11:48:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 471. worker_id: c55289b4. 
2024-02-28 11:48:48 | INFO | stdout | INFO:     127.0.0.1:48898 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 11:49:06 | INFO | stdout | INFO:     127.0.0.1:45012 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 11:49:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 473. worker_id: c55289b4. 
2024-02-28 11:49:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 473. worker_id: c55289b4. 
2024-02-28 11:50:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 473. worker_id: c55289b4. 
2024-02-28 11:51:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 473. worker_id: c55289b4. 
2024-02-28 11:52:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 473. worker_id: c55289b4. 
2024-02-28 11:52:37 | INFO | stdout | INFO:     127.0.0.1:42976 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 11:52:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 473. worker_id: c55289b4. 
2024-02-28 11:52:58 | INFO | stdout | INFO:     127.0.0.1:38046 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 11:53:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 474. worker_id: c55289b4. 
2024-02-28 11:54:19 | INFO | stdout | INFO:     127.0.0.1:60256 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 11:54:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 475. worker_id: c55289b4. 
2024-02-28 11:55:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 475. worker_id: c55289b4. 
2024-02-28 11:55:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 475. worker_id: c55289b4. 
2024-02-28 11:56:38 | INFO | stdout | INFO:     127.0.0.1:45812 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 11:56:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 476. worker_id: c55289b4. 
2024-02-28 11:57:16 | INFO | stdout | INFO:     127.0.0.1:45288 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 11:57:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 477. worker_id: c55289b4. 
2024-02-28 11:57:56 | INFO | stdout | INFO:     127.0.0.1:40726 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 11:58:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 478. worker_id: c55289b4. 
2024-02-28 11:58:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 478. worker_id: c55289b4. 
2024-02-28 11:59:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 478. worker_id: c55289b4. 
2024-02-28 12:00:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 478. worker_id: c55289b4. 
2024-02-28 12:01:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 478. worker_id: c55289b4. 
2024-02-28 12:01:13 | INFO | stdout | INFO:     127.0.0.1:42556 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 12:01:23 | INFO | stdout | INFO:     127.0.0.1:57948 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 12:01:41 | INFO | stdout | INFO:     127.0.0.1:42128 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 12:01:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 480. worker_id: c55289b4. 
2024-02-28 12:02:01 | INFO | stdout | INFO:     127.0.0.1:32896 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 12:02:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 481. worker_id: c55289b4. 
2024-02-28 12:03:01 | INFO | stdout | INFO:     127.0.0.1:42034 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 12:03:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 482. worker_id: c55289b4. 
2024-02-28 12:04:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 482. worker_id: c55289b4. 
2024-02-28 12:04:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 482. worker_id: c55289b4. 
2024-02-28 12:05:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 482. worker_id: c55289b4. 
2024-02-28 12:06:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 482. worker_id: c55289b4. 
2024-02-28 12:07:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 482. worker_id: c55289b4. 
2024-02-28 12:07:29 | INFO | stdout | INFO:     127.0.0.1:42842 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 12:07:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 482. worker_id: c55289b4. 
2024-02-28 12:08:20 | INFO | stdout | INFO:     127.0.0.1:56220 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 12:08:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 482. worker_id: c55289b4. 
2024-02-28 12:09:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 482. worker_id: c55289b4. 
2024-02-28 12:10:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 482. worker_id: c55289b4. 
2024-02-28 12:10:33 | INFO | stdout | INFO:     127.0.0.1:52440 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 12:10:41 | INFO | stdout | INFO:     127.0.0.1:55180 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 12:10:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 482. worker_id: c55289b4. 
2024-02-28 12:11:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 482. worker_id: c55289b4. 
2024-02-28 12:12:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 482. worker_id: c55289b4. 
2024-02-28 12:13:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 482. worker_id: c55289b4. 
2024-02-28 12:13:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 482. worker_id: c55289b4. 
2024-02-28 12:14:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 482. worker_id: c55289b4. 
2024-02-28 12:15:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 482. worker_id: c55289b4. 
2024-02-28 12:16:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 482. worker_id: c55289b4. 
2024-02-28 12:16:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 482. worker_id: c55289b4. 
2024-02-28 12:17:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 482. worker_id: c55289b4. 
2024-02-28 12:18:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 482. worker_id: c55289b4. 
2024-02-28 12:18:39 | INFO | stdout | INFO:     127.0.0.1:50762 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 12:18:59 | INFO | stdout | INFO:     127.0.0.1:34400 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 12:19:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:19:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:20:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:21:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:22:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:22:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:23:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:24:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:24:56 | INFO | stdout | INFO:     127.0.0.1:37376 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 12:25:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:25:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:26:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:27:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:28:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:29:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:29:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:30:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:31:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:32:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:32:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:33:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:34:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:35:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:35:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:36:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:37:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:38:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:38:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:39:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:40:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:41:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:41:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:42:03 | INFO | stdout | INFO:     127.0.0.1:57864 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 12:42:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:43:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:44:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:44:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:45:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:46:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:47:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:47:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:48:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:49:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:50:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:50:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:51:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:52:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:53:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:53:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:54:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:55:07 | INFO | stdout | INFO:     127.0.0.1:51678 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 12:55:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:56:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:56:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:57:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:58:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:59:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 12:59:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 13:00:03 | INFO | stdout | INFO:     127.0.0.1:47126 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 13:00:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 13:01:05 | INFO | stdout | INFO:     127.0.0.1:36178 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 13:01:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 13:02:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 13:02:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 13:03:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 13:04:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 13:05:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 13:05:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 13:06:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 13:07:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 13:08:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 13:08:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 13:09:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 13:10:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 13:11:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 483. worker_id: c55289b4. 
2024-02-28 13:11:16 | INFO | stdout | INFO:     127.0.0.1:49874 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 13:11:39 | INFO | stdout | INFO:     127.0.0.1:49034 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 13:11:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 484. worker_id: c55289b4. 
2024-02-28 13:12:10 | INFO | stdout | INFO:     127.0.0.1:51746 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 13:12:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 485. worker_id: c55289b4. 
2024-02-28 13:12:36 | INFO | stdout | INFO:     127.0.0.1:42770 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 13:13:17 | INFO | stdout | INFO:     127.0.0.1:37034 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 13:13:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=4, locked=False). call_ct: 487. worker_id: c55289b4. 
2024-02-28 13:13:31 | INFO | stdout | INFO:     127.0.0.1:43800 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 13:13:48 | INFO | stdout | INFO:     127.0.0.1:55350 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 13:14:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 489. worker_id: c55289b4. 
2024-02-28 13:14:22 | INFO | stdout | INFO:     127.0.0.1:34754 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 13:14:36 | INFO | stdout | INFO:     127.0.0.1:53336 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 13:14:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 491. worker_id: c55289b4. 
2024-02-28 13:15:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 491. worker_id: c55289b4. 
2024-02-28 13:16:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 491. worker_id: c55289b4. 
2024-02-28 13:17:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 491. worker_id: c55289b4. 
2024-02-28 13:17:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 491. worker_id: c55289b4. 
2024-02-28 13:18:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 491. worker_id: c55289b4. 
2024-02-28 13:19:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 491. worker_id: c55289b4. 
2024-02-28 13:20:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 491. worker_id: c55289b4. 
2024-02-28 13:20:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 491. worker_id: c55289b4. 
2024-02-28 13:21:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 491. worker_id: c55289b4. 
2024-02-28 13:22:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 491. worker_id: c55289b4. 
2024-02-28 13:23:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 491. worker_id: c55289b4. 
2024-02-28 13:23:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 491. worker_id: c55289b4. 
2024-02-28 13:24:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 491. worker_id: c55289b4. 
2024-02-28 13:25:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 491. worker_id: c55289b4. 
2024-02-28 13:26:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 491. worker_id: c55289b4. 
2024-02-28 13:26:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 491. worker_id: c55289b4. 
2024-02-28 13:27:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 491. worker_id: c55289b4. 
2024-02-28 13:28:15 | INFO | stdout | INFO:     127.0.0.1:42778 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 13:28:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 491. worker_id: c55289b4. 
2024-02-28 13:28:33 | INFO | stdout | INFO:     127.0.0.1:39088 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 13:28:46 | INFO | stdout | INFO:     127.0.0.1:56590 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 13:29:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 493. worker_id: c55289b4. 
2024-02-28 13:29:06 | INFO | stdout | INFO:     127.0.0.1:44240 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 13:29:20 | INFO | stdout | INFO:     127.0.0.1:34186 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 13:29:36 | INFO | stdout | INFO:     127.0.0.1:37576 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 13:29:47 | INFO | stdout | INFO:     127.0.0.1:57414 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 13:29:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 497. worker_id: c55289b4. 
2024-02-28 13:30:09 | INFO | stdout | INFO:     127.0.0.1:47322 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 13:30:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 498. worker_id: c55289b4. 
2024-02-28 13:31:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 498. worker_id: c55289b4. 
2024-02-28 13:32:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 498. worker_id: c55289b4. 
2024-02-28 13:32:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 498. worker_id: c55289b4. 
2024-02-28 13:33:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 498. worker_id: c55289b4. 
2024-02-28 13:34:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 498. worker_id: c55289b4. 
2024-02-28 13:35:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 498. worker_id: c55289b4. 
2024-02-28 13:35:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 498. worker_id: c55289b4. 
2024-02-28 13:36:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 498. worker_id: c55289b4. 
2024-02-28 13:37:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 498. worker_id: c55289b4. 
2024-02-28 13:38:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 498. worker_id: c55289b4. 
2024-02-28 13:38:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 498. worker_id: c55289b4. 
2024-02-28 13:39:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 498. worker_id: c55289b4. 
2024-02-28 13:40:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 498. worker_id: c55289b4. 
2024-02-28 13:41:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 498. worker_id: c55289b4. 
2024-02-28 13:41:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 498. worker_id: c55289b4. 
2024-02-28 13:42:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 498. worker_id: c55289b4. 
2024-02-28 13:43:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 498. worker_id: c55289b4. 
2024-02-28 13:43:50 | INFO | stdout | INFO:     127.0.0.1:55126 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 13:44:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 499. worker_id: c55289b4. 
2024-02-28 13:44:11 | INFO | stdout | INFO:     127.0.0.1:45622 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 13:44:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 500. worker_id: c55289b4. 
2024-02-28 13:45:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 500. worker_id: c55289b4. 
2024-02-28 13:46:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 500. worker_id: c55289b4. 
2024-02-28 13:47:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 500. worker_id: c55289b4. 
2024-02-28 13:47:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 500. worker_id: c55289b4. 
2024-02-28 13:48:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 500. worker_id: c55289b4. 
2024-02-28 13:49:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 500. worker_id: c55289b4. 
2024-02-28 13:50:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 500. worker_id: c55289b4. 
2024-02-28 13:50:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 500. worker_id: c55289b4. 
2024-02-28 13:51:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 500. worker_id: c55289b4. 
2024-02-28 13:52:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 500. worker_id: c55289b4. 
2024-02-28 13:53:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 500. worker_id: c55289b4. 
2024-02-28 13:53:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 500. worker_id: c55289b4. 
2024-02-28 13:54:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 500. worker_id: c55289b4. 
2024-02-28 13:55:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 500. worker_id: c55289b4. 
2024-02-28 13:56:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 500. worker_id: c55289b4. 
2024-02-28 13:56:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 500. worker_id: c55289b4. 
2024-02-28 13:57:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 500. worker_id: c55289b4. 
2024-02-28 13:58:17 | INFO | stdout | INFO:     127.0.0.1:53412 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 13:58:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 500. worker_id: c55289b4. 
2024-02-28 13:59:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 500. worker_id: c55289b4. 
2024-02-28 13:59:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 500. worker_id: c55289b4. 
2024-02-28 14:00:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 500. worker_id: c55289b4. 
2024-02-28 14:00:53 | INFO | stdout | INFO:     127.0.0.1:52522 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 14:01:10 | INFO | stdout | INFO:     127.0.0.1:42442 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 14:01:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:02:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:02:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:03:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:04:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:05:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:05:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:06:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:07:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:08:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:08:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:09:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:10:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:11:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:11:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:12:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:13:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:14:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:14:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:15:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:16:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:17:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:17:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:18:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:19:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:20:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 502. worker_id: c55289b4. 
2024-02-28 14:20:16 | INFO | stdout | INFO:     127.0.0.1:60278 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 14:20:45 | INFO | stdout | INFO:     127.0.0.1:35974 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 14:20:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 504. worker_id: c55289b4. 
2024-02-28 14:20:57 | INFO | stdout | INFO:     127.0.0.1:38874 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 14:21:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 505. worker_id: c55289b4. 
2024-02-28 14:22:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 505. worker_id: c55289b4. 
2024-02-28 14:23:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 505. worker_id: c55289b4. 
2024-02-28 14:23:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 505. worker_id: c55289b4. 
2024-02-28 14:24:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 505. worker_id: c55289b4. 
2024-02-28 14:25:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 505. worker_id: c55289b4. 
2024-02-28 14:26:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 505. worker_id: c55289b4. 
2024-02-28 14:26:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 505. worker_id: c55289b4. 
2024-02-28 14:27:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 505. worker_id: c55289b4. 
2024-02-28 14:28:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 505. worker_id: c55289b4. 
2024-02-28 14:29:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 505. worker_id: c55289b4. 
2024-02-28 14:29:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 505. worker_id: c55289b4. 
2024-02-28 14:30:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 505. worker_id: c55289b4. 
2024-02-28 14:31:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 505. worker_id: c55289b4. 
2024-02-28 14:32:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 505. worker_id: c55289b4. 
2024-02-28 14:32:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 505. worker_id: c55289b4. 
2024-02-28 14:33:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 505. worker_id: c55289b4. 
2024-02-28 14:34:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 505. worker_id: c55289b4. 
2024-02-28 14:35:00 | INFO | stdout | INFO:     127.0.0.1:45800 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 14:35:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:35:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:36:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:37:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:38:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:38:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:39:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:40:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:41:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:41:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:42:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:43:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:44:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:44:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:45:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:46:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:47:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:47:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:48:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:49:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:50:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:50:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:51:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:52:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:53:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:53:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:54:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:55:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:56:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:56:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:57:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:58:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:59:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 14:59:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 15:00:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 15:01:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 15:02:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 15:02:48 | INFO | stdout | INFO:     127.0.0.1:50086 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 15:02:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 15:03:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 15:04:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 15:05:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 15:05:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 15:06:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 506. worker_id: c55289b4. 
2024-02-28 15:06:41 | INFO | stdout | INFO:     127.0.0.1:56820 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 15:06:56 | INFO | stdout | INFO:     127.0.0.1:47480 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 15:07:11 | INFO | stdout | INFO:     127.0.0.1:37552 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 15:07:24 | INFO | stdout | INFO:     127.0.0.1:51360 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 15:07:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 509. worker_id: c55289b4. 
2024-02-28 15:07:32 | INFO | stdout | INFO:     127.0.0.1:46322 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 15:08:00 | INFO | stdout | INFO:     127.0.0.1:39698 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 15:08:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 511. worker_id: c55289b4. 
2024-02-28 15:08:34 | INFO | stdout | INFO:     127.0.0.1:39650 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 15:08:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 512. worker_id: c55289b4. 
2024-02-28 15:08:56 | INFO | stdout | INFO:     127.0.0.1:49224 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 15:09:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 513. worker_id: c55289b4. 
2024-02-28 15:09:49 | INFO | stdout | INFO:     127.0.0.1:37292 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 15:10:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 514. worker_id: c55289b4. 
2024-02-28 15:11:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 514. worker_id: c55289b4. 
2024-02-28 15:11:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 514. worker_id: c55289b4. 
2024-02-28 15:12:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 514. worker_id: c55289b4. 
2024-02-28 15:12:49 | INFO | stdout | INFO:     127.0.0.1:58712 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 15:12:57 | INFO | stdout | INFO:     127.0.0.1:42606 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 15:13:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 515. worker_id: c55289b4. 
2024-02-28 15:13:38 | INFO | stdout | INFO:     127.0.0.1:52718 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 15:14:00 | INFO | stdout | INFO:     127.0.0.1:35340 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 15:14:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:14:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:15:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:16:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:17:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:17:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:18:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:19:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:20:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:20:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:21:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:22:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:23:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:23:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:24:41 | INFO | stdout | INFO:     127.0.0.1:46120 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 15:24:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:25:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:26:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:26:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:27:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:28:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:29:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:29:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:30:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:31:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:32:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:32:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:33:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:34:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:35:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:35:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:36:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:37:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:38:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:38:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:39:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:40:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:41:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 517. worker_id: c55289b4. 
2024-02-28 15:41:20 | INFO | stdout | INFO:     127.0.0.1:34920 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 15:41:41 | INFO | stdout | INFO:     127.0.0.1:59826 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 15:41:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 518. worker_id: c55289b4. 
2024-02-28 15:42:05 | INFO | stdout | INFO:     127.0.0.1:42844 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 15:42:07 | INFO | stdout | INFO:     127.0.0.1:42848 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 15:42:35 | INFO | stdout | INFO:     127.0.0.1:37736 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 15:42:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 520. worker_id: c55289b4. 
2024-02-28 15:43:16 | INFO | stdout | INFO:     127.0.0.1:41290 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 15:43:27 | INFO | stdout | INFO:     127.0.0.1:42526 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 15:43:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=4, locked=False). call_ct: 522. worker_id: c55289b4. 
2024-02-28 15:43:47 | INFO | stdout | INFO:     127.0.0.1:56628 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 15:43:50 | INFO | stdout | INFO:     127.0.0.1:56642 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 15:44:05 | INFO | stdout | INFO:     127.0.0.1:60132 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 15:44:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 524. worker_id: c55289b4. 
2024-02-28 15:44:34 | INFO | stdout | INFO:     127.0.0.1:39060 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 15:44:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 15:45:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 15:46:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 15:47:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 15:47:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 15:48:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 15:49:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 15:50:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 15:51:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 15:51:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 15:52:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 15:53:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 15:54:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 15:54:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 15:55:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 15:56:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 15:57:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 15:57:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 15:58:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 15:59:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:00:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:00:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:01:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:02:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:03:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:03:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:04:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:05:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:06:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:06:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:07:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:08:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:09:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:09:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:10:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:11:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:12:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:12:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:13:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:14:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:15:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:15:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:16:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:17:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:18:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:18:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:19:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:20:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:21:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:21:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:21:59 | INFO | stdout | INFO:     127.0.0.1:60680 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 16:22:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:22:48 | INFO | stdout | INFO:     127.0.0.1:39898 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 16:23:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:24:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:24:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:25:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:26:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:27:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:27:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:28:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:29:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:30:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:30:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:31:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:32:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:33:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:33:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:34:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:35:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:36:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:36:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:37:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:38:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:39:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:39:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:40:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:41:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:42:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:42:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:43:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:44:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:45:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:45:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:46:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:47:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:48:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:48:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:49:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:50:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:51:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:51:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:52:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:53:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:54:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:54:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:55:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:56:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:57:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:57:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:58:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 16:59:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 17:00:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 17:00:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 17:01:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 17:02:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 17:03:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 17:03:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 17:04:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 17:05:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 17:05:31 | INFO | stdout | INFO:     127.0.0.1:43996 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 17:06:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 525. worker_id: c55289b4. 
2024-02-28 17:06:13 | INFO | stdout | INFO:     127.0.0.1:45112 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 17:06:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 526. worker_id: c55289b4. 
2024-02-28 17:07:27 | INFO | stdout | INFO:     127.0.0.1:57142 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 17:07:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 526. worker_id: c55289b4. 
2024-02-28 17:07:47 | INFO | stdout | INFO:     127.0.0.1:55768 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 17:08:13 | INFO | stdout | INFO:     127.0.0.1:37438 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 17:08:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:09:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:09:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:10:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:11:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:12:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:12:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:13:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:14:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:15:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:15:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:16:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:17:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:18:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:18:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:19:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:20:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:21:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:21:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:22:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:23:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:24:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:24:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:25:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:26:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:27:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:27:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:28:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:29:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:30:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:30:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:31:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:32:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:33:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:33:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:34:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:35:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:36:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:36:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:37:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:38:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:39:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:39:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:40:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:41:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:42:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:42:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:43:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:44:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:45:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:45:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:46:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:47:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:48:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:48:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:49:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:50:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:51:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:51:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:52:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:53:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:54:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:54:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:55:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:56:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:57:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:57:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:58:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 17:59:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 18:00:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 18:00:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 18:01:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 18:02:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 18:03:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 18:03:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 18:04:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 18:05:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 18:06:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 18:06:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 18:07:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 18:08:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 18:09:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 18:09:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 18:10:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 18:11:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 18:12:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 18:12:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 18:13:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 18:14:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 18:15:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 18:15:42 | INFO | stdout | INFO:     127.0.0.1:47346 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 18:15:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 528. worker_id: c55289b4. 
2024-02-28 18:16:02 | INFO | stdout | INFO:     127.0.0.1:59340 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 18:16:36 | INFO | stdout | INFO:     127.0.0.1:55490 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 18:16:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 530. worker_id: c55289b4. 
2024-02-28 18:17:22 | INFO | stdout | INFO:     127.0.0.1:60804 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 18:17:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 531. worker_id: c55289b4. 
2024-02-28 18:18:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 531. worker_id: c55289b4. 
2024-02-28 18:18:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 531. worker_id: c55289b4. 
2024-02-28 18:19:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 531. worker_id: c55289b4. 
2024-02-28 18:20:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 531. worker_id: c55289b4. 
2024-02-28 18:21:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 531. worker_id: c55289b4. 
2024-02-28 18:21:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 531. worker_id: c55289b4. 
2024-02-28 18:22:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 531. worker_id: c55289b4. 
2024-02-28 18:23:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 531. worker_id: c55289b4. 
2024-02-28 18:23:55 | INFO | stdout | INFO:     127.0.0.1:38322 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 18:24:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 531. worker_id: c55289b4. 
2024-02-28 18:24:42 | INFO | stdout | INFO:     127.0.0.1:35504 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 18:24:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:25:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:26:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:27:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:27:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:28:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:29:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:30:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:30:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:31:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:32:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:33:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:34:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:34:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:35:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:36:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:37:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:37:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:38:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:39:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:40:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:40:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:41:11 | INFO | stdout | INFO:     127.0.0.1:48088 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 18:41:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:42:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:43:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:43:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:44:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:45:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:46:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:46:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:47:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:48:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:49:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:49:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:50:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:51:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:52:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:52:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:53:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:54:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:55:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:55:01 | INFO | stdout | INFO:     127.0.0.1:36116 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 18:55:19 | INFO | stdout | INFO:     127.0.0.1:47412 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 18:55:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:56:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:57:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:58:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:58:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 18:59:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:00:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:01:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:01:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:02:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:03:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:04:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:04:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:05:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:06:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:07:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:07:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:08:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:09:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:10:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:10:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:11:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:12:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:13:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:13:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:14:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:15:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:16:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:16:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:17:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:18:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:19:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:19:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:20:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:21:08 | INFO | stdout | INFO:     127.0.0.1:50498 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 19:21:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:22:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:22:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:23:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:24:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:25:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:25:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:26:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:27:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:28:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:28:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:29:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:30:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:31:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:31:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:32:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:33:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:34:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:34:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:35:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:36:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:37:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:37:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:38:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:39:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:40:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:40:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:41:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:42:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:43:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:43:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:44:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:45:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:46:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:46:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:47:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:48:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:49:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:49:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:50:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:51:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:52:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:52:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:53:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:54:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:55:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:55:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:56:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:57:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:58:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:58:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 19:59:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:00:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:01:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:01:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:02:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:03:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:04:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:04:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:05:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:06:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:07:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:07:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:08:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:09:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:10:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:10:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:11:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:12:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:13:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:13:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:14:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:15:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:16:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:16:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:17:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:18:14 | INFO | stdout | INFO:     127.0.0.1:58802 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 20:18:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:19:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:19:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 532. worker_id: c55289b4. 
2024-02-28 20:20:03 | INFO | stdout | INFO:     127.0.0.1:53284 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 20:20:11 | INFO | stdout | INFO:     127.0.0.1:51856 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 20:20:22 | INFO | stdout | INFO:     127.0.0.1:55618 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 20:20:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 535. worker_id: c55289b4. 
2024-02-28 20:20:39 | INFO | stdout | INFO:     127.0.0.1:45654 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 20:20:56 | INFO | stdout | INFO:     127.0.0.1:38734 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 20:21:17 | INFO | stdout | INFO:     127.0.0.1:53752 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 20:21:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 537. worker_id: c55289b4. 
2024-02-28 20:21:29 | INFO | stdout | INFO:     127.0.0.1:55252 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 20:21:41 | INFO | stdout | INFO:     127.0.0.1:33496 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 20:21:56 | INFO | stdout | INFO:     127.0.0.1:36424 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 20:22:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 540. worker_id: c55289b4. 
2024-02-28 20:22:10 | INFO | stdout | INFO:     127.0.0.1:42478 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 20:22:13 | INFO | stdout | INFO:     127.0.0.1:42492 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 20:22:32 | INFO | stdout | INFO:     127.0.0.1:56216 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 20:22:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 543. worker_id: c55289b4. 
2024-02-28 20:22:59 | INFO | stdout | INFO:     127.0.0.1:57536 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 20:23:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:24:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:25:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:25:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:26:37 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:27:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:28:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:28:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:29:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:30:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:31:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:31:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:32:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:33:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:34:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:34:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:35:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:36:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:37:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:37:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:38:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:39:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:40:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:40:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:41:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:42:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:43:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:43:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:44:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:45:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:46:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:46:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:47:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:48:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:49:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:49:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:50:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:51:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:52:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:52:54 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:53:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:54:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:55:09 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:55:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:56:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:57:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:58:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:58:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 20:59:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:00:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:01:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:01:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:02:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:03:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:04:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:04:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:05:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:06:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:07:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:07:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:08:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:09:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:10:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:10:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:11:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:12:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:13:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:13:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:14:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:15:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:16:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:16:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:17:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:18:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:19:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:19:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:20:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:21:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:22:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:22:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:23:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:24:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:25:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:25:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:26:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:27:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:28:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:28:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 544. worker_id: c55289b4. 
2024-02-28 21:29:07 | INFO | stdout | INFO:     127.0.0.1:50600 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 21:29:24 | INFO | stdout | INFO:     127.0.0.1:37902 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 21:29:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:30:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:31:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:31:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:32:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:33:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:34:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:34:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:35:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:36:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:37:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:37:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:38:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:39:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:40:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:40:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:41:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:42:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:43:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:43:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:44:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:45:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:46:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:46:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:47:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:48:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:49:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:49:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:50:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:51:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:52:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:52:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:53:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:54:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:55:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:55:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:56:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:57:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:58:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:58:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 21:59:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:00:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:01:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:01:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:02:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:03:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:04:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:04:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:05:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:06:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:07:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:08:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:08:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:09:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:10:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:11:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:11:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:12:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:13:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:14:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:14:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:15:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:16:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:17:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:17:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:18:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:19:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:20:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:20:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:21:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:22:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:23:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:23:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:24:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:25:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:26:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:26:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:27:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:28:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:29:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4. 
2024-02-28 22:29:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 545. worker_id: c55289b4.