2026-10-02T17:06:53.756748092Z (APIServer pid=1) INFO:     10.0.0.224:56244 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:06:53.853523505Z (APIServer pid=1) INFO:     10.0.0.224:57800 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:06:54.535625263Z (APIServer pid=1) INFO:     10.0.0.224:51734 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:06:54.564867700Z (APIServer pid=1) INFO:     10.0.0.224:56246 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:06:54.623824413Z (APIServer pid=1) INFO:     10.0.0.224:56250 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:06:54.632203564Z (APIServer pid=1) INFO:     10.0.0.224:56254 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:06:54.967331607Z (APIServer pid=1) INFO:     10.0.0.224:56258 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:06:55.505599059Z (APIServer pid=1) INFO:     10.0.0.224:51348 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:06:55.537199183Z (APIServer pid=1) INFO:     10.0.0.224:51734 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:06:55.564913045Z (APIServer pid=1) INFO:     10.0.0.224:51382 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:06:55.979097467Z (APIServer pid=1) INFO:     10.0.0.224:51386 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:06:56.535968361Z (APIServer pid=1) INFO:     10.0.0.224:51734 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:06:56.673230688Z (APIServer pid=1) INFO:     10.0.0.224:32934 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:06:56.903014169Z (APIServer pid=1) INFO:     10.0.0.224:51332 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:06:56.924254937Z (APIServer pid=1) INFO:     10.0.0.224:32900 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:06:57.537848317Z (APIServer pid=1) INFO:     10.0.0.224:51734 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:06:58.076413931Z (APIServer pid=1) INFO:     10.0.0.224:56138 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:06:58.226251064Z (APIServer pid=1) INFO:     10.0.0.224:56146 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:06:58.380400544Z (APIServer pid=1) INFO:     10.0.0.224:51362 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:06:58.438180307Z (APIServer pid=1) INFO:     10.0.0.224:56124 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:06:58.520200487Z (APIServer pid=1) INFO:     10.0.0.224:56108 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:06:58.531141892Z (APIServer pid=1) INFO:     10.0.0.224:56100 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:06:58.536533165Z (APIServer pid=1) INFO:     10.0.0.224:51734 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:06:58.540227436Z (APIServer pid=1) INFO:     10.0.0.224:52204 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:11.931965950Z (APIServer pid=1) INFO 10-02 17:07:11 [api_utils.py:347] 
2026-10-02T17:07:11.932028278Z (APIServer pid=1) INFO 10-02 17:07:11 [api_utils.py:347]        █     █     █▄   ▄█
2026-10-02T17:07:11.932035581Z (APIServer pid=1) INFO 10-02 17:07:11 [api_utils.py:347]  ▄▄ ▄█ █     █     █ ▀▄▀ █  version 0.29.0
2026-10-02T17:07:11.932040852Z (APIServer pid=1) INFO 10-02 17:07:11 [api_utils.py:347]   █▄█▀ █     █     █     █  model   Qwen/Qwen2.5-7B-Instruct
2026-10-02T17:07:11.932046021Z (APIServer pid=1) INFO 10-02 17:07:11 [api_utils.py:347]    ▀▀  ▀▀▀▀▀ ▀▀▀▀▀ ▀     ▀
2026-10-02T17:07:11.932050710Z (APIServer pid=1) INFO 10-02 17:07:11 [api_utils.py:347] 
2026-10-02T17:07:11.939010683Z (APIServer pid=1) INFO 10-02 17:07:11 [api_utils.py:286] non-default args: {'model_tag': 'Qwen/Qwen2.5-7B-Instruct', 'host': '0.0.0.0', 'model': 'Qwen/Qwen2.5-7B-Instruct', 'revision': 'a09a35458c702b33eeacc393d103063234e8bc28', 'max_model_len': 1024, 'served_model_name': ['Qwen/Qwen2.5-7B-Instruct'], 'kv_cache_memory_bytes': 17179869184, 'enable_prefix_caching': False, 'cudagraph_metrics': True, 'max_num_seqs': 256, 'optimization_level': '2'}
2026-10-02T17:07:12.129462178Z (APIServer pid=1) INFO 10-02 17:07:12 [model.py:684] Resolved architecture: Qwen2ForCausalLM
2026-10-02T17:07:12.129819243Z (APIServer pid=1) INFO 10-02 17:07:12 [model.py:2021] Using max model len 1024
2026-10-02T17:07:12.133251578Z (APIServer pid=1) INFO 10-02 17:07:12 [kernel.py:369] Final IR op priority after setting platform defaults: IrOpPriorityConfig(rms_norm=['native'], fused_add_rms_norm=['native'])
2026-10-02T17:07:22.896842688Z (EngineCore pid=72) INFO 10-02 17:07:22 [core.py:123] Initializing a V1 LLM engine (v0.29.0) with config: model='Qwen/Qwen2.5-7B-Instruct', speculative_config=None, tokenizer='Qwen/Qwen2.5-7B-Instruct', skip_tokenizer_init=False, tokenizer_mode=auto, revision=a09a35458c702b33eeacc393d103063234e8bc28, tokenizer_revision=a09a35458c702b33eeacc393d103063234e8bc28, trust_remote_code=False, dtype=torch.bfloat16, max_seq_len=1024, download_dir=None, load_format=auto, tensor_parallel_size=1, pipeline_parallel_size=1, data_parallel_size=1, decode_context_parallel_size=1, dcp_comm_backend=ag_rs, disable_custom_all_reduce=False, quantization=None, quantization_config=None, enforce_eager=False, enable_return_routed_experts=False, kv_cache_dtype=auto, device_config=cuda, structured_outputs_config=StructuredOutputsConfig(backend='auto', disable_any_whitespace=False, disable_additional_properties=False, reasoning_parser='', reasoning_parser_plugin='', enable_in_reasoning=False), observability_config=ObservabilityConfig(show_hidden_metrics_for_version=None, otlp_traces_endpoint=None, collect_detailed_traces=None, per_request_spec_decode_metrics='none', kv_cache_metrics=False, kv_cache_metrics_sample=0.01, cudagraph_metrics=True, enable_layerwise_nvtx_tracing=False, enable_mfu_metrics=False, enable_mm_processor_stats=False, enable_logging_iteration_details=False, jit_monitor_mode='warn', jit_monitor_verbose=False), seed=0, served_model_name=Qwen/Qwen2.5-7B-Instruct, enable_prefix_caching=False, enable_chunked_prefill=True, pooler_config=None, compilation_config={'mode': <CompilationMode.VLLM_COMPILE: 3>, 'debug_dump_path': None, 'cache_dir': '', 'compile_cache_save_format': 'binary', 'backend': 'inductor', 'custom_ops': ['none'], 'ir_enable_torch_wrap': True, 'splitting_ops': ['vllm::unified_attention_with_output', 'vllm::unified_mla_attention_with_output', 'vllm::mamba_mixer2', 'vllm::mamba_mixer', 'vllm::short_conv', 'vllm::qwen4_exp_compute_ple_ngram_ids', 'vllm::qwen4_exp_ple_short_conv', 'vllm::qwen4_exp_qsa_with_output', 'vllm::linear_attention', 'vllm::qwen_gdn_attention_core', 'vllm::qwen_gdn_attention_core_fused_norm_packed', 'vllm::gdn_attention_core_xpu', 'vllm::olmo_hybrid_gdn_full_forward', 'vllm::sparse_attn_indexer', 'vllm::rocm_aiter_sparse_attn_indexer', 'vllm::deepseek_v4_attention', 'vllm::hpc_rope_norm_forward', 'vllm::unified_kv_cache_update', 'vllm::unified_mla_kv_cache_update'], 'compile_mm_encoder': False, 'cudagraph_mm_encoder': False, 'encoder_cudagraph_token_budgets': [], 'encoder_cudagraph_max_vision_items_per_batch': 0, 'encoder_cudagraph_max_frames_per_batch': None, 'compile_sizes': [], 'compile_ranges_endpoints': [2048], 'inductor_compile_config': {'enable_auto_functionalized_v2': False, 'combo_kernels': True, 'benchmark_combo_kernel': True}, 'inductor_passes': {}, 'cudagraph_mode': <CUDAGraphMode.FULL_AND_PIECEWISE: (2, 1)>, 'cudagraph_num_of_warmups': 1, 'cudagraph_capture_sizes': [1, 2, 4, 8, 16, 24, 32, 40, 48, 56, 64, 72, 80, 88, 96, 104, 112, 120, 128, 136, 144, 152, 160, 168, 176, 184, 192, 200, 208, 216, 224, 232, 240, 248, 256, 272, 288, 304, 320, 336, 352, 368, 384, 400, 416, 432, 448, 464, 480, 496, 512], 'cudagraph_copy_inputs': False, 'cudagraph_specialize_lora': True, 'use_inductor_graph_partition': False, 'pass_config': {'fuse_norm_quant': False, 'fuse_act_quant': False, 'fuse_attn_quant': False, 'enable_sp': False, 'fuse_gemm_comms': False, 'fuse_allreduce_rms': False, 'enable_qk_norm_rope_fusion': False, 'fuse_rope_kvcache_cat_mla': False, 'fuse_act_padding': False, 'fuse_qk_norm_rope_kvcache': False}, 'max_cudagraph_capture_size': 512, 'dynamic_shapes_config': {'type': <DynamicShapesType.BACKED: 'backed'>, 'evaluate_guards': False, 'assume_32_bit_indexing': False}, 'local_cache_dir': None, 'fast_moe_cold_start': False, 'static_all_moe_layers': []}, kernel_config=KernelConfig(ir_op_priority=IrOpPriorityConfig(rms_norm=['native'], fused_add_rms_norm=['native']), enable_flashinfer_autotune=True, enable_cutedsl_warmup=True, enable_jit_warmup=True, enable_bf16x3_router_gemm=False, moe_backend='auto', linear_backend='auto')
2026-10-02T17:07:25.233767376Z (EngineCore pid=72) <frozen importlib._bootstrap_external>:1297: FutureWarning: The cuda.cudart module is deprecated and will be removed in a future release, please switch to use the cuda.bindings.runtime module instead.
2026-10-02T17:07:25.233952094Z (EngineCore pid=72) <frozen importlib._bootstrap_external>:1297: FutureWarning: The cuda.nvrtc module is deprecated and will be removed in a future release, please switch to use the cuda.bindings.nvrtc module instead.
2026-10-02T17:07:25.864263152Z (EngineCore pid=72) INFO 10-02 17:07:25 [parallel_state.py:1775] world_size=1 rank=0 local_rank=0 distributed_init_method=file:///tmp/vllm_dist_0ea69f3891a1494ebb76409235977df3 backend=nccl
2026-10-02T17:07:25.872824226Z (EngineCore pid=72) INFO 10-02 17:07:25 [parallel_state.py:2119] rank 0 in world size 1 is assigned as DP rank 0, PP rank 0, PCP rank 0, TP rank 0, EP rank N/A, EPLB rank N/A
2026-10-02T17:07:25.872835787Z (EngineCore pid=72) INFO 10-02 17:07:25 [gpu_worker.py:429] Using V2 Model Runner
2026-10-02T17:07:26.778799343Z (EngineCore pid=72) INFO 10-02 17:07:26 [model_runner.py:382] Loading model from scratch...
2026-10-02T17:07:26.923418599Z (EngineCore pid=72) INFO 10-02 17:07:26 [cuda.py:492] Using FLASH_ATTN attention backend out of potential backends: ['FLASH_ATTN', 'FLASHINFER', 'TRITON_ATTN', 'FLEX_ATTENTION'].
2026-10-02T17:07:26.923743402Z (EngineCore pid=72) INFO 10-02 17:07:26 [flash_attn.py:897] Using FlashAttention version 2
2026-10-02T17:07:27.304792437Z (EngineCore pid=72) INFO 10-02 17:07:27 [weight_utils.py:863] Filesystem type for checkpoints: EXT4. Checkpoint size: 14.19 GiB. Available RAM: 52.02 GiB.
2026-10-02T17:07:27.305003345Z (EngineCore pid=72) INFO 10-02 17:07:27 [weight_utils.py:886] Auto-prefetch is disabled because the filesystem (EXT4) is not a recognized network FS (NFS/Lustre). If you want to force prefetching, start vLLM with --safetensors-load-strategy=prefetch.
2026-10-02T17:07:27.305344298Z (EngineCore pid=72) 
Loading safetensors checkpoint shards:   0% Completed | 0/4 [00:00<?, ?it/s]
2026-10-02T17:07:27.814185109Z (EngineCore pid=72) 
Loading safetensors checkpoint shards:  25% Completed | 1/4 [00:00<00:01,  1.97it/s]
2026-10-02T17:07:28.474071340Z (EngineCore pid=72) 
Loading safetensors checkpoint shards:  50% Completed | 2/4 [00:01<00:01,  1.67it/s]
2026-10-02T17:07:29.124988137Z (EngineCore pid=72) 
Loading safetensors checkpoint shards:  75% Completed | 3/4 [00:01<00:00,  1.61it/s]
2026-10-02T17:07:29.739526313Z (EngineCore pid=72) 
Loading safetensors checkpoint shards: 100% Completed | 4/4 [00:02<00:00,  1.62it/s]
2026-10-02T17:07:29.739577149Z (EngineCore pid=72) 
Loading safetensors checkpoint shards: 100% Completed | 4/4 [00:02<00:00,  1.64it/s]
2026-10-02T17:07:29.739584003Z (EngineCore pid=72) 
2026-10-02T17:07:29.876870171Z (EngineCore pid=72) INFO 10-02 17:07:29 [default_loader.py:430] Loading weights took 2.57 seconds
2026-10-02T17:07:30.508388226Z (EngineCore pid=72) INFO 10-02 17:07:30 [model_runner.py:404] Model loading took 14.29 GiB memory and 4.049787 seconds
2026-10-02T17:07:30.515757360Z (EngineCore pid=72) INFO 10-02 17:07:30 [topk_topp_sampler.py:62] Using FlashInfer for top-p & top-k sampling.
2026-10-02T17:07:30.516524458Z (EngineCore pid=72) INFO 10-02 17:07:30 [utils.py:306] Using LBNHC KV cache layout.
2026-10-02T17:07:31.321228239Z (EngineCore pid=72) INFO 10-02 17:07:31 [caching.py:343] reconstructed serializable fn from standalone compile artifacts. num_artifacts=3 num_submods=29
2026-10-02T17:07:31.330002695Z (EngineCore pid=72) INFO 10-02 17:07:31 [decorators.py:313] Directly load AOT compilation from path /root/.cache/vllm/torch_compile_cache/torch_aot_compile/d30c14480339411d6b55e721379ebd4705912059816be217501f93938fe6c390/rank_0_0/model
2026-10-02T17:07:31.330045336Z (EngineCore pid=72) INFO 10-02 17:07:31 [monitor.py:53] torch.compile took 0.18 s in total
2026-10-02T17:07:31.492749425Z (EngineCore pid=72) INFO 10-02 17:07:31 [monitor.py:81] Initial profiling/warmup run took 0.16 s
2026-10-02T17:07:32.064079993Z (EngineCore pid=72) INFO 10-02 17:07:32 [gpu_worker.py:544] Initial free memory 46.96 GiB, reserved 16.0 GiB memory for KV Cache as specified by kv_cache_memory_bytes config and skipped memory profiling. This does not respect the gpu_memory_utilization config. Only use kv_cache_memory_bytes config when you want manual control of KV cache memory size. If OOM'ed, check the difference of initial free memory between the current run and the previous run where kv_cache_memory_bytes is suggested and update it correspondingly.
2026-10-02T17:07:32.064881055Z (EngineCore pid=72) INFO 10-02 17:07:32 [kv_cache_utils.py:2032] GPU KV cache size: 299,584 tokens, Maximum concurrency for 1,024 tokens per request: 292.56x
2026-10-02T17:07:32.093438408Z (EngineCore pid=72) INFO 10-02 17:07:32 [kernel_warmup.py:124] JIT kernel warmup starting.
2026-10-02T17:07:32.093454228Z (EngineCore pid=72) INFO 10-02 17:07:32 [kernel_warmup.py:134] JIT kernel warmup finished in 0.00s.
2026-10-02T17:07:35.794594395Z (EngineCore pid=72) 
Capturing CUDA graphs (PIECEWISE):   0%|          | 0/51 [00:00<?, ?it/s]
Capturing CUDA graphs (PIECEWISE):   4%|▍         | 2/51 [00:00<00:04, 10.69it/s]
Capturing CUDA graphs (PIECEWISE):   8%|▊         | 4/51 [00:00<00:04, 11.05it/s]
Capturing CUDA graphs (PIECEWISE):  12%|█▏        | 6/51 [00:00<00:03, 11.30it/s]
Capturing CUDA graphs (PIECEWISE):  16%|█▌        | 8/51 [00:00<00:03, 11.40it/s]
Capturing CUDA graphs (PIECEWISE):  20%|█▉        | 10/51 [00:00<00:03, 11.98it/s]
Capturing CUDA graphs (PIECEWISE):  24%|██▎       | 12/51 [00:01<00:03, 12.40it/s]
Capturing CUDA graphs (PIECEWISE):  27%|██▋       | 14/51 [00:01<00:02, 12.67it/s]
Capturing CUDA graphs (PIECEWISE):  31%|███▏      | 16/51 [00:01<00:02, 12.93it/s]
Capturing CUDA graphs (PIECEWISE):  35%|███▌      | 18/51 [00:01<00:02, 14.01it/s]
Capturing CUDA graphs (PIECEWISE):  39%|███▉      | 20/51 [00:01<00:02, 15.04it/s]
Capturing CUDA graphs (PIECEWISE):  43%|████▎     | 22/51 [00:01<00:01, 15.84it/s]
Capturing CUDA graphs (PIECEWISE):  47%|████▋     | 24/51 [00:01<00:01, 16.52it/s]
Capturing CUDA graphs (PIECEWISE):  51%|█████     | 26/51 [00:01<00:01, 17.17it/s]
Capturing CUDA graphs (PIECEWISE):  55%|█████▍    | 28/51 [00:01<00:01, 17.59it/s]
Capturing CUDA graphs (PIECEWISE):  59%|█████▉    | 30/51 [00:02<00:01, 17.91it/s]
Capturing CUDA graphs (PIECEWISE):  63%|██████▎   | 32/51 [00:02<00:01, 18.19it/s]
Capturing CUDA graphs (PIECEWISE):  67%|██████▋   | 34/51 [00:02<00:00, 18.64it/s]
Capturing CUDA graphs (PIECEWISE):  71%|███████   | 36/51 [00:02<00:00, 19.02it/s]
Capturing CUDA graphs (PIECEWISE):  75%|███████▍  | 38/51 [00:02<00:00, 18.69it/s]
Capturing CUDA graphs (PIECEWISE):  80%|████████  | 41/51 [00:02<00:00, 19.30it/s]
Capturing CUDA graphs (PIECEWISE):  86%|████████▋ | 44/51 [00:02<00:00, 19.80it/s]
Capturing CUDA graphs (PIECEWISE):  92%|█████████▏| 47/51 [00:02<00:00, 20.21it/s]
Capturing CUDA graphs (PIECEWISE):  98%|█████████▊| 50/51 [00:03<00:00, 20.64it/s]
Capturing CUDA graphs (PIECEWISE): 100%|██████████| 51/51 [00:03<00:00, 16.32it/s]
2026-10-02T17:07:37.061873066Z (EngineCore pid=72) 
Capturing CUDA graphs (FULL):   0%|          | 0/35 [00:00<?, ?it/s]
Capturing CUDA graphs (FULL):   9%|▊         | 3/35 [00:00<00:01, 23.52it/s]
Capturing CUDA graphs (FULL):  17%|█▋        | 6/35 [00:00<00:01, 23.97it/s]
Capturing CUDA graphs (FULL):  26%|██▌       | 9/35 [00:00<00:01, 24.43it/s]
Capturing CUDA graphs (FULL):  34%|███▍      | 12/35 [00:00<00:00, 24.96it/s]
Capturing CUDA graphs (FULL):  43%|████▎     | 15/35 [00:00<00:00, 25.29it/s]
Capturing CUDA graphs (FULL):  51%|█████▏    | 18/35 [00:00<00:00, 26.19it/s]
Capturing CUDA graphs (FULL):  60%|██████    | 21/35 [00:00<00:00, 27.02it/s]
Capturing CUDA graphs (FULL):  69%|██████▊   | 24/35 [00:00<00:00, 27.82it/s]
Capturing CUDA graphs (FULL):  77%|███████▋  | 27/35 [00:01<00:00, 28.02it/s]
Capturing CUDA graphs (FULL):  89%|████████▊ | 31/35 [00:01<00:00, 29.21it/s]
Capturing CUDA graphs (FULL): 100%|██████████| 35/35 [00:01<00:00, 30.53it/s]
Capturing CUDA graphs (FULL): 100%|██████████| 35/35 [00:01<00:00, 27.62it/s]
2026-10-02T17:07:37.062263953Z (EngineCore pid=72) INFO 10-02 17:07:37 [model_runner.py:960] Graph capturing finished in 5 secs, took 0.52 GiB
2026-10-02T17:07:38.106628145Z (EngineCore pid=72) INFO 10-02 17:07:38 [jit_monitor.py:85] Kernel JIT monitor activated; monitored JIT compilations during inference will use mode=warn.
2026-10-02T17:07:38.500556452Z (EngineCore pid=72) INFO 10-02 17:07:38 [torch_utils.py:277] Reducing Torch threads from 28 to 1 for serving. Set OMP_NUM_THREADS in the external environment to override.
2026-10-02T17:07:38.500767459Z (EngineCore pid=72) INFO 10-02 17:07:38 [core.py:361] init engine (profile, create kv cache, warmup model) took 7.98 s (compilation: 0.18 s)
2026-10-02T17:07:39.153174435Z (EngineCore pid=72) INFO 10-02 17:07:39 [kernel.py:369] Final IR op priority after setting platform defaults: IrOpPriorityConfig(rms_norm=['native'], fused_add_rms_norm=['native'])
2026-10-02T17:07:39.183736402Z (APIServer pid=1) INFO 10-02 17:07:39 [entry.py:135] Supported tasks: ['generate']
2026-10-02T17:07:39.230632948Z (APIServer pid=1) WARNING 10-02 17:07:39 [__init__.py:44] SECURITY WARNING: Development endpoints are enabled! This should NOT be used in production!
2026-10-02T17:07:39.426039663Z (APIServer pid=1) Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
2026-10-02T17:07:39.946356755Z (APIServer pid=1) INFO 10-02 17:07:39 [hf.py:547] Detected the chat template content format to be 'string'. You can set `--chat-template-content-format` to override this.
2026-10-02T17:07:39.963167624Z (APIServer pid=1) WARNING 10-02 17:07:39 [model.py:1759] Default vLLM sampling parameters have been overridden by the model's `generation_config.json`: `{'repetition_penalty': 1.05, 'temperature': 0.7, 'top_k': 20, 'top_p': 0.8}`. If this is not intended, please relaunch vLLM instance with `--generation-config vllm`.
2026-10-02T17:07:39.985717293Z (APIServer pid=1) INFO 10-02 17:07:39 [entry.py:139] Starting vLLM server on http://0.0.0.0:8000
2026-10-02T17:07:39.985729405Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:61] Available routes are:
2026-10-02T17:07:39.985802593Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /openapi.json, Methods: HEAD, GET
2026-10-02T17:07:39.985834714Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /docs, Methods: HEAD, GET
2026-10-02T17:07:39.985839683Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /docs/oauth2-redirect, Methods: HEAD, GET
2026-10-02T17:07:39.985853258Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /redoc, Methods: HEAD, GET
2026-10-02T17:07:39.985861124Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /load, Methods: GET
2026-10-02T17:07:39.985883386Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /version, Methods: GET
2026-10-02T17:07:39.985891071Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /health, Methods: GET
2026-10-02T17:07:39.985927869Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /metrics, Methods: GET
2026-10-02T17:07:39.985977594Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /tokenize, Methods: POST
2026-10-02T17:07:39.985983024Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /detokenize, Methods: POST
2026-10-02T17:07:39.986028218Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /v1/models, Methods: GET
2026-10-02T17:07:39.986032356Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /ping, Methods: GET
2026-10-02T17:07:39.986073023Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /ping, Methods: POST
2026-10-02T17:07:39.986077241Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /invocations, Methods: POST
2026-10-02T17:07:39.986115343Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /reset_prefix_cache, Methods: POST
2026-10-02T17:07:39.986119211Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /reset_mm_cache, Methods: POST
2026-10-02T17:07:39.986190485Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /reset_encoder_cache, Methods: POST
2026-10-02T17:07:39.986195935Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /pause, Methods: POST
2026-10-02T17:07:39.986240389Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /resume, Methods: POST
2026-10-02T17:07:39.986244447Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /abort_requests, Methods: POST
2026-10-02T17:07:39.986278351Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /is_paused, Methods: GET
2026-10-02T17:07:39.986282057Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /init_weight_transfer_engine, Methods: POST
2026-10-02T17:07:39.986316132Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /start_weight_update, Methods: POST
2026-10-02T17:07:39.986355066Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /start_draft_weight_update, Methods: POST
2026-10-02T17:07:39.986360396Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /update_weights, Methods: POST
2026-10-02T17:07:39.986406072Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /finish_weight_update, Methods: POST
2026-10-02T17:07:39.986410149Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /update_weight_version, Methods: POST
2026-10-02T17:07:39.986439825Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /weight_info, Methods: GET
2026-10-02T17:07:39.986488838Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /get_world_size, Methods: GET
2026-10-02T17:07:39.986497144Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /collective_rpc, Methods: POST
2026-10-02T17:07:39.986571083Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /server_info, Methods: GET
2026-10-02T17:07:39.986601050Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /sleep, Methods: POST
2026-10-02T17:07:39.986635355Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /wake_up, Methods: POST
2026-10-02T17:07:39.986638842Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /is_sleeping, Methods: GET
2026-10-02T17:07:39.986647638Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /v1/chat/completions, Methods: POST
2026-10-02T17:07:39.986650784Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /v1/chat/completions/batch, Methods: POST
2026-10-02T17:07:39.986662807Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /v1/responses, Methods: POST
2026-10-02T17:07:39.986666503Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /v1/responses/{response_id}, Methods: GET
2026-10-02T17:07:39.986746704Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /v1/responses/{response_id}/cancel, Methods: POST
2026-10-02T17:07:39.986763547Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /v1/completions, Methods: POST
2026-10-02T17:07:39.986791319Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /v1/messages, Methods: POST
2026-10-02T17:07:39.986838237Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /v1/messages/count_tokens, Methods: POST
2026-10-02T17:07:39.986842696Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /generative_scoring, Methods: POST
2026-10-02T17:07:39.986875738Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /scale_elastic_ep, Methods: POST
2026-10-02T17:07:39.986879555Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /is_scaling_elastic_ep, Methods: POST
2026-10-02T17:07:39.986935380Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /v1/chat/completions/render, Methods: POST
2026-10-02T17:07:39.986940210Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /v1/messages/render, Methods: POST
2026-10-02T17:07:39.986968454Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /v1/completions/render, Methods: POST
2026-10-02T17:07:39.987003600Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /v1/chat/completions/derender, Methods: POST
2026-10-02T17:07:39.987007396Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /v1/completions/derender, Methods: POST
2026-10-02T17:07:39.987039487Z (APIServer pid=1) INFO 10-02 17:07:39 [launcher.py:70] Route: /inference/v1/generate, Methods: POST
2026-10-02T17:07:40.006510727Z (APIServer pid=1) INFO:     Started server process [1]
2026-10-02T17:07:40.006525184Z (APIServer pid=1) INFO:     Waiting for application startup.
2026-10-02T17:07:40.373015928Z (APIServer pid=1) INFO:     Application startup complete.
2026-10-02T17:07:40.405641077Z (APIServer pid=1) INFO:     10.0.0.224:55612 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:40.537040809Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:07:40.706344020Z (APIServer pid=1) INFO:     10.0.0.224:55634 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:40.870003812Z (APIServer pid=1) INFO:     10.0.0.224:55650 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:41.236348050Z (APIServer pid=1) INFO:     10.0.0.224:55658 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:41.536941266Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:07:41.813191389Z (APIServer pid=1) INFO:     10.0.0.224:55672 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:41.841847247Z (APIServer pid=1) INFO:     10.0.0.224:55676 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:42.345331098Z (APIServer pid=1) INFO:     10.0.0.224:55692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:42.417311514Z (APIServer pid=1) INFO:     10.0.0.224:55696 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:42.537836777Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:07:42.793137591Z (APIServer pid=1) INFO:     10.0.0.224:55708 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:43.331425602Z (APIServer pid=1) INFO:     10.0.0.224:55712 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:43.535777634Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:07:43.879357068Z (APIServer pid=1) INFO:     10.0.0.224:55714 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:44.536226622Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:07:44.546225710Z (APIServer pid=1) INFO:     10.0.0.224:55716 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:44.937890553Z (APIServer pid=1) INFO:     10.0.0.224:55724 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:45.045905000Z (APIServer pid=1) INFO:     10.0.0.224:55730 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:45.281542093Z (APIServer pid=1) INFO:     10.0.0.224:55736 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:45.517761793Z (APIServer pid=1) INFO:     10.0.0.224:55742 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:45.535472662Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:07:45.753359913Z (APIServer pid=1) INFO:     10.0.0.224:55750 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:46.358016769Z (APIServer pid=1) INFO:     10.0.0.224:55612 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:46.444307287Z (APIServer pid=1) INFO:     10.0.0.224:55756 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:46.537390481Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:07:46.878550149Z (APIServer pid=1) INFO:     10.0.0.224:55650 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:47.059294355Z (APIServer pid=1) INFO:     10.0.0.224:55658 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:47.304816689Z (APIServer pid=1) INFO:     10.0.0.224:55764 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:47.436735981Z (APIServer pid=1) INFO:     10.0.0.224:55778 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:47.534237301Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:07:47.573224144Z (APIServer pid=1) INFO:     10.0.0.224:55792 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:47.651374773Z (APIServer pid=1) INFO:     10.0.0.224:58668 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:48.134316010Z (APIServer pid=1) INFO:     10.0.0.224:55676 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:48.545323721Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:07:48.737972288Z (APIServer pid=1) INFO:     10.0.0.224:55708 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:48.758176090Z (APIServer pid=1) INFO:     10.0.0.224:55696 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:48.794581914Z (APIServer pid=1) INFO:     10.0.0.224:55692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:49.512300440Z (APIServer pid=1) INFO:     10.0.0.224:55712 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:49.536058718Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:07:50.086735142Z (APIServer pid=1) INFO:     10.0.0.224:55714 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:50.196282221Z (APIServer pid=1) INFO:     10.0.0.224:55672 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:50.323916838Z (APIServer pid=1) INFO:     10.0.0.224:58682 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:50.374435219Z (APIServer pid=1) INFO 10-02 17:07:50 [loggers.py:310] Engine 000: Avg prompt throughput: 1525.5 tokens/s, Avg generation throughput: 456.2 tokens/s, Running: 22 reqs, Waiting: 0 reqs, GPU KV cache usage: 5.0%, Prefix cache hit rate: 0.0%
2026-10-02T17:07:50.426281936Z (APIServer pid=1) INFO:     10.0.0.224:58686 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:50.535146396Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:07:50.537783432Z (APIServer pid=1) INFO:     10.0.0.224:58692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:51.099235277Z (APIServer pid=1) INFO:     10.0.0.224:55716 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:51.163610132Z (APIServer pid=1) INFO:     10.0.0.224:58706 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:51.535006511Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:07:51.814979257Z (APIServer pid=1) INFO:     10.0.0.224:55736 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:52.512311508Z (APIServer pid=1) INFO:     10.0.0.224:55750 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:52.534621103Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:07:53.162915549Z (APIServer pid=1) INFO:     10.0.0.224:55756 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:53.422115711Z (APIServer pid=1) INFO:     10.0.0.224:55650 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:53.534509772Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:07:53.668575013Z (APIServer pid=1) INFO:     10.0.0.224:55658 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:54.306238797Z (APIServer pid=1) INFO:     10.0.0.224:58668 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:54.471049760Z (APIServer pid=1) INFO:     10.0.0.224:55676 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:54.534900046Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:07:54.910974882Z (APIServer pid=1) INFO:     10.0.0.224:55792 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:54.931822419Z (APIServer pid=1) INFO:     10.0.0.224:55778 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:55.116792740Z (APIServer pid=1) INFO:     10.0.0.224:55764 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:55.414108540Z (APIServer pid=1) INFO:     10.0.0.224:55692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:55.536524099Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:07:55.889144779Z (APIServer pid=1) INFO:     10.0.0.224:55712 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:56.230850576Z (APIServer pid=1) INFO:     10.0.0.224:55696 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:56.535537954Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:07:56.586210757Z (APIServer pid=1) INFO:     10.0.0.224:55672 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:56.983476356Z (APIServer pid=1) INFO:     10.0.0.224:58692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:57.514129137Z (APIServer pid=1) INFO:     10.0.0.224:58706 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:57.535393870Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:07:57.683128712Z (APIServer pid=1) INFO:     10.0.0.224:55716 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:57.868632329Z (APIServer pid=1) INFO:     10.0.0.224:58686 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:57.935095405Z (APIServer pid=1) INFO:     10.0.0.224:58682 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:58.211078233Z (APIServer pid=1) INFO:     10.0.0.224:55736 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:58.537002251Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:07:58.634112724Z (APIServer pid=1) INFO:     10.0.0.224:55714 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:58.857057487Z (APIServer pid=1) INFO:     10.0.0.224:55750 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:58.941490127Z (APIServer pid=1) INFO:     10.0.0.224:55708 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:58.995783340Z (APIServer pid=1) INFO:     10.0.0.224:42270 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:59.132364648Z (APIServer pid=1) INFO:     10.0.0.224:42274 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:59.406745814Z (APIServer pid=1) INFO:     10.0.0.224:42286 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:59.468800702Z (APIServer pid=1) INFO:     10.0.0.224:42292 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:07:59.534877468Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:00.232906341Z (APIServer pid=1) INFO:     10.0.0.224:55658 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:00.377198648Z (APIServer pid=1) INFO 10-02 17:08:00 [loggers.py:310] Engine 000: Avg prompt throughput: 1817.8 tokens/s, Avg generation throughput: 802.6 tokens/s, Running: 23 reqs, Waiting: 0 reqs, GPU KV cache usage: 5.2%, Prefix cache hit rate: 0.0%
2026-10-02T17:08:00.536609222Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:01.147206544Z (APIServer pid=1) INFO:     10.0.0.224:55676 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:01.445412442Z (APIServer pid=1) INFO:     10.0.0.224:55778 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:01.535038263Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:01.583206268Z (APIServer pid=1) INFO:     10.0.0.224:55764 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:01.685738882Z (APIServer pid=1) INFO:     10.0.0.224:55792 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:02.336799733Z (APIServer pid=1) INFO:     10.0.0.224:55712 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:02.368408273Z (APIServer pid=1) INFO:     10.0.0.224:55692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:02.415927365Z (APIServer pid=1) INFO:     10.0.0.224:58668 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:02.537028694Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:02.758993026Z (APIServer pid=1) INFO:     10.0.0.224:55650 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:03.498360729Z (APIServer pid=1) INFO:     10.0.0.224:55672 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:03.534772011Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:03.999006890Z (APIServer pid=1) INFO:     10.0.0.224:58692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:04.500393239Z (APIServer pid=1) INFO:     10.0.0.224:58682 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:04.535530547Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:04.610446453Z (APIServer pid=1) INFO:     10.0.0.224:58686 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:04.622045688Z (APIServer pid=1) INFO:     10.0.0.224:55716 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:04.643010977Z (APIServer pid=1) INFO:     10.0.0.224:58706 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:04.927739935Z (APIServer pid=1) INFO:     10.0.0.224:55736 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:05.079306879Z (APIServer pid=1) INFO:     10.0.0.224:55696 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:05.535760455Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:05.693790474Z (APIServer pid=1) INFO:     10.0.0.224:42274 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:06.534888654Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:07.515048054Z (APIServer pid=1) INFO:     10.0.0.224:55676 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:07.535110728Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:08.007352755Z (APIServer pid=1) INFO:     10.0.0.224:55792 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:08.054521796Z (APIServer pid=1) INFO:     10.0.0.224:55764 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:08.062124741Z (APIServer pid=1) INFO:     10.0.0.224:55778 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:08.206435542Z (APIServer pid=1) INFO:     10.0.0.224:55658 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:08.230770309Z (APIServer pid=1) INFO:     10.0.0.224:42292 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:08.275917565Z (APIServer pid=1) INFO:     10.0.0.224:42286 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:08.536176863Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:08.538454852Z (APIServer pid=1) INFO:     10.0.0.224:42270 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:08.928163279Z (APIServer pid=1) INFO:     10.0.0.224:55692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:09.534293231Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:09.734046104Z (APIServer pid=1) INFO:     10.0.0.224:55650 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:10.380098953Z (APIServer pid=1) INFO 10-02 17:08:10 [loggers.py:310] Engine 000: Avg prompt throughput: 1487.3 tokens/s, Avg generation throughput: 816.3 tokens/s, Running: 17 reqs, Waiting: 0 reqs, GPU KV cache usage: 4.0%, Prefix cache hit rate: 0.0%
2026-10-02T17:08:10.448047632Z (APIServer pid=1) INFO:     10.0.0.224:58692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:10.535955430Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:10.691241389Z (APIServer pid=1) INFO:     10.0.0.224:55672 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:11.348616493Z (APIServer pid=1) INFO:     10.0.0.224:55696 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:11.350122805Z (APIServer pid=1) INFO:     10.0.0.224:55736 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:11.535077926Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:11.717474960Z (APIServer pid=1) INFO:     10.0.0.224:58706 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:11.974280511Z (APIServer pid=1) INFO:     10.0.0.224:42274 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:12.389320837Z (APIServer pid=1) INFO:     10.0.0.224:55716 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:12.447435651Z (APIServer pid=1) INFO:     10.0.0.224:58686 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:12.535779380Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:12.836203193Z (APIServer pid=1) INFO:     10.0.0.224:58682 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:12.868253898Z (APIServer pid=1) INFO:     10.0.0.224:58668 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:13.364511106Z (APIServer pid=1) INFO:     10.0.0.224:55712 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:13.445912387Z (APIServer pid=1) INFO:     10.0.0.224:33164 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:13.535171815Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:13.845334884Z (APIServer pid=1) INFO:     10.0.0.224:33180 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:13.961253555Z (APIServer pid=1) INFO:     10.0.0.224:33190 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:14.331169777Z (APIServer pid=1) INFO:     10.0.0.224:55676 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:14.534883573Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:14.665547134Z (APIServer pid=1) INFO:     10.0.0.224:55792 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:15.025238574Z (APIServer pid=1) INFO:     10.0.0.224:42270 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:15.483364585Z (APIServer pid=1) INFO:     10.0.0.224:55692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:15.535000384Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:15.575366258Z (APIServer pid=1) INFO:     10.0.0.224:55658 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:15.876125883Z (APIServer pid=1) INFO:     10.0.0.224:42286 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:15.951152737Z (APIServer pid=1) INFO:     10.0.0.224:42292 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:16.045121591Z (APIServer pid=1) INFO:     10.0.0.224:55778 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:16.112821429Z (APIServer pid=1) INFO:     10.0.0.224:55764 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:16.325216405Z (APIServer pid=1) INFO:     10.0.0.224:33204 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:16.534354164Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:16.823048233Z (APIServer pid=1) INFO:     10.0.0.224:55650 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:17.178997612Z (APIServer pid=1) INFO:     10.0.0.224:58692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:17.535228383Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:17.750126932Z (APIServer pid=1) INFO:     10.0.0.224:55672 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:17.867816083Z (APIServer pid=1) INFO:     10.0.0.224:48976 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:18.166466719Z (APIServer pid=1) INFO:     10.0.0.224:55736 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:18.476546760Z (APIServer pid=1) INFO:     10.0.0.224:58706 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:18.535822474Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:18.630022434Z (APIServer pid=1) INFO:     10.0.0.224:55696 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:18.738908474Z (APIServer pid=1) INFO:     10.0.0.224:48988 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:19.258354986Z (APIServer pid=1) INFO:     10.0.0.224:42274 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:19.535077206Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:19.702616857Z (APIServer pid=1) INFO:     10.0.0.224:58668 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:20.382441967Z (APIServer pid=1) INFO 10-02 17:08:20 [loggers.py:310] Engine 000: Avg prompt throughput: 1873.0 tokens/s, Avg generation throughput: 827.0 tokens/s, Running: 22 reqs, Waiting: 0 reqs, GPU KV cache usage: 5.2%, Prefix cache hit rate: 0.0%
2026-10-02T17:08:20.536244998Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:20.538898696Z (APIServer pid=1) INFO:     10.0.0.224:33180 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:20.559904931Z (APIServer pid=1) INFO:     10.0.0.224:33190 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:20.981028613Z (APIServer pid=1) INFO:     10.0.0.224:33164 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:21.100809782Z (APIServer pid=1) INFO:     10.0.0.224:55676 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:21.380761695Z (APIServer pid=1) INFO:     10.0.0.224:55792 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:21.426669986Z (APIServer pid=1) INFO:     10.0.0.224:55712 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:21.491942003Z (APIServer pid=1) INFO:     10.0.0.224:58682 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:21.535742158Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:21.765274930Z (APIServer pid=1) INFO:     10.0.0.224:58686 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:21.813246203Z (APIServer pid=1) INFO:     10.0.0.224:55716 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:21.889964929Z (APIServer pid=1) INFO:     10.0.0.224:48996 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:22.166628559Z (APIServer pid=1) INFO:     10.0.0.224:42270 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:22.237799497Z (APIServer pid=1) INFO:     10.0.0.224:49002 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:22.535291546Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:22.726221430Z (APIServer pid=1) INFO:     10.0.0.224:55658 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:22.782807338Z (APIServer pid=1) INFO:     10.0.0.224:55692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:22.899293920Z (APIServer pid=1) INFO:     10.0.0.224:49006 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:23.205113682Z (APIServer pid=1) INFO:     10.0.0.224:42292 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:23.316409790Z (APIServer pid=1) INFO:     10.0.0.224:55778 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:23.406731362Z (APIServer pid=1) INFO:     10.0.0.224:55764 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:23.498851729Z (APIServer pid=1) INFO:     10.0.0.224:33204 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:23.535104191Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:24.535533208Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:24.738326816Z (APIServer pid=1) INFO:     10.0.0.224:58692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:24.931237088Z (APIServer pid=1) INFO:     10.0.0.224:55650 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:25.106806939Z (APIServer pid=1) INFO:     10.0.0.224:48976 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:25.215139173Z (APIServer pid=1) INFO:     10.0.0.224:55672 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:25.369503564Z (APIServer pid=1) INFO:     10.0.0.224:42286 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:25.535896891Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:25.578583945Z (APIServer pid=1) INFO:     10.0.0.224:55736 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:26.168673358Z (APIServer pid=1) INFO:     10.0.0.224:48988 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:26.216951330Z (APIServer pid=1) INFO:     10.0.0.224:55696 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:26.535208921Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:26.789404116Z (APIServer pid=1) INFO:     10.0.0.224:42274 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:26.823460223Z (APIServer pid=1) INFO:     10.0.0.224:58706 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:27.108493915Z (APIServer pid=1) INFO:     10.0.0.224:49020 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:27.193255446Z (APIServer pid=1) INFO:     10.0.0.224:58668 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:27.534789024Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:27.537789316Z (APIServer pid=1) INFO:     10.0.0.224:49026 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:27.697913554Z (APIServer pid=1) INFO:     10.0.0.224:57442 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:28.249102336Z (APIServer pid=1) INFO:     10.0.0.224:33180 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:28.312603803Z (APIServer pid=1) INFO:     10.0.0.224:33190 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:28.534726613Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:28.746059733Z (APIServer pid=1) INFO:     10.0.0.224:33164 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:28.801971228Z (APIServer pid=1) INFO:     10.0.0.224:55676 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:29.332484210Z (APIServer pid=1) INFO:     10.0.0.224:58682 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:29.534749602Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:29.787237465Z (APIServer pid=1) INFO:     10.0.0.224:49002 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:30.382904260Z (APIServer pid=1) INFO 10-02 17:08:30 [loggers.py:310] Engine 000: Avg prompt throughput: 2148.8 tokens/s, Avg generation throughput: 974.6 tokens/s, Running: 22 reqs, Waiting: 0 reqs, GPU KV cache usage: 5.1%, Prefix cache hit rate: 0.0%
2026-10-02T17:08:30.535089468Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:30.562106875Z (APIServer pid=1) INFO:     10.0.0.224:33204 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:30.658042080Z (APIServer pid=1) INFO:     10.0.0.224:55764 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:30.850647013Z (APIServer pid=1) INFO:     10.0.0.224:55778 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:31.228160249Z (APIServer pid=1) INFO:     10.0.0.224:42292 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:31.382591645Z (APIServer pid=1) INFO:     10.0.0.224:49006 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:31.389150792Z (APIServer pid=1) INFO:     10.0.0.224:55692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:31.535052765Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:31.945140953Z (APIServer pid=1) INFO:     10.0.0.224:58692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:32.100446510Z (APIServer pid=1) INFO:     10.0.0.224:55658 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:32.535761006Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:32.727314366Z (APIServer pid=1) INFO:     10.0.0.224:55736 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:32.818653657Z (APIServer pid=1) INFO:     10.0.0.224:42286 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:33.157780244Z (APIServer pid=1) INFO:     10.0.0.224:55672 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:33.534744864Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:33.669736170Z (APIServer pid=1) INFO:     10.0.0.224:55696 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:33.856488491Z (APIServer pid=1) INFO:     10.0.0.224:58706 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:34.472367242Z (APIServer pid=1) INFO:     10.0.0.224:57442 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:34.535381289Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:34.890648580Z (APIServer pid=1) INFO:     10.0.0.224:33180 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:34.928988481Z (APIServer pid=1) INFO:     10.0.0.224:33190 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:35.535629662Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:35.729288404Z (APIServer pid=1) INFO:     10.0.0.224:58682 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:35.857371204Z (APIServer pid=1) INFO:     10.0.0.224:55676 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:35.925642492Z (APIServer pid=1) INFO:     10.0.0.224:33164 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:36.048985429Z (APIServer pid=1) INFO:     10.0.0.224:49026 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:36.535177333Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:36.618757174Z (APIServer pid=1) INFO:     10.0.0.224:49002 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:36.670735298Z (APIServer pid=1) INFO:     10.0.0.224:58668 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:37.033028676Z (APIServer pid=1) INFO:     10.0.0.224:49020 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:37.464420209Z (APIServer pid=1) INFO:     10.0.0.224:55778 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:37.535096002Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:37.690936378Z (APIServer pid=1) INFO:     10.0.0.224:55764 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:38.152808744Z (APIServer pid=1) INFO:     10.0.0.224:55692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:38.202311176Z (APIServer pid=1) INFO:     10.0.0.224:49006 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:38.536162067Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:38.594458753Z (APIServer pid=1) INFO:     10.0.0.224:58692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:39.175105638Z (APIServer pid=1) INFO:     10.0.0.224:55658 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:39.302623932Z (APIServer pid=1) INFO:     10.0.0.224:42286 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:39.336809625Z (APIServer pid=1) INFO:     10.0.0.224:55736 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:39.534517376Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:39.747718341Z (APIServer pid=1) INFO:     10.0.0.224:55672 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:39.846714190Z (APIServer pid=1) INFO:     10.0.0.224:42292 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:39.921413024Z (APIServer pid=1) INFO:     10.0.0.224:33204 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:40.163066904Z (APIServer pid=1) INFO:     10.0.0.224:60840 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:40.165018146Z (APIServer pid=1) INFO:     10.0.0.224:60842 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:40.385836353Z (APIServer pid=1) INFO 10-02 17:08:40 [loggers.py:310] Engine 000: Avg prompt throughput: 1983.0 tokens/s, Avg generation throughput: 811.7 tokens/s, Running: 25 reqs, Waiting: 0 reqs, GPU KV cache usage: 5.5%, Prefix cache hit rate: 0.0%
2026-10-02T17:08:40.535149572Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:40.598109417Z (APIServer pid=1) INFO:     10.0.0.224:55696 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:40.692639780Z (APIServer pid=1) INFO:     10.0.0.224:58706 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:40.860675565Z (APIServer pid=1) INFO:     10.0.0.224:60856 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:41.044261721Z (APIServer pid=1) INFO:     10.0.0.224:60868 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:41.259205385Z (APIServer pid=1) INFO:     10.0.0.224:60876 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:41.427936963Z (APIServer pid=1) INFO:     10.0.0.224:60884 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:41.474059999Z (APIServer pid=1) INFO:     10.0.0.224:60886 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:41.535765837Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:41.690814187Z (APIServer pid=1) INFO:     10.0.0.224:57442 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:41.923227652Z (APIServer pid=1) INFO:     10.0.0.224:60890 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:41.933816772Z (APIServer pid=1) INFO:     10.0.0.224:60894 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:41.982091920Z (APIServer pid=1) INFO:     10.0.0.224:60902 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:42.411809805Z (APIServer pid=1) INFO:     10.0.0.224:33190 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:42.453427580Z (APIServer pid=1) INFO:     10.0.0.224:33180 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:42.534868085Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:42.611891855Z (APIServer pid=1) INFO:     10.0.0.224:60916 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:42.738635390Z (APIServer pid=1) INFO:     10.0.0.224:60932 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:42.962246847Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:42.979828370Z (APIServer pid=1) INFO:     10.0.0.224:60958 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:43.537131598Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:43.601673557Z (APIServer pid=1) INFO:     10.0.0.224:55676 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:44.257438506Z (APIServer pid=1) INFO:     10.0.0.224:49026 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:44.489218276Z (APIServer pid=1) INFO:     10.0.0.224:58668 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:44.498204631Z (APIServer pid=1) INFO:     10.0.0.224:49002 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:44.535268565Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:45.211439975Z (APIServer pid=1) INFO:     10.0.0.224:55778 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:45.296270236Z (APIServer pid=1) INFO:     10.0.0.224:49020 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:45.366876509Z (APIServer pid=1) INFO:     10.0.0.224:33164 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:45.535346603Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:45.979204959Z (APIServer pid=1) INFO:     10.0.0.224:55764 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:46.535568363Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:46.582586247Z (APIServer pid=1) INFO:     10.0.0.224:58692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:46.888008078Z (APIServer pid=1) INFO:     10.0.0.224:49006 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:46.991735013Z (APIServer pid=1) INFO:     10.0.0.224:55692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:47.510501056Z (APIServer pid=1) INFO:     10.0.0.224:55736 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:47.536523917Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:47.689819320Z (APIServer pid=1) INFO:     10.0.0.224:55672 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:47.730664748Z (APIServer pid=1) INFO:     10.0.0.224:42292 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:48.347721629Z (APIServer pid=1) INFO:     10.0.0.224:60842 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:48.499353804Z (APIServer pid=1) INFO:     10.0.0.224:58706 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:48.535340524Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:48.866428251Z (APIServer pid=1) INFO:     10.0.0.224:60868 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:49.205443094Z (APIServer pid=1) INFO:     10.0.0.224:57442 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:49.535774614Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:49.835894670Z (APIServer pid=1) INFO:     10.0.0.224:60932 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:49.879144093Z (APIServer pid=1) INFO:     10.0.0.224:60916 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:50.014809571Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:50.386054717Z (APIServer pid=1) INFO 10-02 17:08:50 [loggers.py:310] Engine 000: Avg prompt throughput: 2093.8 tokens/s, Avg generation throughput: 1064.9 tokens/s, Running: 21 reqs, Waiting: 0 reqs, GPU KV cache usage: 4.8%, Prefix cache hit rate: 0.0%
2026-10-02T17:08:50.535863912Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:50.624041628Z (APIServer pid=1) INFO:     10.0.0.224:55676 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:50.709640418Z (APIServer pid=1) INFO:     10.0.0.224:60958 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:50.827113371Z (APIServer pid=1) INFO:     10.0.0.224:33180 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:51.534861670Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:52.006464112Z (APIServer pid=1) INFO:     10.0.0.224:58668 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:52.122738593Z (APIServer pid=1) INFO:     10.0.0.224:55778 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:52.535814205Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:52.653236241Z (APIServer pid=1) INFO:     10.0.0.224:33164 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:52.860424850Z (APIServer pid=1) INFO:     10.0.0.224:55764 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:53.157646746Z (APIServer pid=1) INFO:     10.0.0.224:49020 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:53.341610255Z (APIServer pid=1) INFO:     10.0.0.224:49002 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:53.343616381Z (APIServer pid=1) INFO:     10.0.0.224:58692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:53.387083114Z (APIServer pid=1) INFO:     10.0.0.224:49026 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:53.536557296Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:53.551930211Z (APIServer pid=1) INFO:     10.0.0.224:33190 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:54.523905281Z (APIServer pid=1) INFO:     10.0.0.224:42292 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:54.536529221Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:54.772017867Z (APIServer pid=1) INFO:     10.0.0.224:55672 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:54.773859292Z (APIServer pid=1) INFO:     10.0.0.224:55736 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:55.066506898Z (APIServer pid=1) INFO:     10.0.0.224:55692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:55.204994981Z (APIServer pid=1) INFO:     10.0.0.224:60842 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:55.294346922Z (APIServer pid=1) INFO:     10.0.0.224:58706 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:55.535731374Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:55.869421790Z (APIServer pid=1) INFO:     10.0.0.224:60868 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:56.073838960Z (APIServer pid=1) INFO:     10.0.0.224:57442 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:56.206461675Z (APIServer pid=1) INFO:     10.0.0.224:49006 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:56.346595352Z (APIServer pid=1) INFO:     10.0.0.224:43832 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:56.474031073Z (APIServer pid=1) INFO:     10.0.0.224:43840 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:56.530359204Z (APIServer pid=1) INFO:     10.0.0.224:43850 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:56.535606304Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:56.599729594Z (APIServer pid=1) INFO:     10.0.0.224:43856 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:56.648383736Z (APIServer pid=1) INFO:     10.0.0.224:43866 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:57.209590595Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:57.346048548Z (APIServer pid=1) INFO:     10.0.0.224:60916 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:57.534737041Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:57.683811299Z (APIServer pid=1) INFO:     10.0.0.224:60932 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:58.281383243Z (APIServer pid=1) INFO:     10.0.0.224:33180 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:58.534806870Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:08:59.167733031Z (APIServer pid=1) INFO:     10.0.0.224:55778 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:59.451075649Z (APIServer pid=1) INFO:     10.0.0.224:58668 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:08:59.534527308Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:00.365971778Z (APIServer pid=1) INFO:     10.0.0.224:33190 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:00.388343530Z (APIServer pid=1) INFO 10-02 17:09:00 [loggers.py:310] Engine 000: Avg prompt throughput: 1762.8 tokens/s, Avg generation throughput: 894.2 tokens/s, Running: 20 reqs, Waiting: 0 reqs, GPU KV cache usage: 4.7%, Prefix cache hit rate: 0.0%
2026-10-02T17:09:00.391776557Z (APIServer pid=1) INFO:     10.0.0.224:49026 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:00.535860668Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:00.786928340Z (APIServer pid=1) INFO:     10.0.0.224:49002 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:00.969817350Z (APIServer pid=1) INFO:     10.0.0.224:58692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:01.087443409Z (APIServer pid=1) INFO:     10.0.0.224:49020 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:01.534862812Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:01.861761272Z (APIServer pid=1) INFO:     10.0.0.224:55692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:01.904365800Z (APIServer pid=1) INFO:     10.0.0.224:55736 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:01.998428198Z (APIServer pid=1) INFO:     10.0.0.224:60842 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:02.523760329Z (APIServer pid=1) INFO:     10.0.0.224:58706 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:02.534581547Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:02.666532425Z (APIServer pid=1) INFO:     10.0.0.224:55672 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:03.092215965Z (APIServer pid=1) INFO:     10.0.0.224:43832 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:03.330288485Z (APIServer pid=1) INFO:     10.0.0.224:43866 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:03.414393838Z (APIServer pid=1) INFO:     10.0.0.224:43850 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:03.535825749Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:04.216117780Z (APIServer pid=1) INFO:     10.0.0.224:60932 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:04.373479224Z (APIServer pid=1) INFO:     10.0.0.224:60916 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:04.536041229Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:04.886584944Z (APIServer pid=1) INFO:     10.0.0.224:33180 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:05.037838153Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:05.501979776Z (APIServer pid=1) INFO:     10.0.0.224:43856 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:05.538388062Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:05.733538597Z (APIServer pid=1) INFO:     10.0.0.224:55778 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:05.777376101Z (APIServer pid=1) INFO:     10.0.0.224:43840 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:06.070135807Z (APIServer pid=1) INFO:     10.0.0.224:58668 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:06.130478994Z (APIServer pid=1) INFO:     10.0.0.224:49006 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:06.535583032Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:07.454067119Z (APIServer pid=1) INFO:     10.0.0.224:49020 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:07.534982002Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:07.568825659Z (APIServer pid=1) INFO:     10.0.0.224:58692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:07.592703903Z (APIServer pid=1) INFO:     10.0.0.224:49002 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:07.880762027Z (APIServer pid=1) INFO:     10.0.0.224:49026 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:08.535974719Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:08.743630648Z (APIServer pid=1) INFO:     10.0.0.224:60842 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:08.840050486Z (APIServer pid=1) INFO:     10.0.0.224:55736 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:09.042430932Z (APIServer pid=1) INFO:     10.0.0.224:58706 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:09.536040026Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:10.222321317Z (APIServer pid=1) INFO:     10.0.0.224:43850 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:10.248516362Z (APIServer pid=1) INFO:     10.0.0.224:43866 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:10.390191027Z (APIServer pid=1) INFO 10-02 17:09:10 [loggers.py:310] Engine 000: Avg prompt throughput: 1652.7 tokens/s, Avg generation throughput: 793.0 tokens/s, Running: 18 reqs, Waiting: 0 reqs, GPU KV cache usage: 4.2%, Prefix cache hit rate: 0.0%
2026-10-02T17:09:10.535728611Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:10.626795388Z (APIServer pid=1) INFO:     10.0.0.224:60916 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:10.900848508Z (APIServer pid=1) INFO:     10.0.0.224:60932 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:11.026886870Z (APIServer pid=1) INFO:     10.0.0.224:43832 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:11.291631205Z (APIServer pid=1) INFO:     10.0.0.224:33180 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:11.320870044Z (APIServer pid=1) INFO:     10.0.0.224:55672 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:11.535179849Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:11.631768334Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:11.942576913Z (APIServer pid=1) INFO:     10.0.0.224:43856 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:12.534960537Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:12.677813074Z (APIServer pid=1) INFO:     10.0.0.224:49006 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:13.534376106Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:14.177063484Z (APIServer pid=1) INFO:     10.0.0.224:49026 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:14.535796738Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:14.592319247Z (APIServer pid=1) INFO:     10.0.0.224:49002 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:14.874284224Z (APIServer pid=1) INFO:     10.0.0.224:55736 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:15.039062751Z (APIServer pid=1) INFO:     10.0.0.224:58706 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:15.099338301Z (APIServer pid=1) INFO:     10.0.0.224:60842 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:15.535561316Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:15.574073281Z (APIServer pid=1) INFO:     10.0.0.224:58692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:16.106340695Z (APIServer pid=1) INFO:     10.0.0.224:49020 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:16.198670495Z (APIServer pid=1) INFO:     10.0.0.224:58668 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:16.205772525Z (APIServer pid=1) INFO:     10.0.0.224:43840 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:16.318741889Z (APIServer pid=1) INFO:     10.0.0.224:55778 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:16.334148518Z (APIServer pid=1) INFO:     10.0.0.224:40790 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:16.534773983Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:16.803663789Z (APIServer pid=1) INFO:     10.0.0.224:43866 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:16.986178422Z (APIServer pid=1) INFO:     10.0.0.224:60916 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:17.328496054Z (APIServer pid=1) INFO:     10.0.0.224:43832 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:17.536126516Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:17.743154421Z (APIServer pid=1) INFO:     10.0.0.224:55672 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:18.482934773Z (APIServer pid=1) INFO:     10.0.0.224:43856 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:18.535029456Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:18.617979919Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:18.909170364Z (APIServer pid=1) INFO:     10.0.0.224:49006 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:18.982637161Z (APIServer pid=1) INFO:     10.0.0.224:33180 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:18.988378575Z (APIServer pid=1) INFO:     10.0.0.224:60932 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:19.142922020Z (APIServer pid=1) INFO:     10.0.0.224:43850 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:19.156335379Z (APIServer pid=1) INFO:     10.0.0.224:33084 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:19.534988440Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:20.392177291Z (APIServer pid=1) INFO 10-02 17:09:20 [loggers.py:310] Engine 000: Avg prompt throughput: 1707.8 tokens/s, Avg generation throughput: 706.2 tokens/s, Running: 22 reqs, Waiting: 0 reqs, GPU KV cache usage: 5.1%, Prefix cache hit rate: 0.0%
2026-10-02T17:09:20.535375640Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:20.663422732Z (APIServer pid=1) INFO:     10.0.0.224:33092 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:21.202929664Z (APIServer pid=1) INFO:     10.0.0.224:49002 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:21.399321449Z (APIServer pid=1) INFO:     10.0.0.224:49026 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:21.455921694Z (APIServer pid=1) INFO:     10.0.0.224:55736 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:21.534720012Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:22.193250800Z (APIServer pid=1) INFO:     10.0.0.224:58692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:22.539492025Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:23.535986059Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:23.853251072Z (APIServer pid=1) INFO:     10.0.0.224:55672 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:23.913655253Z (APIServer pid=1) INFO:     10.0.0.224:43832 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:24.327458685Z (APIServer pid=1) INFO:     10.0.0.224:60916 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:24.355386049Z (APIServer pid=1) INFO:     10.0.0.224:43866 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:24.535574943Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:24.664820135Z (APIServer pid=1) INFO:     10.0.0.224:43856 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:24.810167429Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:25.167740996Z (APIServer pid=1) INFO:     10.0.0.224:43850 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:25.284493596Z (APIServer pid=1) INFO:     10.0.0.224:33084 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:25.334441870Z (APIServer pid=1) INFO:     10.0.0.224:33180 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:25.536926732Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:26.425031463Z (APIServer pid=1) INFO:     10.0.0.224:60932 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:26.537766675Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:26.838739166Z (APIServer pid=1) INFO:     10.0.0.224:33092 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:27.536517517Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:27.686619342Z (APIServer pid=1) INFO:     10.0.0.224:55736 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:27.758759246Z (APIServer pid=1) INFO:     10.0.0.224:49026 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:27.811960217Z (APIServer pid=1) INFO:     10.0.0.224:49002 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:27.959338843Z (APIServer pid=1) INFO:     10.0.0.224:49006 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:28.051620201Z (APIServer pid=1) INFO:     10.0.0.224:56744 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:28.453621414Z (APIServer pid=1) INFO:     10.0.0.224:58692 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:28.483877301Z (APIServer pid=1) INFO:     10.0.0.224:56752 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:28.535923463Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:28.703644813Z (APIServer pid=1) INFO:     10.0.0.224:56758 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:29.192547182Z (APIServer pid=1) INFO:     10.0.0.224:56764 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:29.211819776Z (APIServer pid=1) INFO:     10.0.0.224:56774 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:29.413654291Z (APIServer pid=1) INFO:     10.0.0.224:56784 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:29.445255517Z (APIServer pid=1) INFO:     10.0.0.224:56798 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:29.475076213Z (APIServer pid=1) INFO:     10.0.0.224:56808 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:29.536085467Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:30.131374308Z (APIServer pid=1) INFO:     10.0.0.224:56824 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:30.393236955Z (APIServer pid=1) INFO 10-02 17:09:30 [loggers.py:310] Engine 000: Avg prompt throughput: 1652.9 tokens/s, Avg generation throughput: 702.4 tokens/s, Running: 25 reqs, Waiting: 0 reqs, GPU KV cache usage: 5.7%, Prefix cache hit rate: 0.0%
2026-10-02T17:09:30.535465894Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:30.636231621Z (APIServer pid=1) INFO:     10.0.0.224:43832 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:30.924271779Z (APIServer pid=1) INFO:     10.0.0.224:60916 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:31.262467083Z (APIServer pid=1) INFO:     10.0.0.224:43856 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:31.536666647Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:32.362194297Z (APIServer pid=1) INFO:     10.0.0.224:33180 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:32.536187200Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:32.715031826Z (APIServer pid=1) INFO:     10.0.0.224:33084 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:33.304657381Z (APIServer pid=1) INFO:     10.0.0.224:33092 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:33.495808589Z (APIServer pid=1) INFO:     10.0.0.224:60932 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:33.537981381Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:33.928602091Z (APIServer pid=1) INFO:     10.0.0.224:43850 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:33.986886944Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:34.103750374Z (APIServer pid=1) INFO:     10.0.0.224:43866 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:34.535895362Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:35.537553386Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:35.591315135Z (APIServer pid=1) INFO:     10.0.0.224:56808 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:35.795247628Z (APIServer pid=1) INFO:     10.0.0.224:56798 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:35.867293275Z (APIServer pid=1) INFO:     10.0.0.224:56784 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:36.105769577Z (APIServer pid=1) INFO:     10.0.0.224:56774 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:36.535653578Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:36.636403625Z (APIServer pid=1) INFO:     10.0.0.224:56824 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:36.722050825Z (APIServer pid=1) INFO:     10.0.0.224:43832 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:37.536132346Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:37.617726219Z (APIServer pid=1) INFO:     10.0.0.224:43856 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:37.637634663Z (APIServer pid=1) INFO:     10.0.0.224:60916 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:38.536875304Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:38.942408700Z (APIServer pid=1) INFO:     10.0.0.224:33084 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:39.261462957Z (APIServer pid=1) INFO:     10.0.0.224:33092 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:39.495453102Z (APIServer pid=1) INFO:     10.0.0.224:60932 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:39.539295865Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:39.595303531Z (APIServer pid=1) INFO:     10.0.0.224:33180 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:39.878931093Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:39.918239131Z (APIServer pid=1) INFO:     10.0.0.224:43866 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:40.281412653Z (APIServer pid=1) INFO:     10.0.0.224:43850 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:40.395139002Z (APIServer pid=1) INFO 10-02 17:09:40 [loggers.py:310] Engine 000: Avg prompt throughput: 1377.2 tokens/s, Avg generation throughput: 740.3 tokens/s, Running: 15 reqs, Waiting: 0 reqs, GPU KV cache usage: 3.3%, Prefix cache hit rate: 0.0%
2026-10-02T17:09:40.536286031Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:40.571220375Z (APIServer pid=1) INFO:     10.0.0.224:42114 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:40.588319278Z (APIServer pid=1) INFO:     10.0.0.224:42116 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:40.962294239Z (APIServer pid=1) INFO:     10.0.0.224:42132 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:41.539386004Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:41.619320325Z (APIServer pid=1) INFO:     10.0.0.224:42148 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:41.898353769Z (APIServer pid=1) INFO:     10.0.0.224:56798 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:42.238108111Z (APIServer pid=1) INFO:     10.0.0.224:56774 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:42.410357645Z (APIServer pid=1) INFO:     10.0.0.224:56784 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:42.535942240Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:43.538500971Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:43.617371444Z (APIServer pid=1) INFO:     10.0.0.224:60916 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:43.706157137Z (APIServer pid=1) INFO:     10.0.0.224:43856 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:43.825762339Z (APIServer pid=1) INFO:     10.0.0.224:43832 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:44.018735214Z (APIServer pid=1) INFO:     10.0.0.224:56824 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:44.536920181Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:44.653820300Z (APIServer pid=1) INFO:     10.0.0.224:56808 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:44.666159151Z (APIServer pid=1) INFO:     10.0.0.224:42152 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:44.753072361Z (APIServer pid=1) INFO:     10.0.0.224:42156 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:44.869864094Z (APIServer pid=1) INFO:     10.0.0.224:42162 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:45.240043544Z (APIServer pid=1) INFO:     10.0.0.224:42168 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:45.537617530Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:46.081585436Z (APIServer pid=1) INFO:     10.0.0.224:33180 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:46.102544141Z (APIServer pid=1) INFO:     10.0.0.224:60932 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:46.333409541Z (APIServer pid=1) INFO:     10.0.0.224:33092 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:46.373442666Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:46.536497882Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:46.720489168Z (APIServer pid=1) INFO:     10.0.0.224:43866 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:46.735499199Z (APIServer pid=1) INFO:     10.0.0.224:33084 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:47.514048927Z (APIServer pid=1) INFO:     10.0.0.224:42132 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:47.536170786Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:47.674890234Z (APIServer pid=1) INFO:     10.0.0.224:42116 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:48.234274246Z (APIServer pid=1) INFO:     10.0.0.224:42148 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:48.368099028Z (APIServer pid=1) INFO:     10.0.0.224:42114 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:48.457164738Z (APIServer pid=1) INFO:     10.0.0.224:56798 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:48.500290649Z (APIServer pid=1) INFO:     10.0.0.224:43850 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:48.535654945Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:48.778522921Z (APIServer pid=1) INFO:     10.0.0.224:45276 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:49.278914718Z (APIServer pid=1) INFO:     10.0.0.224:56784 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:49.536157137Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:49.610259263Z (APIServer pid=1) INFO:     10.0.0.224:56774 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:49.715528206Z (APIServer pid=1) INFO:     10.0.0.224:45278 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:50.279862298Z (APIServer pid=1) INFO:     10.0.0.224:45286 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:50.396374474Z (APIServer pid=1) INFO 10-02 17:09:50 [loggers.py:310] Engine 000: Avg prompt throughput: 1818.1 tokens/s, Avg generation throughput: 765.4 tokens/s, Running: 26 reqs, Waiting: 0 reqs, GPU KV cache usage: 6.0%, Prefix cache hit rate: 0.0%
2026-10-02T17:09:50.537071153Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:50.595196665Z (APIServer pid=1) INFO:     10.0.0.224:60916 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:50.699273067Z (APIServer pid=1) INFO:     10.0.0.224:43856 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:51.154193566Z (APIServer pid=1) INFO:     10.0.0.224:56824 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:51.255539897Z (APIServer pid=1) INFO:     10.0.0.224:43832 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:51.535768294Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:51.800552202Z (APIServer pid=1) INFO:     10.0.0.224:42162 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:52.369040051Z (APIServer pid=1) INFO:     10.0.0.224:42168 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:52.535449014Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:52.690085333Z (APIServer pid=1) INFO:     10.0.0.224:42156 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:52.785389865Z (APIServer pid=1) INFO:     10.0.0.224:42152 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:53.306529216Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:53.536220269Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:53.679754962Z (APIServer pid=1) INFO:     10.0.0.224:33084 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:54.151914908Z (APIServer pid=1) INFO:     10.0.0.224:42132 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:54.534641762Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:54.660048430Z (APIServer pid=1) INFO:     10.0.0.224:42116 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:55.239937510Z (APIServer pid=1) INFO:     10.0.0.224:45276 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:55.535954327Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:55.919350353Z (APIServer pid=1) INFO:     10.0.0.224:45278 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:55.939184255Z (APIServer pid=1) INFO:     10.0.0.224:56774 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:56.539359573Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:56.601605769Z (APIServer pid=1) INFO:     10.0.0.224:45286 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:56.847550460Z (APIServer pid=1) INFO:     10.0.0.224:43856 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:56.849921293Z (APIServer pid=1) INFO:     10.0.0.224:60916 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:57.062302977Z (APIServer pid=1) INFO:     10.0.0.224:56784 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:57.535634894Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:57.872088579Z (APIServer pid=1) INFO:     10.0.0.224:42162 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:57.981343341Z (APIServer pid=1) INFO:     10.0.0.224:43832 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:57.990308648Z (APIServer pid=1) INFO:     10.0.0.224:56824 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:58.485281617Z (APIServer pid=1) INFO:     10.0.0.224:43850 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:58.537465047Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:58.566586494Z (APIServer pid=1) INFO:     10.0.0.224:56798 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:58.576759588Z (APIServer pid=1) INFO:     10.0.0.224:42114 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:58.802012558Z (APIServer pid=1) INFO:     10.0.0.224:42168 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:58.894067338Z (APIServer pid=1) INFO:     10.0.0.224:42148 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:58.977333815Z (APIServer pid=1) INFO:     10.0.0.224:52134 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:59.140256599Z (APIServer pid=1) INFO:     10.0.0.224:52142 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:59.519418906Z (APIServer pid=1) INFO:     10.0.0.224:42152 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:09:59.535336771Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:09:59.909967116Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:00.142521412Z (APIServer pid=1) INFO:     10.0.0.224:42156 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:00.395604270Z (APIServer pid=1) INFO:     10.0.0.224:33084 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:00.397109000Z (APIServer pid=1) INFO 10-02 17:10:00 [loggers.py:310] Engine 000: Avg prompt throughput: 1763.0 tokens/s, Avg generation throughput: 785.3 tokens/s, Running: 22 reqs, Waiting: 0 reqs, GPU KV cache usage: 4.8%, Prefix cache hit rate: 0.0%
2026-10-02T17:10:00.536616634Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:00.841718974Z (APIServer pid=1) INFO:     10.0.0.224:42132 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:01.384832146Z (APIServer pid=1) INFO:     10.0.0.224:42116 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:01.536050496Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:01.800726339Z (APIServer pid=1) INFO:     10.0.0.224:52146 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:01.983300721Z (APIServer pid=1) INFO:     10.0.0.224:45276 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:02.063231365Z (APIServer pid=1) INFO:     10.0.0.224:52148 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:02.536237757Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:02.869467527Z (APIServer pid=1) INFO:     10.0.0.224:56774 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:03.536036915Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:03.911882193Z (APIServer pid=1) INFO:     10.0.0.224:56784 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:04.402556982Z (APIServer pid=1) INFO:     10.0.0.224:43856 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:04.535705767Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:04.544456749Z (APIServer pid=1) INFO:     10.0.0.224:42162 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:05.535428513Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:05.650785668Z (APIServer pid=1) INFO:     10.0.0.224:42152 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:05.731898854Z (APIServer pid=1) INFO:     10.0.0.224:52142 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:06.017325508Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:06.235286699Z (APIServer pid=1) INFO:     10.0.0.224:42156 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:06.487375262Z (APIServer pid=1) INFO:     10.0.0.224:33084 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:06.536378842Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:06.592720036Z (APIServer pid=1) INFO:     10.0.0.224:52134 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:07.279335137Z (APIServer pid=1) INFO:     10.0.0.224:42132 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:07.537419070Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:07.539515597Z (APIServer pid=1) INFO:     10.0.0.224:42116 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:07.595173231Z (APIServer pid=1) INFO:     10.0.0.224:42148 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:07.635158205Z (APIServer pid=1) INFO:     10.0.0.224:42168 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:07.763219031Z (APIServer pid=1) INFO:     10.0.0.224:56798 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:08.195951263Z (APIServer pid=1) INFO:     10.0.0.224:45276 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:08.308272783Z (APIServer pid=1) INFO:     10.0.0.224:52148 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:08.476980099Z (APIServer pid=1) INFO:     10.0.0.224:52146 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:08.535997154Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:08.767432918Z (APIServer pid=1) INFO:     10.0.0.224:42114 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:08.908805570Z (APIServer pid=1) INFO:     10.0.0.224:43850 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:09.126910172Z (APIServer pid=1) INFO:     10.0.0.224:56824 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:09.538137718Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:09.667154759Z (APIServer pid=1) INFO:     10.0.0.224:56774 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:10.149371477Z (APIServer pid=1) INFO:     10.0.0.224:46598 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:10.179375470Z (APIServer pid=1) INFO:     10.0.0.224:46602 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:10.326425906Z (APIServer pid=1) INFO:     10.0.0.224:46606 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:10.398652723Z (APIServer pid=1) INFO 10-02 17:10:10 [loggers.py:310] Engine 000: Avg prompt throughput: 1652.8 tokens/s, Avg generation throughput: 784.2 tokens/s, Running: 24 reqs, Waiting: 0 reqs, GPU KV cache usage: 5.3%, Prefix cache hit rate: 0.0%
2026-10-02T17:10:10.449174238Z (APIServer pid=1) INFO:     10.0.0.224:46616 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:10.536545530Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:10.539382914Z (APIServer pid=1) INFO:     10.0.0.224:46630 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:10.648063223Z (APIServer pid=1) INFO:     10.0.0.224:56784 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:11.148664790Z (APIServer pid=1) INFO:     10.0.0.224:46646 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:11.537742064Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:11.608739051Z (APIServer pid=1) INFO:     10.0.0.224:42162 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:11.725447238Z (APIServer pid=1) INFO:     10.0.0.224:43856 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:11.833374525Z (APIServer pid=1) INFO:     10.0.0.224:46662 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:12.034908781Z (APIServer pid=1) INFO:     10.0.0.224:46666 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:12.048273748Z (APIServer pid=1) INFO:     10.0.0.224:46674 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:12.538526651Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:12.791762827Z (APIServer pid=1) INFO:     10.0.0.224:46676 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:13.428407973Z (APIServer pid=1) INFO:     10.0.0.224:42156 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:13.535572351Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:13.539740645Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:13.782654688Z (APIServer pid=1) INFO:     10.0.0.224:52134 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:13.840172422Z (APIServer pid=1) INFO:     10.0.0.224:33084 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:14.536131230Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:14.973341831Z (APIServer pid=1) INFO:     10.0.0.224:56798 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:15.535606385Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:15.874030625Z (APIServer pid=1) INFO:     10.0.0.224:56824 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:15.922146980Z (APIServer pid=1) INFO:     10.0.0.224:43850 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:16.004512066Z (APIServer pid=1) INFO:     10.0.0.224:42114 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:16.121815827Z (APIServer pid=1) INFO:     10.0.0.224:52146 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:16.126859653Z (APIServer pid=1) INFO:     10.0.0.224:52148 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:16.166095233Z (APIServer pid=1) INFO:     10.0.0.224:45276 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:16.167184419Z (APIServer pid=1) INFO:     10.0.0.224:42168 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:16.297384690Z (APIServer pid=1) INFO:     10.0.0.224:42148 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:16.535515907Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:17.003728582Z (APIServer pid=1) INFO:     10.0.0.224:56774 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:17.080359760Z (APIServer pid=1) INFO:     10.0.0.224:42116 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:17.535510751Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:17.860194437Z (APIServer pid=1) INFO:     10.0.0.224:56784 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:18.539168887Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:18.571094044Z (APIServer pid=1) INFO:     10.0.0.224:42162 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:19.536054674Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:19.940996679Z (APIServer pid=1) INFO:     10.0.0.224:42156 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:19.944845982Z (APIServer pid=1) INFO:     10.0.0.224:46676 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:20.138414999Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:20.400169037Z (APIServer pid=1) INFO 10-02 17:10:20 [loggers.py:310] Engine 000: Avg prompt throughput: 1707.9 tokens/s, Avg generation throughput: 916.7 tokens/s, Running: 16 reqs, Waiting: 0 reqs, GPU KV cache usage: 3.7%, Prefix cache hit rate: 0.0%
2026-10-02T17:10:20.535398558Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:21.421329758Z (APIServer pid=1) INFO:     10.0.0.224:56798 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:21.465226272Z (APIServer pid=1) INFO:     10.0.0.224:33084 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:21.538468575Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:21.541104278Z (APIServer pid=1) INFO:     10.0.0.224:52134 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:21.655950981Z (APIServer pid=1) INFO:     10.0.0.224:46674 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:21.675125720Z (APIServer pid=1) INFO:     10.0.0.224:46666 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:22.112351649Z (APIServer pid=1) INFO:     10.0.0.224:46662 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:22.230013514Z (APIServer pid=1) INFO:     10.0.0.224:43856 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:22.535321620Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:22.650675590Z (APIServer pid=1) INFO:     10.0.0.224:43850 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:22.759032689Z (APIServer pid=1) INFO:     10.0.0.224:42114 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:22.836062729Z (APIServer pid=1) INFO:     10.0.0.224:42168 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:22.878418326Z (APIServer pid=1) INFO:     10.0.0.224:52146 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:23.145161025Z (APIServer pid=1) INFO:     10.0.0.224:42148 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:23.395084361Z (APIServer pid=1) INFO:     10.0.0.224:45276 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:23.535514997Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:23.557998157Z (APIServer pid=1) INFO:     10.0.0.224:42116 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:24.539184372Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:24.746900992Z (APIServer pid=1) INFO:     10.0.0.224:56784 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:25.140617867Z (APIServer pid=1) INFO:     10.0.0.224:42162 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:25.240867648Z (APIServer pid=1) INFO:     10.0.0.224:56774 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:25.537547945Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:26.535785422Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:26.538855956Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:27.536159099Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:27.680615389Z (APIServer pid=1) INFO:     10.0.0.224:46676 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:28.097809461Z (APIServer pid=1) INFO:     10.0.0.224:46666 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:28.535485959Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:29.162641507Z (APIServer pid=1) INFO:     10.0.0.224:42116 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:29.477431895Z (APIServer pid=1) INFO:     10.0.0.224:45276 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:29.534576796Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:29.653061954Z (APIServer pid=1) INFO:     10.0.0.224:42148 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:29.830001404Z (APIServer pid=1) INFO:     10.0.0.224:52146 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:30.401011695Z (APIServer pid=1) INFO 10-02 17:10:30 [loggers.py:310] Engine 000: Avg prompt throughput: 1322.3 tokens/s, Avg generation throughput: 696.7 tokens/s, Running: 9 reqs, Waiting: 0 reqs, GPU KV cache usage: 2.0%, Prefix cache hit rate: 0.0%
2026-10-02T17:10:30.427664775Z (APIServer pid=1) INFO:     10.0.0.224:56784 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:30.477771496Z (APIServer pid=1) INFO:     10.0.0.224:42168 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:30.535042445Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:31.367619402Z (APIServer pid=1) INFO:     10.0.0.224:56774 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:31.536114638Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:32.334777365Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:32.450055853Z (APIServer pid=1) INFO:     10.0.0.224:42162 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:32.535347079Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:32.970138755Z (APIServer pid=1) INFO:     10.0.0.224:42114 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:33.095736393Z (APIServer pid=1) INFO:     10.0.0.224:43850 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:33.142209679Z (APIServer pid=1) INFO:     10.0.0.224:43856 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:33.535035241Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:33.800272381Z (APIServer pid=1) INFO:     10.0.0.224:46666 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:34.293202772Z (APIServer pid=1) INFO:     10.0.0.224:46676 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:34.441288310Z (APIServer pid=1) INFO:     10.0.0.224:55680 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:34.522528875Z (APIServer pid=1) INFO:     10.0.0.224:55696 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:34.535413766Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:35.537005769Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:36.534532251Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:37.177821399Z (APIServer pid=1) INFO:     10.0.0.224:56774 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:37.535600545Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:37.598095260Z (APIServer pid=1) INFO:     10.0.0.224:42168 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:37.744200031Z (APIServer pid=1) INFO:     10.0.0.224:56784 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:37.746072273Z (APIServer pid=1) INFO:     10.0.0.224:52146 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:37.956835421Z (APIServer pid=1) INFO:     10.0.0.224:42148 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:38.406296434Z (APIServer pid=1) INFO:     10.0.0.224:42162 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:38.510500154Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:38.534574949Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:38.937649900Z (APIServer pid=1) INFO:     10.0.0.224:43856 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:39.158524325Z (APIServer pid=1) INFO:     10.0.0.224:43850 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:39.385753843Z (APIServer pid=1) INFO:     10.0.0.224:42114 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:39.535292631Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:39.737278288Z (APIServer pid=1) INFO:     10.0.0.224:46666 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:40.182174387Z (APIServer pid=1) INFO:     10.0.0.224:55680 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:40.234341546Z (APIServer pid=1) INFO:     10.0.0.224:55696 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:40.402377726Z (APIServer pid=1) INFO 10-02 17:10:40 [loggers.py:310] Engine 000: Avg prompt throughput: 1377.3 tokens/s, Avg generation throughput: 518.9 tokens/s, Running: 13 reqs, Waiting: 0 reqs, GPU KV cache usage: 2.7%, Prefix cache hit rate: 0.0%
2026-10-02T17:10:40.490086285Z (APIServer pid=1) INFO:     10.0.0.224:46676 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:40.533873011Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:41.535263483Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:41.923339373Z (APIServer pid=1) INFO:     10.0.0.224:47234 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:41.991390612Z (APIServer pid=1) INFO:     10.0.0.224:47238 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:42.216930871Z (APIServer pid=1) INFO:     10.0.0.224:47244 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:42.534226343Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:42.766611737Z (APIServer pid=1) INFO:     10.0.0.224:47248 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:43.007187866Z (APIServer pid=1) INFO:     10.0.0.224:47254 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:43.415419316Z (APIServer pid=1) INFO:     10.0.0.224:56774 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:43.422605275Z (APIServer pid=1) INFO:     10.0.0.224:47270 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:43.534123186Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:43.714993192Z (APIServer pid=1) INFO:     10.0.0.224:47276 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:44.280765278Z (APIServer pid=1) INFO:     10.0.0.224:42148 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:44.520500230Z (APIServer pid=1) INFO:     10.0.0.224:52146 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:44.535037678Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:44.535810837Z (APIServer pid=1) INFO:     10.0.0.224:56784 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:44.623248495Z (APIServer pid=1) INFO:     10.0.0.224:42162 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:45.057859157Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:45.538333404Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:45.565491796Z (APIServer pid=1) INFO:     10.0.0.224:43850 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:46.163564809Z (APIServer pid=1) INFO:     10.0.0.224:46666 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:46.196144760Z (APIServer pid=1) INFO:     10.0.0.224:42114 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:46.535045787Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:46.660407069Z (APIServer pid=1) INFO:     10.0.0.224:55696 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:46.693371987Z (APIServer pid=1) INFO:     10.0.0.224:55680 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:46.695432775Z (APIServer pid=1) INFO:     10.0.0.224:43856 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:46.969101353Z (APIServer pid=1) INFO:     10.0.0.224:46676 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:47.278025759Z (APIServer pid=1) INFO:     10.0.0.224:42168 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:47.534949652Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:47.912587899Z (APIServer pid=1) INFO:     10.0.0.224:57018 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:48.061754355Z (APIServer pid=1) INFO:     10.0.0.224:57032 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:48.378489229Z (APIServer pid=1) INFO:     10.0.0.224:57040 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:48.534815065Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:48.843668527Z (APIServer pid=1) INFO:     10.0.0.224:47238 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:48.935309004Z (APIServer pid=1) INFO:     10.0.0.224:47244 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:49.534554168Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:49.623767726Z (APIServer pid=1) INFO:     10.0.0.224:47248 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:50.023842255Z (APIServer pid=1) INFO:     10.0.0.224:47254 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:50.403486305Z (APIServer pid=1) INFO 10-02 17:10:50 [loggers.py:310] Engine 000: Avg prompt throughput: 1597.7 tokens/s, Avg generation throughput: 755.4 tokens/s, Running: 20 reqs, Waiting: 0 reqs, GPU KV cache usage: 4.7%, Prefix cache hit rate: 0.0%
2026-10-02T17:10:50.431657689Z (APIServer pid=1) INFO:     10.0.0.224:47276 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:50.471594752Z (APIServer pid=1) INFO:     10.0.0.224:47270 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:50.492939846Z (APIServer pid=1) INFO:     10.0.0.224:56774 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:50.535438211Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:50.788048816Z (APIServer pid=1) INFO:     10.0.0.224:47234 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:51.226623277Z (APIServer pid=1) INFO:     10.0.0.224:42148 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:51.472427820Z (APIServer pid=1) INFO:     10.0.0.224:42162 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:51.534560231Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:51.820304281Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:52.535227825Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:53.407519259Z (APIServer pid=1) INFO:     10.0.0.224:46676 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:53.412110141Z (APIServer pid=1) INFO:     10.0.0.224:43856 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:53.533868735Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:53.821545782Z (APIServer pid=1) INFO:     10.0.0.224:42168 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:54.370659366Z (APIServer pid=1) INFO:     10.0.0.224:57032 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:54.535381123Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:55.534966926Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:55.592098542Z (APIServer pid=1) INFO:     10.0.0.224:47248 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:55.802012426Z (APIServer pid=1) INFO:     10.0.0.224:47244 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:55.906625770Z (APIServer pid=1) INFO:     10.0.0.224:47238 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:55.967488806Z (APIServer pid=1) INFO:     10.0.0.224:57040 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:56.110258263Z (APIServer pid=1) INFO:     10.0.0.224:57018 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:56.167461243Z (APIServer pid=1) INFO:     10.0.0.224:47254 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:56.534586864Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:56.755249998Z (APIServer pid=1) INFO:     10.0.0.224:47234 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:56.953173971Z (APIServer pid=1) INFO:     10.0.0.224:47270 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:56.965416641Z (APIServer pid=1) INFO:     10.0.0.224:56774 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:57.234350814Z (APIServer pid=1) INFO:     10.0.0.224:47276 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:57.334676567Z (APIServer pid=1) INFO:     10.0.0.224:55680 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:57.535023642Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:57.997924059Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:58.507990549Z (APIServer pid=1) INFO:     10.0.0.224:42162 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:58.534542808Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:58.739444385Z (APIServer pid=1) INFO:     10.0.0.224:42148 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:58.943061739Z (APIServer pid=1) INFO:     10.0.0.224:52144 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:58.965622216Z (APIServer pid=1) INFO:     10.0.0.224:52158 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:58.978534849Z (APIServer pid=1) INFO:     10.0.0.224:52166 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:59.207428384Z (APIServer pid=1) INFO:     10.0.0.224:52182 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:59.274362294Z (APIServer pid=1) INFO:     10.0.0.224:52186 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:59.431707011Z (APIServer pid=1) INFO:     10.0.0.224:52196 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:59.441024391Z (APIServer pid=1) INFO:     10.0.0.224:52200 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:59.484092061Z (APIServer pid=1) INFO:     10.0.0.224:52202 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:59.534091189Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:10:59.633519690Z (APIServer pid=1) INFO:     10.0.0.224:52210 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:59.724947996Z (APIServer pid=1) INFO:     10.0.0.224:52216 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:10:59.872306361Z (APIServer pid=1) INFO:     10.0.0.224:52224 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:00.404967803Z (APIServer pid=1) INFO 10-02 17:11:00 [loggers.py:310] Engine 000: Avg prompt throughput: 1983.3 tokens/s, Avg generation throughput: 691.0 tokens/s, Running: 28 reqs, Waiting: 0 reqs, GPU KV cache usage: 6.1%, Prefix cache hit rate: 0.0%
2026-10-02T17:11:00.535050532Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:00.770736092Z (APIServer pid=1) INFO:     10.0.0.224:42168 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:01.013816053Z (APIServer pid=1) INFO:     10.0.0.224:43856 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:01.478281223Z (APIServer pid=1) INFO:     10.0.0.224:57032 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:01.534992385Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:01.618228765Z (APIServer pid=1) INFO:     10.0.0.224:46676 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:02.038205815Z (APIServer pid=1) INFO:     10.0.0.224:52228 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:02.535598912Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:03.372127969Z (APIServer pid=1) INFO:     10.0.0.224:47254 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:03.534998993Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:03.577404163Z (APIServer pid=1) INFO:     10.0.0.224:57018 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:03.604379689Z (APIServer pid=1) INFO:     10.0.0.224:57040 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:03.722961047Z (APIServer pid=1) INFO:     10.0.0.224:47238 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:03.745654796Z (APIServer pid=1) INFO:     10.0.0.224:47244 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:03.765454584Z (APIServer pid=1) INFO:     10.0.0.224:47248 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:04.067396346Z (APIServer pid=1) INFO:     10.0.0.224:52236 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:04.541070299Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:04.669026747Z (APIServer pid=1) INFO:     10.0.0.224:55680 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:04.869938966Z (APIServer pid=1) INFO:     10.0.0.224:47276 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:05.076453566Z (APIServer pid=1) INFO:     10.0.0.224:56774 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:05.250757901Z (APIServer pid=1) INFO:     10.0.0.224:47270 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:05.535751846Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:05.581257385Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:05.625494872Z (APIServer pid=1) INFO:     10.0.0.224:47234 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:05.735126374Z (APIServer pid=1) INFO:     10.0.0.224:52252 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:06.151374808Z (APIServer pid=1) INFO:     10.0.0.224:52254 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:06.170854141Z (APIServer pid=1) INFO:     10.0.0.224:52256 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:06.324862924Z (APIServer pid=1) INFO:     10.0.0.224:42162 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:06.424987217Z (APIServer pid=1) INFO:     10.0.0.224:52268 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:06.535018874Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:06.832921554Z (APIServer pid=1) INFO:     10.0.0.224:42148 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:07.095433420Z (APIServer pid=1) INFO:     10.0.0.224:52210 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:07.168441441Z (APIServer pid=1) INFO:     10.0.0.224:52216 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:07.534288057Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:07.837584885Z (APIServer pid=1) INFO:     10.0.0.224:52224 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:08.366141500Z (APIServer pid=1) INFO:     10.0.0.224:43856 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:08.535563184Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:08.741191591Z (APIServer pid=1) INFO:     10.0.0.224:42168 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:08.937810139Z (APIServer pid=1) INFO:     10.0.0.224:46676 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:09.534188179Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:09.978536181Z (APIServer pid=1) INFO:     10.0.0.224:52228 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:10.407584857Z (APIServer pid=1) INFO 10-02 17:11:10 [loggers.py:310] Engine 000: Avg prompt throughput: 1707.7 tokens/s, Avg generation throughput: 1031.9 tokens/s, Running: 26 reqs, Waiting: 0 reqs, GPU KV cache usage: 6.3%, Prefix cache hit rate: 0.0%
2026-10-02T17:11:10.427632943Z (APIServer pid=1) INFO:     10.0.0.224:57032 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:10.534583597Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:10.675978619Z (APIServer pid=1) INFO:     10.0.0.224:52202 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:10.781358709Z (APIServer pid=1) INFO:     10.0.0.224:47254 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:10.915474218Z (APIServer pid=1) INFO:     10.0.0.224:52196 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:11.183977717Z (APIServer pid=1) INFO:     10.0.0.224:52236 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:11.240397609Z (APIServer pid=1) INFO:     10.0.0.224:47238 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:11.262726009Z (APIServer pid=1) INFO:     10.0.0.224:47248 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:11.395652502Z (APIServer pid=1) INFO:     10.0.0.224:47244 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:11.534284262Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:11.620134342Z (APIServer pid=1) INFO:     10.0.0.224:57040 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:12.000045515Z (APIServer pid=1) INFO:     10.0.0.224:57018 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:12.241641567Z (APIServer pid=1) INFO:     10.0.0.224:47276 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:12.254834870Z (APIServer pid=1) INFO:     10.0.0.224:55680 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:12.534153325Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:12.584286496Z (APIServer pid=1) INFO:     10.0.0.224:56774 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:12.799048206Z (APIServer pid=1) INFO:     10.0.0.224:47270 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:12.962839025Z (APIServer pid=1) INFO:     10.0.0.224:36912 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:13.004316724Z (APIServer pid=1) INFO:     10.0.0.224:36924 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:13.272869146Z (APIServer pid=1) INFO:     10.0.0.224:52252 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:13.358402600Z (APIServer pid=1) INFO:     10.0.0.224:47234 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:13.526746710Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:13.534833338Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:13.719274069Z (APIServer pid=1) INFO:     10.0.0.224:36940 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:14.344518563Z (APIServer pid=1) INFO:     10.0.0.224:42148 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:14.386891803Z (APIServer pid=1) INFO:     10.0.0.224:52210 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:14.534245738Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:14.929237815Z (APIServer pid=1) INFO:     10.0.0.224:52216 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:14.973925622Z (APIServer pid=1) INFO:     10.0.0.224:52268 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:15.250049019Z (APIServer pid=1) INFO:     10.0.0.224:42162 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:15.350728881Z (APIServer pid=1) INFO:     10.0.0.224:52224 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:15.534344525Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:15.868372976Z (APIServer pid=1) INFO:     10.0.0.224:52254 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:16.241356758Z (APIServer pid=1) INFO:     10.0.0.224:43856 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:16.534401491Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:17.536951441Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:17.663727310Z (APIServer pid=1) INFO:     10.0.0.224:52228 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:18.125914360Z (APIServer pid=1) INFO:     10.0.0.224:52202 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:18.447255493Z (APIServer pid=1) INFO:     10.0.0.224:52196 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:18.518864464Z (APIServer pid=1) INFO:     10.0.0.224:52236 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:18.535311355Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:18.614169595Z (APIServer pid=1) INFO:     10.0.0.224:47248 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:19.211097421Z (APIServer pid=1) INFO:     10.0.0.224:57018 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:19.535994782Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:20.408320837Z (APIServer pid=1) INFO 10-02 17:11:20 [loggers.py:310] Engine 000: Avg prompt throughput: 1873.2 tokens/s, Avg generation throughput: 961.9 tokens/s, Running: 14 reqs, Waiting: 0 reqs, GPU KV cache usage: 3.4%, Prefix cache hit rate: 0.0%
2026-10-02T17:11:20.534757447Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:20.694512801Z (APIServer pid=1) INFO:     10.0.0.224:52210 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:21.051587535Z (APIServer pid=1) INFO:     10.0.0.224:42148 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:21.397058926Z (APIServer pid=1) INFO:     10.0.0.224:52224 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:21.490672194Z (APIServer pid=1) INFO:     10.0.0.224:42162 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:21.534855028Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:21.608837096Z (APIServer pid=1) INFO:     10.0.0.224:52268 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:21.956622284Z (APIServer pid=1) INFO:     10.0.0.224:52254 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:21.963239268Z (APIServer pid=1) INFO:     10.0.0.224:52216 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:22.535790500Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:22.715128202Z (APIServer pid=1) INFO:     10.0.0.224:43856 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:22.788038499Z (APIServer pid=1) INFO:     10.0.0.224:36940 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:22.949671736Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:23.248101671Z (APIServer pid=1) INFO:     10.0.0.224:47234 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:23.363460748Z (APIServer pid=1) INFO:     10.0.0.224:52252 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:23.535106317Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:23.852085769Z (APIServer pid=1) INFO:     10.0.0.224:36924 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:24.496296168Z (APIServer pid=1) INFO:     10.0.0.224:52202 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:24.514569706Z (APIServer pid=1) INFO:     10.0.0.224:52228 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:24.536621874Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:24.699894074Z (APIServer pid=1) INFO:     10.0.0.224:36912 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:25.475388046Z (APIServer pid=1) INFO:     10.0.0.224:57018 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:25.535839876Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:25.817191296Z (APIServer pid=1) INFO:     10.0.0.224:47248 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:26.534794159Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:26.824276981Z (APIServer pid=1) INFO:     10.0.0.224:52236 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:26.863558528Z (APIServer pid=1) INFO:     10.0.0.224:52196 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:27.215718659Z (APIServer pid=1) INFO:     10.0.0.224:52210 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:27.267740903Z (APIServer pid=1) INFO:     10.0.0.224:57924 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:27.389533520Z (APIServer pid=1) INFO:     10.0.0.224:57926 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:27.536573764Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:28.084269218Z (APIServer pid=1) INFO:     10.0.0.224:52268 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:28.536156412Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:28.559740931Z (APIServer pid=1) INFO:     10.0.0.224:52216 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:28.672227620Z (APIServer pid=1) INFO:     10.0.0.224:52254 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:28.842727196Z (APIServer pid=1) INFO:     10.0.0.224:42162 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:29.364094445Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:29.535850662Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:30.065085605Z (APIServer pid=1) INFO:     10.0.0.224:36924 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:30.409167133Z (APIServer pid=1) INFO 10-02 17:11:30 [loggers.py:310] Engine 000: Avg prompt throughput: 1597.8 tokens/s, Avg generation throughput: 682.2 tokens/s, Running: 16 reqs, Waiting: 0 reqs, GPU KV cache usage: 3.7%, Prefix cache hit rate: 0.0%
2026-10-02T17:11:30.535111944Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:30.710651079Z (APIServer pid=1) INFO:     10.0.0.224:52228 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:30.871602860Z (APIServer pid=1) INFO:     10.0.0.224:36912 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:30.951135932Z (APIServer pid=1) INFO:     10.0.0.224:52202 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:31.535378863Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:31.780231446Z (APIServer pid=1) INFO:     10.0.0.224:57018 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:31.782430355Z (APIServer pid=1) INFO:     10.0.0.224:52252 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:31.918093653Z (APIServer pid=1) INFO:     10.0.0.224:47234 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:32.535559258Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:32.780541428Z (APIServer pid=1) INFO:     10.0.0.224:47248 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:33.358090327Z (APIServer pid=1) INFO:     10.0.0.224:52210 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:33.425860695Z (APIServer pid=1) INFO:     10.0.0.224:57924 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:33.535333387Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:33.592385431Z (APIServer pid=1) INFO:     10.0.0.224:57926 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:34.104750495Z (APIServer pid=1) INFO:     10.0.0.224:52196 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:34.346237229Z (APIServer pid=1) INFO:     10.0.0.224:52268 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:34.456239801Z (APIServer pid=1) INFO:     10.0.0.224:52236 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:34.539259339Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:34.540324991Z (APIServer pid=1) INFO:     10.0.0.224:48468 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:35.058984369Z (APIServer pid=1) INFO:     10.0.0.224:42162 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:35.448342854Z (APIServer pid=1) INFO:     10.0.0.224:52254 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:35.534386800Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:35.820332799Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:36.004258056Z (APIServer pid=1) INFO:     10.0.0.224:52216 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:36.058756493Z (APIServer pid=1) INFO:     10.0.0.224:48474 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:36.345802497Z (APIServer pid=1) INFO:     10.0.0.224:48482 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:36.535737803Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:36.969778746Z (APIServer pid=1) INFO:     10.0.0.224:36924 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:37.271915833Z (APIServer pid=1) INFO:     10.0.0.224:52202 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:37.535746113Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:37.613406182Z (APIServer pid=1) INFO:     10.0.0.224:36912 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:37.633749705Z (APIServer pid=1) INFO:     10.0.0.224:52228 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:37.812958433Z (APIServer pid=1) INFO:     10.0.0.224:46274 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:37.899877951Z (APIServer pid=1) INFO:     10.0.0.224:46290 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:37.924182108Z (APIServer pid=1) INFO:     10.0.0.224:46292 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:37.992512212Z (APIServer pid=1) INFO:     10.0.0.224:46300 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:38.194131614Z (APIServer pid=1) INFO:     10.0.0.224:46310 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:38.206132717Z (APIServer pid=1) INFO:     10.0.0.224:46316 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:38.536005246Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:38.634645287Z (APIServer pid=1) INFO:     10.0.0.224:46318 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:38.853539945Z (APIServer pid=1) INFO:     10.0.0.224:47234 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:39.103555580Z (APIServer pid=1) INFO:     10.0.0.224:57018 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:39.224297784Z (APIServer pid=1) INFO:     10.0.0.224:52252 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:39.536859570Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:39.571640464Z (APIServer pid=1) INFO:     10.0.0.224:46324 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:39.774980704Z (APIServer pid=1) INFO:     10.0.0.224:46326 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:39.907099553Z (APIServer pid=1) INFO:     10.0.0.224:46342 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:40.409466290Z (APIServer pid=1) INFO 10-02 17:11:40 [loggers.py:310] Engine 000: Avg prompt throughput: 2038.7 tokens/s, Avg generation throughput: 733.3 tokens/s, Running: 30 reqs, Waiting: 0 reqs, GPU KV cache usage: 6.8%, Prefix cache hit rate: 0.0%
2026-10-02T17:11:40.535563318Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:41.081386547Z (APIServer pid=1) INFO:     10.0.0.224:57926 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:41.297988599Z (APIServer pid=1) INFO:     10.0.0.224:52196 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:41.307566260Z (APIServer pid=1) INFO:     10.0.0.224:57924 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:41.371921354Z (APIServer pid=1) INFO:     10.0.0.224:52210 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:41.536599435Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:41.640584733Z (APIServer pid=1) INFO:     10.0.0.224:52268 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:42.521326391Z (APIServer pid=1) INFO:     10.0.0.224:42162 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:42.535384596Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:42.694043360Z (APIServer pid=1) INFO:     10.0.0.224:52254 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:43.008389293Z (APIServer pid=1) INFO:     10.0.0.224:48468 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:43.151094166Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:43.161471335Z (APIServer pid=1) INFO:     10.0.0.224:52236 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:43.320883651Z (APIServer pid=1) INFO:     10.0.0.224:47248 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:43.534582535Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:43.966739530Z (APIServer pid=1) INFO:     10.0.0.224:48482 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:44.024220555Z (APIServer pid=1) INFO:     10.0.0.224:48474 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:44.047818669Z (APIServer pid=1) INFO:     10.0.0.224:52216 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:44.503182251Z (APIServer pid=1) INFO:     10.0.0.224:46348 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:44.534472178Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:45.055859262Z (APIServer pid=1) INFO:     10.0.0.224:52202 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:45.283253805Z (APIServer pid=1) INFO:     10.0.0.224:46274 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:45.371650069Z (APIServer pid=1) INFO:     10.0.0.224:46290 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:45.423241532Z (APIServer pid=1) INFO:     10.0.0.224:46292 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:45.535170849Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:46.535369815Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:47.498528244Z (APIServer pid=1) INFO:     10.0.0.224:46342 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:47.535989426Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:47.605655010Z (APIServer pid=1) INFO:     10.0.0.224:46326 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:47.837761784Z (APIServer pid=1) INFO:     10.0.0.224:46324 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:48.180311831Z (APIServer pid=1) INFO:     10.0.0.224:52210 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:48.534403145Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:48.632176040Z (APIServer pid=1) INFO:     10.0.0.224:52268 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:49.086633591Z (APIServer pid=1) INFO:     10.0.0.224:52196 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:49.253859029Z (APIServer pid=1) INFO:     10.0.0.224:42162 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:49.529097565Z (APIServer pid=1) INFO:     10.0.0.224:52254 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:49.536456669Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:49.623485384Z (APIServer pid=1) INFO:     10.0.0.224:57924 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:49.858373256Z (APIServer pid=1) INFO:     10.0.0.224:47248 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:50.263307058Z (APIServer pid=1) INFO:     10.0.0.224:52236 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:50.315308894Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:50.410780528Z (APIServer pid=1) INFO 10-02 17:11:50 [loggers.py:310] Engine 000: Avg prompt throughput: 1652.8 tokens/s, Avg generation throughput: 934.5 tokens/s, Running: 20 reqs, Waiting: 0 reqs, GPU KV cache usage: 4.6%, Prefix cache hit rate: 0.0%
2026-10-02T17:11:50.535079293Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:50.877324605Z (APIServer pid=1) INFO:     10.0.0.224:46348 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:51.241410134Z (APIServer pid=1) INFO:     10.0.0.224:48474 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:51.536536823Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:51.832546889Z (APIServer pid=1) INFO:     10.0.0.224:46292 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:52.248462301Z (APIServer pid=1) INFO:     10.0.0.224:46290 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:52.286373260Z (APIServer pid=1) INFO:     10.0.0.224:46274 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:52.487530480Z (APIServer pid=1) INFO:     10.0.0.224:52202 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:52.535495139Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:52.634962311Z (APIServer pid=1) INFO:     10.0.0.224:52216 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:53.305941652Z (APIServer pid=1) INFO:     10.0.0.224:48482 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:53.535224469Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:54.102922349Z (APIServer pid=1) INFO:     10.0.0.224:46326 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:54.260212411Z (APIServer pid=1) INFO:     10.0.0.224:46324 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:54.535101576Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:54.696040965Z (APIServer pid=1) INFO:     10.0.0.224:52210 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:54.856311289Z (APIServer pid=1) INFO:     10.0.0.224:46342 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:54.963396626Z (APIServer pid=1) INFO:     10.0.0.224:56762 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:55.517532028Z (APIServer pid=1) INFO:     10.0.0.224:52196 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:55.535196066Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:55.743286417Z (APIServer pid=1) INFO:     10.0.0.224:42162 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:55.750271636Z (APIServer pid=1) INFO:     10.0.0.224:52268 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:56.428240133Z (APIServer pid=1) INFO:     10.0.0.224:47248 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:56.466039723Z (APIServer pid=1) INFO:     10.0.0.224:57924 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:56.535511802Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:56.565031809Z (APIServer pid=1) INFO:     10.0.0.224:52254 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:56.953969278Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:57.026149998Z (APIServer pid=1) INFO:     10.0.0.224:52236 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:57.236932328Z (APIServer pid=1) INFO:     10.0.0.224:56774 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:57.535984744Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:58.011134567Z (APIServer pid=1) INFO:     10.0.0.224:48474 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:58.086291050Z (APIServer pid=1) INFO:     10.0.0.224:46348 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:58.239310594Z (APIServer pid=1) INFO:     10.0.0.224:36980 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:58.336887641Z (APIServer pid=1) INFO:     10.0.0.224:36982 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:58.379457531Z (APIServer pid=1) INFO:     10.0.0.224:36988 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:58.534313140Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:59.514158110Z (APIServer pid=1) INFO:     10.0.0.224:52216 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:59.534216516Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:11:59.600816005Z (APIServer pid=1) INFO:     10.0.0.224:52202 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:11:59.729014457Z (APIServer pid=1) INFO:     10.0.0.224:46274 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:00.411997505Z (APIServer pid=1) INFO 10-02 17:12:00 [loggers.py:310] Engine 000: Avg prompt throughput: 1707.9 tokens/s, Avg generation throughput: 768.7 tokens/s, Running: 22 reqs, Waiting: 0 reqs, GPU KV cache usage: 5.1%, Prefix cache hit rate: 0.0%
2026-10-02T17:12:00.535391392Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:00.571117319Z (APIServer pid=1) INFO:     10.0.0.224:48482 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:00.764010466Z (APIServer pid=1) INFO:     10.0.0.224:46290 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:00.825927189Z (APIServer pid=1) INFO:     10.0.0.224:46292 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:01.218377435Z (APIServer pid=1) INFO:     10.0.0.224:46324 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:01.522387987Z (APIServer pid=1) INFO:     10.0.0.224:46326 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:01.535047412Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:01.586514679Z (APIServer pid=1) INFO:     10.0.0.224:52210 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:01.679193363Z (APIServer pid=1) INFO:     10.0.0.224:36996 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:01.753749624Z (APIServer pid=1) INFO:     10.0.0.224:46342 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:01.893990688Z (APIServer pid=1) INFO:     10.0.0.224:56762 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:02.021861352Z (APIServer pid=1) INFO:     10.0.0.224:37008 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:02.115868233Z (APIServer pid=1) INFO:     10.0.0.224:37022 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:02.433978116Z (APIServer pid=1) INFO:     10.0.0.224:37030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:02.536776332Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:02.752145317Z (APIServer pid=1) INFO:     10.0.0.224:52196 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:02.916619263Z (APIServer pid=1) INFO:     10.0.0.224:37046 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:02.922525055Z (APIServer pid=1) INFO:     10.0.0.224:37056 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:03.131674194Z (APIServer pid=1) INFO:     10.0.0.224:52268 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:03.340520711Z (APIServer pid=1) INFO:     10.0.0.224:42162 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:03.440322624Z (APIServer pid=1) INFO:     10.0.0.224:37060 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:03.534183679Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:03.635271019Z (APIServer pid=1) INFO:     10.0.0.224:37074 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:03.659365140Z (APIServer pid=1) INFO:     10.0.0.224:37080 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:04.170081197Z (APIServer pid=1) INFO:     10.0.0.224:57924 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:04.536095314Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:04.766996875Z (APIServer pid=1) INFO:     10.0.0.224:56774 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:05.341058853Z (APIServer pid=1) INFO:     10.0.0.224:52236 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:05.343582844Z (APIServer pid=1) INFO:     10.0.0.224:60946 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:05.535972962Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:05.579044910Z (APIServer pid=1) INFO:     10.0.0.224:52254 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:05.798728763Z (APIServer pid=1) INFO:     10.0.0.224:36980 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:06.235131258Z (APIServer pid=1) INFO:     10.0.0.224:36988 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:06.461452856Z (APIServer pid=1) INFO:     10.0.0.224:36982 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:06.535416460Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:07.267918717Z (APIServer pid=1) INFO:     10.0.0.224:46274 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:07.273532729Z (APIServer pid=1) INFO:     10.0.0.224:52202 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:07.535412579Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:07.576151734Z (APIServer pid=1) INFO:     10.0.0.224:52216 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:07.599506019Z (APIServer pid=1) INFO:     10.0.0.224:46348 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:07.864352857Z (APIServer pid=1) INFO:     10.0.0.224:48474 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:07.968739781Z (APIServer pid=1) INFO:     10.0.0.224:47248 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:08.102951459Z (APIServer pid=1) INFO:     10.0.0.224:55592 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:08.385989317Z (APIServer pid=1) INFO:     10.0.0.224:55600 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:08.534759083Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:08.720672430Z (APIServer pid=1) INFO:     10.0.0.224:46290 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:09.305202037Z (APIServer pid=1) INFO:     10.0.0.224:46324 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:09.534587956Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:10.008242798Z (APIServer pid=1) INFO:     10.0.0.224:37030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:10.057170454Z (APIServer pid=1) INFO:     10.0.0.224:37022 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:10.102078755Z (APIServer pid=1) INFO:     10.0.0.224:37008 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:10.414591286Z (APIServer pid=1) INFO 10-02 17:12:10 [loggers.py:310] Engine 000: Avg prompt throughput: 2258.5 tokens/s, Avg generation throughput: 992.3 tokens/s, Running: 28 reqs, Waiting: 0 reqs, GPU KV cache usage: 6.5%, Prefix cache hit rate: 0.0%
2026-10-02T17:12:10.455713736Z (APIServer pid=1) INFO:     10.0.0.224:37046 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:10.535581829Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:10.901665808Z (APIServer pid=1) INFO:     10.0.0.224:37080 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:11.463861115Z (APIServer pid=1) INFO:     10.0.0.224:57924 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:11.467428415Z (APIServer pid=1) INFO:     10.0.0.224:37074 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:11.535141585Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:12.026988520Z (APIServer pid=1) INFO:     10.0.0.224:56774 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:12.148092987Z (APIServer pid=1) INFO:     10.0.0.224:37060 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:12.538908148Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:13.535878788Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:14.489424546Z (APIServer pid=1) INFO:     10.0.0.224:55592 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:14.497215907Z (APIServer pid=1) INFO:     10.0.0.224:55600 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:14.534997753Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:15.349230135Z (APIServer pid=1) INFO:     10.0.0.224:46324 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:15.535319064Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:16.220838565Z (APIServer pid=1) INFO:     10.0.0.224:37046 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:16.535253515Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:16.815781528Z (APIServer pid=1) INFO:     10.0.0.224:37080 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:17.196106877Z (APIServer pid=1) INFO:     10.0.0.224:57924 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:17.536135755Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:17.907961356Z (APIServer pid=1) INFO:     10.0.0.224:37060 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:17.952907008Z (APIServer pid=1) INFO:     10.0.0.224:56774 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:18.534654134Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:18.702739353Z (APIServer pid=1) INFO:     10.0.0.224:37074 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:19.178368418Z (APIServer pid=1) INFO:     10.0.0.224:37008 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:19.208671833Z (APIServer pid=1) INFO:     10.0.0.224:37022 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:19.537150460Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:19.588204236Z (APIServer pid=1) INFO:     10.0.0.224:37030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:19.590067631Z (APIServer pid=1) INFO:     10.0.0.224:46290 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:19.595568340Z (APIServer pid=1) INFO:     10.0.0.224:56982 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:19.794787652Z (APIServer pid=1) INFO:     10.0.0.224:56996 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:19.918469181Z (APIServer pid=1) INFO:     10.0.0.224:57004 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:20.126676331Z (APIServer pid=1) INFO:     10.0.0.224:57020 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:20.179835090Z (APIServer pid=1) INFO:     10.0.0.224:57030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:20.416312219Z (APIServer pid=1) INFO 10-02 17:12:20 [loggers.py:310] Engine 000: Avg prompt throughput: 1322.2 tokens/s, Avg generation throughput: 630.8 tokens/s, Running: 18 reqs, Waiting: 0 reqs, GPU KV cache usage: 3.9%, Prefix cache hit rate: 0.0%
2026-10-02T17:12:20.534748682Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:20.577521274Z (APIServer pid=1) INFO:     10.0.0.224:55600 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:20.805925201Z (APIServer pid=1) INFO:     10.0.0.224:55592 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:21.023598241Z (APIServer pid=1) INFO:     10.0.0.224:57046 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:21.537442159Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:21.880056314Z (APIServer pid=1) INFO:     10.0.0.224:46324 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:21.889186371Z (APIServer pid=1) INFO:     10.0.0.224:57052 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:22.535780208Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:22.536601057Z (APIServer pid=1) INFO:     10.0.0.224:37046 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:22.940002153Z (APIServer pid=1) INFO:     10.0.0.224:57068 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:22.941084626Z (APIServer pid=1) INFO:     10.0.0.224:57070 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:23.535576186Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:23.610140642Z (APIServer pid=1) INFO:     10.0.0.224:57924 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:23.749061585Z (APIServer pid=1) INFO:     10.0.0.224:37080 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:24.075157394Z (APIServer pid=1) INFO:     10.0.0.224:57076 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:24.102996069Z (APIServer pid=1) INFO:     10.0.0.224:57082 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:24.535296792Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:24.609192247Z (APIServer pid=1) INFO:     10.0.0.224:56774 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:24.837597706Z (APIServer pid=1) INFO:     10.0.0.224:37060 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:25.116354567Z (APIServer pid=1) INFO:     10.0.0.224:57086 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:25.193925355Z (APIServer pid=1) INFO:     10.0.0.224:57092 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:25.258331695Z (APIServer pid=1) INFO:     10.0.0.224:57098 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:25.534635077Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:25.835857726Z (APIServer pid=1) INFO:     10.0.0.224:37074 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:25.870250627Z (APIServer pid=1) INFO:     10.0.0.224:57114 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:26.285385604Z (APIServer pid=1) INFO:     10.0.0.224:37022 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:26.316785498Z (APIServer pid=1) INFO:     10.0.0.224:37008 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:26.374347243Z (APIServer pid=1) INFO:     10.0.0.224:57124 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:26.535219715Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:27.128224450Z (APIServer pid=1) INFO:     10.0.0.224:57030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:27.182014590Z (APIServer pid=1) INFO:     10.0.0.224:57020 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:27.535267748Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:27.676272040Z (APIServer pid=1) INFO:     10.0.0.224:55592 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:27.983520479Z (APIServer pid=1) INFO:     10.0.0.224:57046 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:28.054939691Z (APIServer pid=1) INFO:     10.0.0.224:55600 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:28.110584591Z (APIServer pid=1) INFO:     10.0.0.224:57004 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:28.536648125Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:28.754044503Z (APIServer pid=1) INFO:     10.0.0.224:56996 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:28.954878150Z (APIServer pid=1) INFO:     10.0.0.224:46324 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:28.997311502Z (APIServer pid=1) INFO:     10.0.0.224:57052 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:29.301166087Z (APIServer pid=1) INFO:     10.0.0.224:56982 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:29.535549536Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:29.758827119Z (APIServer pid=1) INFO:     10.0.0.224:37046 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:30.017026412Z (APIServer pid=1) INFO:     10.0.0.224:37030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:30.018016330Z (APIServer pid=1) INFO:     10.0.0.224:46290 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:30.297111198Z (APIServer pid=1) INFO:     10.0.0.224:57068 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:30.345045208Z (APIServer pid=1) INFO:     10.0.0.224:57070 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:30.415879036Z (APIServer pid=1) INFO 10-02 17:12:30 [loggers.py:310] Engine 000: Avg prompt throughput: 1928.6 tokens/s, Avg generation throughput: 843.3 tokens/s, Running: 28 reqs, Waiting: 0 reqs, GPU KV cache usage: 6.3%, Prefix cache hit rate: 0.0%
2026-10-02T17:12:30.507277484Z (APIServer pid=1) INFO:     10.0.0.224:42060 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:30.534073502Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:30.759130544Z (APIServer pid=1) INFO:     10.0.0.224:42062 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:30.810518010Z (APIServer pid=1) INFO:     10.0.0.224:42076 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:30.962264612Z (APIServer pid=1) INFO:     10.0.0.224:42092 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:31.091456246Z (APIServer pid=1) INFO:     10.0.0.224:42108 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:31.251154772Z (APIServer pid=1) INFO:     10.0.0.224:42110 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:31.309084221Z (APIServer pid=1) INFO:     10.0.0.224:42122 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:31.402828435Z (APIServer pid=1) INFO:     10.0.0.224:42134 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:31.533994025Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:31.595052849Z (APIServer pid=1) INFO:     10.0.0.224:57924 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:31.803235101Z (APIServer pid=1) INFO:     10.0.0.224:37080 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:31.950583805Z (APIServer pid=1) INFO:     10.0.0.224:42150 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:32.535317513Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:32.655365227Z (APIServer pid=1) INFO:     10.0.0.224:56774 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:32.797167595Z (APIServer pid=1) INFO:     10.0.0.224:57082 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:32.810407366Z (APIServer pid=1) INFO:     10.0.0.224:57076 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:32.896113544Z (APIServer pid=1) INFO:     10.0.0.224:37060 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:33.279179661Z (APIServer pid=1) INFO:     10.0.0.224:42158 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:33.360728786Z (APIServer pid=1) INFO:     10.0.0.224:57086 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:33.534289356Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:33.729442064Z (APIServer pid=1) INFO:     10.0.0.224:57098 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:34.136143817Z (APIServer pid=1) INFO:     10.0.0.224:57114 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:34.400474449Z (APIServer pid=1) INFO:     10.0.0.224:37074 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:34.534676567Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:34.763062179Z (APIServer pid=1) INFO:     10.0.0.224:57124 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:35.276520538Z (APIServer pid=1) INFO:     10.0.0.224:57020 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:35.535240562Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:35.564149768Z (APIServer pid=1) INFO:     10.0.0.224:57030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:35.714921059Z (APIServer pid=1) INFO:     10.0.0.224:37008 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:35.863647893Z (APIServer pid=1) INFO:     10.0.0.224:55592 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:36.037791161Z (APIServer pid=1) INFO:     10.0.0.224:37022 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:36.339900963Z (APIServer pid=1) INFO:     10.0.0.224:55600 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:36.534952211Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:36.707051633Z (APIServer pid=1) INFO:     10.0.0.224:57004 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:36.855156613Z (APIServer pid=1) INFO:     10.0.0.224:57046 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:36.976745574Z (APIServer pid=1) INFO:     10.0.0.224:57092 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:37.019744001Z (APIServer pid=1) INFO:     10.0.0.224:42174 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:37.088139098Z (APIServer pid=1) INFO:     10.0.0.224:42176 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:37.178139267Z (APIServer pid=1) INFO:     10.0.0.224:42188 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:37.356945644Z (APIServer pid=1) INFO:     10.0.0.224:56996 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:37.475821475Z (APIServer pid=1) INFO:     10.0.0.224:42200 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:37.535810752Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:37.613543264Z (APIServer pid=1) INFO:     10.0.0.224:50804 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:37.982394132Z (APIServer pid=1) INFO:     10.0.0.224:57052 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:38.067036763Z (APIServer pid=1) INFO:     10.0.0.224:46324 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:38.535260253Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:39.173008718Z (APIServer pid=1) INFO:     10.0.0.224:42060 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:39.213431867Z (APIServer pid=1) INFO:     10.0.0.224:42062 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:39.530670855Z (APIServer pid=1) INFO:     10.0.0.224:42108 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:39.536036649Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:39.853263733Z (APIServer pid=1) INFO:     10.0.0.224:57924 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:39.895191452Z (APIServer pid=1) INFO:     10.0.0.224:37080 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:40.295367712Z (APIServer pid=1) INFO:     10.0.0.224:42150 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:40.418791635Z (APIServer pid=1) INFO 10-02 17:12:40 [loggers.py:310] Engine 000: Avg prompt throughput: 2478.8 tokens/s, Avg generation throughput: 1108.5 tokens/s, Running: 33 reqs, Waiting: 0 reqs, GPU KV cache usage: 7.6%, Prefix cache hit rate: 0.0%
2026-10-02T17:12:40.535192125Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:40.717108050Z (APIServer pid=1) INFO:     10.0.0.224:42134 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:40.806258596Z (APIServer pid=1) INFO:     10.0.0.224:42122 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:41.535627187Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:41.746946938Z (APIServer pid=1) INFO:     10.0.0.224:57098 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:42.008234689Z (APIServer pid=1) INFO:     10.0.0.224:57114 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:42.261246954Z (APIServer pid=1) INFO:     10.0.0.224:37074 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:42.536030138Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:43.123486071Z (APIServer pid=1) INFO:     10.0.0.224:57020 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:43.205009878Z (APIServer pid=1) INFO:     10.0.0.224:57030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:43.244968632Z (APIServer pid=1) INFO:     10.0.0.224:57124 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:43.534637009Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:43.670273012Z (APIServer pid=1) INFO:     10.0.0.224:37022 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:43.908094196Z (APIServer pid=1) INFO:     10.0.0.224:55592 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:44.149662901Z (APIServer pid=1) INFO:     10.0.0.224:55600 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:44.534914882Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:44.555260169Z (APIServer pid=1) INFO:     10.0.0.224:42188 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:44.780093437Z (APIServer pid=1) INFO:     10.0.0.224:50804 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:45.085422353Z (APIServer pid=1) INFO:     10.0.0.224:46324 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:45.398455123Z (APIServer pid=1) INFO:     10.0.0.224:57052 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:45.534246180Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:45.631425404Z (APIServer pid=1) INFO:     10.0.0.224:42200 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:46.534724582Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:46.752727823Z (APIServer pid=1) INFO:     10.0.0.224:37080 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:47.536044380Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:47.852799403Z (APIServer pid=1) INFO:     10.0.0.224:42122 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:47.922381769Z (APIServer pid=1) INFO:     10.0.0.224:42134 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:47.980522247Z (APIServer pid=1) INFO:     10.0.0.224:42150 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:48.227288989Z (APIServer pid=1) INFO:     10.0.0.224:57098 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:48.309770161Z (APIServer pid=1) INFO:     10.0.0.224:57924 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:48.334220395Z (APIServer pid=1) INFO:     10.0.0.224:42108 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:48.455396335Z (APIServer pid=1) INFO:     10.0.0.224:42062 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:48.535085660Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:48.689800792Z (APIServer pid=1) INFO:     10.0.0.224:57114 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:48.946819166Z (APIServer pid=1) INFO:     10.0.0.224:37074 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:48.959477870Z (APIServer pid=1) INFO:     10.0.0.224:42060 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:49.273546615Z (APIServer pid=1) INFO:     10.0.0.224:56996 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:49.534654455Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:49.848385853Z (APIServer pid=1) INFO:     10.0.0.224:57020 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:49.851801057Z (APIServer pid=1) INFO:     10.0.0.224:60152 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:49.976555400Z (APIServer pid=1) INFO:     10.0.0.224:57030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:50.286438648Z (APIServer pid=1) INFO:     10.0.0.224:57124 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:50.420274014Z (APIServer pid=1) INFO 10-02 17:12:50 [loggers.py:310] Engine 000: Avg prompt throughput: 1818.0 tokens/s, Avg generation throughput: 890.7 tokens/s, Running: 24 reqs, Waiting: 0 reqs, GPU KV cache usage: 5.3%, Prefix cache hit rate: 0.0%
2026-10-02T17:12:50.534308621Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:50.670932849Z (APIServer pid=1) INFO:     10.0.0.224:55592 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:51.535161989Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:52.535351574Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:52.557806381Z (APIServer pid=1) INFO:     10.0.0.224:42200 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:53.534825881Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:53.942308725Z (APIServer pid=1) INFO:     10.0.0.224:37080 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:54.534777376Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:55.097239662Z (APIServer pid=1) INFO:     10.0.0.224:56996 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:55.158242349Z (APIServer pid=1) INFO:     10.0.0.224:42060 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:55.213529244Z (APIServer pid=1) INFO:     10.0.0.224:37074 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:55.308271690Z (APIServer pid=1) INFO:     10.0.0.224:57114 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:55.366467613Z (APIServer pid=1) INFO:     10.0.0.224:42062 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:55.438612543Z (APIServer pid=1) INFO:     10.0.0.224:42108 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:55.533919545Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:55.562113370Z (APIServer pid=1) INFO:     10.0.0.224:57924 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:55.646617319Z (APIServer pid=1) INFO:     10.0.0.224:57098 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:56.290484487Z (APIServer pid=1) INFO:     10.0.0.224:57124 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:56.535193616Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:56.602257019Z (APIServer pid=1) INFO:     10.0.0.224:55592 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:56.721601895Z (APIServer pid=1) INFO:     10.0.0.224:57030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:56.767554127Z (APIServer pid=1) INFO:     10.0.0.224:60152 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:56.770011001Z (APIServer pid=1) INFO:     10.0.0.224:57020 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:57.240180512Z (APIServer pid=1) INFO:     10.0.0.224:42150 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:57.490637114Z (APIServer pid=1) INFO:     10.0.0.224:42134 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:57.535212428Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:57.851748187Z (APIServer pid=1) INFO:     10.0.0.224:42122 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:57.914606787Z (APIServer pid=1) INFO:     10.0.0.224:51974 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:58.534826586Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:59.036005173Z (APIServer pid=1) INFO:     10.0.0.224:42200 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:59.319102543Z (APIServer pid=1) INFO:     10.0.0.224:51988 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:59.536070259Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:12:59.596795544Z (APIServer pid=1) INFO:     10.0.0.224:51992 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:59.657229880Z (APIServer pid=1) INFO:     10.0.0.224:52002 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:12:59.702873108Z (APIServer pid=1) INFO:     10.0.0.224:52004 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:00.002641971Z (APIServer pid=1) INFO:     10.0.0.224:52012 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:00.265783027Z (APIServer pid=1) INFO:     10.0.0.224:52020 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:00.421750451Z (APIServer pid=1) INFO 10-02 17:13:00 [loggers.py:310] Engine 000: Avg prompt throughput: 1487.5 tokens/s, Avg generation throughput: 708.0 tokens/s, Running: 25 reqs, Waiting: 0 reqs, GPU KV cache usage: 5.7%, Prefix cache hit rate: 0.0%
2026-10-02T17:13:00.535472568Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:00.693464532Z (APIServer pid=1) INFO:     10.0.0.224:37080 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:00.822821549Z (APIServer pid=1) INFO:     10.0.0.224:52024 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:01.535073943Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:02.032286266Z (APIServer pid=1) INFO:     10.0.0.224:57114 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:02.536160840Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:02.586950036Z (APIServer pid=1) INFO:     10.0.0.224:57098 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:03.194761014Z (APIServer pid=1) INFO:     10.0.0.224:60152 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:03.383959066Z (APIServer pid=1) INFO:     10.0.0.224:57020 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:03.453240354Z (APIServer pid=1) INFO:     10.0.0.224:57030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:03.466132979Z (APIServer pid=1) INFO:     10.0.0.224:55592 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:03.473871711Z (APIServer pid=1) INFO:     10.0.0.224:57124 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:03.515123533Z (APIServer pid=1) INFO:     10.0.0.224:42150 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:03.535229469Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:03.661069278Z (APIServer pid=1) INFO:     10.0.0.224:57924 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:03.706738035Z (APIServer pid=1) INFO:     10.0.0.224:42108 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:03.731708138Z (APIServer pid=1) INFO:     10.0.0.224:42062 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:03.978927212Z (APIServer pid=1) INFO:     10.0.0.224:37074 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:04.319325443Z (APIServer pid=1) INFO:     10.0.0.224:42134 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:04.534191775Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:04.846097839Z (APIServer pid=1) INFO:     10.0.0.224:51974 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:05.036626933Z (APIServer pid=1) INFO:     10.0.0.224:42122 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:05.345675195Z (APIServer pid=1) INFO:     10.0.0.224:42060 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:05.536247681Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:06.039109352Z (APIServer pid=1) INFO:     10.0.0.224:42200 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:06.535106733Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:07.535060731Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:07.775541531Z (APIServer pid=1) INFO:     10.0.0.224:52024 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:07.879587091Z (APIServer pid=1) INFO:     10.0.0.224:37080 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:08.368458276Z (APIServer pid=1) INFO:     10.0.0.224:52020 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:08.535325965Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:08.593394437Z (APIServer pid=1) INFO:     10.0.0.224:57114 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:08.756616788Z (APIServer pid=1) INFO:     10.0.0.224:52012 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:09.250174486Z (APIServer pid=1) INFO:     10.0.0.224:57098 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:09.534085239Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:09.592340554Z (APIServer pid=1) INFO:     10.0.0.224:52004 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:10.422143737Z (APIServer pid=1) INFO 10-02 17:13:10 [loggers.py:310] Engine 000: Avg prompt throughput: 1432.5 tokens/s, Avg generation throughput: 867.4 tokens/s, Running: 11 reqs, Waiting: 0 reqs, GPU KV cache usage: 2.5%, Prefix cache hit rate: 0.0%
2026-10-02T17:13:10.534853202Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:10.624352196Z (APIServer pid=1) INFO:     10.0.0.224:42134 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:11.263836212Z (APIServer pid=1) INFO:     10.0.0.224:42060 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:11.534935351Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:12.535006910Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:13.077117595Z (APIServer pid=1) INFO:     10.0.0.224:42200 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:13.238292083Z (APIServer pid=1) INFO:     10.0.0.224:42122 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:13.474744403Z (APIServer pid=1) INFO:     10.0.0.224:52024 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:13.534509115Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:13.916237867Z (APIServer pid=1) INFO:     10.0.0.224:52020 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:13.991665891Z (APIServer pid=1) INFO:     10.0.0.224:37080 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:14.469878806Z (APIServer pid=1) INFO:     10.0.0.224:52012 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:14.534414841Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:15.464415202Z (APIServer pid=1) INFO:     10.0.0.224:52004 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:15.504858288Z (APIServer pid=1) INFO:     10.0.0.224:57098 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:15.533620415Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:15.673865505Z (APIServer pid=1) INFO:     10.0.0.224:57114 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:15.851149537Z (APIServer pid=1) INFO:     10.0.0.224:32910 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:16.534355756Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:16.780353886Z (APIServer pid=1) INFO:     10.0.0.224:42060 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:17.269962041Z (APIServer pid=1) INFO:     10.0.0.224:42134 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:17.536031642Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:17.750107131Z (APIServer pid=1) INFO:     10.0.0.224:56544 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:18.295173382Z (APIServer pid=1) INFO:     10.0.0.224:56552 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:18.314380250Z (APIServer pid=1) INFO:     10.0.0.224:56564 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:18.317060468Z (APIServer pid=1) INFO:     10.0.0.224:56576 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:18.536287858Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:18.939422548Z (APIServer pid=1) INFO:     10.0.0.224:56592 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:19.439480769Z (APIServer pid=1) INFO:     10.0.0.224:52024 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:19.534264663Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:20.032543075Z (APIServer pid=1) INFO:     10.0.0.224:37080 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:20.051887003Z (APIServer pid=1) INFO:     10.0.0.224:52020 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:20.114510028Z (APIServer pid=1) INFO:     10.0.0.224:42122 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:20.268659051Z (APIServer pid=1) INFO:     10.0.0.224:42200 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:20.422635467Z (APIServer pid=1) INFO 10-02 17:13:20 [loggers.py:310] Engine 000: Avg prompt throughput: 1267.2 tokens/s, Avg generation throughput: 493.8 tokens/s, Running: 17 reqs, Waiting: 0 reqs, GPU KV cache usage: 3.8%, Prefix cache hit rate: 0.0%
2026-10-02T17:13:20.534770951Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:20.989757683Z (APIServer pid=1) INFO:     10.0.0.224:52012 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:21.052421194Z (APIServer pid=1) INFO:     10.0.0.224:56598 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:21.425478524Z (APIServer pid=1) INFO:     10.0.0.224:56602 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:21.534150281Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:21.628003801Z (APIServer pid=1) INFO:     10.0.0.224:52004 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:22.092362025Z (APIServer pid=1) INFO:     10.0.0.224:32910 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:22.535371989Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:22.678375652Z (APIServer pid=1) INFO:     10.0.0.224:57114 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:23.305743166Z (APIServer pid=1) INFO:     10.0.0.224:42060 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:23.342909650Z (APIServer pid=1) INFO:     10.0.0.224:57098 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:23.534295870Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:23.734263722Z (APIServer pid=1) INFO:     10.0.0.224:42134 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:24.534351357Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:24.584392803Z (APIServer pid=1) INFO:     10.0.0.224:56564 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:24.602543799Z (APIServer pid=1) INFO:     10.0.0.224:56576 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:24.752162605Z (APIServer pid=1) INFO:     10.0.0.224:56552 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:24.886556023Z (APIServer pid=1) INFO:     10.0.0.224:56544 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:24.898913610Z (APIServer pid=1) INFO:     10.0.0.224:56614 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:25.090208807Z (APIServer pid=1) INFO:     10.0.0.224:56624 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:25.372955142Z (APIServer pid=1) INFO:     10.0.0.224:56632 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:25.466402835Z (APIServer pid=1) INFO:     10.0.0.224:56592 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:25.534618442Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:26.017047000Z (APIServer pid=1) INFO:     10.0.0.224:52024 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:26.389754990Z (APIServer pid=1) INFO:     10.0.0.224:56648 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:26.499077467Z (APIServer pid=1) INFO:     10.0.0.224:56654 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:26.538424745Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:26.714412913Z (APIServer pid=1) INFO:     10.0.0.224:56668 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:26.959325504Z (APIServer pid=1) INFO:     10.0.0.224:42200 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:27.105746656Z (APIServer pid=1) INFO:     10.0.0.224:42122 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:27.539207353Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:27.859128177Z (APIServer pid=1) INFO:     10.0.0.224:56598 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:28.071987822Z (APIServer pid=1) INFO:     10.0.0.224:56602 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:28.534896540Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:28.933014715Z (APIServer pid=1) INFO:     10.0.0.224:32910 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:29.535395463Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:29.550492917Z (APIServer pid=1) INFO:     10.0.0.224:57114 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:29.939592285Z (APIServer pid=1) INFO:     10.0.0.224:57098 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:30.013591683Z (APIServer pid=1) INFO:     10.0.0.224:42060 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:30.159641695Z (APIServer pid=1) INFO:     10.0.0.224:52004 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:30.423301969Z (APIServer pid=1) INFO 10-02 17:13:30 [loggers.py:310] Engine 000: Avg prompt throughput: 1708.0 tokens/s, Avg generation throughput: 779.6 tokens/s, Running: 21 reqs, Waiting: 0 reqs, GPU KV cache usage: 4.9%, Prefix cache hit rate: 0.0%
2026-10-02T17:13:30.537100179Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:30.555463978Z (APIServer pid=1) INFO:     10.0.0.224:42134 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:30.776470343Z (APIServer pid=1) INFO:     10.0.0.224:52012 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:31.071947148Z (APIServer pid=1) INFO:     10.0.0.224:52020 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:31.256035739Z (APIServer pid=1) INFO:     10.0.0.224:37080 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:31.431814841Z (APIServer pid=1) INFO:     10.0.0.224:46316 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:31.535022730Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:31.875074486Z (APIServer pid=1) INFO:     10.0.0.224:56624 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:31.913229556Z (APIServer pid=1) INFO:     10.0.0.224:56632 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:32.155264377Z (APIServer pid=1) INFO:     10.0.0.224:56592 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:32.332434976Z (APIServer pid=1) INFO:     10.0.0.224:56614 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:32.535236533Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:33.068899989Z (APIServer pid=1) INFO:     10.0.0.224:56654 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:33.204643374Z (APIServer pid=1) INFO:     10.0.0.224:56648 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:33.326797379Z (APIServer pid=1) INFO:     10.0.0.224:56668 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:33.535490954Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:33.969172797Z (APIServer pid=1) INFO:     10.0.0.224:42122 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:34.132326349Z (APIServer pid=1) INFO:     10.0.0.224:42200 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:34.211555565Z (APIServer pid=1) INFO:     10.0.0.224:52024 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:34.526288140Z (APIServer pid=1) INFO:     10.0.0.224:56598 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:34.537074121Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:34.953620704Z (APIServer pid=1) INFO:     10.0.0.224:56602 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:34.958121335Z (APIServer pid=1) INFO:     10.0.0.224:56544 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:34.986211726Z (APIServer pid=1) INFO:     10.0.0.224:56552 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:35.058323092Z (APIServer pid=1) INFO:     10.0.0.224:56576 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:35.376047692Z (APIServer pid=1) INFO:     10.0.0.224:56564 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:35.535024883Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:35.595173840Z (APIServer pid=1) INFO:     10.0.0.224:46326 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:35.855433949Z (APIServer pid=1) INFO:     10.0.0.224:46338 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:35.999905351Z (APIServer pid=1) INFO:     10.0.0.224:32910 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:36.127209864Z (APIServer pid=1) INFO:     10.0.0.224:46352 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:36.163009289Z (APIServer pid=1) INFO:     10.0.0.224:46364 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:36.536050899Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:37.027122042Z (APIServer pid=1) INFO:     10.0.0.224:57114 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:37.535546487Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:37.582080455Z (APIServer pid=1) INFO:     10.0.0.224:52004 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:37.801257629Z (APIServer pid=1) INFO:     10.0.0.224:42134 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:38.030301881Z (APIServer pid=1) INFO:     10.0.0.224:52012 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:38.536655016Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:39.022235140Z (APIServer pid=1) INFO:     10.0.0.224:56592 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:39.086830206Z (APIServer pid=1) INFO:     10.0.0.224:56632 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:39.534410832Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:39.988239638Z (APIServer pid=1) INFO:     10.0.0.224:56654 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:40.087392043Z (APIServer pid=1) INFO:     10.0.0.224:56648 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:40.392107028Z (APIServer pid=1) INFO:     10.0.0.224:56668 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:40.424667121Z (APIServer pid=1) INFO 10-02 17:13:40 [loggers.py:310] Engine 000: Avg prompt throughput: 1873.2 tokens/s, Avg generation throughput: 891.6 tokens/s, Running: 22 reqs, Waiting: 0 reqs, GPU KV cache usage: 5.2%, Prefix cache hit rate: 0.0%
2026-10-02T17:13:40.431878918Z (APIServer pid=1) INFO:     10.0.0.224:56614 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:40.495984589Z (APIServer pid=1) INFO:     10.0.0.224:56624 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:40.531239797Z (APIServer pid=1) INFO:     10.0.0.224:46316 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:40.536461720Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:40.613321647Z (APIServer pid=1) INFO:     10.0.0.224:37080 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:40.639644581Z (APIServer pid=1) INFO:     10.0.0.224:52020 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:40.841609480Z (APIServer pid=1) INFO:     10.0.0.224:42060 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:40.915949131Z (APIServer pid=1) INFO:     10.0.0.224:57098 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:41.535243219Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:41.939487580Z (APIServer pid=1) INFO:     10.0.0.224:56598 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:42.233829724Z (APIServer pid=1) INFO:     10.0.0.224:56602 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:42.535485886Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:42.785504310Z (APIServer pid=1) INFO:     10.0.0.224:46338 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:42.804563029Z (APIServer pid=1) INFO:     10.0.0.224:46326 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:43.368326193Z (APIServer pid=1) INFO:     10.0.0.224:46364 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:43.415327894Z (APIServer pid=1) INFO:     10.0.0.224:46352 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:43.535770180Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:43.538465486Z (APIServer pid=1) INFO:     10.0.0.224:32910 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:43.566718071Z (APIServer pid=1) INFO:     10.0.0.224:56564 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:43.663408603Z (APIServer pid=1) INFO:     10.0.0.224:56576 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:44.375644900Z (APIServer pid=1) INFO:     10.0.0.224:57114 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:44.534586785Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:44.908212566Z (APIServer pid=1) INFO:     10.0.0.224:42134 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:45.096609576Z (APIServer pid=1) INFO:     10.0.0.224:52012 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:45.229557507Z (APIServer pid=1) INFO:     10.0.0.224:52004 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:45.246287652Z (APIServer pid=1) INFO:     10.0.0.224:56552 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:45.534923338Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:46.070965981Z (APIServer pid=1) INFO:     10.0.0.224:56544 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:46.256919900Z (APIServer pid=1) INFO:     10.0.0.224:56632 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:46.294866708Z (APIServer pid=1) INFO:     10.0.0.224:56592 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:46.318178711Z (APIServer pid=1) INFO:     10.0.0.224:52024 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:46.534420167Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:46.784345876Z (APIServer pid=1) INFO:     10.0.0.224:57124 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:47.007232598Z (APIServer pid=1) INFO:     10.0.0.224:57136 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:47.055531988Z (APIServer pid=1) INFO:     10.0.0.224:57142 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:47.366718932Z (APIServer pid=1) INFO:     10.0.0.224:57148 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:47.512609983Z (APIServer pid=1) INFO:     10.0.0.224:57162 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:47.537758863Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:47.947998195Z (APIServer pid=1) INFO:     10.0.0.224:56614 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:48.166615964Z (APIServer pid=1) INFO:     10.0.0.224:57098 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:48.385972305Z (APIServer pid=1) INFO:     10.0.0.224:42060 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:48.534965410Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:48.902087440Z (APIServer pid=1) INFO:     10.0.0.224:46316 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:49.119877076Z (APIServer pid=1) INFO:     10.0.0.224:56598 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:49.535069924Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:49.564551449Z (APIServer pid=1) INFO:     10.0.0.224:56602 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:49.783973695Z (APIServer pid=1) INFO:     10.0.0.224:52020 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:49.938891267Z (APIServer pid=1) INFO:     10.0.0.224:37080 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:50.139107286Z (APIServer pid=1) INFO:     10.0.0.224:46326 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:50.424194106Z (APIServer pid=1) INFO 10-02 17:13:50 [loggers.py:310] Engine 000: Avg prompt throughput: 2204.1 tokens/s, Avg generation throughput: 901.3 tokens/s, Running: 28 reqs, Waiting: 0 reqs, GPU KV cache usage: 6.4%, Prefix cache hit rate: 0.0%
2026-10-02T17:13:50.477841295Z (APIServer pid=1) INFO:     10.0.0.224:46338 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:50.535094898Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:50.600500382Z (APIServer pid=1) INFO:     10.0.0.224:56624 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:50.851523703Z (APIServer pid=1) INFO:     10.0.0.224:46352 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:51.333646140Z (APIServer pid=1) INFO:     10.0.0.224:56576 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:51.511195583Z (APIServer pid=1) INFO:     10.0.0.224:32910 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:51.521724739Z (APIServer pid=1) INFO:     10.0.0.224:56564 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:51.535546417Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:51.587070801Z (APIServer pid=1) INFO:     10.0.0.224:46364 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:51.630250531Z (APIServer pid=1) INFO:     10.0.0.224:56668 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:51.966847186Z (APIServer pid=1) INFO:     10.0.0.224:57114 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:52.133755742Z (APIServer pid=1) INFO:     10.0.0.224:56648 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:52.180114370Z (APIServer pid=1) INFO:     10.0.0.224:56654 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:52.535474438Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:52.991084303Z (APIServer pid=1) INFO:     10.0.0.224:56552 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:52.993288542Z (APIServer pid=1) INFO:     10.0.0.224:52004 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:53.105762723Z (APIServer pid=1) INFO:     10.0.0.224:52012 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:53.299097238Z (APIServer pid=1) INFO:     10.0.0.224:42134 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:53.534758914Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:53.593944373Z (APIServer pid=1) INFO:     10.0.0.224:36014 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:53.778335234Z (APIServer pid=1) INFO:     10.0.0.224:36024 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:54.068437846Z (APIServer pid=1) INFO:     10.0.0.224:56544 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:54.203937861Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:54.520514354Z (APIServer pid=1) INFO:     10.0.0.224:52024 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:54.535394368Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:54.537810789Z (APIServer pid=1) INFO:     10.0.0.224:56592 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:54.977161716Z (APIServer pid=1) INFO:     10.0.0.224:57142 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:55.535096503Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:55.694356207Z (APIServer pid=1) INFO:     10.0.0.224:56614 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:56.241626041Z (APIServer pid=1) INFO:     10.0.0.224:42060 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:56.489457479Z (APIServer pid=1) INFO:     10.0.0.224:57098 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:56.534647211Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:56.764626175Z (APIServer pid=1) INFO:     10.0.0.224:46316 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:56.986592282Z (APIServer pid=1) INFO:     10.0.0.224:56598 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:57.169598428Z (APIServer pid=1) INFO:     10.0.0.224:57162 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:57.386133679Z (APIServer pid=1) INFO:     10.0.0.224:56602 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:57.536250652Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:58.108080105Z (APIServer pid=1) INFO:     10.0.0.224:46338 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:58.307249398Z (APIServer pid=1) INFO:     10.0.0.224:56624 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:58.417594463Z (APIServer pid=1) INFO:     10.0.0.224:46326 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:58.534539830Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:58.668642068Z (APIServer pid=1) INFO:     10.0.0.224:46352 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:13:59.534974154Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:13:59.703170379Z (APIServer pid=1) INFO:     10.0.0.224:56654 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:00.426186454Z (APIServer pid=1) INFO 10-02 17:14:00 [loggers.py:310] Engine 000: Avg prompt throughput: 1873.0 tokens/s, Avg generation throughput: 1040.8 tokens/s, Running: 18 reqs, Waiting: 0 reqs, GPU KV cache usage: 4.3%, Prefix cache hit rate: 0.0%
2026-10-02T17:14:00.535387640Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:00.664528808Z (APIServer pid=1) INFO:     10.0.0.224:56544 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:01.480320497Z (APIServer pid=1) INFO:     10.0.0.224:57142 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:01.534044642Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:02.046755140Z (APIServer pid=1) INFO:     10.0.0.224:56614 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:02.201526617Z (APIServer pid=1) INFO:     10.0.0.224:56592 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:02.339842625Z (APIServer pid=1) INFO:     10.0.0.224:52024 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:02.495110306Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:02.529204464Z (APIServer pid=1) INFO:     10.0.0.224:36024 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:02.534441665Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:02.717253727Z (APIServer pid=1) INFO:     10.0.0.224:42060 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:02.764504998Z (APIServer pid=1) INFO:     10.0.0.224:36014 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:02.810577956Z (APIServer pid=1) INFO:     10.0.0.224:42134 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:03.304859364Z (APIServer pid=1) INFO:     10.0.0.224:46316 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:03.535550202Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:04.535762246Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:05.329309324Z (APIServer pid=1) INFO:     10.0.0.224:46352 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:05.533558643Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:06.507086420Z (APIServer pid=1) INFO:     10.0.0.224:56544 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:06.534884107Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:06.797892510Z (APIServer pid=1) INFO:     10.0.0.224:56654 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:06.851425353Z (APIServer pid=1) INFO:     10.0.0.224:46326 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:07.076749824Z (APIServer pid=1) INFO:     10.0.0.224:56624 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:07.534354131Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:08.090023753Z (APIServer pid=1) INFO:     10.0.0.224:52024 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:08.110029429Z (APIServer pid=1) INFO:     10.0.0.224:56592 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:08.534560274Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:08.556143877Z (APIServer pid=1) INFO:     10.0.0.224:42134 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:09.458132848Z (APIServer pid=1) INFO:     10.0.0.224:46316 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:09.533842243Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:09.570349814Z (APIServer pid=1) INFO:     10.0.0.224:36014 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:09.702760621Z (APIServer pid=1) INFO:     10.0.0.224:42060 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:09.749463577Z (APIServer pid=1) INFO:     10.0.0.224:36024 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:10.427537036Z (APIServer pid=1) INFO 10-02 17:14:10 [loggers.py:310] Engine 000: Avg prompt throughput: 1267.1 tokens/s, Avg generation throughput: 587.9 tokens/s, Running: 12 reqs, Waiting: 0 reqs, GPU KV cache usage: 2.7%, Prefix cache hit rate: 0.0%
2026-10-02T17:14:10.534135210Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:10.675399090Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:11.534736076Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:11.578638699Z (APIServer pid=1) INFO:     10.0.0.224:46352 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:11.613967547Z (APIServer pid=1) INFO:     10.0.0.224:56614 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:11.638030967Z (APIServer pid=1) INFO:     10.0.0.224:57142 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:11.853556262Z (APIServer pid=1) INFO:     10.0.0.224:42100 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:12.031223816Z (APIServer pid=1) INFO:     10.0.0.224:42108 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:12.078221048Z (APIServer pid=1) INFO:     10.0.0.224:42116 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:12.279148419Z (APIServer pid=1) INFO:     10.0.0.224:42128 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:12.310743712Z (APIServer pid=1) INFO:     10.0.0.224:42140 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:12.346106021Z (APIServer pid=1) INFO:     10.0.0.224:42146 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:12.538205686Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:13.038432299Z (APIServer pid=1) INFO:     10.0.0.224:46326 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:13.252314423Z (APIServer pid=1) INFO:     10.0.0.224:56624 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:13.535167617Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:13.970254688Z (APIServer pid=1) INFO:     10.0.0.224:56654 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:14.117421777Z (APIServer pid=1) INFO:     10.0.0.224:56544 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:14.478083266Z (APIServer pid=1) INFO:     10.0.0.224:56592 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:14.534208770Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:14.811002251Z (APIServer pid=1) INFO:     10.0.0.224:52024 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:15.168732981Z (APIServer pid=1) INFO:     10.0.0.224:42134 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:15.527219506Z (APIServer pid=1) INFO:     10.0.0.224:42150 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:15.535436410Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:16.087883811Z (APIServer pid=1) INFO:     10.0.0.224:42060 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:16.407606058Z (APIServer pid=1) INFO:     10.0.0.224:36024 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:16.422985315Z (APIServer pid=1) INFO:     10.0.0.224:36014 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:16.477044562Z (APIServer pid=1) INFO:     10.0.0.224:46316 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:16.534847572Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:16.704785492Z (APIServer pid=1) INFO:     10.0.0.224:42158 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:16.820443230Z (APIServer pid=1) INFO:     10.0.0.224:42174 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:17.000357824Z (APIServer pid=1) INFO:     10.0.0.224:42188 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:17.133244538Z (APIServer pid=1) INFO:     10.0.0.224:42192 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:17.429753087Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:17.535401368Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:18.167567058Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:18.420345668Z (APIServer pid=1) INFO:     10.0.0.224:37980 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:18.534843107Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:18.786880710Z (APIServer pid=1) INFO:     10.0.0.224:42100 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:18.888258444Z (APIServer pid=1) INFO:     10.0.0.224:57142 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:19.285231974Z (APIServer pid=1) INFO:     10.0.0.224:42146 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:19.344488648Z (APIServer pid=1) INFO:     10.0.0.224:42140 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:19.534544506Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:19.537364816Z (APIServer pid=1) INFO:     10.0.0.224:42128 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:19.581585169Z (APIServer pid=1) INFO:     10.0.0.224:42116 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:19.637319356Z (APIServer pid=1) INFO:     10.0.0.224:42108 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:19.933857751Z (APIServer pid=1) INFO:     10.0.0.224:56614 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:20.296117976Z (APIServer pid=1) INFO:     10.0.0.224:56624 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:20.319078757Z (APIServer pid=1) INFO:     10.0.0.224:46326 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:20.429028254Z (APIServer pid=1) INFO 10-02 17:14:20 [loggers.py:310] Engine 000: Avg prompt throughput: 2093.5 tokens/s, Avg generation throughput: 755.6 tokens/s, Running: 27 reqs, Waiting: 0 reqs, GPU KV cache usage: 5.9%, Prefix cache hit rate: 0.0%
2026-10-02T17:14:20.535498086Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:20.789175062Z (APIServer pid=1) INFO:     10.0.0.224:46352 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:21.288927380Z (APIServer pid=1) INFO:     10.0.0.224:56544 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:21.534107294Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:22.109775137Z (APIServer pid=1) INFO:     10.0.0.224:52024 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:22.496473430Z (APIServer pid=1) INFO:     10.0.0.224:42134 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:22.534537517Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:22.685592821Z (APIServer pid=1) INFO:     10.0.0.224:42150 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:23.153732444Z (APIServer pid=1) INFO:     10.0.0.224:56592 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:23.237330393Z (APIServer pid=1) INFO:     10.0.0.224:42060 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:23.331734981Z (APIServer pid=1) INFO:     10.0.0.224:56654 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:23.396516217Z (APIServer pid=1) INFO:     10.0.0.224:37992 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:23.401977461Z (APIServer pid=1) INFO:     10.0.0.224:37998 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:23.535207031Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:23.709488448Z (APIServer pid=1) INFO:     10.0.0.224:38010 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:24.120427648Z (APIServer pid=1) INFO:     10.0.0.224:42174 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:24.304068332Z (APIServer pid=1) INFO:     10.0.0.224:42192 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:24.533556789Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:24.560858932Z (APIServer pid=1) INFO:     10.0.0.224:42188 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:24.957088669Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:25.406800213Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:25.534844180Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:25.724859863Z (APIServer pid=1) INFO:     10.0.0.224:37980 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:26.059111062Z (APIServer pid=1) INFO:     10.0.0.224:57142 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:26.518967726Z (APIServer pid=1) INFO:     10.0.0.224:42140 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:26.534375297Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:26.591418753Z (APIServer pid=1) INFO:     10.0.0.224:42128 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:26.725389843Z (APIServer pid=1) INFO:     10.0.0.224:42116 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:27.091893464Z (APIServer pid=1) INFO:     10.0.0.224:56614 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:27.376355312Z (APIServer pid=1) INFO:     10.0.0.224:46326 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:27.534138240Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:28.158283647Z (APIServer pid=1) INFO:     10.0.0.224:56544 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:28.292617471Z (APIServer pid=1) INFO:     10.0.0.224:46352 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:28.451190067Z (APIServer pid=1) INFO:     10.0.0.224:56624 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:28.537072196Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:29.136740720Z (APIServer pid=1) INFO:     10.0.0.224:52024 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:29.245116318Z (APIServer pid=1) INFO:     10.0.0.224:42108 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:29.362157716Z (APIServer pid=1) INFO:     10.0.0.224:42146 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:29.535852394Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:29.693744066Z (APIServer pid=1) INFO:     10.0.0.224:42134 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:29.852501732Z (APIServer pid=1) INFO:     10.0.0.224:42150 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:30.430874818Z (APIServer pid=1) INFO 10-02 17:14:30 [loggers.py:310] Engine 000: Avg prompt throughput: 1762.9 tokens/s, Avg generation throughput: 958.3 tokens/s, Running: 20 reqs, Waiting: 0 reqs, GPU KV cache usage: 4.6%, Prefix cache hit rate: 0.0%
2026-10-02T17:14:30.479203803Z (APIServer pid=1) INFO:     10.0.0.224:38010 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:30.535300964Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:31.131744544Z (APIServer pid=1) INFO:     10.0.0.224:42188 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:31.452077643Z (APIServer pid=1) INFO:     10.0.0.224:42192 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:31.534347816Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:32.306421836Z (APIServer pid=1) INFO:     10.0.0.224:37980 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:32.341618313Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:32.534099547Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:32.791198448Z (APIServer pid=1) INFO:     10.0.0.224:57142 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:33.010896894Z (APIServer pid=1) INFO:     10.0.0.224:42140 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:33.059826423Z (APIServer pid=1) INFO:     10.0.0.224:42116 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:33.243397535Z (APIServer pid=1) INFO:     10.0.0.224:42128 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:33.534769100Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:33.801065655Z (APIServer pid=1) INFO:     10.0.0.224:46326 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:34.308598973Z (APIServer pid=1) INFO:     10.0.0.224:56614 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:34.533078350Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:34.677458861Z (APIServer pid=1) INFO:     10.0.0.224:46352 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:34.843884924Z (APIServer pid=1) INFO:     10.0.0.224:56624 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:35.188774014Z (APIServer pid=1) INFO:     10.0.0.224:56544 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:35.304242484Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:35.533378637Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:35.588533700Z (APIServer pid=1) INFO:     10.0.0.224:42174 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:36.534096339Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:36.550230710Z (APIServer pid=1) INFO:     10.0.0.224:42150 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:36.574998271Z (APIServer pid=1) INFO:     10.0.0.224:42134 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:36.965169325Z (APIServer pid=1) INFO:     10.0.0.224:38010 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:37.078768609Z (APIServer pid=1) INFO:     10.0.0.224:42146 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:37.533777687Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:37.960811412Z (APIServer pid=1) INFO:     10.0.0.224:42192 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:38.217381195Z (APIServer pid=1) INFO:     10.0.0.224:42188 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:38.248199310Z (APIServer pid=1) INFO:     10.0.0.224:42108 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:38.534084063Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:38.957615041Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:39.053739793Z (APIServer pid=1) INFO:     10.0.0.224:37980 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:39.533926916Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:39.941331245Z (APIServer pid=1) INFO:     10.0.0.224:42128 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:40.070759082Z (APIServer pid=1) INFO:     10.0.0.224:46326 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:40.432349764Z (APIServer pid=1) INFO 10-02 17:14:40 [loggers.py:310] Engine 000: Avg prompt throughput: 1487.4 tokens/s, Avg generation throughput: 749.5 tokens/s, Running: 17 reqs, Waiting: 0 reqs, GPU KV cache usage: 4.0%, Prefix cache hit rate: 0.0%
2026-10-02T17:14:40.535067626Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:40.602950985Z (APIServer pid=1) INFO:     10.0.0.224:56614 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:40.664731570Z (APIServer pid=1) INFO:     10.0.0.224:42116 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:40.788534895Z (APIServer pid=1) INFO:     10.0.0.224:42140 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:41.534937098Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:41.554937624Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:41.961753112Z (APIServer pid=1) INFO:     10.0.0.224:42174 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:42.112743003Z (APIServer pid=1) INFO:     10.0.0.224:56544 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:42.533744876Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:42.634166698Z (APIServer pid=1) INFO:     10.0.0.224:56624 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:42.665387092Z (APIServer pid=1) INFO:     10.0.0.224:46352 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:43.122103811Z (APIServer pid=1) INFO:     10.0.0.224:42134 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:43.535671870Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:43.695285320Z (APIServer pid=1) INFO:     10.0.0.224:42146 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:43.945802593Z (APIServer pid=1) INFO:     10.0.0.224:38010 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:44.535242328Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:44.868510200Z (APIServer pid=1) INFO:     10.0.0.224:42108 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:44.945727559Z (APIServer pid=1) INFO:     10.0.0.224:42188 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:45.369842577Z (APIServer pid=1) INFO:     10.0.0.224:37980 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:45.480654611Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:45.533745030Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:45.810087398Z (APIServer pid=1) INFO:     10.0.0.224:42192 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:46.062047874Z (APIServer pid=1) INFO:     10.0.0.224:42150 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:46.136733797Z (APIServer pid=1) INFO:     10.0.0.224:52148 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:46.534813944Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:46.902666990Z (APIServer pid=1) INFO:     10.0.0.224:42140 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:46.977225513Z (APIServer pid=1) INFO:     10.0.0.224:42116 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:47.204241456Z (APIServer pid=1) INFO:     10.0.0.224:56614 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:47.535673915Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:48.167158907Z (APIServer pid=1) INFO:     10.0.0.224:42174 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:48.244633101Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:48.533729554Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:49.033250112Z (APIServer pid=1) INFO:     10.0.0.224:46352 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:49.067725338Z (APIServer pid=1) INFO:     10.0.0.224:56624 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:49.102260347Z (APIServer pid=1) INFO:     10.0.0.224:56544 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:49.126784819Z (APIServer pid=1) INFO:     10.0.0.224:46326 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:49.364511869Z (APIServer pid=1) INFO:     10.0.0.224:42128 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:49.425135411Z (APIServer pid=1) INFO:     10.0.0.224:42526 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:49.535055181Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:50.241458625Z (APIServer pid=1) INFO:     10.0.0.224:42146 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:50.331656395Z (APIServer pid=1) INFO:     10.0.0.224:42134 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:50.432488902Z (APIServer pid=1) INFO 10-02 17:14:50 [loggers.py:310] Engine 000: Avg prompt throughput: 1653.0 tokens/s, Avg generation throughput: 688.8 tokens/s, Running: 20 reqs, Waiting: 0 reqs, GPU KV cache usage: 4.4%, Prefix cache hit rate: 0.0%
2026-10-02T17:14:50.536906571Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:50.547336791Z (APIServer pid=1) INFO:     10.0.0.224:38010 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:50.634522597Z (APIServer pid=1) INFO:     10.0.0.224:42530 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:50.789127899Z (APIServer pid=1) INFO:     10.0.0.224:42542 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:50.831570557Z (APIServer pid=1) INFO:     10.0.0.224:42548 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:51.365632005Z (APIServer pid=1) INFO:     10.0.0.224:42552 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:51.533716358Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:51.730880136Z (APIServer pid=1) INFO:     10.0.0.224:42108 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:52.265245878Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:52.266345673Z (APIServer pid=1) INFO:     10.0.0.224:37980 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:52.304762217Z (APIServer pid=1) INFO:     10.0.0.224:42188 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:52.469668932Z (APIServer pid=1) INFO:     10.0.0.224:42556 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:52.533748606Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:53.065327560Z (APIServer pid=1) INFO:     10.0.0.224:52148 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:53.248466385Z (APIServer pid=1) INFO:     10.0.0.224:42150 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:53.536543974Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:53.985370987Z (APIServer pid=1) INFO:     10.0.0.224:42116 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:54.350520492Z (APIServer pid=1) INFO:     10.0.0.224:56614 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:54.534862489Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:54.645325574Z (APIServer pid=1) INFO:     10.0.0.224:42140 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:54.835598822Z (APIServer pid=1) INFO:     10.0.0.224:42192 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:54.940637883Z (APIServer pid=1) INFO:     10.0.0.224:42568 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:54.978324518Z (APIServer pid=1) INFO:     10.0.0.224:42572 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:55.139759194Z (APIServer pid=1) INFO:     10.0.0.224:42586 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:55.294132497Z (APIServer pid=1) INFO:     10.0.0.224:42600 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:55.535383798Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:55.663343184Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:56.535192162Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:56.802075574Z (APIServer pid=1) INFO:     10.0.0.224:42526 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:57.096152542Z (APIServer pid=1) INFO:     10.0.0.224:42128 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:57.183497880Z (APIServer pid=1) INFO:     10.0.0.224:56624 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:57.534752549Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:57.719236963Z (APIServer pid=1) INFO:     10.0.0.224:42548 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:57.882983241Z (APIServer pid=1) INFO:     10.0.0.224:42542 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:58.181297003Z (APIServer pid=1) INFO:     10.0.0.224:42552 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:58.534359693Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:14:58.939189022Z (APIServer pid=1) INFO:     10.0.0.224:42108 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:59.360742356Z (APIServer pid=1) INFO:     10.0.0.224:42556 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:59.422019921Z (APIServer pid=1) INFO:     10.0.0.224:42188 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:14:59.534749683Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:00.006743776Z (APIServer pid=1) INFO:     10.0.0.224:42150 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:00.433380220Z (APIServer pid=1) INFO 10-02 17:15:00 [loggers.py:310] Engine 000: Avg prompt throughput: 1763.0 tokens/s, Avg generation throughput: 897.7 tokens/s, Running: 19 reqs, Waiting: 0 reqs, GPU KV cache usage: 4.5%, Prefix cache hit rate: 0.0%
2026-10-02T17:15:00.470534802Z (APIServer pid=1) INFO:     10.0.0.224:52148 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:00.471495053Z (APIServer pid=1) INFO:     10.0.0.224:37980 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:00.535190881Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:00.583021065Z (APIServer pid=1) INFO:     10.0.0.224:42116 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:00.925758573Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:01.396749693Z (APIServer pid=1) INFO:     10.0.0.224:42140 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:01.535194663Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:02.001722823Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:02.275590783Z (APIServer pid=1) INFO:     10.0.0.224:42600 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:02.534151339Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:02.538516635Z (APIServer pid=1) INFO:     10.0.0.224:42586 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:02.569600704Z (APIServer pid=1) INFO:     10.0.0.224:42572 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:02.611535573Z (APIServer pid=1) INFO:     10.0.0.224:42568 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:03.534616292Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:03.657598798Z (APIServer pid=1) INFO:     10.0.0.224:56624 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:03.881826959Z (APIServer pid=1) INFO:     10.0.0.224:42128 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:03.999749739Z (APIServer pid=1) INFO:     10.0.0.224:42526 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:04.327095177Z (APIServer pid=1) INFO:     10.0.0.224:42542 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:04.444721917Z (APIServer pid=1) INFO:     10.0.0.224:42548 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:04.535820678Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:04.902364203Z (APIServer pid=1) INFO:     10.0.0.224:42552 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:05.264195094Z (APIServer pid=1) INFO:     10.0.0.224:42192 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:05.428737164Z (APIServer pid=1) INFO:     10.0.0.224:56614 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:05.534756526Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:05.572758164Z (APIServer pid=1) INFO:     10.0.0.224:42108 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:05.703314892Z (APIServer pid=1) INFO:     10.0.0.224:45544 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:06.534574617Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:06.901300936Z (APIServer pid=1) INFO:     10.0.0.224:42150 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:06.928638885Z (APIServer pid=1) INFO:     10.0.0.224:42188 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:07.063736200Z (APIServer pid=1) INFO:     10.0.0.224:42116 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:07.212969485Z (APIServer pid=1) INFO:     10.0.0.224:37980 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:07.535220129Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:07.779422557Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:08.231993533Z (APIServer pid=1) INFO:     10.0.0.224:42140 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:08.534219524Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:09.033743268Z (APIServer pid=1) INFO:     10.0.0.224:42568 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:09.495777529Z (APIServer pid=1) INFO:     10.0.0.224:42572 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:09.533982401Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:10.167079654Z (APIServer pid=1) INFO:     10.0.0.224:42128 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:10.434501440Z (APIServer pid=1) INFO 10-02 17:15:10 [loggers.py:310] Engine 000: Avg prompt throughput: 1597.7 tokens/s, Avg generation throughput: 777.2 tokens/s, Running: 16 reqs, Waiting: 0 reqs, GPU KV cache usage: 3.8%, Prefix cache hit rate: 0.0%
2026-10-02T17:15:10.534421814Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:11.111429299Z (APIServer pid=1) INFO:     10.0.0.224:42552 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:11.352000425Z (APIServer pid=1) INFO:     10.0.0.224:42192 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:11.403452242Z (APIServer pid=1) INFO:     10.0.0.224:56614 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:11.533737206Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:11.544031428Z (APIServer pid=1) INFO:     10.0.0.224:42548 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:11.573720564Z (APIServer pid=1) INFO:     10.0.0.224:42542 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:11.708884885Z (APIServer pid=1) INFO:     10.0.0.224:42108 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:12.036521310Z (APIServer pid=1) INFO:     10.0.0.224:45544 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:12.192991079Z (APIServer pid=1) INFO:     10.0.0.224:42526 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:12.205374584Z (APIServer pid=1) INFO:     10.0.0.224:56624 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:12.381050879Z (APIServer pid=1) INFO:     10.0.0.224:42586 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:12.468324672Z (APIServer pid=1) INFO:     10.0.0.224:42600 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:12.534495860Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:12.555798532Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:12.681060961Z (APIServer pid=1) INFO:     10.0.0.224:46772 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:12.763191790Z (APIServer pid=1) INFO:     10.0.0.224:46780 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:12.970402354Z (APIServer pid=1) INFO:     10.0.0.224:46788 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:13.024841156Z (APIServer pid=1) INFO:     10.0.0.224:46800 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:13.113506195Z (APIServer pid=1) INFO:     10.0.0.224:46808 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:13.125765113Z (APIServer pid=1) INFO:     10.0.0.224:46816 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:13.251918754Z (APIServer pid=1) INFO:     10.0.0.224:46832 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:13.533903907Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:14.034067367Z (APIServer pid=1) INFO:     10.0.0.224:37980 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:14.232123919Z (APIServer pid=1) INFO:     10.0.0.224:42116 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:14.330183122Z (APIServer pid=1) INFO:     10.0.0.224:42188 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:14.477887491Z (APIServer pid=1) INFO:     10.0.0.224:42150 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:14.533963593Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:15.343242763Z (APIServer pid=1) INFO:     10.0.0.224:42140 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:15.460811676Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:15.534011294Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:16.534592855Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:16.592578258Z (APIServer pid=1) INFO:     10.0.0.224:42572 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:17.157126987Z (APIServer pid=1) INFO:     10.0.0.224:42568 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:17.232007156Z (APIServer pid=1) INFO:     10.0.0.224:46846 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:17.233977684Z (APIServer pid=1) INFO:     10.0.0.224:46852 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:17.534983545Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:17.603773403Z (APIServer pid=1) INFO:     10.0.0.224:42128 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:17.671422309Z (APIServer pid=1) INFO:     10.0.0.224:49048 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:17.743098925Z (APIServer pid=1) INFO:     10.0.0.224:49060 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:18.534032041Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:18.555188098Z (APIServer pid=1) INFO:     10.0.0.224:49062 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:18.823388313Z (APIServer pid=1) INFO:     10.0.0.224:42552 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:19.325140811Z (APIServer pid=1) INFO:     10.0.0.224:42108 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:19.535098015Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:19.832036912Z (APIServer pid=1) INFO:     10.0.0.224:46780 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:19.898940652Z (APIServer pid=1) INFO:     10.0.0.224:46772 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:20.032792677Z (APIServer pid=1) INFO:     10.0.0.224:46788 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:20.199994133Z (APIServer pid=1) INFO:     10.0.0.224:46816 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:20.435714065Z (APIServer pid=1) INFO 10-02 17:15:20 [loggers.py:310] Engine 000: Avg prompt throughput: 2148.6 tokens/s, Avg generation throughput: 872.8 tokens/s, Running: 20 reqs, Waiting: 0 reqs, GPU KV cache usage: 4.5%, Prefix cache hit rate: 0.0%
2026-10-02T17:15:20.534004926Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:21.464235471Z (APIServer pid=1) INFO:     10.0.0.224:42150 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:21.534360918Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:21.599657045Z (APIServer pid=1) INFO:     10.0.0.224:42188 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:21.819840485Z (APIServer pid=1) INFO:     10.0.0.224:42116 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:21.959355494Z (APIServer pid=1) INFO:     10.0.0.224:37980 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:22.533900692Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:22.995937526Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:23.134186566Z (APIServer pid=1) INFO:     10.0.0.224:42140 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:23.376008201Z (APIServer pid=1) INFO:     10.0.0.224:42572 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:23.533987737Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:23.620876784Z (APIServer pid=1) INFO:     10.0.0.224:46832 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:23.635035048Z (APIServer pid=1) INFO:     10.0.0.224:46808 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:23.747714104Z (APIServer pid=1) INFO:     10.0.0.224:46800 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:23.835186001Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:24.360143310Z (APIServer pid=1) INFO:     10.0.0.224:49060 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:24.516148772Z (APIServer pid=1) INFO:     10.0.0.224:49048 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:24.535822963Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:24.817307050Z (APIServer pid=1) INFO:     10.0.0.224:42128 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:25.534556543Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:25.546485622Z (APIServer pid=1) INFO:     10.0.0.224:42552 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:25.579620548Z (APIServer pid=1) INFO:     10.0.0.224:49062 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:25.601082071Z (APIServer pid=1) INFO:     10.0.0.224:46846 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:25.717186690Z (APIServer pid=1) INFO:     10.0.0.224:46852 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:26.404368114Z (APIServer pid=1) INFO:     10.0.0.224:42108 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:26.533526532Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:26.740905001Z (APIServer pid=1) INFO:     10.0.0.224:46816 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:27.140246546Z (APIServer pid=1) INFO:     10.0.0.224:46788 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:27.534527842Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:27.734169053Z (APIServer pid=1) INFO:     10.0.0.224:46772 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:27.745563381Z (APIServer pid=1) INFO:     10.0.0.224:46780 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:27.810671113Z (APIServer pid=1) INFO:     10.0.0.224:42568 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:28.049351901Z (APIServer pid=1) INFO:     10.0.0.224:44426 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:28.290488283Z (APIServer pid=1) INFO:     10.0.0.224:44438 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:28.355125678Z (APIServer pid=1) INFO:     10.0.0.224:42150 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:28.534052086Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:29.139543712Z (APIServer pid=1) INFO:     10.0.0.224:37980 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:29.534121538Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:29.702375488Z (APIServer pid=1) INFO:     10.0.0.224:42116 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:29.730114726Z (APIServer pid=1) INFO:     10.0.0.224:42188 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:30.012482630Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:30.437536927Z (APIServer pid=1) INFO 10-02 17:15:30 [loggers.py:310] Engine 000: Avg prompt throughput: 1707.8 tokens/s, Avg generation throughput: 817.0 tokens/s, Running: 24 reqs, Waiting: 0 reqs, GPU KV cache usage: 5.6%, Prefix cache hit rate: 0.0%
2026-10-02T17:15:30.535399428Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:30.751729748Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:31.256730623Z (APIServer pid=1) INFO:     10.0.0.224:49048 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:31.534370027Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:31.924872153Z (APIServer pid=1) INFO:     10.0.0.224:42128 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:32.213435497Z (APIServer pid=1) INFO:     10.0.0.224:46852 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:32.533719199Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:32.721237407Z (APIServer pid=1) INFO:     10.0.0.224:46846 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:32.758304402Z (APIServer pid=1) INFO:     10.0.0.224:42108 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:33.066331690Z (APIServer pid=1) INFO:     10.0.0.224:49062 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:33.203289785Z (APIServer pid=1) INFO:     10.0.0.224:46816 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:33.249205106Z (APIServer pid=1) INFO:     10.0.0.224:42552 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:33.322876575Z (APIServer pid=1) INFO:     10.0.0.224:49060 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:33.533449210Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:33.584258064Z (APIServer pid=1) INFO:     10.0.0.224:46800 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:33.808949709Z (APIServer pid=1) INFO:     10.0.0.224:46808 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:33.960891683Z (APIServer pid=1) INFO:     10.0.0.224:46788 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:34.017099804Z (APIServer pid=1) INFO:     10.0.0.224:46832 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:34.028299345Z (APIServer pid=1) INFO:     10.0.0.224:42572 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:34.534157548Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:34.629550028Z (APIServer pid=1) INFO:     10.0.0.224:46772 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:34.810487280Z (APIServer pid=1) INFO:     10.0.0.224:44426 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:34.837508912Z (APIServer pid=1) INFO:     10.0.0.224:42568 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:35.200671907Z (APIServer pid=1) INFO:     10.0.0.224:42150 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:35.358156158Z (APIServer pid=1) INFO:     10.0.0.224:44438 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:35.534396929Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:35.567125811Z (APIServer pid=1) INFO:     10.0.0.224:46780 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:35.831564006Z (APIServer pid=1) INFO:     10.0.0.224:44444 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:35.970612144Z (APIServer pid=1) INFO:     10.0.0.224:44460 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:36.211667333Z (APIServer pid=1) INFO:     10.0.0.224:37980 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:36.341976111Z (APIServer pid=1) INFO:     10.0.0.224:44462 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:36.446277720Z (APIServer pid=1) INFO:     10.0.0.224:44468 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:36.534061126Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:36.791342208Z (APIServer pid=1) INFO:     10.0.0.224:44474 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:37.209237828Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:37.533977937Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:37.712565235Z (APIServer pid=1) INFO:     10.0.0.224:42188 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:37.720434753Z (APIServer pid=1) INFO:     10.0.0.224:42116 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:37.940184733Z (APIServer pid=1) INFO:     10.0.0.224:37522 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:38.137196804Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:38.319526112Z (APIServer pid=1) INFO:     10.0.0.224:37536 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:38.534774740Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:38.735127093Z (APIServer pid=1) INFO:     10.0.0.224:49048 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:39.326547590Z (APIServer pid=1) INFO:     10.0.0.224:37538 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:39.536337377Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:40.439217316Z (APIServer pid=1) INFO 10-02 17:15:40 [loggers.py:310] Engine 000: Avg prompt throughput: 1928.2 tokens/s, Avg generation throughput: 925.4 tokens/s, Running: 28 reqs, Waiting: 0 reqs, GPU KV cache usage: 6.8%, Prefix cache hit rate: 0.0%
2026-10-02T17:15:40.534980347Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:40.705365449Z (APIServer pid=1) INFO:     10.0.0.224:46800 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:40.935528867Z (APIServer pid=1) INFO:     10.0.0.224:46808 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:41.103004770Z (APIServer pid=1) INFO:     10.0.0.224:46832 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:41.534020154Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:41.714732241Z (APIServer pid=1) INFO:     10.0.0.224:42568 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:42.462900117Z (APIServer pid=1) INFO:     10.0.0.224:44444 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:42.534974663Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:43.422557641Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:43.467240536Z (APIServer pid=1) INFO:     10.0.0.224:44474 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:43.533382299Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:43.667158960Z (APIServer pid=1) INFO:     10.0.0.224:44468 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:43.828411040Z (APIServer pid=1) INFO:     10.0.0.224:44462 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:44.171513645Z (APIServer pid=1) INFO:     10.0.0.224:37522 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:44.477876522Z (APIServer pid=1) INFO:     10.0.0.224:37536 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:44.534226900Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:44.675354961Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:45.077917342Z (APIServer pid=1) INFO:     10.0.0.224:49048 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:45.254914239Z (APIServer pid=1) INFO:     10.0.0.224:42188 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:45.500078971Z (APIServer pid=1) INFO:     10.0.0.224:37538 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:45.534229033Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:45.661030976Z (APIServer pid=1) INFO:     10.0.0.224:42116 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:45.988437365Z (APIServer pid=1) INFO:     10.0.0.224:37980 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:46.220078121Z (APIServer pid=1) INFO:     10.0.0.224:44460 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:46.346267678Z (APIServer pid=1) INFO:     10.0.0.224:46780 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:46.456074363Z (APIServer pid=1) INFO:     10.0.0.224:44438 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:46.533863171Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:46.721735807Z (APIServer pid=1) INFO:     10.0.0.224:42150 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:47.113092315Z (APIServer pid=1) INFO:     10.0.0.224:46800 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:47.534555005Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:47.642779005Z (APIServer pid=1) INFO:     10.0.0.224:46832 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:48.101253718Z (APIServer pid=1) INFO:     10.0.0.224:42568 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:48.183426144Z (APIServer pid=1) INFO:     10.0.0.224:46808 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:48.490926357Z (APIServer pid=1) INFO:     10.0.0.224:49054 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:48.533620219Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:48.949045778Z (APIServer pid=1) INFO:     10.0.0.224:44444 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:49.143378243Z (APIServer pid=1) INFO:     10.0.0.224:49056 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:49.146568612Z (APIServer pid=1) INFO:     10.0.0.224:49066 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:49.192458645Z (APIServer pid=1) INFO:     10.0.0.224:49074 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:49.490402867Z (APIServer pid=1) INFO:     10.0.0.224:49076 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:49.534142713Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:49.981740924Z (APIServer pid=1) INFO:     10.0.0.224:49086 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:50.342781834Z (APIServer pid=1) INFO:     10.0.0.224:44474 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:50.440064390Z (APIServer pid=1) INFO 10-02 17:15:50 [loggers.py:310] Engine 000: Avg prompt throughput: 1763.0 tokens/s, Avg generation throughput: 753.1 tokens/s, Running: 25 reqs, Waiting: 0 reqs, GPU KV cache usage: 5.7%, Prefix cache hit rate: 0.0%
2026-10-02T17:15:50.534732504Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:50.549141249Z (APIServer pid=1) INFO:     10.0.0.224:44462 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:50.610252601Z (APIServer pid=1) INFO:     10.0.0.224:44468 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:50.742475731Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:50.794829398Z (APIServer pid=1) INFO:     10.0.0.224:49096 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:50.933893555Z (APIServer pid=1) INFO:     10.0.0.224:49112 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:51.527484316Z (APIServer pid=1) INFO:     10.0.0.224:37536 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:51.534224153Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:51.623732380Z (APIServer pid=1) INFO:     10.0.0.224:37522 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:51.657514078Z (APIServer pid=1) INFO:     10.0.0.224:49126 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:51.989675440Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:52.534558451Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:53.534355946Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:54.315740444Z (APIServer pid=1) INFO:     10.0.0.224:46800 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:54.328999110Z (APIServer pid=1) INFO:     10.0.0.224:46832 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:54.535335823Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:55.107803629Z (APIServer pid=1) INFO:     10.0.0.224:46808 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:55.304030257Z (APIServer pid=1) INFO:     10.0.0.224:49054 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:55.534289977Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:56.136562866Z (APIServer pid=1) INFO:     10.0.0.224:49076 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:56.533855453Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:56.539531944Z (APIServer pid=1) INFO:     10.0.0.224:49086 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:56.758191797Z (APIServer pid=1) INFO:     10.0.0.224:44474 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:56.971998164Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:57.443113724Z (APIServer pid=1) INFO:     10.0.0.224:49112 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:57.534664146Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:58.009277637Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:58.062638624Z (APIServer pid=1) INFO:     10.0.0.224:49126 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:58.159545954Z (APIServer pid=1) INFO:     10.0.0.224:37522 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:58.253153997Z (APIServer pid=1) INFO:     10.0.0.224:37536 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:58.537016692Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:59.535934908Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:15:59.746947534Z (APIServer pid=1) INFO:     10.0.0.224:49096 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:59.865174037Z (APIServer pid=1) INFO:     10.0.0.224:44468 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:15:59.890394651Z (APIServer pid=1) INFO:     10.0.0.224:44462 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:00.237205953Z (APIServer pid=1) INFO:     10.0.0.224:49074 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:00.426651427Z (APIServer pid=1) INFO:     10.0.0.224:46832 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:00.441310545Z (APIServer pid=1) INFO 10-02 17:16:00 [loggers.py:310] Engine 000: Avg prompt throughput: 1487.5 tokens/s, Avg generation throughput: 774.6 tokens/s, Running: 15 reqs, Waiting: 0 reqs, GPU KV cache usage: 3.4%, Prefix cache hit rate: 0.0%
2026-10-02T17:16:00.535762310Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:00.882348127Z (APIServer pid=1) INFO:     10.0.0.224:46800 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:01.536083393Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:01.995258676Z (APIServer pid=1) INFO:     10.0.0.224:49054 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:02.534973646Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:02.571259918Z (APIServer pid=1) INFO:     10.0.0.224:44474 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:02.659775665Z (APIServer pid=1) INFO:     10.0.0.224:49086 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:03.330536734Z (APIServer pid=1) INFO:     10.0.0.224:49112 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:03.423234130Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:03.534719043Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:03.923446789Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:03.984828891Z (APIServer pid=1) INFO:     10.0.0.224:49126 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:04.534717977Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:04.955753320Z (APIServer pid=1) INFO:     10.0.0.224:37536 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:05.037668693Z (APIServer pid=1) INFO:     10.0.0.224:37522 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:05.274866383Z (APIServer pid=1) INFO:     10.0.0.224:49076 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:05.364142463Z (APIServer pid=1) INFO:     10.0.0.224:46808 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:05.448185449Z (APIServer pid=1) INFO:     10.0.0.224:36216 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:05.534460829Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:06.054636804Z (APIServer pid=1) INFO:     10.0.0.224:44462 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:06.449414475Z (APIServer pid=1) INFO:     10.0.0.224:46832 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:06.534308489Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:06.891298855Z (APIServer pid=1) INFO:     10.0.0.224:46800 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:07.440468802Z (APIServer pid=1) INFO:     10.0.0.224:49074 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:07.534955795Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:07.621342093Z (APIServer pid=1) INFO:     10.0.0.224:44468 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:07.766216151Z (APIServer pid=1) INFO:     10.0.0.224:49096 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:07.898120170Z (APIServer pid=1) INFO:     10.0.0.224:44484 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:07.986875437Z (APIServer pid=1) INFO:     10.0.0.224:44488 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:08.534129851Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:08.599245367Z (APIServer pid=1) INFO:     10.0.0.224:49054 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:09.041514912Z (APIServer pid=1) INFO:     10.0.0.224:49086 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:09.165757906Z (APIServer pid=1) INFO:     10.0.0.224:44474 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:09.534829417Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:09.583272918Z (APIServer pid=1) INFO:     10.0.0.224:44494 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:09.584323319Z (APIServer pid=1) INFO:     10.0.0.224:44506 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:10.443085746Z (APIServer pid=1) INFO 10-02 17:16:10 [loggers.py:310] Engine 000: Avg prompt throughput: 1487.4 tokens/s, Avg generation throughput: 680.4 tokens/s, Running: 18 reqs, Waiting: 0 reqs, GPU KV cache usage: 4.1%, Prefix cache hit rate: 0.0%
2026-10-02T17:16:10.535130049Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:10.767235992Z (APIServer pid=1) INFO:     10.0.0.224:49126 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:11.041117173Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:11.352594608Z (APIServer pid=1) INFO:     10.0.0.224:37536 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:11.534816122Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:11.855244545Z (APIServer pid=1) INFO:     10.0.0.224:36216 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:12.158620745Z (APIServer pid=1) INFO:     10.0.0.224:46808 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:12.191535157Z (APIServer pid=1) INFO:     10.0.0.224:49076 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:12.403025203Z (APIServer pid=1) INFO:     10.0.0.224:44462 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:12.506471167Z (APIServer pid=1) INFO:     10.0.0.224:37522 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:12.534640835Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:12.871850712Z (APIServer pid=1) INFO:     10.0.0.224:46832 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:13.199776040Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:13.533587443Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:13.548594497Z (APIServer pid=1) INFO:     10.0.0.224:46800 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:14.324544068Z (APIServer pid=1) INFO:     10.0.0.224:44488 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:14.534757385Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:14.647088714Z (APIServer pid=1) INFO:     10.0.0.224:44484 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:14.711402027Z (APIServer pid=1) INFO:     10.0.0.224:49096 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:14.780661280Z (APIServer pid=1) INFO:     10.0.0.224:44468 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:14.934484123Z (APIServer pid=1) INFO:     10.0.0.224:49074 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:15.534794369Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:15.937820743Z (APIServer pid=1) INFO:     10.0.0.224:44494 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:15.966872305Z (APIServer pid=1) INFO:     10.0.0.224:44506 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:15.970139830Z (APIServer pid=1) INFO:     10.0.0.224:44474 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:16.119839634Z (APIServer pid=1) INFO:     10.0.0.224:49086 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:16.514559055Z (APIServer pid=1) INFO:     10.0.0.224:49054 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:16.533895297Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:16.804825201Z (APIServer pid=1) INFO:     10.0.0.224:44520 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:16.859672272Z (APIServer pid=1) INFO:     10.0.0.224:44526 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:17.386127703Z (APIServer pid=1) INFO:     10.0.0.224:44538 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:17.534502628Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:18.395228860Z (APIServer pid=1) INFO:     10.0.0.224:37536 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:18.535058630Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:19.195523862Z (APIServer pid=1) INFO:     10.0.0.224:46832 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:19.268793352Z (APIServer pid=1) INFO:     10.0.0.224:37522 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:19.534495191Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:20.078852168Z (APIServer pid=1) INFO:     10.0.0.224:46800 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:20.091449365Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:20.126600647Z (APIServer pid=1) INFO:     10.0.0.224:44462 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:20.376926565Z (APIServer pid=1) INFO:     10.0.0.224:49076 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:20.444649861Z (APIServer pid=1) INFO 10-02 17:16:20 [loggers.py:310] Engine 000: Avg prompt throughput: 1652.7 tokens/s, Avg generation throughput: 769.9 tokens/s, Running: 20 reqs, Waiting: 0 reqs, GPU KV cache usage: 4.6%, Prefix cache hit rate: 0.0%
2026-10-02T17:16:20.468207699Z (APIServer pid=1) INFO:     10.0.0.224:46808 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:20.534325675Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:20.673744592Z (APIServer pid=1) INFO:     10.0.0.224:36216 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:21.074644774Z (APIServer pid=1) INFO:     10.0.0.224:44488 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:21.159503650Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:21.398340310Z (APIServer pid=1) INFO:     10.0.0.224:44484 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:21.469451419Z (APIServer pid=1) INFO:     10.0.0.224:44468 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:21.534119670Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:22.316731670Z (APIServer pid=1) INFO:     10.0.0.224:49074 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:22.534435179Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:22.898179276Z (APIServer pid=1) INFO:     10.0.0.224:49054 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:23.470727062Z (APIServer pid=1) INFO:     10.0.0.224:44526 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:23.500068912Z (APIServer pid=1) INFO:     10.0.0.224:44520 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:23.533852653Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:23.770077325Z (APIServer pid=1) INFO:     10.0.0.224:44538 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:24.424807336Z (APIServer pid=1) INFO:     10.0.0.224:49086 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:24.449364980Z (APIServer pid=1) INFO:     10.0.0.224:44474 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:24.502417466Z (APIServer pid=1) INFO:     10.0.0.224:44506 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:24.534422601Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:25.415236753Z (APIServer pid=1) INFO:     10.0.0.224:37536 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:25.536609030Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:25.543281419Z (APIServer pid=1) INFO:     10.0.0.224:44494 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:25.654496311Z (APIServer pid=1) INFO:     10.0.0.224:49096 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:26.219496917Z (APIServer pid=1) INFO:     10.0.0.224:37522 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:26.536460313Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:26.836726184Z (APIServer pid=1) INFO:     10.0.0.224:49076 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:26.894933325Z (APIServer pid=1) INFO:     10.0.0.224:46808 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:27.154581663Z (APIServer pid=1) INFO:     10.0.0.224:36216 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:27.158386723Z (APIServer pid=1) INFO:     10.0.0.224:44462 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:27.485880425Z (APIServer pid=1) INFO:     10.0.0.224:46800 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:27.536819164Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:27.854006660Z (APIServer pid=1) INFO:     10.0.0.224:44484 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:27.919654792Z (APIServer pid=1) INFO:     10.0.0.224:44468 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:28.449021495Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:28.535143234Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:28.634196070Z (APIServer pid=1) INFO:     10.0.0.224:44488 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:28.732357133Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:28.999883794Z (APIServer pid=1) INFO:     10.0.0.224:49074 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:29.099314384Z (APIServer pid=1) INFO:     10.0.0.224:46832 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:29.308027428Z (APIServer pid=1) INFO:     10.0.0.224:58878 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:29.480098853Z (APIServer pid=1) INFO:     10.0.0.224:58880 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:29.506545390Z (APIServer pid=1) INFO:     10.0.0.224:58884 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:29.533532167Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:29.565500722Z (APIServer pid=1) INFO:     10.0.0.224:58892 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:29.972640927Z (APIServer pid=1) INFO:     10.0.0.224:49054 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:30.122645284Z (APIServer pid=1) INFO:     10.0.0.224:58906 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:30.446815477Z (APIServer pid=1) INFO 10-02 17:16:30 [loggers.py:310] Engine 000: Avg prompt throughput: 2038.2 tokens/s, Avg generation throughput: 769.4 tokens/s, Running: 28 reqs, Waiting: 0 reqs, GPU KV cache usage: 6.3%, Prefix cache hit rate: 0.0%
2026-10-02T17:16:30.535084657Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:30.961715666Z (APIServer pid=1) INFO:     10.0.0.224:44538 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:31.183702626Z (APIServer pid=1) INFO:     10.0.0.224:44520 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:31.533455145Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:31.650565020Z (APIServer pid=1) INFO:     10.0.0.224:44506 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:32.033750127Z (APIServer pid=1) INFO:     10.0.0.224:44474 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:32.208390608Z (APIServer pid=1) INFO:     10.0.0.224:49086 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:32.384453841Z (APIServer pid=1) INFO:     10.0.0.224:44526 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:32.534079255Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:32.858843677Z (APIServer pid=1) INFO:     10.0.0.224:49096 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:33.534196648Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:34.281255107Z (APIServer pid=1) INFO:     10.0.0.224:46800 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:34.445027371Z (APIServer pid=1) INFO:     10.0.0.224:36216 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:34.534817691Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:34.537467271Z (APIServer pid=1) INFO:     10.0.0.224:44462 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:34.975034442Z (APIServer pid=1) INFO:     10.0.0.224:44468 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:35.497551591Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:35.534383504Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:35.764862085Z (APIServer pid=1) INFO:     10.0.0.224:46832 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:35.805810614Z (APIServer pid=1) INFO:     10.0.0.224:49074 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:35.874884989Z (APIServer pid=1) INFO:     10.0.0.224:58878 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:36.271736451Z (APIServer pid=1) INFO:     10.0.0.224:58892 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:36.480076161Z (APIServer pid=1) INFO:     10.0.0.224:49054 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:36.534026131Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:36.558950798Z (APIServer pid=1) INFO:     10.0.0.224:58884 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:36.709209074Z (APIServer pid=1) INFO:     10.0.0.224:58906 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:37.049314401Z (APIServer pid=1) INFO:     10.0.0.224:58880 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:37.116906479Z (APIServer pid=1) INFO:     10.0.0.224:44488 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:37.534381524Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:37.579219139Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:37.904981466Z (APIServer pid=1) INFO:     10.0.0.224:44520 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:38.200119612Z (APIServer pid=1) INFO:     10.0.0.224:44538 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:38.533906909Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:38.670787846Z (APIServer pid=1) INFO:     10.0.0.224:44474 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:38.787940231Z (APIServer pid=1) INFO:     10.0.0.224:44506 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:39.277894103Z (APIServer pid=1) INFO:     10.0.0.224:44526 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:39.503247314Z (APIServer pid=1) INFO:     10.0.0.224:49096 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:39.533578591Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:39.771119577Z (APIServer pid=1) INFO:     10.0.0.224:49086 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:40.211442117Z (APIServer pid=1) INFO:     10.0.0.224:53464 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:40.401516035Z (APIServer pid=1) INFO:     10.0.0.224:53466 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:40.414104196Z (APIServer pid=1) INFO:     10.0.0.224:53482 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:40.449045200Z (APIServer pid=1) INFO 10-02 17:16:40 [loggers.py:310] Engine 000: Avg prompt throughput: 1652.7 tokens/s, Avg generation throughput: 884.0 tokens/s, Running: 24 reqs, Waiting: 0 reqs, GPU KV cache usage: 5.5%, Prefix cache hit rate: 0.0%
2026-10-02T17:16:40.466607334Z (APIServer pid=1) INFO:     10.0.0.224:53492 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:40.534746546Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:40.574119271Z (APIServer pid=1) INFO:     10.0.0.224:53508 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:40.782404760Z (APIServer pid=1) INFO:     10.0.0.224:53518 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:41.430821337Z (APIServer pid=1) INFO:     10.0.0.224:46800 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:41.534227006Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:41.891347916Z (APIServer pid=1) INFO:     10.0.0.224:44468 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:41.911647536Z (APIServer pid=1) INFO:     10.0.0.224:44462 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:41.993832718Z (APIServer pid=1) INFO:     10.0.0.224:36216 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:42.379140780Z (APIServer pid=1) INFO:     10.0.0.224:53532 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:42.534117669Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:42.641617934Z (APIServer pid=1) INFO:     10.0.0.224:53538 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:42.708551690Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:43.535337212Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:43.574072235Z (APIServer pid=1) INFO:     10.0.0.224:58884 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:43.605025856Z (APIServer pid=1) INFO:     10.0.0.224:58906 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:43.951166930Z (APIServer pid=1) INFO:     10.0.0.224:49054 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:44.237818625Z (APIServer pid=1) INFO:     10.0.0.224:44488 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:44.309465112Z (APIServer pid=1) INFO:     10.0.0.224:58880 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:44.353819207Z (APIServer pid=1) INFO:     10.0.0.224:58892 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:44.371953490Z (APIServer pid=1) INFO:     10.0.0.224:58878 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:44.534248337Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:44.643995131Z (APIServer pid=1) INFO:     10.0.0.224:49074 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:45.384947569Z (APIServer pid=1) INFO:     10.0.0.224:44538 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:45.439825097Z (APIServer pid=1) INFO:     10.0.0.224:44520 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:45.441794373Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:45.537403031Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:46.533869694Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:46.585919218Z (APIServer pid=1) INFO:     10.0.0.224:44526 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:46.969958878Z (APIServer pid=1) INFO:     10.0.0.224:49096 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:47.497121111Z (APIServer pid=1) INFO:     10.0.0.224:53464 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:47.533493735Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:48.374732556Z (APIServer pid=1) INFO:     10.0.0.224:46800 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:48.534933752Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:48.746356921Z (APIServer pid=1) INFO:     10.0.0.224:36216 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:49.534319323Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:49.730430972Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:49.770926507Z (APIServer pid=1) INFO:     10.0.0.224:53538 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:49.905673318Z (APIServer pid=1) INFO:     10.0.0.224:53532 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:50.057830327Z (APIServer pid=1) INFO:     10.0.0.224:44462 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:50.230428834Z (APIServer pid=1) INFO:     10.0.0.224:58884 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:50.448928694Z (APIServer pid=1) INFO 10-02 17:16:50 [loggers.py:310] Engine 000: Avg prompt throughput: 1818.3 tokens/s, Avg generation throughput: 915.2 tokens/s, Running: 19 reqs, Waiting: 0 reqs, GPU KV cache usage: 4.5%, Prefix cache hit rate: 0.0%
2026-10-02T17:16:50.526953355Z (APIServer pid=1) INFO:     10.0.0.224:49054 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:50.533305912Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:50.564003921Z (APIServer pid=1) INFO:     10.0.0.224:58906 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:50.625309597Z (APIServer pid=1) INFO:     10.0.0.224:44468 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:50.761065012Z (APIServer pid=1) INFO:     10.0.0.224:53518 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:51.060744716Z (APIServer pid=1) INFO:     10.0.0.224:44488 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:51.117221622Z (APIServer pid=1) INFO:     10.0.0.224:58878 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:51.432768143Z (APIServer pid=1) INFO:     10.0.0.224:49074 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:51.535200777Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:51.849162797Z (APIServer pid=1) INFO:     10.0.0.224:58892 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:52.073322656Z (APIServer pid=1) INFO:     10.0.0.224:44520 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:52.103881492Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:52.533591750Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:52.558646030Z (APIServer pid=1) INFO:     10.0.0.224:44538 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:52.616094209Z (APIServer pid=1) INFO:     10.0.0.224:58880 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:52.691811527Z (APIServer pid=1) INFO:     10.0.0.224:37434 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:52.800234833Z (APIServer pid=1) INFO:     10.0.0.224:37450 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:53.328834447Z (APIServer pid=1) INFO:     10.0.0.224:37460 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:53.534481207Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:53.589603417Z (APIServer pid=1) INFO:     10.0.0.224:44526 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:53.614354116Z (APIServer pid=1) INFO:     10.0.0.224:37474 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:54.301242018Z (APIServer pid=1) INFO:     10.0.0.224:49096 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:54.515726331Z (APIServer pid=1) INFO:     10.0.0.224:53464 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:54.533669936Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:54.599200434Z (APIServer pid=1) INFO:     10.0.0.224:37484 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:54.881131090Z (APIServer pid=1) INFO:     10.0.0.224:37488 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:55.534140343Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:55.659878937Z (APIServer pid=1) INFO:     10.0.0.224:46800 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:56.082613823Z (APIServer pid=1) INFO:     10.0.0.224:36216 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:56.533440691Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:56.632620978Z (APIServer pid=1) INFO:     10.0.0.224:37490 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:56.933155455Z (APIServer pid=1) INFO:     10.0.0.224:37494 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:57.097430538Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:57.511044646Z (APIServer pid=1) INFO:     10.0.0.224:58884 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:57.534547560Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:57.905227032Z (APIServer pid=1) INFO:     10.0.0.224:53518 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:58.533624397Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:59.049069642Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:59.339449780Z (APIServer pid=1) INFO:     10.0.0.224:37450 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:59.462622464Z (APIServer pid=1) INFO:     10.0.0.224:37434 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:59.533464774Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:16:59.715039967Z (APIServer pid=1) INFO:     10.0.0.224:58880 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:16:59.880799861Z (APIServer pid=1) INFO:     10.0.0.224:37460 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:00.164990742Z (APIServer pid=1) INFO:     10.0.0.224:37474 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:00.450344867Z (APIServer pid=1) INFO 10-02 17:17:00 [loggers.py:310] Engine 000: Avg prompt throughput: 1873.1 tokens/s, Avg generation throughput: 869.9 tokens/s, Running: 17 reqs, Waiting: 0 reqs, GPU KV cache usage: 3.9%, Prefix cache hit rate: 0.0%
2026-10-02T17:17:00.533853245Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:00.974837062Z (APIServer pid=1) INFO:     10.0.0.224:37484 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:01.436163350Z (APIServer pid=1) INFO:     10.0.0.224:37488 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:01.534008147Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:01.605476197Z (APIServer pid=1) INFO:     10.0.0.224:53464 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:01.852209536Z (APIServer pid=1) INFO:     10.0.0.224:46800 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:02.438451576Z (APIServer pid=1) INFO:     10.0.0.224:36216 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:02.534584433Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:03.007614141Z (APIServer pid=1) INFO:     10.0.0.224:37494 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:03.250895157Z (APIServer pid=1) INFO:     10.0.0.224:36030 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:03.261162008Z (APIServer pid=1) INFO:     10.0.0.224:37490 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:03.515452564Z (APIServer pid=1) INFO:     10.0.0.224:49096 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:03.535888161Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:03.853711918Z (APIServer pid=1) INFO:     10.0.0.224:58884 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:03.950876000Z (APIServer pid=1) INFO:     10.0.0.224:44526 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:04.325610482Z (APIServer pid=1) INFO:     10.0.0.224:53518 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:04.348788653Z (APIServer pid=1) INFO:     10.0.0.224:40978 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:04.534711769Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:04.831667795Z (APIServer pid=1) INFO:     10.0.0.224:40980 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:04.898938867Z (APIServer pid=1) INFO:     10.0.0.224:40986 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:05.396972090Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:05.412733959Z (APIServer pid=1) INFO:     10.0.0.224:40998 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:05.534850920Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:05.895780886Z (APIServer pid=1) INFO:     10.0.0.224:37434 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:06.316061852Z (APIServer pid=1) INFO:     10.0.0.224:37460 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:06.459001260Z (APIServer pid=1) INFO:     10.0.0.224:58880 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:06.533736355Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:06.928826522Z (APIServer pid=1) INFO:     10.0.0.224:37474 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:06.996248088Z (APIServer pid=1) INFO:     10.0.0.224:37450 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:07.133818758Z (APIServer pid=1) INFO:     10.0.0.224:41002 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:07.475921703Z (APIServer pid=1) INFO:     10.0.0.224:41008 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:07.534614250Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:07.921651834Z (APIServer pid=1) INFO:     10.0.0.224:37484 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:08.060567481Z (APIServer pid=1) INFO:     10.0.0.224:37488 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:08.534190277Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:09.536653131Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:10.426013242Z (APIServer pid=1) INFO:     10.0.0.224:44526 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:10.451797129Z (APIServer pid=1) INFO 10-02 17:17:10 [loggers.py:310] Engine 000: Avg prompt throughput: 1432.4 tokens/s, Avg generation throughput: 778.7 tokens/s, Running: 15 reqs, Waiting: 0 reqs, GPU KV cache usage: 3.7%, Prefix cache hit rate: 0.0%
2026-10-02T17:17:10.534653447Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:10.890518919Z (APIServer pid=1) INFO:     10.0.0.224:40980 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:11.098181021Z (APIServer pid=1) INFO:     10.0.0.224:40986 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:11.407798184Z (APIServer pid=1) INFO:     10.0.0.224:40978 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:11.498665435Z (APIServer pid=1) INFO:     10.0.0.224:40998 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:11.533909051Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:11.994429246Z (APIServer pid=1) INFO:     10.0.0.224:37434 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:12.112139132Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:12.123799382Z (APIServer pid=1) INFO:     10.0.0.224:53518 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:12.534584743Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:12.706481315Z (APIServer pid=1) INFO:     10.0.0.224:58880 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:12.864068618Z (APIServer pid=1) INFO:     10.0.0.224:37460 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:13.370640953Z (APIServer pid=1) INFO:     10.0.0.224:41008 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:13.534645024Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:13.959451248Z (APIServer pid=1) INFO:     10.0.0.224:37488 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:13.972592822Z (APIServer pid=1) INFO:     10.0.0.224:37484 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:14.019225895Z (APIServer pid=1) INFO:     10.0.0.224:41002 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:14.065529688Z (APIServer pid=1) INFO:     10.0.0.224:37450 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:14.414592535Z (APIServer pid=1) INFO:     10.0.0.224:37474 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:14.526552082Z (APIServer pid=1) INFO:     10.0.0.224:58884 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:14.534606608Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:14.597111418Z (APIServer pid=1) INFO:     10.0.0.224:49096 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:14.771542081Z (APIServer pid=1) INFO:     10.0.0.224:57294 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:15.061709728Z (APIServer pid=1) INFO:     10.0.0.224:57296 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:15.533290813Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:15.710299770Z (APIServer pid=1) INFO:     10.0.0.224:57310 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:16.183657407Z (APIServer pid=1) INFO:     10.0.0.224:57314 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:16.390296278Z (APIServer pid=1) INFO:     10.0.0.224:57326 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:16.510445878Z (APIServer pid=1) INFO:     10.0.0.224:57334 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:16.514625684Z (APIServer pid=1) INFO:     10.0.0.224:57340 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:16.533819727Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:16.643420855Z (APIServer pid=1) INFO:     10.0.0.224:57354 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:16.947746715Z (APIServer pid=1) INFO:     10.0.0.224:57358 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:17.236214915Z (APIServer pid=1) INFO:     10.0.0.224:44526 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:17.517907903Z (APIServer pid=1) INFO:     10.0.0.224:57366 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:17.533242816Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:17.695131085Z (APIServer pid=1) INFO:     10.0.0.224:59806 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:18.070173638Z (APIServer pid=1) INFO:     10.0.0.224:40986 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:18.219179833Z (APIServer pid=1) INFO:     10.0.0.224:40980 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:18.494624972Z (APIServer pid=1) INFO:     10.0.0.224:40978 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:18.534241447Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:18.540177076Z (APIServer pid=1) INFO:     10.0.0.224:40998 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:18.696779121Z (APIServer pid=1) INFO:     10.0.0.224:59816 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:18.890851794Z (APIServer pid=1) INFO:     10.0.0.224:59822 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:19.215534732Z (APIServer pid=1) INFO:     10.0.0.224:59826 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:19.535906485Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:19.760846576Z (APIServer pid=1) INFO:     10.0.0.224:53518 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:20.145074207Z (APIServer pid=1) INFO:     10.0.0.224:37460 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:20.454581353Z (APIServer pid=1) INFO 10-02 17:17:20 [loggers.py:310] Engine 000: Avg prompt throughput: 2148.3 tokens/s, Avg generation throughput: 752.4 tokens/s, Running: 29 reqs, Waiting: 0 reqs, GPU KV cache usage: 6.7%, Prefix cache hit rate: 0.0%
2026-10-02T17:17:20.533577647Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:20.587101112Z (APIServer pid=1) INFO:     10.0.0.224:58880 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:20.605632765Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:20.934027819Z (APIServer pid=1) INFO:     10.0.0.224:41008 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:20.955220554Z (APIServer pid=1) INFO:     10.0.0.224:37434 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:21.060037043Z (APIServer pid=1) INFO:     10.0.0.224:59838 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:21.209212287Z (APIServer pid=1) INFO:     10.0.0.224:59846 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:21.535260871Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:21.697279436Z (APIServer pid=1) INFO:     10.0.0.224:37484 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:21.748781807Z (APIServer pid=1) INFO:     10.0.0.224:37450 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:21.783768487Z (APIServer pid=1) INFO:     10.0.0.224:41002 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:22.112277584Z (APIServer pid=1) INFO:     10.0.0.224:37474 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:22.181360023Z (APIServer pid=1) INFO:     10.0.0.224:58884 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:22.533493162Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:22.602602843Z (APIServer pid=1) INFO:     10.0.0.224:57294 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:22.789021935Z (APIServer pid=1) INFO:     10.0.0.224:57296 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:22.997527447Z (APIServer pid=1) INFO:     10.0.0.224:49096 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:23.109038528Z (APIServer pid=1) INFO:     10.0.0.224:37488 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:23.194867264Z (APIServer pid=1) INFO:     10.0.0.224:59852 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:23.534719604Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:23.659343575Z (APIServer pid=1) INFO:     10.0.0.224:57310 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:23.728582620Z (APIServer pid=1) INFO:     10.0.0.224:59862 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:23.846593235Z (APIServer pid=1) INFO:     10.0.0.224:59878 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:24.088172027Z (APIServer pid=1) INFO:     10.0.0.224:59882 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:24.302361563Z (APIServer pid=1) INFO:     10.0.0.224:59884 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:24.533523093Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:24.898322440Z (APIServer pid=1) INFO:     10.0.0.224:57358 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:24.911562701Z (APIServer pid=1) INFO:     10.0.0.224:57354 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:25.533808218Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:26.362076695Z (APIServer pid=1) INFO:     10.0.0.224:59822 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:26.392201862Z (APIServer pid=1) INFO:     10.0.0.224:59816 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:26.533620840Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:27.352886420Z (APIServer pid=1) INFO:     10.0.0.224:53518 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:27.534948190Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:27.537729558Z (APIServer pid=1) INFO:     10.0.0.224:59826 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:27.671893979Z (APIServer pid=1) INFO:     10.0.0.224:40998 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:28.221110541Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:28.534106328Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:28.971843027Z (APIServer pid=1) INFO:     10.0.0.224:37450 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:29.153048332Z (APIServer pid=1) INFO:     10.0.0.224:58884 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:29.187081442Z (APIServer pid=1) INFO:     10.0.0.224:37474 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:29.533113269Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:29.782320344Z (APIServer pid=1) INFO:     10.0.0.224:57296 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:29.789741116Z (APIServer pid=1) INFO:     10.0.0.224:57294 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:30.083785437Z (APIServer pid=1) INFO:     10.0.0.224:59852 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:30.155084378Z (APIServer pid=1) INFO:     10.0.0.224:37488 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:30.453630694Z (APIServer pid=1) INFO 10-02 17:17:30 [loggers.py:310] Engine 000: Avg prompt throughput: 1983.8 tokens/s, Avg generation throughput: 1017.4 tokens/s, Running: 20 reqs, Waiting: 0 reqs, GPU KV cache usage: 4.6%, Prefix cache hit rate: 0.0%
2026-10-02T17:17:30.503874770Z (APIServer pid=1) INFO:     10.0.0.224:57310 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:30.533330445Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:30.624082188Z (APIServer pid=1) INFO:     10.0.0.224:59878 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:30.656036437Z (APIServer pid=1) INFO:     10.0.0.224:59862 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:30.868518463Z (APIServer pid=1) INFO:     10.0.0.224:59882 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:31.309203565Z (APIServer pid=1) INFO:     10.0.0.224:59884 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:31.533418146Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:31.933028891Z (APIServer pid=1) INFO:     10.0.0.224:57354 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:31.992847012Z (APIServer pid=1) INFO:     10.0.0.224:57358 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:32.030793026Z (APIServer pid=1) INFO:     10.0.0.224:49096 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:32.095631528Z (APIServer pid=1) INFO:     10.0.0.224:41002 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:32.362125487Z (APIServer pid=1) INFO:     10.0.0.224:37484 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:32.452027608Z (APIServer pid=1) INFO:     10.0.0.224:59846 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:32.534170970Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:32.573795963Z (APIServer pid=1) INFO:     10.0.0.224:59838 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:33.114164058Z (APIServer pid=1) INFO:     10.0.0.224:37434 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:33.534962880Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:33.634291305Z (APIServer pid=1) INFO:     10.0.0.224:59816 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:33.657072937Z (APIServer pid=1) INFO:     10.0.0.224:59822 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:33.740960942Z (APIServer pid=1) INFO:     10.0.0.224:45820 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:33.762559080Z (APIServer pid=1) INFO:     10.0.0.224:45826 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:33.943024880Z (APIServer pid=1) INFO:     10.0.0.224:45838 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:34.028996966Z (APIServer pid=1) INFO:     10.0.0.224:45842 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:34.080575581Z (APIServer pid=1) INFO:     10.0.0.224:45858 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:34.537175679Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:34.627822495Z (APIServer pid=1) INFO:     10.0.0.224:45870 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:34.807525484Z (APIServer pid=1) INFO:     10.0.0.224:45880 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:34.850785444Z (APIServer pid=1) INFO:     10.0.0.224:45886 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:34.888874768Z (APIServer pid=1) INFO:     10.0.0.224:45900 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:35.108283072Z (APIServer pid=1) INFO:     10.0.0.224:53518 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:35.223196993Z (APIServer pid=1) INFO:     10.0.0.224:45910 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:35.528184761Z (APIServer pid=1) INFO:     10.0.0.224:40998 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:35.534563485Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:35.715776454Z (APIServer pid=1) INFO:     10.0.0.224:59826 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:35.874510351Z (APIServer pid=1) INFO:     10.0.0.224:45920 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:35.897731033Z (APIServer pid=1) INFO:     10.0.0.224:45922 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:36.534128890Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:36.594802614Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:36.683238498Z (APIServer pid=1) INFO:     10.0.0.224:45934 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:36.881587167Z (APIServer pid=1) INFO:     10.0.0.224:45950 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:37.006907502Z (APIServer pid=1) INFO:     10.0.0.224:45956 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:37.071118901Z (APIServer pid=1) INFO:     10.0.0.224:45962 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:37.219243521Z (APIServer pid=1) INFO:     10.0.0.224:45974 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:37.352081380Z (APIServer pid=1) INFO:     10.0.0.224:37450 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:37.358898452Z (APIServer pid=1) INFO:     10.0.0.224:45976 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:37.395518272Z (APIServer pid=1) INFO:     10.0.0.224:45984 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:37.533865696Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:38.422716272Z (APIServer pid=1) INFO:     10.0.0.224:57296 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:38.468527165Z (APIServer pid=1) INFO:     10.0.0.224:59852 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:38.533821227Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:38.608599052Z (APIServer pid=1) INFO:     10.0.0.224:37488 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:39.021577538Z (APIServer pid=1) INFO:     10.0.0.224:57294 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:39.533558424Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:39.917314717Z (APIServer pid=1) INFO:     10.0.0.224:59884 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:40.168354650Z (APIServer pid=1) INFO:     10.0.0.224:59882 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:40.186225437Z (APIServer pid=1) INFO:     10.0.0.224:59862 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:40.456801589Z (APIServer pid=1) INFO 10-02 17:17:40 [loggers.py:310] Engine 000: Avg prompt throughput: 2533.8 tokens/s, Avg generation throughput: 994.3 tokens/s, Running: 41 reqs, Waiting: 0 reqs, GPU KV cache usage: 9.7%, Prefix cache hit rate: 0.0%
2026-10-02T17:17:40.534876845Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:40.587236243Z (APIServer pid=1) INFO:     10.0.0.224:57354 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:40.602898303Z (APIServer pid=1) INFO:     10.0.0.224:59878 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:41.070732386Z (APIServer pid=1) INFO:     10.0.0.224:59838 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:41.280336011Z (APIServer pid=1) INFO:     10.0.0.224:59846 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:41.534187118Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:41.569067317Z (APIServer pid=1) INFO:     10.0.0.224:37484 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:41.895175103Z (APIServer pid=1) INFO:     10.0.0.224:37434 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:42.090892346Z (APIServer pid=1) INFO:     10.0.0.224:41002 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:42.454805602Z (APIServer pid=1) INFO:     10.0.0.224:45858 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:42.533885413Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:43.233736439Z (APIServer pid=1) INFO:     10.0.0.224:45910 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:43.247876336Z (APIServer pid=1) INFO:     10.0.0.224:53518 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:43.304012039Z (APIServer pid=1) INFO:     10.0.0.224:40998 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:43.533457729Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:43.763994289Z (APIServer pid=1) INFO:     10.0.0.224:45922 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:43.802499948Z (APIServer pid=1) INFO:     10.0.0.224:45920 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:44.003289892Z (APIServer pid=1) INFO:     10.0.0.224:59826 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:44.010403213Z (APIServer pid=1) INFO:     10.0.0.224:45900 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:44.115952265Z (APIServer pid=1) INFO:     10.0.0.224:45886 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:44.467050551Z (APIServer pid=1) INFO:     10.0.0.224:45880 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:44.533181662Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:44.670658072Z (APIServer pid=1) INFO:     10.0.0.224:45870 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:44.692815277Z (APIServer pid=1) INFO:     10.0.0.224:45842 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:44.894076682Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:45.013022259Z (APIServer pid=1) INFO:     10.0.0.224:45934 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:45.354079901Z (APIServer pid=1) INFO:     10.0.0.224:45976 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:45.534589241Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:45.678850071Z (APIServer pid=1) INFO:     10.0.0.224:37450 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:45.811935306Z (APIServer pid=1) INFO:     10.0.0.224:45984 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:45.988042011Z (APIServer pid=1) INFO:     10.0.0.224:45974 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:46.534933934Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:47.037336018Z (APIServer pid=1) INFO:     10.0.0.224:57294 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:47.207451109Z (APIServer pid=1) INFO:     10.0.0.224:37488 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:47.281213498Z (APIServer pid=1) INFO:     10.0.0.224:59852 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:47.533570796Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:47.674635476Z (APIServer pid=1) INFO:     10.0.0.224:57296 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:48.003021849Z (APIServer pid=1) INFO:     10.0.0.224:59862 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:48.105080846Z (APIServer pid=1) INFO:     10.0.0.224:59882 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:48.269656224Z (APIServer pid=1) INFO:     10.0.0.224:59884 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:48.534075400Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:48.589821618Z (APIServer pid=1) INFO:     10.0.0.224:59878 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:48.817149582Z (APIServer pid=1) INFO:     10.0.0.224:59838 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:48.904042085Z (APIServer pid=1) INFO:     10.0.0.224:57354 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:49.039810883Z (APIServer pid=1) INFO:     10.0.0.224:45962 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:49.235879891Z (APIServer pid=1) INFO:     10.0.0.224:59846 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:49.534926359Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:49.537541723Z (APIServer pid=1) INFO:     10.0.0.224:37484 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:49.841776670Z (APIServer pid=1) INFO:     10.0.0.224:37434 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:50.332751203Z (APIServer pid=1) INFO:     10.0.0.224:45858 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:50.459604040Z (APIServer pid=1) INFO 10-02 17:17:50 [loggers.py:310] Engine 000: Avg prompt throughput: 2203.4 tokens/s, Avg generation throughput: 1074.3 tokens/s, Running: 32 reqs, Waiting: 0 reqs, GPU KV cache usage: 7.4%, Prefix cache hit rate: 0.0%
2026-10-02T17:17:50.466319029Z (APIServer pid=1) INFO:     10.0.0.224:41002 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:50.534119118Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:50.681108637Z (APIServer pid=1) INFO:     10.0.0.224:59278 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:50.782556892Z (APIServer pid=1) INFO:     10.0.0.224:59286 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:50.919280070Z (APIServer pid=1) INFO:     10.0.0.224:59288 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:51.475714738Z (APIServer pid=1) INFO:     10.0.0.224:40998 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:51.487917823Z (APIServer pid=1) INFO:     10.0.0.224:53518 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:51.532984621Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:51.559833898Z (APIServer pid=1) INFO:     10.0.0.224:45910 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:51.560807886Z (APIServer pid=1) INFO:     10.0.0.224:59290 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:51.717019855Z (APIServer pid=1) INFO:     10.0.0.224:59302 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:51.811316006Z (APIServer pid=1) INFO:     10.0.0.224:59314 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:52.309799786Z (APIServer pid=1) INFO:     10.0.0.224:45886 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:52.396749937Z (APIServer pid=1) INFO:     10.0.0.224:45900 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:52.533844606Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:52.975996113Z (APIServer pid=1) INFO:     10.0.0.224:45934 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:52.987175776Z (APIServer pid=1) INFO:     10.0.0.224:42194 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:52.989042338Z (APIServer pid=1) INFO:     10.0.0.224:45842 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:53.010787795Z (APIServer pid=1) INFO:     10.0.0.224:45870 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:53.111753911Z (APIServer pid=1) INFO:     10.0.0.224:45880 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:53.508202609Z (APIServer pid=1) INFO:     10.0.0.224:45976 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:53.533255467Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:53.614154751Z (APIServer pid=1) INFO:     10.0.0.224:59826 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:53.771423524Z (APIServer pid=1) INFO:     10.0.0.224:45920 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:54.534394969Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:54.924216805Z (APIServer pid=1) INFO:     10.0.0.224:45974 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:54.980997214Z (APIServer pid=1) INFO:     10.0.0.224:45984 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:55.251116063Z (APIServer pid=1) INFO:     10.0.0.224:37450 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:55.496260422Z (APIServer pid=1) INFO:     10.0.0.224:57294 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:55.534931013Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:55.940745311Z (APIServer pid=1) INFO:     10.0.0.224:57296 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:56.479369455Z (APIServer pid=1) INFO:     10.0.0.224:59884 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:56.497003175Z (APIServer pid=1) INFO:     10.0.0.224:59882 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:56.533007105Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:56.544073434Z (APIServer pid=1) INFO:     10.0.0.224:59862 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:56.749717457Z (APIServer pid=1) INFO:     10.0.0.224:59852 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:57.532970076Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:57.577190117Z (APIServer pid=1) INFO:     10.0.0.224:37484 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:57.595070262Z (APIServer pid=1) INFO:     10.0.0.224:59846 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:57.907505340Z (APIServer pid=1) INFO:     10.0.0.224:45962 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:58.345731391Z (APIServer pid=1) INFO:     10.0.0.224:37434 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:58.426255918Z (APIServer pid=1) INFO:     10.0.0.224:57354 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-10-02T17:17:58.533222715Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:17:59.535334270Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:18:00.461953022Z (APIServer pid=1) INFO 10-02 17:18:00 [loggers.py:310] Engine 000: Avg prompt throughput: 1873.0 tokens/s, Avg generation throughput: 1114.5 tokens/s, Running: 14 reqs, Waiting: 0 reqs, GPU KV cache usage: 3.3%, Prefix cache hit rate: 0.0%
2026-10-02T17:18:00.532953730Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:18:01.534717981Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:18:02.534141364Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:18:03.533440774Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK
2026-10-02T17:18:04.534524180Z (APIServer pid=1) INFO:     10.0.0.224:55628 - "GET /metrics HTTP/1.1" 200 OK