[2025-06-16 16:07:27] server_args=ServerArgs(model_path='RedHatAI/Mistral-Small-24B-Instruct-2501-FP8-dynamic', tokenizer_path='RedHatAI/Mistral-Small-24B-Instruct ...
llama_model_loader: loaded meta data with 26 key-value pairs and 579 tensors from D:\models\Publisher\Repository\DeepSeek-R1-Distill-Qwen-14B-Q4_K_M.gguf (version GGUF V3 (latest)) llama_model_loader: ...