Created
September 21, 2025 07:14
-
-
Save vincenzopalazzo/17010af3839807fcbaf5541b51096cab to your computer and use it in GitHub Desktop.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| common_init_from_params: setting dry_penalty_last_n to ctx_size = 1024 | |
| Failed to generate tool call example: Value is not callable: null at row 1, column 72: | |
| <|im_start|>{% for message in messages %}{{message['role'] | capitalize}}{% if message['content'][0]['type'] == 'image' %}{{':'}}{% else %}{{': '}}{% endif %}{% for line in message['content'] %}{% if line['type'] == 'text' %}{{line['text']}}{% elif line['type'] == 'image' %}{{ '<image>' }}{% endif %}{% endfor %}<end_of_utterance> | |
| ^ | |
| {% endfor %}{% if add_generation_prompt %}{{ 'Assistant:' }}{% endif %} | |
| at row 1, column 42: | |
| <|im_start|>{% for message in messages %}{{message['role'] | capitalize}}{% if message['content'][0]['type'] == 'image' %}{{':'}}{% else %}{{': '}}{% endif %}{% for line in message['content'] %}{% if line['type'] == 'text' %}{{line['text']}}{% elif line['type'] == 'image' %}{{ '<image>' }}{% endif %}{% endfor %}<end_of_utterance> | |
| ^ | |
| {% endfor %}{% if add_generation_prompt %}{{ 'Assistant:' }}{% endif %} | |
| at row 1, column 42: | |
| <|im_start|>{% for message in messages %}{{message['role'] | capitalize}}{% if message['content'][0]['type'] == 'image' %}{{':'}}{% else %}{{': '}}{% endif %}{% for line in message['content'] %}{% if line['type'] == 'text' %}{{line['text']}}{% elif line['type'] == 'image' %}{{ '<image>' }}{% endif %}{% endfor %}<end_of_utterance> | |
| ^ | |
| {% endfor %}{% if add_generation_prompt %}{{ 'Assistant:' }}{% endif %} | |
| at row 1, column 13: | |
| <|im_start|>{% for message in messages %}{{message['role'] | capitalize}}{% if message['content'][0]['type'] == 'image' %}{{':'}}{% else %}{{': '}}{% endif %}{% for line in message['content'] %}{% if line['type'] == 'text' %}{{line['text']}}{% elif line['type'] == 'image' %}{{ '<image>' }}{% endif %}{% endfor %}<end_of_utterance> | |
| ^ | |
| {% endfor %}{% if add_generation_prompt %}{{ 'Assistant:' }}{% endif %} | |
| at row 1, column 1: | |
| <|im_start|>{% for message in messages %}{{message['role'] | capitalize}}{% if message['content'][0]['type'] == 'image' %}{{':'}}{% else %}{{': '}}{% endif %}{% for line in message['content'] %}{% if line['type'] == 'text' %}{{line['text']}}{% elif line['type'] == 'image' %}{{ '<image>' }}{% endif %}{% endfor %}<end_of_utterance> | |
| ^ | |
| {% endfor %}{% if add_generation_prompt %}{{ 'Assistant:' }}{% endif %} | |
| clip_model_loader: model name: SmolVLM 500M Instruct | |
| clip_model_loader: description: | |
| clip_model_loader: GGUF version: 3 | |
| clip_model_loader: alignment: 32 | |
| clip_model_loader: n_tensors: 291 | |
| clip_model_loader: n_kv: 49 | |
| mtmd_init_from_file: error: Failed to load CLIP model from /Users/vincenzopalazzo/.qvac/models/http_6288a8ab14280ef2_SmolVLM-500M-Instruct-Q8_0.gguf | |
| Failed to load vision model from /Users/vincenzopalazzo/.qvac/models/http_6288a8ab14280ef2_SmolVLM-500M-Instruct-Q8_0.gguf | |
| ggml_metal_free: deallocating | |
| [llamacpp:llm] Error during model load: Error: Failed to load vision model from /Users/vincenzopalazzo/.qvac/models/http_6288a8ab14280ef2_SmolVLM-500M-Instruct-Q8_0.gguf | |
| at new LlamaInterface (file:///Users/vincenzopalazzo/github/experiments/qvac-doc-recognition/node_modules/.pnpm/@tetherto+llm-llamacpp@2.5.0_@tetherto+qvac-lib-dl-hyperdrive@2.2.1_bare-buffer@3.3.1__bare-buffer@3.3.1/node_modules/@tetherto/llm-llamacpp/addon.js:14:28) | |
| at LlmLlamacpp._createAddon (file:///Users/vincenzopalazzo/github/experiments/qvac-doc-recognition/node_modules/.pnpm/@tetherto+llm-llamacpp@2.5.0_@tetherto+qvac-lib-dl-hyperdrive@2.2.1_bare-buffer@3.3.1__bare-buffer@3.3.1/node_modules/@tetherto/llm-llamacpp/index.js:97:12) | |
| at LlmLlamacpp._load (file:///Users/vincenzopalazzo/github/experiments/qvac-doc-recognition/node_modules/.pnpm/@tetherto+llm-llamacpp@2.5.0_@tetherto+qvac-lib-dl-hyperdrive@2.2.1_bare-buffer@3.3.1__bare-buffer@3.3.1/node_modules/@tetherto/llm-llamacpp/index.js:57:25) | |
| at async LlmLlamacpp.load (file:///Users/vincenzopalazzo/github/experiments/qvac-doc-recognition/node_modules/.pnpm/@tetherto+infer-base@2.6.4_@tetherto+qvac-lib-dl-hyperdrive@2.2.1_bare-buffer@3.3.1__bare-buffer@3.3.1/node_modules/@tetherto/infer-base/WeightsProvider/BaseInference.js:65:5) | |
| at async loadModel (file:///Users/vincenzopalazzo/github/experiments/qvac-doc-recognition/node_modules/.pnpm/@tetherto+qvac-sdk@0.1.0_@tetherto+qvac-lib-dl-hyperdrive@2.2.1_bare-buffer@3.3.1__bare_fd9e6fd2c99e7a9526d3f2efa8cedf2e/node_modules/@tetherto/qvac-sdk/dist/server/bare/addons/load-model.js:51:5) | |
| at async handleLoadModel (file:///Users/vincenzopalazzo/github/experiments/qvac-doc-recognition/node_modules/.pnpm/@tetherto+qvac-sdk@0.1.0_@tetherto+qvac-lib-dl-hyperdrive@2.2.1_bare-buffer@3.3.1__bare_fd9e6fd2c99e7a9526d3f2efa8cedf2e/node_modules/@tetherto/qvac-sdk/dist/server/rpc/handlers/load-model.js:9:13) | |
| at async RPC.handleRequest (file:///Users/vincenzopalazzo/github/experiments/qvac-doc-recognition/node_modules/.pnpm/@tetherto+qvac-sdk@0.1.0_@tetherto+qvac-lib-dl-hyperdrive@2.2.1_bare-buffer@3.3.1__bare_fd9e6fd2c99e7a9526d3f2efa8cedf2e/node_modules/@tetherto/qvac-sdk/dist/server/rpc/handle-request.js:36:40) | |
| at async RPC._onmessage (file:///Users/vincenzopalazzo/github/experiments/qvac-doc-recognition/node_modules/.pnpm/bare-rpc@0.2.12_bare-buffer@3.3.1_bare-events@2.7.0/node_modules/bare-rpc/index.js:212:11) { | |
| code: 'INTERNAL_ERROR' | |
| } | |
| Error loading model: Error: Failed to load vision model from /Users/vincenzopalazzo/.qvac/models/http_6288a8ab14280ef2_SmolVLM-500M-Instruct-Q8_0.gguf | |
| at new LlamaInterface (file:///Users/vincenzopalazzo/github/experiments/qvac-doc-recognition/node_modules/.pnpm/@tetherto+llm-llamacpp@2.5.0_@tetherto+qvac-lib-dl-hyperdrive@2.2.1_bare-buffer@3.3.1__bare-buffer@3.3.1/node_modules/@tetherto/llm-llamacpp/addon.js:14:28) | |
| at LlmLlamacpp._createAddon (file:///Users/vincenzopalazzo/github/experiments/qvac-doc-recognition/node_modules/.pnpm/@tetherto+llm-llamacpp@2.5.0_@tetherto+qvac-lib-dl-hyperdrive@2.2.1_bare-buffer@3.3.1__bare-buffer@3.3.1/node_modules/@tetherto/llm-llamacpp/index.js:97:12) | |
| at LlmLlamacpp._load (file:///Users/vincenzopalazzo/github/experiments/qvac-doc-recognition/node_modules/.pnpm/@tetherto+llm-llamacpp@2.5.0_@tetherto+qvac-lib-dl-hyperdrive@2.2.1_bare-buffer@3.3.1__bare-buffer@3.3.1/node_modules/@tetherto/llm-llamacpp/index.js:57:25) | |
| at async LlmLlamacpp.load (file:///Users/vincenzopalazzo/github/experiments/qvac-doc-recognition/node_modules/.pnpm/@tetherto+infer-base@2.6.4_@tetherto+qvac-lib-dl-hyperdrive@2.2.1_bare-buffer@3.3.1__bare-buffer@3.3.1/node_modules/@tetherto/infer-base/WeightsProvider/BaseInference.js:65:5) | |
| at async loadModel (file:///Users/vincenzopalazzo/github/experiments/qvac-doc-recognition/node_modules/.pnpm/@tetherto+qvac-sdk@0.1.0_@tetherto+qvac-lib-dl-hyperdrive@2.2.1_bare-buffer@3.3.1__bare_fd9e6fd2c99e7a9526d3f2efa8cedf2e/node_modules/@tetherto/qvac-sdk/dist/server/bare/addons/load-model.js:51:5) | |
| at async handleLoadModel (file:///Users/vincenzopalazzo/github/experiments/qvac-doc-recognition/node_modules/.pnpm/@tetherto+qvac-sdk@0.1.0_@tetherto+qvac-lib-dl-hyperdrive@2.2.1_bare-buffer@3.3.1__bare_fd9e6fd2c99e7a9526d3f2efa8cedf2e/node_modules/@tetherto/qvac-sdk/dist/server/rpc/handlers/load-model.js:9:13) | |
| at async RPC.handleRequest (file:///Users/vincenzopalazzo/github/experiments/qvac-doc-recognition/node_modules/.pnpm/@tetherto+qvac-sdk@0.1.0_@tetherto+qvac-lib-dl-hyperdrive@2.2.1_bare-buffer@3.3.1__bare_fd9e6fd2c99e7a9526d3f2efa8cedf2e/node_modules/@tetherto/qvac-sdk/dist/server/rpc/handle-request.js:36:40) | |
| at async RPC._onmessage (file:///Users/vincenzopalazzo/github/experiments/qvac-doc-recognition/node_modules/.pnpm/bare-rpc@0.2.12_bare-buffer@3.3.1_bare-events@2.7.0/node_modules/bare-rpc/index.js:212:11) { | |
| code: 'INTERNAL_ERROR' | |
| } | |
| Failed to load AI model: Error: Failed to load vision model from /Users/vincenzopalazzo/.qvac/models/http_6288a8ab14280ef2_SmolVLM-500M-Instruct-Q8_0.gguf | |
| at loadModel (/Users/vincenzopalazzo/github/experiments/qvac-doc-recognition/node_modules/.pnpm/@tetherto+qvac-sdk@0.1.0_@tetherto+qvac-lib-dl-hyperdrive@2.2.1_bare-buffer@3.3.1__bare_fd9e6fd2c99e7a9526d3f2efa8cedf2e/node_modules/@tetherto/qvac-sdk/dist/client/api/load-model.js:90:27) | |
| at process.processTicksAndRejections (node:internal/process/task_queues:105:5) | |
| at async AIService.initialize (/Users/vincenzopalazzo/github/experiments/qvac-doc-recognition/src/services/aiService.ts:25:16) | |
| at async TelegramBot.initializeServices (/Users/vincenzopalazzo/github/experiments/qvac-doc-recognition/src/bot.ts:27:7) | |
| ⚠️ Failed to initialize AI service: Error: Failed to load vision model from /Users/vincenzopalazzo/.qvac/models/http_6288a8ab14280ef2_SmolVLM-500M-Instruct-Q8_0.gguf | |
| at loadModel (/Users/vincenzopalazzo/github/experiments/qvac-doc-recognition/node_modules/.pnpm/@tetherto+qvac-sdk@0.1.0_@tetherto+qvac-lib-dl-hyperdrive@2.2.1_bare-buffer@3.3.1__bare_fd9e6fd2c99e7a9526d3f2efa8cedf2e/node_modules/@tetherto/qvac-sdk/dist/client/api/load-model.js:90:27) | |
| at process.processTicksAndRejections (node:internal/process/task_queues:105:5) | |
| at async AIService.initialize (/Users/vincenzopalazzo/github/experiments/qvac-doc-recognition/src/services/aiService.ts:25:16) | |
| at async TelegramBot.initializeServices (/Users/vincenzopalazzo/github/experiments/qvac-doc-recognition/src/bot.ts:27:7) | |
| Bot will continue without AI capabilities |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment