I hereby claim:
- I am arturomf94 on github.
- I am arturomf94 (https://keybase.io/arturomf94) on keybase.
- I have a public key ASB925rE_KAUgL3Xn2094nPX-VQ7eI2tDUPbOj1GeCpzuwo
To claim this, I am signing this object:
| import re | |
| from datasets import load_dataset | |
| import torch | |
| import verifiers as vf | |
| """ | |
| # inference | |
| CUDA_VISIBLE_DEVICES=0 vf-vllm --model 'google/gemma-3-4b-it' --dtype bfloat16 --max-model-len 131072 |
| # using `transformers==4.49.0` there's a input side-effect when calling the processor | |
| # this example shows the case for Qwen2.5-VL | |
| from transformers import AutoProcessor | |
| from qwen_vl_utils import process_vision_info | |
| processor = AutoProcessor.from_pretrained("Qwen/Qwen2.5-VL-3B-Instruct") | |
| messages1 = [ | |
| { |
I hereby claim:
To claim this, I am signing this object: