Skip to content

Instantly share code, notes, and snippets.

import re
from datasets import load_dataset
import torch
import verifiers as vf
"""
# inference
CUDA_VISIBLE_DEVICES=0 vf-vllm --model 'google/gemma-3-4b-it' --dtype bfloat16 --max-model-len 131072
# using `transformers==4.49.0` there's a input side-effect when calling the processor
# this example shows the case for Qwen2.5-VL
from transformers import AutoProcessor
from qwen_vl_utils import process_vision_info
processor = AutoProcessor.from_pretrained("Qwen/Qwen2.5-VL-3B-Instruct")
messages1 = [
{

Keybase proof

I hereby claim:

  • I am arturomf94 on github.
  • I am arturomf94 (https://keybase.io/arturomf94) on keybase.
  • I have a public key ASB925rE_KAUgL3Xn2094nPX-VQ7eI2tDUPbOj1GeCpzuwo

To claim this, I am signing this object: