Skip to content

Instantly share code, notes, and snippets.

View naufalso's full-sized avatar

Naufal Suryanto naufalso

View GitHub Profile
@philschmid
philschmid / get_memory_size.py
Created January 16, 2025 13:53
Get needed GPU per precision for a Hugging Face Model Id
from typing import Dict, Union
from huggingface_hub import get_safetensors_metadata
import argparse
import sys
# Example:
# python get_gpu_memory.py Qwen/Qwen2.5-7B-Instruct
# Dictionary mapping dtype strings to their byte sizes
bytes_per_dtype: Dict[str, float] = {
@alaniwi
alaniwi / example.sh
Last active June 30, 2023 14:08
Script to run commands in different "panes" of a terminal window
# example usage:
#
# this runs the following commands simultaneously, each in different areas of the screen:
# 1) echo hello
# 2) cal
# 3) for i in 1 2 3 4 5 ; do date; sleep 1; done
#
# it waits for 2 seconds after they have all finished, before clearing the screen
#
./run_in_panes.py -s 2 'echo hello' 'cal' 'for i in 1 2 3 4 5 ; do date; sleep 1; done'