Last active
January 26, 2026 09:07
-
-
Save nanguoyu/94c5955958ca41bb3f0d7c36767ef9c9 to your computer and use it in GitHub Desktop.
DLR Experiments
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| sbatch scripts/muscia/slurm_60m_lax_6seeds_12n.sh --lax_use_dlr True --lr_act False | |
| sbatch scripts/muscia/slurm_60m_lax_6seeds_12n.sh --lax_use_dlr True --lr_act True | |
| sbatch scripts/muscia/slurm_130m_lax_3seeds_12n.sh --lax_use_dlr True --lr_act True | |
| sbatch scripts/muscia/slurm_130m_lax_3seeds_12n.sh --lax_use_dlr True --lr_act False | |
| sbatch scripts/muscia/slurm_350m_lax_3seeds_12n.sh --lax_use_dlr True --lr_act True | |
| sbatch scripts/muscia/slurm_350m_lax_3seeds_12n.sh --lax_use_dlr True --lr_act False | |
| sbatch scripts/muscia/slurm_60m_lora_lr_6seeds_12n.sh --lr_act True -r 64 | |
| sbatch scripts/muscia/slurm_60m_lora_lr_6seeds_12n.sh --lr_act True -r 96 | |
| sbatch scripts/muscia/slurm_130m_lora_lr_3seeds_12n.sh --weight_decay 0.1 --dlr_scope mlp | |
| sbatch scripts/muscia/slurm_130m_lora_lr_3seeds_12n.sh --weight_decay 0.1 --dlr_scope attn | |
| sbatch scripts/muscia/slurm_350m_lora_lr_3seeds_12n.sh --weight_decay 0.1 --dlr_scope attn | |
| sbatch scripts/muscia/slurm_350m_lora_lr_3seeds_12n.sh --weight_decay 0.1 --dlr_scope mlp |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment