theharshpat

# Functions to manage multiple GitHub accounts via SSH
# Example for switching to and managing my tailwiinder account
# 
# Setup Required:
# 1. Configure SSH hosts in ~/.ssh/config
# 2. Set up SSH keys for your GitHub accounts
# 3. Add these functions to your .zshrc
#
# Usage:
# - clone-tom: Clone a new repository using tailwiinder account

theharshpat

"""
The 2024 Transformer (the Noam Transformer):
- RMSNorm
- GQA or some combination 
- Sliding window attention 
- Swiglu
- RoPE (Rotary Positional Embedding)

LLM Arches:
                hidden | MLP mult.   |  n_layers | rope_theta |  GQA Group Size  | GLU Act. |  ops 

theharshpat

Anti-hype LLM reading list

Goals: Add links that are reasonable and good explanations of how stuff works. No hype and no vendor content if possible. Practical first-hand accounts of models in prod eagerly sought.

Foundational Concepts

Pre-Transformer Models

theharshpat

# git clone https://github.com/NVlabs/stylegan2
import os
import numpy as np
from scipy.interpolate import interp1d
from scipy.io import wavfile
import matplotlib.pyplot as plt
import PIL.Image
import moviepy.editor

import dnnlib

theharshpat

from __future__ import division, print_function
import math
from oxmaps import Line, Pano, PanoImage, PanoTile, Point, db
from PIL import Image

ids = [
    'eGYyAlN9kvBEg6AYtJV60A',
    'CCQWTbDqYokwHNwBWnl8wQ',
    '_UBAlMtHNb7hUYpxXkmcCA',
    'tBMPwhLVH4Kk8EdQc15-3w',