Mark Rogers markrogersjr

## gpt_oss_flash.md

      
        
          
            
              
              1 file
            
          
          
            
              
              3 forks
            
          
            
              
                
                0 comments
              
            
          
            
              
              3 stars
            
          
        
        
          
              
          
          
            
                markrogersjr
                / gpt_oss_flash.md
            
            
              Last active
              November 26, 2025 15:39
            
              
                GPT-OSS with Flash Attention and Memory-Efficient Attention via PyTorch-Native SDPA
              
          
        
      
        
  
      
    GPT-OSS with Flash Attention and Memory-Efficient Attention via PyTorch-Native SDPA

from time import time
import warnings

import torch
import transformers