Skip to content

Instantly share code, notes, and snippets.

View appleparan's full-sized avatar

Jongsu Liam Kim appleparan

View GitHub Profile
@appleparan
appleparan / Dockerfile
Last active November 14, 2024 23:56
Dockerfile for appleparan/ml_base
# Image for vision and tabular machine learnig project with jupterlab
FROM nvcr.io/nvidia/tensorrt:24.10-py3 AS base
# Declare environmental variables
ENV DEBIAN_FRONTEND=noninteractive \
DEBCONF_NONINTERACTIVE_SEEN=true \
TZ=Asia/Seoul \
LANG=en_US.UTF-8 \
LC_ALL=en_US.UTF-8 \
SHELL=/bin/bash \
@appleparan
appleparan / ecCodes.Dockerfile
Last active May 19, 2024 13:20
Docker image for ecCodes (CentOS 7.8). Use linuxbrew to avoid glibc dependency hell
FROM centos:centos7.8.2003
# Install required packages
RUN yum groupinstall -y 'Development Tools'
RUN yum install -y gcc \
make \
patch \
zlib-devel \
bzip2 \
bzip2-devel \
import pandas as pd
from datasets import load_dataset_builder, load_dataset, Dataset
def main(dataset_name1 = 'kyujinpy/OpenOrca-KO', dataset_name2 = 'Open-Orca/OpenOrca', split='train'):
# Load the dataset builder
builder1 = load_dataset_builder(dataset_name1)
builder2 = load_dataset_builder(dataset_name2)
# kyujinpy/OpenOrca-KO
# id, input, instruction, output
@appleparan
appleparan / Assignment and Broadcasting.md
Last active March 15, 2021 21:24
Julia Korea ๋‹ต๋ณ€

์™€ ์ข‹์€ ์งˆ๋ฌธ์ด๋„ค์š”. ๋•๋ถ„์— ์ €๋„ ์›๋ก ์ ์ธ ๋ถ€๋ถ„์—์„œ ๋‹ค์‹œ ์ดํ•ด๋ฅผ ๋‹ค์žก๋Š” ์ข‹์€ ๊ธฐํšŒ๊ฐ€ ๋˜์—ˆ์Šต๋‹ˆ๋‹ค.

  • ๊ธฐ๋ณธ์ ์œผ๋กœ Julia์˜ Argument Passing ์€ "pass-by-sharing"์ž…๋‹ˆ๋‹ค. ์ด ์ ์„ ์—ผ๋‘์— ๋‘์…”์•ผ ํ•ฉ๋‹ˆ๋‹ค.

๊ทธ๋Ÿผ BenchmarkTools.jl์˜ @btime๊ณผ InteractiveUtils์˜ @code_lowered๋ฅผ ์ด์šฉํ•ด์„œ ๊ฐ์ž์˜ ์ฝ”๋“œ๊ฐ€ ๋‚ด๋ถ€์ ์œผ๋กœ ์–ด๋–ป๊ฒŒ ๋™์ž‘ํ•˜๋Š” ์ง€ ์•Œ์•„๋ด…์‹œ๋‹ค.

  1. test1

Keybase proof

I hereby claim:

  • I am appleparan on github.
  • I am appleparan (https://keybase.io/appleparan) on keybase.
  • I have a public key ASC72HifOLmY_OF7OZd3w4FUxpjbiS6zQvQQ7_enOcMjZgo

To claim this, I am signing this object:

@appleparan
appleparan / complex.c
Created February 5, 2020 05:49
Complex usage in C
#include <stdio.h>
#include <complex.h>
/*
Compile option : icc -std=c99 main.c -o main
*/
int main() {
double complex a;
a = 1.0 + I * 2.0;
using DataFrames
s = DataFrame([[true], [true], [false], [false], [false], [false], [false], [false], [false]],
[:MBF, :SBF, :VOX1, :HCM1, :YHP1, :SFF, :ACE2, :SWI5, :CLN3])
for step in 1:30
last = s[end, :]
new = proceed(last)
push!(s, new)
end
#= /home/appleparan/src/DebugFlux/test_curnn.jl:12 =# Zygote.@code_adjoint(gradient((m->begin
#= /home/appleparan/src/DebugFlux/test_curnn.jl:12 =#
sum(m(x))
end), m)) = Zygote.Adjoint(1: (%4, %5 :: Zygote.Context, %1, %2, %3)
%6 = (ZygoteRules._pullback)(%5, tuple, %2)
%7 = (getindex)(%6, 1)
%8 = (getindex)(%6, 2) %9 = (ZygoteRules._pullback)(%5, Core._apply, ZygoteRules.pullback, %7, %3)
%10 = (getindex)(%9, 1) %11 = (getindex)(%9, 2)
%12 = (ZygoteRules._pullback)(%5, Base.indexed_iterate, %10, 1)
# This file is machine-generated - editing it directly is not advised
[[AbstractFFTs]]
deps = ["LinearAlgebra"]
git-tree-sha1 = "380e36c66edfa099cd90116b24c1ce8cafccac40"
uuid = "621f4979-c628-5d54-868e-fcf4e3e8185c"
version = "0.4.1"
[[AbstractTrees]]
deps = ["Markdown", "Test"]
@appleparan
appleparan / README.md
Last active June 24, 2019 12:38
KSITI Nurion FFTW
  • KNL (Xeon Phi) only

FFTW compilation option

  • Specific compiler option
$ CC=icc CFLAGS="-fast -fPIC -traceback -xCOMMON-AVX512" ./configure --prefix=$HOME/usr/local/fftw_mic/ --enable-avx512 --enable-openmp
$ make && make install