JenZhao

Apache Spark installation + ipython/jupyter notebook integration guide for macOS

Tested with Apache Spark 2.1.0, Python 2.7.13 and Java 1.8.0_112

For older versions of Spark and ipython, please, see also previous version of text.

Install Java Development Kit

JenZhao

-- Remove the history from 
rm -rf .git

-- recreate the repos from the current content only
git init
git add .
git commit -m "Initial commit"

-- push to the github remote repos ensuring you overwrite history
git remote add origin git@github.com:<YOUR ACCOUNT>/<YOUR REPOS>.git

JenZhao

#!/usr/bin/env sh
echo "Stuff I do after a fresh xubuntu install:"
echo ""
echo "Installing f.lux"
sudo add-apt-repository ppa:kilian/f.lux
sudo apt-get update
echo "Installing all my favorite applications"
sudo apt-get -y install fluxgui python-pip git-core gitg gedit gedit-plugins gparted bleachbit gnome-do lightread chromium-browser zsh
echo "Removing unwanted applications"
sudo apt-get -y remove firefox