Tested with Apache Spark 2.1.0, Python 2.7.13 and Java 1.8.0_112
For older versions of Spark and ipython, please, see also previous version of text.
littlebeandog
peterroelants
/ mnist_estimator.py
Last active
February 14, 2024 11:26
Example using TensorFlow Estimator, Experiment & Dataset on MNIST data.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """Script to illustrate usage of tf.estimator.Estimator in TF v1.3""" | |
| import tensorflow as tf | |
| from tensorflow.examples.tutorials.mnist import input_data as mnist_data | |
| from tensorflow.contrib import slim | |
| from tensorflow.contrib.learn import ModeKeys | |
| from tensorflow.contrib.learn import learn_runner | |
| # Show debugging output |
ololobus
/ Spark+ipython_on_MacOS.md
Last active
October 3, 2025 16:28
Apache Spark installation + ipython/jupyter notebook integration guide for macOS
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # --------------------------------------------------------------------------- | |
| # | |
| # Description: This file holds all my BASH configurations and aliases | |
| # | |
| # Sections: | |
| # 1. Environment Configuration | |
| # 2. Make Terminal Better (remapping defaults and adding functionality) | |
| # 3. File and Folder Management | |
| # 4. Searching | |
| # 5. Process Management |