Fei Hu's Blog

Get better thinking by writing

Set up PySpark with Keras

pip install -U matplotlib numpy pandas scipy jupyter ipython scikit-learn scikit-image openslide-python pip install tensorflow pip install git+https://github.com/fcholle...

Git Notes

Merge a remote pull to the current branch Add the following script to ~/.gitconfig [alias] pr = "!f() { git fetch ${2:-upstream} pull/$1/head:pr/$1 && git checkout pr/$1; }; f" ...

Parfor in Workflow

org.apache.sysml.api.mlcontext.MLContext -> org.apache.sysml.api.mlcontext.ScriptExecutor -> org.apache.sysml.api.ScriptExecutorUtils -> org.apache.sysml.runtime.controlprogram.Program -&g...

Install Load Balance V2 for OpenStack

On the controller node apt-get install python-neutron-lbaas -y vi /etc/neutron/neutron.conf: [DEFAULT] ... service_plugins = router, neutron_lbaas.services.loadbalancer.plugin.LoadBalan...

SystemML Matrix

MatrixIndex vs MatrixCharacteristics

SystemML Workflow

1. Create DML script Use org.apache.sysml.api.mlcontex.Script class to create DML script. The in() and out() functions are utilized to map the input and output values 2. Handling DML /org/apac...

Spark Workflow


CS231n_Notes_1.2: Linear Classification

Interpreting a linear classifier Notice that a linear classifier computes the score of a class as a weighted sum of all of its pixel values across all 3 of its color channels. Depending on precisel...

CS231n_Notes_1.1: Image Classification

Image Classification Problem is the task of assigning an input image one label from a fixed set of categories. Many other seemingly distinct Computer Vision tasks (such as ojbject detection...

Setup PyCharm For SystemML with PySpark

1. Install PySpark 1.1 Download Spark package 1.2 Set up SPARK_HOME at ~/.bash_profile export SPARK_HOME="/Users/mac/Documents/Software/spark-2.1.1-bin-hadoop2.7" export PATH="$SPARK_HOME/bin:...