Understanding Roofline Charts
The purpose of this post is to discuss my current understanding of roofline charts. Let me lay some background first. Before I got into machine […]
machine learning
Efficiently Computing the Fisher Vector Product in TRPO
The purpose of this post is to provide math proofs and clarify some implementation details in the recently introduced reinforcement learning method called “Trust Region […]
Initializing Weights for the Convolutional and Fully Connected Layers
You may have noticed that weights for convolutional and fully connected layers in a deep neural network (DNN) are initialized in a specific way. For […]
Word2Vec Experiments
In this post, I’ll describe some experiments on word2vec, a technique invented by researchers at Google that aims to find compact vector representations for words […]
Understanding Data Parallelism in Machine Learning
In this post, I’ll show how to modify the spiral data set example presented in Karpathy’s post (http://cs231n.github.io/neural-networks-case-study/) to run in a data parallel mode. […]
Building a 2 Layer Network to Classify a Spiral Dataset using Matlab and CNTK
The purpose of this post is to provide some additional insights and Matlab and CNTK implementations for the two layer network used to classify a […]