Time dependent models

Posted on Mon 11 September 2017 in posts • Tagged with python, machine learning

Time Dependent Classification/RegressionΒΆ

I have been interested in time dependent classification/regression for a long time. Most machine learning models are implemented as static models where our assumptions about the relationships between the input variables and the parameters of the models is fixed. This assumption is mostly true, however, there are cases where the model parameters for the same input variable must be allowed to change with time. Furthermore, the change in the model parameters should not be large compared to their value at the previous timesteps. One simple way to approach this problem is to have a different model for each timestep, however, this will not allow us to learn from all the data at hand. The second approach is to have a different parameter for each timestep and a base set of parameters. This second approach although more appropriate will not allow us to enforce our constraint that the model parameters at a given timestep should not change too much from their value at the last timestep.

Continue reading

Pytorch RNN sequence tagging

Posted on Sun 03 September 2017 in posts • Tagged with python, machine learning, deeplearning

Metropolis Hastings algorithm - a python primer

Posted on Tue 18 April 2017 in posts • Tagged with machine learning, implementation, bayesian

Convex Optimization using CVXPY

Posted on Mon 02 January 2017 in posts • Tagged with machine learning


I got introduced to the concept of convex optimization after viewing Stephen P. Boyd's lecture vidoes on the topic from the Machine Learning Summer School 2015 in Tubingen. Prof. Boyd has a very engaging style of explaining the topic. His lectures also included some code samples using the CVXPY library
Continue reading