The stochastic principal component regression with varying learning-rate can handle online data sets.
Useful links