On The Job Learning. How To Optimize?