Learn From Your Past Experiences and Then Let Them Go