Learning To Retain While Acquiring: Combating Distributio...