Goals from summer signings Joe Aribo and Sheyi Ojo set Steven Gerrard's side up for the return match in Luxembourg although James Tavernier missed a penalty.
Aberdeen drew 1-1 with Chikhura Sachkhere in Georgia. The Dons fell behind to a penalty late in the first half but Sam Cosgrove equalised from the spot midway through the second period.
