Steven Gerrard's men fell behind at Ibrox but Alfredo Morelos equalised almost immediately and late goals from James Tavernier (penalty) and Morelos sealed the points.
Meanwhile, Celtic lost 3-1 to Salzburg in Austria - they took an early lead through Odsonne Edouard but the hosts hit back and are top of the section.
