In a first half of few chances, Odsonne Edouard broke the deadlock with a cool finish after 32 minutes and Neil Lennon's men defended well throughout.
Allan McGregor made a couple of vital saves before substitute Jonny Hayes scored the second goal in stoppage time.
Rangers had Jordan Jones sent off for a reckless challenge on Moritz Bauer right at the end.
