Declan McDaid fired home the opener against his former club from 25 yards and Paul McGowan doubled the visitors' advantage in 32 minutes.
Luke McCowan pulled one back five minutes later but it wasn't enough for the Honest Men as Mark Kerr's first game in charge ended in defeat.