Goals from Brian McClair and Roy Aitken gave Davie Hay's side a 2-0 lead but Tommy McLean's men fought back through Andy Walker and Paul Smith.
Extra-time failed to produce a winner and Celtic progressed 5-4 on penalties, with Tommy Burns netting the decisive spot-kick.
