Stranraer set up a Scottish Cup fifth-round tie against Dundee United at Stair Park after beating Dunfermline 3-1 on Tuesday night.
Other than a penalty shoot-out defeat to Livingston, Stephen Aitken's team are unbeaten since August and knocked out their League 1 rivals in an East End Park replay.
Sean Winter and Stephen Stirling had the Blues in control and Jamie Longworth added a late third goal after Ross Millen had pulled one back from the penalty spot.
Andy Jackson hit a first-half hat-trick as Brechin overcame Annan 4-2 at Glebe Park. Scott Davidson and David Hopkirk replied for the visitors after the break, either side of Colin Hamilton netting for City, who now face Falkirk.
Berwick Rangers edged out fellow League 2 club Albion Rovers 1-0 thanks to a late Andy Russell goal to book a fifth-round trip to Edinburgh to play Lowland League Spartans. Rovers had Josh Mullin sent off in the closing minutes at Cliftonhill.
Revised William Hill Scottish Cup fifth-round draw
Queen of the South v St Johnstone
Rangers v Raith Rovers
Dundee v Celtic
Hibernian v Arbroath
Falkirk v Brechin City
Stranraer v Dundee United
Partick Thistle v Inverness Caley Thistle
Spartans v Berwick Rangers
Ties to be played weekend of February 7/8
