Danny Lennon's side trailed 1-0 after the first leg but Martin McNiff levelled the aggregate score on the hour mark and Ally Love converted a late penalty to send the Bully Wee up.
Highland League champions Cove Rangers will be playing in Ladbrokes League 2 in 2019/20, with Berwick Rangers dropping out of the SPFL. Jamie Masson, Jordon Brown and Paul McManus all scored at Shielfield for a 3-0 win and a 7-0 aggregate success.
Queen of the South retained their place in the Ladbrokes Championship following a 0-0 draw with Raith Rovers at Palmerston, with Queens having won the first leg 3-1.