A first-half goal from new signing Danny Johnson proved decisive as James McPake's men came out on top in the all-Championship clash.
A draw would have seen both sides qualify but this result means that League 1 East Fife claim one of the best runners-up spots instead.