The 42-year-old former Hibernian winger takes over from John Brogan, who left the Coatbridge club in the wake of their Scottish Cup defeat to Formartine United last month.
Harper also played for Derby County, Portsmouth, Stoke City and Dunfermline Athletic before a stint with Junior side Thorniewood United.
Albion Rovers are currently bottom of Ladbrokes League 2 as they prepare to face Edinburgh City at The Reigart Stadium on Saturday.