There were no changes to the starting lineup that secured a 1-0 victory over Hearts last weekend, with Leanne Crichton keeping faith with the same side for this afternoon's derby.
The Gers took an early lead inside the opening two minutes as Laura Berry found the back of the net, following excellent work down the right-hand side from Katie Wilkinson and Calliste Brookshire.
Rangers looked to build on their early advantage and came close again in the 12th minute. A well-delivered free kick from Brookshire found Mijke Roelfsema, whose header narrowly cleared the crossbar.
The Light Blues continued to create opportunities and came agonisingly close to doubling their lead in the 36th minute as Brookshire's effort crashed against the crossbar before Bailey Collins was unable to convert the rebound.
The half-time whistle followed shortly after, with Berry's early strike giving Rangers a one-goal advantage at the interval.
Rangers started the second half brightly and were awarded a penalty following a handball inside the Celtic box, after an attempted cross from Brookshire. Katie Wilkinson stepped up to take the spot-kick, but her effort was denied by Adelaide Gay.
Celtic threatened at the other end in the 65th minute, with their effort striking the post. The hosts continued to press and, just a minute later, found an equaliser as the ball fell to Maria McAneny, who fired into the top corner.
The hosts took the lead in the 80th minute as Addison Handley found the top corner with a strike from outside the box.
With time running out, Rangers continued to push for a response. Brogan Hay drove forward in the 86th minute before finding Hannah Blake, whose effort narrowly missed the target.
Crichton's side continued to apply pressure in the closing stages and came agonisingly close to finding an equaliser in the 90th minute as Eilidh Austin's long-range effort crashed against the crossbar.
Despite a determined late push, Rangers were unable to find a second goal as the match finished 2-1 in Celtic's favour.
The result brings Rangers' winning run to an end, but the Light Blues remain six points clear at the top of the ScottishPower Women's Premier League as attention turns to the Scottish Cup fixture against Motherwell next Sunday.
RANGERS: Ohba, Collins, Austin, Roelfsema, Docherty, Thrysøe, McLeary, Cruft (Blake, 71'), Berry, Wilkinson (Hay, 71'), Brookshire
Subs not used: Fife, Smith, Boyce, Hill, Connolly-Jackson, Black, Ewens
CELTIC: Gay, Walsh, Robertson, Fisher, McGregor, Cross (Howe, 90'), Luke, Handley (Craig, 85'), Doran-Barr (Jordan, 71'), Lawson, McAneny
Subs not used: Rodgers, Gallacher, Clark, Morgan, Nakao, Arthur