Brooklyn Kabongolo and Lewis Smith had the home side ahead, but goals from Emmanuel Fernandez and Mikey Moore in the final 10 minutes saw Danny Röhl’s take a point.
From last weekend’s victory over Hearts, there were two changes to the starting line-up as James Tavernier replaced Dujon Sterling, who was out of the matchday squad, while Djeidi Gassama came in for Ryan Naderi who was on the bench after managing a knock this week.
Rangers started with Jack Butland in goal, behind a back four of captain James Tavernier, John Souttar, Emmanuel Fernandez and Tuur Rommens. Nico Raskin and Tochi Chukwuani were once again in midfield, with Gassama coming in alongside Skov Olsen and Mikey Moore. Youssef Chermiti, who scored a hat-trick last weekend, completed the line-up.
Rangers got the action underway at the Home of the Set Fare Arena and the first opportunity fell for Youssef Chermiti as he got on the end of a delivery from Tuur Rommens but the striker was unable to get the connection he was looking for as Livingston goalkeeper Jerome Prior gathered.
With six minutes played Rangers came agonisingly close after a well-worked set-piece. Skov Olsen played it short to Mikey Moore who whipped a delivery deep into the box with Rommens on hand at the back post to head towards goal but the full-back was denied as Prior got a touch to tip it onto the post.
At the other end, Macaulay Tait found Robbie Muirhead with a through ball and the Livingston striker released an effort towards goal, but it was straight at Jack Butland who held the shot.
Despite the strong start from Rangers, it was the home side who had the lead with 14 minutes played. A free-kick provided the opening for Marvin Bartley’s side as Muirhead delivered a cross into the box and Brooklyn Kabongolo got the crucial touch to send it into the back of the net.
Minutes later, Rangers had a free-kick of their own in a central position on the edge of the box which James Tavernier curled towards goal. Prior pushed away the effort from the captain, before Emmanuel Fernandez sent the rebound high of the target.
Prior, who had already pulled off some big moments in this match, came up with another crucial save on the half-hour mark as he pushed away what looked to be a goalbound from Mikey Moore.
A series of corners near the end of the first-half, saw Rangers hold Livingston deep in their half as they piled on the pressure for an equaliser. The home side were defending in their numbers as a Chermiti strike inside the box was blocked.
Röhl turned to his bench at half-time with Bojan Miovski called in to replace Andreas Skov Olsen.
Just minutes into the second-half, Miovski had his first chance, and it was a great strike as he sent a left-footed curling ball from the edge of the box towards goal but Prior was again on hand for Livingston to touch it over the bar.
Rangers had another lift at the start of this half, and another big chance saw Tavernier find Rommens who took a nice touch beyond the defender before picking out Mikey Moore inside the box. The on-loan Spurs man got a shot away but it was blocked by the feet of Prior.
However, with 55 minutes on the clock it was 2-0 to the home side. Rangers dealt with an initial free-kick before the ball was sent back in by Emmanuel Danso who found Lewis Smith and he sent a strike across goal and into the back of the net.
With an hour played, Livingston were reduced to 10 men as referee Ryan Lee showed a straight-red card to Cristian Montano for a last man foul on Djeidi Gassama.
Another change followed for Rangers, who looked to capitalise on the man advantage in the last half an hour with striker Ryan Naderi coming on to replace Tochi Chukwuani.
The home side were still managing to keep the Gers out, as Naderi sent a ball across goal, and with Miovski waiting for a tap in, Daniel Finlayson pulled off a superb block to deny a strike.
Souttar was next to be replaced, with Thelo Aasgaard coming on for the centre back for the remaining 20 minutes before Nedim Bajrami came on for Djeidi Gassama shortly after.
With less than 10 minutes to go, Rangers had a goal back with a long throw causing problems for Livingston. The ball fell to centre-back Emmanuel Fernandez and it was a fantastic hit from the defender who reduced the deficit with his sixth goal of the season.
It was the response Rangers needed and they were level with 88 minutes played with Mikey Moore equalising for Röhl’s men. It was a good delivery from captain James Tavernier from the right, with Moore glancing a header beyond Prior.
All three stands of away supporters were in full voice, with nine minutes added time to be played as Rangers searched for a winner.
There was a lengthy VAR check in added time after Moore was fouled during another attack, but it was judged to be just outside the box as the match finished 2-2.
RANGERS: Butland, Tavernier, Souttar (Aasgaard, 74), Fernandez, Rommens, Raskin, Chukwuani (Naderi, 63) Skov Olsen (Miovski, 46) Moore, Gassama (Bajrami, 80), Chermiti.
Subs: Kelly, Meghoma, Djiga, Aarons, Diomande.
Livingston: Prior, McGowan, Pittman, Muirhead (May, 72), Smith (Babacar Fati, 62), Finlayson (Kerr, 76), Danso (Nouble, 72), Kabongolo, Tait (Sylla, 72), Montano, Wilson.
Subs: Smith, McKay, Bokilla, Wanner.