The 27-year-old was back in Steven Gerrard’s starting XI for the first time since he played in the League Cup against East Fife a month ago.
The Gers fell behind just two minutes after the break but clawed their way back in the game through James Tavernier, Alfredo Morelos and then substitute Brandon Barker to return to winning ways.
Speaking to RangersTV Halliday said: “I think the most important thing we had to do today was get the three points.
“I don’t think it is the best we have played, by any stretch of the imagination, but it is always going to be difficult when a team come and have eleven men behind the ball.
“We controlled the game, we dominated the game and it was just that final bit of quality in the final third to score at will. It took until the red card for Livingston to start to create chances.
“They are just looking for that one chance, whether it be from a set-piece or, in their case today, a penalty. Fair credit to the boys for bouncing back and crucially we won.
“It was good to be back, I was delighted to just play after not playing for about a month. You just need that little run to get your match fitness back up to speed but I enjoyed it, it is always good to get back out there to play.
Halliday started down the left with the returning Ryan Kent in front of him but saw Barker replace the deadline day signing before half-time when the winger was forced off with injury.
Reacting he said: “For and foremost I am delighted to have Kenty back and it was between him and Alfredo for the stand out player last season.
“First thing first we are disappointed to lose him and I hope he comes back soon. Brandon came on and took his chance and I am delighted for him to get his goal on his home debut.”
Rangers now welcome Feyenoord to Ibrox this Thursday in their first UEFA Europa League group stage game and Halliday is excited.
He said:
“It is a group we are delighted about, they are some good tests in there and the first one comes on Thursday against a good Feyenoord team. We just hope the fans come out in their numbers as usual and back us from the start.”