Everton beat Liverpool 1-0 after extra time while Aston Villa, Blackburn and Derby also progressed to the fifth round of the FA Cup.
Dan Gosling was Everton's hero as he settled a fiercely competitive Merseyside derby with a late strike, while it also took extra time for Blackburn to beat Sunderland 2-1.
Aston Villa overcame Doncaster 3-1 and Derby stunned Nottingham Forest in a five-goal thriller.
Liverpool were dealt an early blow at Goodison Park when talismanic captain Steven Gerrard picked up an injury and had to be replaced by Yossi Benayoun in the 16th minute.
Gerrard's withdrawal was cheered by many Everton fans but the home side could not take advantage in a first half full of commitment but short on chances.
Everton came closest in the second half when Leon Osman crashed a shot against the post, before Lucas Leiva was sent off for a second bookable offence after 76 minutes.
The Toffees dominated possession as the clock ticked down and continued to press forward in extra time.
It looked like Liverpool would hold on until Gosling collected Andy van der Meyde's deep cross on 118 minutes and curled a delightful finish past Jose Reina.
Everton will face Aston Villa at home in the next round after Martin O'Neill's men beat Doncaster at home.
Villa were held to a goalless draw at the Keepmoat Stadium in January but it took just 15 minutes for them to break down Doncaster's resistance in the replay.
Steve Sidwell opened the scoring from close range, seizing on a rebound after Neil Sullivan had kept out a Craig Gardner effort.
Villa doubled their advantage four minutes later when John Carew, back in the starting line-up following injury, beat Sullivan with a deflected shot from outside the area.
Jason Price pulled a goal back for Rovers on the stroke of half-time following good work by James Coppinger but Villa hit back again at the start of the second period.
Nathan Delfouneso made it 3-1 with a fine diving header from Nicky Shorey's cross and Doncaster could not respond.
Blackburn will next host Coventry following Benni McCarthy's 118th-minute winner against Sunderland.
Both managers made several changes from their Premier League matches at the weekend but it was Sunderland who settled quickest.
A deflected Daryl Murphy shot fell into the path of David Healy after seven minutes and the Northern Ireland international made no mistake as he slotted past Paul Robinson.
Aaron Mokoena levelled for Blackburn in the 37th minute with a ferocious shot from 25 yards which flew into the top corner.
There were no more goals in normal time and the game seemed destined for penalties until McCarthy headed home Carlos Villanueva's cross.
Derby set up a fifth-round tie against Manchester United as they came from behind to secure a dramatic 3-2 victory over local rivals Nottingham Forest.
Forest made a perfect start as Chris Cohen broke the deadlock after just two minutes and Nathan Tyson made it 2-0 from the penalty spot in the 14th minute.
Rob Hulse reduced Derby's arrears on 27 minutes and Paul Green then grabbed an equaliser on the hour mark.
Kris Commons then scored against his former club in the 74th minute to give the Rams the opportunity to avenge their recent Carling Cup semi-final defeat at the hands of Manchester United.