A goal fifteen minutes from time earned Stevie Campbell's side their first league victory since September at Kilwinning Sports Centre in Saturday morning's seven-goal thriller.
On a fiery surface both teams served an enthralling see-saw encounter which could have gone either way.
However, with the Ayrshire side having been reduced to ten men, the Tangerines came from behind to just edge it in the end.
Yet it was the visitors who got off to a flying start, taking a two-goal lead inside the opening ten minutes.
Just three minutes had gone when Ryan Gauld's fantastic finish from a Ross Gilmour cross put United in front.
However, only a superb save by Philip Anderson prevented Killie levelling, and almost immediately Robert Thomson was thwarted at the other end when through one on one with the keeper.
On ten minutes, Jordan Moore did make it two, coolly slotting in a Ryan Ferguson assist.
However, as has been the case too often this season, we conceded quickly as the homes side pulled one back within seven minutes.
In keeping with end to end nature of the match, Killie twice hit the woodwork, whilst United failed to capitalise on two further one on ones!
But the teams went in level at the break, the home side having equalised after 38 minutes.
Killie came out of the traps flying at the start of the second half and went ahead with a terrific strike into the top corner to go in front ten minutes after the re-start.
Soon afterwards the hosts were reduced to ten men and on the hour mark it was all square again.
Ferguson was again the provider with a great cross which Robert Thomson turned in.
Despite United's numerical advantage, it remained pretty even, but Ray Lundie bulleted home a header from a Scott Smith corner to put United in front.
Indeed, only a last gasp save by Anderson with his feet ensured it stayed that way.
Dundee United: Anderson, Gilmour (Soutar 85), Barrett, Johnston, Lundie, Ferguson, Petrie, Smith, Gauld (Bell 89), Moore (Allan 82), Thomson. Subs unused: Hay, Lunday.