Kilmarnock took an early lead through Bryson in 10 minutes but United equalised through Russell just one minute later.
A brilliant solo run and finish by David Goodwillie gave United the lead, but Bryson pulled another back for Killie
Just before half time Stuart Duff hit the bar.
Killie took the lead midway through the second half and although United pushed forward they were denied a deserved equaliser.
In a bizarre incident at the end of the game, as United pressed for for an equaliser, Willo Flood was sent off for taking a quick free kick in the final minute, with the referee apparently not ready.
Killie:
Harpur, McGhee, K.Wright, Clancy, G. Murray, Flannigan, Di Giacomo, Bryson (McInnes 78), Koudou, Fernandez (Cox 88), W.Gibson (Invincibile 65) (Subs - Brown, Logan - not used)
United:
McLean, Proctor, Pope, Cameron, Kenneth, McGrath, Flood, Andreoni, Goodwillie, Duff, Russell
(Subs - Gibson, Fleming, Paterson, Mathieson - not used)
Referee - P. Rafferty