Stags turned in a much improved show for caretaker boss Paul Holland but couldn't find a way past brilliant Bulls keeper Wayne Brown who capped a string of saves with a last minute penalty save from Mickey Boulding.
Clint Easton netted the all-important winner from a seventh minute free kick.
- Click on the green play icon to watch a video slideshow of match action photos by Chad's Angela Ward
But otherwise Stags pinned the Bulls in their own half for long periods without finding an ounce of luck against United's promotion-chasers.
In direct contrast to Saturday, Stags were warmly applauded off at half time and full time but, despite showing fire and passion, they simply slipped deeper into the mire on a cold, windy night.
They even lost keeper Carl Muggleton to a groin strain in the first half as Lady Luck shunned them.
Holland made two changes, one enforced, from Saturday's home embarrassment against Rochdale.
Striker Louis, who has not scored for four games since his initial three goals in four match burst, was dropped to the bench and Arnold came in to play just behind top scorer Boulding.
Keith Briggs missed out with a hamstring injury so D'Laryea returned to central midfield.
The game began at high pace in the powerful wind and Arnold tried to prod Boulding through, but the imposing Beckwith covered well.
Stags cleared a corner and broke fast down the right with Arnold's testing cross headed clear by Easton.
Mansfield kept on the pressure and won a corner which was cleared to Atkinson who warmed Brown's hands from 18 yards.
But on seven minutes Mansfield conceded a free kick 20 yards out in a central position, as at Wrexham, and Easton curled it superbly round the wall and inside Muggleton's right hand post to edge the visitors ahead.
It was a real kick in the teeth, but fired-up Stags grittily hit back as Hamshaw ran at the defence and saw Brown turn his shot round.
Soon after Arnold swivelled 30 yards from goal to unleash a thunderous blast which Brown had to tip over his bar.
Brown was again in the way as Dawson tried his luck from 20 yards.
Robinson found himself in space in the Mansfield box, despite appearing clearly offside and Buxton had to produce a vital tackle before he could get a shot away.
Rose stayed down after a Mullins tackle to the fury of the home fans as the referee decided to brandish a yellow card.
Stags defended well from a high ball into the box and Diagouraga blazed over from 25 yards as it came out to him.
Dawson lost possession to set up another Bulls attack and it ended with John-Baptiste clearing in front of goal as Diagouraga drilled the ball into the six yard box.
Hamshaw only just overhit a through ball for Dawson, the ball rolling through to Brown who was also comfortably behind a Hamshaw strike.
On 33 minutes Hereford should have extended their lead from a burst down the right that fully stretched the home defence. Hooper put the ball across to Robinson who had got in behind everyone but he was unable to take it first time and Mullins was able to do enough to force him to pull his finish wide.
But Mansfield suffered an injury blow at this point as keeper Muggleton signalled a groin injury and was replaced by White - his first game since a sub appearance on 6th October.
Despite Hereford supporters' calls, John-Baptiste was adjudged not have been the last man as he brought down Robinson and was only yellow carded, Smith sending the free kick just over the bar.
Mullins had a firm header blocked from yet another Hamshaw corner, though it did look as if it may be going wide.
A huge White clearance almost put Boulding away down the centre but the two centre halves shut him out well.
Stags forced corner number seven in stoppage time and John-Baptiste met it with a free header that he should have worked Brown with but sent over.
Stags left the field to applause and encouragement from supporters who had seen a much gutsier and committed display from their team.
The second half exploded into controversy as Hamshaw's through ball put Boulding away only to be cynically upended by Beckwith before he could shoot. It looked a red card all the way but he escaped with a yellow and Boulding's free kick was into the wall.
A Stags corner was headed by John-Baptiste and Mullins met it with a dipping header that landed on top of the net.
Stags were simply pummelling the visitors at this point but needed a goal to show for their efforts while they were on top.
Boulding flicked on a Jelleyman ball and Arnold turned well to force a save from Brown from a tight angle.
A superb turn from Boulding in the box gave him sight of goal but he fired hard and low across goal and Atkinson could not reach it to turn it home.
Hereford were momentarily three on two on a fast break only for Atkinson to race back superbly and get in the way of Johnson.
In reply Dawson's up and under was controlled well by Arnold but he dragged a quick finish wide.
Robinson did well to trick his way past Buxton and flash a shot across goal. It was his last action as the Bulls tried to shore things up by going one up front.
Stags responded by sending on young striker Rory Boulding for D'Laryea.
Arnold had a 20 yard blast deflect wide from the first of two more corners as the clock ticked on with the news that Macclesfield had gone ahead.
Boulding did well to hoist the ball back from the by-line shadowed by two defenders but Dawson's volley chance saw him kick at thin air.
Desperate Stags added a third striker as Louis came on for Jelleyman for the last minutes.
Dawson thought he had snatched a point three minutes from time as his low shot looked set for the bottom corner only for Brown to get across superbly to turn it aside.
But in the last minute it seemed Stags would get some reward for their effort as Louis' ball into the box found Boulding who was brought down from behind by Smith.
Boulding's spot kick was firm but Brown was equal to it with a great save diving to his left.
More agony followed as the magnificent Brown clawed a close range Louis effort off the line with Stags saying it had gone over. No such luck right now.
STAGS: Muggleton (White 34), Mullins, Jelleyman (Louis 81), D'Laryea (R. Boulding 71), Hamshaw, Dawson, M. Boulding, Buxton, John-Baptiste, Arnold, Atkinson. Subs not used: Martin, Wood.
HEREFORD: Brown, McLenahan, Rose, McCombe, Smith, Easton, Diagouraga, Robinson (Taylor 67), Johnson (Benjamin 85), Beckwith, Hooper. Subs not used: Ingham, Threlfall, Gleeson.
REFEREE: Mike Thorpe of Suffolk.
ATTENDANCE: 1,606.
GOAL: Hereford - Easton 7.
CAUTIONS: Stags - Mullins 24 (foul), John-Baptiste 37 (foul).
CHAD STAGS MAN OF THE MATCH: Matt Hamshaw.
The full article contains 1240 words and appears in n/a newspaper.