Forest loanee Emile Sinclair's 26th minute strike was quickly cancelled out when former Mansfield striker Iyseden Christie, inevitably, levelled from the penalty spot.
But then with 10 minutes to go Aaron O'Connor restored the visitors lead to put them in sight of only a second away win of the season.
And Nathan Arnold secured a deserved victory four minutes from time.
The Stags had started the better with plenty of attempts on goal, but after taking the lead they were forced to soak up sustained home pressure and were fortunate to be level at half-time.
However, they then started the second half the better with a shoot-on-sight tactic which eventually paid dividends.
Town had made one change for the Boxing Day trip to FA Cup giantkillers Kettering.
Caretaker manager Adie Moses returned to the heart of the defence for the injured Alan O'Hare (ankle) - but was penalised for Kettering's penalty equaliser.
Moses and fellow caretaker boss Mark Stallard - still uncertain of how long they will be in charge as the new manager speculation intensified over Christmas - were looking for a second successive win after the 2-1 victory against Weymouth on Saturday.
- Latest manager speculation news - Holdsworth 'offered job'/Two candidates
The Poppies, who knocked Notts County out of the FA Cup earlier this month, would have been playing at Field Mill next week - but their cup shock means a blank New Year's Day for the Stags.
- Mark Stallard video interview
A poor back header from Bennett caused the home defence problems in the opening seconds, but under pressure from Sinclair the defender quickly recovered to clear.
A long throw from the right by Geohaghon in the second minute was allowed to bounce in the Mansfield box and ex-Stags star Christie was there to shoot on the turn, which Gamble had to parry.
Another long Geohaghon throw reached the ex-Stags man soon after, but this time Gamble comfortably collected a looping header.
Arnold came up with Stags' first goal attempt - a 30-yard effort which dropped wide.
Gamble safely held on to a Westcarr free kick from the left touchline as the Poppies continued to show the early threat.
Stags won a right wing corner, but poor delivery from Jeannin saw it quickly cleared at the near post and a long forward ball then almost put Potter in on goal, Gamble racing superbly from his box to slide in with a tackle.
Stags had two quick attempts at goal, a Sinclair effort on the turn bobbling wide and a minute later Ahmed closer with a firm 18-yard effort after a good move along the edge of the home penalty box.
Left back Kay got well forward to steal a loose ball 25 yards from goal and sidestepped one challenge, before getting in a good low shot that bounced just a couple of yards wide.
But there was more danger from Kettering as Wrack overlapped down the left and crossed which ended with Westcarr heading over.
Silk was warned for a crunching tackle on Boucaud, but the right back was there to comfortably head away the resulting free kick.
It was the Stags who drew first blood with the first real chance of the match in the 26th minute. Kay launched a long ball forward down the left and Jazstczun mistimed the jump for a header to allow Sinclair to get in behind him.
The Forest loanee kept his cool to run forward and beat Harper with a deadly low finish.
But the lead lasted just seven minutes, as Moses was penalised for pulling back Christie in the box. The striker then netted against his former club to equalise with a well struck penalty blasted straight down the centre.
The home side then stepped up pressure and Westcarr shot wide. Seconds later a reverse pass from Christie put Wrack in on goal, but his low finish across Gamble was narrowly wide of the far post.
Home keeper Harper punched away a much better Jeannin free kick and then D'Laryea got a crucial head away in front of goal from a Jazstczun free kick.
But there was more danger for the Stags in first half stoppage time as Westcarr drew Gamble to the right of the area, before crossing low where Wrack completely missed his kick on the unguarded goal.
So after leading, Stags could count themselves lucky to go into the interval on level terms.
D'Laryea almost caught the home side cold within seconds of the restart with a hopeful 35 yard effort off the outside of his right boot which dropped wide.
There were calls for another penalty when the ball struck Moses' hand in the box, but it was clearly ball to hand and the calls came more from the home fans than the players.
And it was the visitors who were making by far the better start to the second half, twice Harper having to deny them the lead.
First Arnold exchanged passes with Sinclair down the right, before unleashing a vicious shot destined for the near top right corner untilthe keeper just managed to turn it over.
Kettering survived two successve corners and then in the 53rd minute Ahmed's powerful dipping 25-yard effort was turned onto the bar and over by Harper.
Shoot-on-sight Stags continued to press and Jeannin and Arnold both missed the target with hopeful punts from distance.
Having survived a torrid spell, Kettering hit back with a spell of three corners, two on the trot, without success.
Then the Stags again came close, from a half-cleared Arnold corner the wingman crossing again to the near post where Hurren headed downwards, but the ball was clutched by the well positioned Harper.
A swift home break saw Potter burst into the box, but his finish across Gamble was wide of the far post.
The Poppies almost went ahead on 67 minutes from left wing corner which saw Solkhon power in a header from eight yards, which hit the underside of the bar and bounce down onto the line before being hooked clear.
A hectic spell of tackles then led to the first bookings for Ahmed and Solkhon.
In the 70th minute man of the match Harper was again there to deny the Stags. A lightning break down the left saw Sinclair stride purposefully into the box, but with O'Connor square to his right he pulled a poor pass behind his strike partner.
O'Connor did superbly well to take control and make space for what seemed a goalbound shot, but harper beat it away.
Mansfield continued to dominate and Ahmed tricked his way past a defender on the byline, but saw his low ball in front of goal cleared from on the line.
Two more Stags corners followed, but the Poppies stood firm.
But Stags finally broke through to take a deserved lead 10 minutes from time.
Ahmed flicked the ball through a square defence and O'Connor nipped in behind them to touch the ball wide of rooted Harper.
The Stags striker was mobbed by happy teammates, but his over celebrations earned him a booking.
But it didn't matter six minutes later as substitute Lee, only on the field for three minutes, flicked a header across the box where Arnold steadied himself before rifling an unstoppable right foot thunderbolt past Harper to seal the points.
KETTERING: Harper, Jazstczun, Wrack, Branston, Potter (Marna 71mins), Solkhon, Boucaud (Arthur 71mins), Geohaghon, Christie, Westcarr, Bennett (Dempster 83mins). Subs: Eaden.
MANSFIELD TOWN: Gamble, Silk, Moses, Hurren, Kay, Arnold, D'Laryea, Ahmed, Jeannin; Sinclair (Lee 82mins), O'Connor. Subs: Blackwood, Herriott, Somner, Kitchen.
REFEREE: R. Fletcher.
GOALS: Kettering - Christie (33mins). Stags - Sinclair (26mins), O'Connor (80mins), Arnold (86mins).
ATTENDANCE: 2,433 (370)
BOOKING: Kettering - Solkhon (Foul, 70mins). Stags - Ahmed (Foul, 69mins); O'Connor, ungentlemanly conduct 80mins)
- Click here to read the latest entry in John Lomas's Stags Blog.
MATCH UPDATES86mins: Arnold finished coolly after Lee flicks on a free kick.
80mins: GOAL! O'Connor latches onto a deflected Ahmed shot to score from close range.
70mins: At the other end O'Connor hammers straight at the keeper when he should have restored the Stags' lead from eight yards, after terrific Sinclair run.
68mins: Let-off for the Stags. A far post Solkhon header appeared to cross the line off the underside of the bar before being cleared and from the follow-up Branston's header was cleared.
66mins: Hurren header easily saved.
62mins: Two long throws from Geohaghon well defended by the Stags, now under pressure.
60mins: Kettering, well on top, force two corners without reward.
54mins: Shoot-on-sight Stags go close to regaining the lead again, this time Ahmed's fierce shot turned away.
50mins: Arnold's goalbound drive arrowing for the top corner is pushed away for a corner, via the woodwork.
46mins: Moses inadvertently handles in the area and the Stags survive loud penalty appeals.
45mins: Wrack again close for Kettering in stoppage time, missing his kick from a low Westcarr cross.
42mins: Wrack free kick headed away by D'Laryea.
39mins: Solkhon squanders great chance to give Kettering the lead after fine work from Christie, firing narrowly wide.
32mins: PENALTY! GOAL! Moses penalised for hauling back Christie and the ex-Stags man levels from the spot a minute later.
26mins: GOAL! Sinclair finds the bottom corner to give the Stags the lead. Used his pace to race clear from the halfway line, from a defensive error, and finish coolly.
26mins: An unmarked Westcarr heads over for the home side.
22mins: As the Stags again go for goal, Kay is well wide from 25 yards
16mins: Ahmed closer for the Stags with a firm 18-yard effort after a good move along the edge of the home penalty area.
14mins: Sinclair effort on the turn bobbles wide.
9mins: From Kettering breakaway from that first corner Gamble races well out of his area to clear from Potter.
8mins: Stags win game's first corner - Jeannin's cross easily cleared at near post.
2mins: Geohaghon long throw from halfway line reaches the Stags penalty area, but the visitors clear - Christie's shot turned away by Gamble.
