The captain notched twice in the final 15 minutes - a header from a corner and then a close-range - to complete a terrific turnaround in Nottinghamshire.
Rovers settled the quicker of the two sides and some tidy bits of play were evident before Harry Clifton saw a goal-bound attempt just take a nick behind for a corner in the game's first genuine attempt on 20 minutes. Glenn Middleton then planted a header onto the roof of the net after a quick counter from the visitors following a slip on the ball by a Mansfield man in his own half.
The hosts had to wait until after the half-hour mark for their first chance, and it was a rare error from new (old) boy Charlie Crew that created it; he was dispossessed near his own corner flag by a Stags player whose wicked cross was met by the stooping head of Louis Reed. Thankfully Thimothee Lo-Tutala was equal to it.
Rovers wrestled back control before the break and almost got a goal that their play deserved right before half-time when Brandon Hanlan was thwarted before Clifton then saw a shot turned behind.
The same player tried his luck with an acrobatic attempt just after the restart before Lo-Tutala produced a fine right-handed stop to keep out Will Evans' fierce shot from the right-hand side of the box. That proved a warning sign as just minutes later the hosts went in front when half-time substitute Stephen McLaughlin produced a long-range stunner that gave Lo-Tutala no chance.
Rovers made a triple change in response and one of them, Jordan Gibson, saw a half-chance come and go as his glancing header sailed over. Thankfully it wouldn't be long before Rovers were level: skipper Bailey got the vital touch as he headed home from a Molyneux corner.
The visitors seemed more likely to snatch a winner and it just had to be the captain who got it, with Bailey in the right place to stab home Molyneux's centre from close range. Here's our player ratings from Field Mill:
5. James Maxwell 7
Was competent enough down his flank but a lack of attacking impetus. Chipped in with his share of tackles and clearances. Photo: Howard Roe/AHPIX LTD
6. Charlie Crew 7
Second debut and was so classy in passages in the first half. Faded slightly after the break and one of three changes made in response to Mansfield's opener. Photo: Howard Roe/AHPIX LTD
7. George Broadbent 9
As is now customary, plenty of punchy and zippy passes but he added steel here in a thoroughly impressive performance. Seemed to cover every blade of grass. Photo: Howard Roe/AHPIX LTD
8. Harry Clifton 7
Came close with an attempt in the game's first shot at goal, from a Pearson knockdown from a free-kick. Had other chances too, and was a lot livelier than last week. Photo: Howard Roe/AHPIX LTD