Jordan Gibson fired Rovers in front before Lyle Taylor equalised - but then Gibson was shown red for ignoring the referee's instructions twice.
Rovers had the best of the early opportunities with Harry Clifton's zippy attempt being parried away by home goalkeeper Matt Macey.
Jordan Gibson then had an effort saved well after a scramble in the box before Luke Molyneux tried his luck to no avail.
Ted Sharman-Lowe was drawn into action for the first time on 33 minutes to keep out a header from Tom Flanagan albeit the offside flag was raised almost immediately.
Just as the game looked to be heading towards half-time goalless, Gibson took it by the scruff of the neck to break the deadlock. He leathered the ball home first time giving Macey no chance after Jamie Sterry's centre.
Rovers almost doubled the lead just after half-time when Clifton saw a close-range effort tipped away by Macey after Joe Ironside pounced on an error and slipped him in.
That was punished just minutes later when Lyle Taylor slammed home after a super-quick counter that saw Oscar Thorn in acres of space and he duly picked out veteran Taylor.
Ironside was then denied by a fabulous save from Macey as the stopper tipped away his goalbound glancing header before Gibson's free-kick was pushed away by the increasingly busy custodian.
Gibson was involved in another flashpoint when he received a bizarre red card. Having been cautioned just prior for a pull-back on a Colchester player, the goalscorer was shown another yellow for moving the ball at a free-kick despite the referee having sprayed the exact spot it was due to be taken. Gibson disobeyed the instruction twice and was given his marching orders.
Sharman-Lowe made a good save to keep out Jack Payne's free-kick before Teddy Bishop smashed the post with virtually the last kick of the game to spare Rovers' blushes.
Here's how we rated the Rovers players:

5. James Maxwell 5
Restored at left-back. Woefully out of position for the equaliser as Thorn given freedom of Colchester to tee up Taylor. Did at least recover after that point. Photo: Howard Roe/AHPIX LTD

6. Owen Bailey 6
Much better than at Walsall but booked after one too many fouls built up. Photo: Andrew Roe/AHPIX LTD

7. George Broadbent 5
Influence on the contest waned as Colchester bossed the midfield battle. Sacrificed late on once Rovers went down to ten men Photo: Howard Roe/AHPIX LTD

8. Harry Clifton 7
Handed a first start since early November. Was rash in a few tackles early doors but settled thereafter. Came close with a shot and provided a bundle of energy and workrate. Photo: Howard Roe/AHPIX LTD

