Charlton striker Chris Iwelumo was named the Championship player of the month for November ahead of kick-off but it was veteran midfielder Holland who opening the scoring on 34 minutes.
And Reid's coolly taken spot-kick with 11 minutes remaining, after Darren Purse's foul on Darren Ambrose, condemned the Bluebirds to defeat.
This is the latest blow for Dave Jones and his Cardiff side, who face court action next Monday with creditors Langston over £24million in loan notes.
Both sides made one change from the weekend with Charlton striker Luke Varney dropping out for Lloyd Sam following their 3-1 home defeat to Burnley.
Dutchman Glenn Loovens returned at the heart of the Cardiff defence for Roger Johnson, who scored a last-minute equaliser to earn a draw at Hull.
It was the visitors who started brightly and, on three minutes, central defender Sam Sodje, a goalscorer in the reverse 3-0 win at The Valley, headed wide of the far post.
Cardiff struggled to breach a mean Charlton defence who haven't conceded an away goal since October 20.
Chances were at a premium in a cagey opening and it took the Bluebirds 33 minutes before they registered their first shot of the match but Nicky Weaver saved Steve Thompson's stinging shot.
But, just a minute later, the visitors took a deserved lead when Holland struck a sweet low shot from the edge of the box past the stranded Kasper Schmeichel.
Cardiff boss Jones will be tearing his hair out as Stephen McPhail hesitated before failing to clear Reid's corner to allow fellow Irishman Holland to pounce.
The Bluebirds introduced former Addicks striker Jimmy Floyd Hasselbaink early in the second half but it wasn't enough.