The Blues dominated the first half and defender Liam Ridgewell flicked in the opener off his chest from Sebastian Larsson's whipped-in free-kick.
Scotland's James McFadden slotted in a fine second goal after a dazzling back-heel flick from Cameron Jerome.
But Scott Dann headed a late own goal to set up a nervous finale, with Darren Bent inches away from an equaliser.
The afternoon began with a carnival atmosphere as Hong Kong businessman Yeung paraded around the touchline, microphone in hand, saying "I love you all" to the home fans.