The conserved oligomeric Golgi (COG) complex is an evolutionarily conserved multi-subunit protein complex that regulates membrane trafficking in eukaryotic cells. In this work we used short interfering RNA strategy to achieve an efficient knockdown (KD) of Cog3p in HeLa cells. For the first time, we have demonstrated that Cog3p depletion is accompanied by reduction in Cog1, 2, and 4 protein levels and by accumulation of COG complex-dependent (CCD) vesicles carrying v-SNAREs GS15 and GS28 and cis-Golgi glycoprotein GPP130. Some of these CCD vesicles appeared to be vesicular coat complex I (COPI) coated. A prolonged block in CCD vesicles tethering is accompanied by extensive fragmentation of the Golgi ribbon. Fragmented Golgi membranes maintained their juxtanuclear localization, cisternal organization and are competent for the anterograde trafficking of vesicular stomatitis virus G protein to the plasma membrane. In a contrast, Cog3p KD resulted in inhibition of retrograde trafficking of the Shiga toxin. Furthermore, the mammalian COG complex physically interacts with GS28 and COPI and specifically binds to isolated CCD vesicles.