Gut microbiota of four economically important Asian carp species (silver carp, Hypophthalmichthys molitrix; bighead carp, Hypophthalmichthys nobilis; grass carp, Ctenopharyngodon idella; common carp, Cyprinus carpio) were compared using 16S rRNA gene pyrosequencing. Analysis of more than 590,000 quality-filtered sequences obtained from the foregut, midgut and hindgut of these four carp species revealed high microbial diversity among the samples. The foregut samples of grass carp exhibited more than 1,600 operational taxonomy units (OTUs) and the highest alpha-diversity index, followed by the silver carp foregut and midgut. Proteobacteria, Firmicutes, Bacteroidetes and Fusobacteria were the predominant phyla regardless of fish species or gut type. Pairwise (weighted) UniFrac distance-based permutational multivariate analysis of variance with fish species as a factor produced significant association (P < 0.01). The gut microbiotas of all four carp species harbored saccharolytic or proteolytic microbes, likely in response to the differences in their feeding habits. In addition, extensive variations were also observed even within the same fish species. Our results indicate that the gut microbiotas of Asian carp depend on the exact species, even when the different species were cohabiting in the same environment. This study provides some new insights into developing commercial fish feeds and improving existing aquaculture strategies.