Began his music career at the age of 11 playing bass drum with the Square Deal Social & Pleasure Club. He was the bass drummer, vocalist and assistant leader of the Treme Brass Band; known for his kazoo playing and singing as well, and has recorded a cd as a vocalist. Besides inspiring younger musicians with his playing, he served as a role model to many of them: trumpeter Kermit Ruffins calls Batiste his "total influence," saying that Batiste "taught [him] how to act, how to dress, how to feel about life." Internationally, Batiste has served as leader of the daily Moldejazz parade since 2000. He was king of the Krewe du Vieux for 2003.