You can use the Dirichlet-multinomial distribution as the response distribution for a mixture component.