Fastest group

In listening to a recent lecture by a "Islamic Scholar" who went through and declared this group and that sect heretics and Non-muslims I can only state that it would seem that as Muslims we are the fastest shrinking religion in the world.