Its rather like the three servants who were given 10, 5, and 1 talents to invest for their master. Part of the growing is preaching and reaching new disciples. part is the growing of the brethrens' talents, and so on. If we are inhibiting good growth then we are putting a stumbling block in front of them. Then we will like the servant who buried his one talent.
