Massive galaxies grow by eating stars in smaller neighbors