If you cease being a chief/moderator of a tribe, your referrals will stay and will still potentially earn you money, however you will lose access to that tribe's referral program and it's growth/blogger tools. If that happens, you can't refer any more users to that tribe.