What seems fair is that you must pay for your followers food, healing, and clothes (armor weapons, etc), and you must protect (if you have a settlement but if not they can fend for themselves; in my eyes if they come and work for you at a settlement you agree to protect them) but besides that...