It's not "fears" about copyright infringement, it's just the way things are. You, as the creator of a work, have the right to control where and how it is published and copied. It is illegal to post private correspondence publicly without the permission of the author.
EDIT: There are, of course...