Why is suicide considered to be a selfish act?

It appears that the argument that suicide is a selfish act is coming from the feelings of the survivors. If the person has no dependents, then we are only talking about the emotional reaction of others. It seems as though the emotional state of the suicidal person is put on a lower level than the emotions of the survivors. Is this fair?