Being immortal and having a high quality of life for as long as we are alive are not mutually exclusive. In fact, don't we have longer lives and better quality of life than our ancestors already? This would just be taking it one step further. Also, having a population that never dies has many more benefits than consequences. The amount of knowledge and experience that will not be wasted because of death is extremely valuable. Also, who says people will be giving birth to children as often as they are currently doing when they don't fear dying. Already in most developed nations the rate of population growth is plateauing. Also, don't forget we have an entire universe at our fingertips. I'm sure when we have 200 year old aerospace engineers and physicists we will be able to get to colonize other planets much faster.
Regarding quality of our ancestors: Yes, but there are downsides too. We probably have longer periods of lower quality of life. We improved both quality and length. But we improved length more.
People are and always will be free to die whenever they want. If you live a longer youth and then face a longer low quality life, either you want that longer low quality life more than you let on, or you cut it short.