The fumes from non-leaded solder are worse for you (make sure to have good ventilation). The lead doesn’t go into the air; the fumes are from flux. As long as you don’t eat the solder, and wash your hands after soldering, there’s no problem with hobby soldering using lead solder.
The reason to prefer lead-free solder is primarily because at industrial scale with tons of trashed electronics the lead becomes an environmental pollutant. For hobbyists, lead solder is easier to work with, and not a serious risk.
I mostly used lead-free solder as a kid (1990's and 2000's) but I still recall the acrid smell of flux fumes. I've accidentally had a few good whiffs that left me recoiling and coughing a bit. I wonder if that'll have any long term effects...