I recently started working through Basic Mathematics by Lang. It has exercises with solutions to about half of them. It starts basic but introduces simple proofs early. Although what counts as 'from scratch' depends on the reader I guess. The book doesn't define numbers via sets, maybe check the table of contents.