I don't know if this is better per-se but my diff-so-fancy config sat in [pager] rather than [core]. I verified that git-delta works as configured this way instead:

  [pager]
          diff = delta --dark --plus-color="#012800" --minus- color="#340001" --theme="zenburn"