I do the same. Fever is a feature, unless the infection is so pervasive the fever itself becomes a health hazard (at which point you need to see a doctor ASAP, not lower your fever)

Taking an antipyretic for a regular flu completely defeats the purpose. Let your immune system do its thing, it is pretty good at it.

https://en.wikipedia.org/wiki/Fever#Management