The most interesting part of UT2k4 to me is the software renderer. It actually worked on period hardware and many would argue it looks better. You should definitely give it a try if you've got the game on a modern machine.
I was surprised when I realized, that a game from year 2004 still had a software renderer. But I thought it was just old leftover from the first Unreal game.