I figured it out! I switched it to HDMI 4 and went to Menu -> Input Settings -> 4k Full UHD Color On.
This enabled full 4k HDR.