Xbox Controllers Causing Camera "Jitter" on PC

I noticed this recently in both Death Stranding and Hogwart's Legacy -- when using my computer mice the camera animation when panning the camera is very smooth even with uncapped FPS. But when I switch to using either of my Xbox controllers the camera animation looks very jittery. At first I thought maybe my controller was defective so I busted out my old Xbox 360 era PC controller -- which exhibited the same issue. I used the "Windows Accessory" tool then to make sure my drivers were up to date but the same issue still occurs.

I dug into this a bit further and I'm starting to wonder if it has to do with the polling rate -- xbox controllers bafflingly have a polling rate still in 2023 of just 124 Hz whereas most mice poll at 1000 Hz. I recall BlurBuster's showed an image here on high refresh rate g-sync panels polling rate did improve frametimes so maybe that's it? The odd thing is I don't remember running into this in all games -- just some in recent times. In Hunt Showdown the controller mostly presents fine even with high uncapped FPS and in games like Dark Souls Remastered or Sekiro the camera animation also looks smooth/fine. Anybody run into this before? Thanks, เว็บแทงบอลยอดนิยมฝากถอนออโต้