Windows 11 - Update stuck at "downloading 0%" but able to install using PowerShell

I have a Windows 11 (Pro) - 22H2 (OS Build: 22621.1702, Windows Feature Experience Pack 1000.22641.1000.0), for some reason when I run Windows Update in the Settings screen, the updates would show up but always shows me Downloading 0% , and this happens even if I leave my computer idle for hours (I do not have auto sleep enabled so the computer is active all the time). However at the same time I am able to using Windows Powershell Get-WindowsUpdate and Install-WindowsUpdate script to download and install updates. This happens to any type of updates regardless of whether it is security or .NET

Question by Spammy on Super User, licensed CC BY-SA. We show a short excerpt and link to the original thread as credit.