Windows 10 - can't change bluetooth headphone volume with buttons on headphones

Sorry if this is the wrong place for this. I started having this problem with my Windows 10 laptop and my bluetooth headphones (I'm sure it's the computer because the feature I'm having trouble with works fine on my phone with both pairs of bluetooth headphones I own). When I try to use the volume buttons on the headphones to change the volume, it doesn't work; I can only use the slider at the bottom right of the screen, which is very inconvenient for me. In the past when I clicked the button, I could change the volume while a video or sound file was playing, and if one wasn't the volume icon

Question by helpmeimstupid on Super User, licensed CC BY-SA. We show a short excerpt and link to the original thread as credit.