Sound not playing out of headphones for specific steam games only

I have Razer Man O' War headphones that work fine for literally everything except a select few steam games (e.g. Hollow Knight, Cuphead, Getting Over It, Ori and the Blind Forest). I can listen to music, watch Youtube videos, play other games, everything works, but for some reason when I try to play these games the sound doesn't play through my headphones. I can switch to my computer's speakers and the sound plays, if I plug in earphones into the earphone slot the sound plays (I think this works because it just replaces the computer speakers directly, and I don't even have to change output dev

Question by 2manysemicolons on Super User, licensed CC BY-SA. We show a short excerpt and link to the original thread as credit.