Can't hear any sound with headphones in windows, but can in ubuntu

I have a (Dual booted) Dell Inspiron N5110 with IDT High Definition Audio CODEC and Windows 7. In Windows 7, I can hear sound from the speakers, but when I plug headphones in, I can't hear anything through either playback device. In Ubuntu, I can hear sound from the speakers, and when I plug headphones in I can hear the sound through the headphones. This is what I want to happen in Windows 7. I have tried using the test function on both the "Headphones / Speakers" and the "Communication Headphones" when I have headphones plugged in (neither work). When I click the sound icon in my system tray

Question by starbeamrainbowlabs on Super User, licensed CC BY-SA. We show a short excerpt and link to the original thread as credit.