Some people don't enjoy listening to music due to a rare neurological condition called 'specific musical anhedonia'. People with this condition can recognise melodies, rhythms, and emotional cues in music, but the signal from it never reaches the brain's 'pleasure centres'. This is due to a disconnect between their brain regions that process sound and those that generate pleasure.