I've read from somewhere that fragrance is actually BAD. Apparently from this source, it frequent triggers headaches, especially migraines. It is due to some synthetic version of the aromatic chemicals and that it affects the olfactory system. In addition, the anecdotal evidence suggests a significant effect of fragrances on the central nervous system.
Now I know why I get these irritating headaches. Thankfully I'm not into fragrance.