for some Items with certain Affixes, you have to Jasper, as not all Affixes can be rolled with Crystals (Defiant, +100% ED), and some affixes can be rolled with Crystals, but only on a certain Classes Items (Rage).
depending on your build and your Crystal resources, you might have to do both.