You can see what sets are obtainable via amethyst here.
But it’s basically what you said: You find a item with an affix you want and crart starting from it.