You can obtain one Umbral Gem by defeating Yurgir, located in the eastern section of the temple. You have the option to ask him to recite his contract, identify the loophole within it, and manipulate him into inadvertently dispatching his own minions, and even himself.

How to make Yurgir defeat himself