The Ōgawa Aji, or regional ruler of the Ōgawa Magiri of the Ryukyu Kingdom, occupied the castle for several generations. For this reason the castle is also known as Ōgawa Castle (大川城 Ōgawa jō). Details of the history of both the castle and the Aji are unclear, and no archaeological excavation has been carried out on the castle. It was likely built in the 14th century. The Ōgawa reached their greatest period of prosperity in the 15th century. At some point the castle was destroyed by the Ryukyuan army. The outer gate of Agena Castle no longer exists, but as the inner gate is bored through the limestone foundation and is surround on both sides with quarried rocks, it still exists. The inner gate is an early example of an arched castle gate, and is protected as a national treasure of Japan. The castle remains now holds numerous utaki sites of worship of the Ryukyuan religion, and is scattered with fragments of Chinese ceramics from the 14th to the 15th century. The area around the castle is now used as Agena Park.