Stone was quarried throughout centuries here. Excellent millstones (raw material of bastions and buildings) could be prepared from this kind of stone, thus the first part of the name of the village - "stone cutting" ("kővágó"). Today people call this phenomenon of nature the “sea of stones”.
The second part of the town's name originates from the Örs clan. This area was the clan's principal territory at the time of Árpád’s conquest of Hungary, accordingly Kővágóörs was seat of “alispán” or “ispán” (comes).
Three surrounding medieval villages (Ecser, Sóstókál, and Kisörs) were destroyed at the time of the fall of the Ottoman Empire, and the ruins of their respective churches can be seen nearby.
The poet Mihály Barla lived here.