TL;DR: the ancient Greeks, with their limited knowledge of geography and abilities to travel, first employed the word "Europe" to define the boundary between their known world, the unknown to the East (Asia) and the unknown to the South (Africa).
quote from the dedicated wikipedia page:
The threefold division of the Old World into Africa, Asia, and Europe has been in use since the 6th century BC by early Greek geographers such as Anaximander and Hecataeus.
Anaximander placed the boundary between Asia and Europe along the Phasis River (the modern Rioni in Georgia in the Caucasus Mountains), from Rioni mouth in Poti on the Black Sea coast, through the Surami Pass and along the Kura River to the Caspian Sea, a convention still followed by Herodotus in the 5th century BC. As geographic knowledge of the Greeks increased during the Hellenistic period, this archaic convention was revised, and the boundary between Asia and Europe was now considered to be the Tanais (the modern Don River). This is the convention used by Roman era authors such as Posidonius, Strabo and Ptolemy.