I would say Europe is the cultural area of the Roman Empire which was maintained and expanded on by the Catholic and Orthodox Churches. The regions permanently lost to Islam (the Maghreb, Egypt, Mesopotamia, Asia Minor) obviously are no longer part of Europe.
I have never been to the Caucasus but I would say the Georgians are European while the Armenians are not. The Armenians seem too Oriental to me.
