Universal Words

From UNL Wiki
(Difference between revisions)
Jump to: navigation, search
(Types of UWs)
(Structure of UWs)
Line 41: Line 41:
 
== Structure of UWs ==
 
== Structure of UWs ==
  
Temporary UWs are always represented between double quotes, and observe the source language spelling practices (concerning, for instance, capitalization). For the time being, they're also expected to be transliterated in Roman characters.  
+
Temporary UWs are always represented between double quotes, and observe the source language spelling practices (concerning, for instance, capitalization). For the time being, they are also expected to be transliterated in Roman characters.  
  
Permanent UWs can be either simple (atomic) or complex (made out of other UWs). In the latter case, they are represented as hyper-nodes, i.e., sub-hyper-graphs, and follow the syntax for [[UNL Sentences]]. A simple UW is an integer which can also be represented, for better readability, as a unique character-string split into two different parts: a root and a suffix. The root can be a word, an expression, a phrase or even an entire sentence in any language. It should be interpreted as a label for a concept. The suffix, which is always introduced by a UNL relation, is used to disambiguate the root.  
+
Permanent UWs can be simple, compound or complex. In the latter case, they are represented as hyper-nodes, i.e., sub-hyper-graphs, and follow the syntax for [[UNL Sentences]]. A simple UW is an integer which can also be represented, for better readability, as a unique character-string split into two different parts: a root and a suffix. The root can be a word, an expression, a phrase or even an entire sentence in any language. It should be interpreted as a label for a concept. The suffix, which is always introduced by a UNL relation, is used to disambiguate the root.  
  
 
As language-independent semantic units, UWs are equivalent to the sets of synonyms of a given language, approaching the concept of "synset" devised by the WordNet (Fellbaum, 1998). As a matter of fact, the current UNL Dictionary has been automatically extracted out of the WordNet 3.0, and UWs have been represented as 9-digit strings with the following format:
 
As language-independent semantic units, UWs are equivalent to the sets of synonyms of a given language, approaching the concept of "synset" devised by the WordNet (Fellbaum, 1998). As a matter of fact, the current UNL Dictionary has been automatically extracted out of the WordNet 3.0, and UWs have been represented as 9-digit strings with the following format:

Revision as of 22:35, 31 August 2012

Universal Words, or simply UWs, are the words of UNL, and correspond to the nodes - to be interlinked by relations and specified by attributes - in a UNL graph. They are labels for relatively stable units of knowledge (the concepts) that can be associated to natural language open lexical categories (noun, verb, adjective and adverb). The set of UWs is relatively open, and includes permanent UWs - those listed in the UNL Dictionary - and temporary UWs. Permanent UWs are defined in the UNL Knowledge Base and exemplified in the UNL Example Base, which are the lexical databases of the UNL.


Contents

Types of UWs

Permanent UWs and Temporary UWs

There are basically two different types of UWs: permanent and temporary.

Permanent UWs
Permanent UWs are included in the UNL Dictionary and correspond to concepts of common use (common nouns, adjectives, adverbs and verbs).
Temporary UWs
Temporary UWs are words that:
  • Represent new concepts or entities and are still candidates to be included in the UNL Dictionary ("Barack Obama", "Twitter");
  • Are too specific to be included in the UNL Dictionary ("Universal Networking Digital Language Foundation", "Léon Werth"); or
  • Are not translatable ("3.14159", "H2O", "www.undlfoundation.org").

The difference between permanent and temporary UWs is rather intuitive. Most named entities, for instance, are represented as temporary UWs, because it would not be feasible to include them all in the UNL Dictionary. Nevertheless, some named entities of widespread use (such as "England", "William Shakespeare", "Romeo and Juliet", "Romeo" etc) have been already included in the UNL Dictionary and are treated as permanent UWs.

Simple UWs, Compound UWs and Complex UWs

UWs can be simple, compound or complex.

Simple UWs
Simple UWs are represented as isolated nodes in the UNL graph.
Compound UWs
Compound UWs are represented as isolated nodes combined with attributes.
Complex UWs
Complex UWs are hyper-nodes, i.e., sub-graphs inside the UNL graph.

Compound and complex UWs are analytical representations of the meaning structure, whereas simple UWs are synthetic representations of the meaning. In principle, all concepts could be represented in any of these three formats. Consider, for instance, the concept "one who writes", which is lexicalized in English by the word "writer". This concept could be represented in UNL as:

  • "writer" (Simple UW), i.e., a single lexical unit;
  • "writ.@agent" (Compound UW), i.e., as a simple UW and an attribute corresponding to the morphological structure of the word ("writ+er"); or
  • "agt(write,person.@topic)" (Complex UW), i.e., as a UNL graph corresponding to the definition ("one who writes")

These differences do not pose any restrictions to the UNL representation. For instance, the English noun phrase "good writer" could be represented in UNL as:

  • mod(writer, good) ("one who writes" as a Simple UW)
  • mod(writ.@agent, good) ("one who writes" as a Compound UW)
  • mod(:01,good)agt:01(write,person.@topic) ("one who writes" as a Complex UW)

In the same way, these differences do not pose any restrictions to the dictionaries. For instance, the French dictionary could bring :

  • [écrivain]{} "writer" (LEX=N,POS=NOU,GEN=MCL,NUM=SNG)<fra,0,0>; ("one who writes" as a Simple UW)
  • [écrivain]{} "writ.@agent" (LEX=N,POS=NOU,GEN=MCL,NUM=SNG)<fra,0,0>; ("one who writes" as a Compound UW)
  • [écrivain]{} "agt(write,person.@topic)" (LEX=N,POS=NOU,GEN=MCL,NUM=SNG)<fra,0,0>; ("one who writes" as a Complex UW)

Structure of UWs

Temporary UWs are always represented between double quotes, and observe the source language spelling practices (concerning, for instance, capitalization). For the time being, they are also expected to be transliterated in Roman characters.

Permanent UWs can be simple, compound or complex. In the latter case, they are represented as hyper-nodes, i.e., sub-hyper-graphs, and follow the syntax for UNL Sentences. A simple UW is an integer which can also be represented, for better readability, as a unique character-string split into two different parts: a root and a suffix. The root can be a word, an expression, a phrase or even an entire sentence in any language. It should be interpreted as a label for a concept. The suffix, which is always introduced by a UNL relation, is used to disambiguate the root.

As language-independent semantic units, UWs are equivalent to the sets of synonyms of a given language, approaching the concept of "synset" devised by the WordNet (Fellbaum, 1998). As a matter of fact, the current UNL Dictionary has been automatically extracted out of the WordNet 3.0, and UWs have been represented as 9-digit strings with the following format:

<POS><WORDNETID>

where <POS> = {1,2,3,4}, being 1 = noun, 2 = verb, 3 = adjective and 4 = adverb;
and <WORDNETID> is the synset ID in the WordNet30.

The current UNL dictionary is, however, only a starting point, as the set of UWs is supposed to be as comprehensive as the set of these different individual concepts depicted by different languages and cultures. In that sense, UWs are not to be considered semantic primitives, nor should represent only common concepts, nor should be derived from any particular language. They must include culture-dependent information and every relevant variation among similar concepts. Furthermore, the UNL Dictionary constitutes an open set, subject to permanent increase with new UWs, as UNL is supposed to incessantly incorporate new cultures and cultural changes.

Formal syntax

The syntax for permanent UWs is defined as follows:

UNL REPRESENTATION
<PERMANENT UW>       ::= <integer>
<TEMPORARY UW>       ::= """<ASCII character>+"""
NL REPRESENTATION
<TEMPORARY UW>       ::= """<UTF-8 character>+"""
<PERMANENT UW>       ::= <root>[<suffix>]
<root>               ::= <UTF-8 character>+
<suffix>             ::= “(“ <suffix> [ “,” <suffix> ]… “)” | <relation> { “>” , “<” } <root>
<relation>           ::= {“agt”, "and", "aoj", ...}

where:
+ to be repeated 1 or more times
< > variable
" " terminal symbol
::= ... is defined as ...
| or
[ ] optional element
{ } alternative element
... to be repeated more than 0 times

Examples

The UW for the concept of "a piece of furniture with tableware for a meal laid out on it" may be represented as follows:

UNL Representation NL Representation
104379964 table(icl>furniture)
table(icl>mobilier)
mesa(icl>mobiliario)
Tisch(icl>Möbel)
стол(icl>мебель)
...

Semantics

The basic assumption of the UNL approach is that the information conveyed by natural languages can be formally represented through three different types of semantic units: concepts, concept modifiers and binary relations between concepts. This three-layered representation model is the cornerstone of UNL and its most distinctive feature over other semantic networks, which normally proposes only two levels: edges and vertices. Nevertheless, it poses several problems to the UNL-ization as the distinction between what is supposed to be represented by each unit is not always clear.

The main difficulty concerns what is to be represented as a concept (and therefore as a UW) and what is to be represented as a relation between concepts. How many concepts (UWs) are there, for instance, in the sentence "Charles Dickens was the author of Oliver Twist"? Should "author" be represented as a concept or as a relation between "Charles Dickens" and "Oliver Twist"? Should the verb "to be" be represented as a concept or as a relation between "Charles Dickens" and "author"? Should the preposition "of" be represented as a concept or as a relation between "author" and "Oliver Twist"?

In order to avoid what can be an endless discussion, the UNL assumes that UWs must correspond to and only to concepts referred by natural language open lexical categories (noun, verb, adjective and adverb). Any other semantic content (such as the ones conveyed by articles, prepositions, conjunctions, etc.) should be represented either as attributes of UWs or as relations between UWs. This criterion is not language-biased: if a given semantic value proves to be conveyed, in any language, by a closed class, it should not be represented as a UW, regardless of its realisation in other languages.

Categories of UWs

Permanent UWs are classified in four different categories, depending on their semantic values:

It should be stressed that these categories are semantic rather than syntactic or morphological. They are related to the UWs and are not oriented to any particular language. In that sense, adjectival UWs (such as "300217728" = "delighting the senses or exciting intellectual or emotional admiration") tend to be associated to English adjectives ("beautiful"), but they can also be realised as prepositional phrases ("with beauty"), verbal phrases ("possessing beauty"), etc.

Additionally, it should be emphasized that the set of UWs is not derived from any particular language. In that sense, there will be many UWs that do not correspond to a single lexical item and will have to be represented by periphrases. The concept "a state of torment created by the sudden sight of one's own misery", for instance, is lexicalized in Czech ("litost"), but not in English. In principle, the set of UWs, which is the UNL Dictionary, is supposed to be as comprehensive as the set of these different individual concepts depicted by different cultures, no matter how specific they are. In that sense, UWs are not to be considered semantic primitives, nor should represent only common concepts. They must include culture-dependent information and every relevant variation among similar concepts. Furthermore, the UNL Dictionary constitutes an open set, subject to permanent increase with new UWs, as UNL is supposed to incessantly incorporate new cultures and cultural changes.

Software