L-rule

From UNL Wiki
(Difference between revisions)
Jump to: navigation, search
(Observations)
(+header for clarity)
 
(43 intermediate revisions by 4 users not shown)
Line 1: Line 1:
'''L-rule''' (linear rule) is the formalism used for applying transformations over ordered sequences of isolated words in the UNL<sup>arium</sup> framework.  
+
'''L-rule''' (linear rule) is a specific type of [[transformation rule]] used for applying transformations over ordered sequences of isolated nodes.  
 +
 
 
== When to use L-rules ==
 
== When to use L-rules ==
L-rules are mainly used for generating spelling changes (such as in contraction, elision, assimilation, etc). They are also used to generate other spelling conventions, such as the use of capital letters and punctuation marks.
+
L-rules are used for:
 +
*reordering nodes in a list: a b c > a c b
 +
*replacing nodes in a list: a b c > a x c
 +
*adding nodes in a list: a b c > a x b c
 +
*deleting nodes in a list: a b c > a c
  
 
== When not to use L-rules ==
 
== When not to use L-rules ==
L-rules are not to be used for sound changes that do not affect spelling.
+
L-rules are not used in transformations over structures other than lists (i.e., trees and graphs). In these cases, we use [[S-rules]] (syntactic rules).
 +
 
 
== Syntax ==
 
== Syntax ==
The general syntax for L-rules is the following:
+
L-rules comply with the syntax below:
<br>
+
(<NODE>)(<NODE>)...(<NODE>) := (<NODE>)(<NODE>)...(<NODE>);
(CONDITION) := (ACTION);
+
 
Where:
 
Where:
*CONDITION is a single form or a sequence of forms over which actions will take place; and
+
*<NODE> is a [[node]]  
*ACTION is the action to be performed over each form or sequence of forms of the CONDITION.
+
*the left side of the operator := states the condition
CONDITION and ACTION may be expressed as:
+
*the right side of the operator := states the action (replacement, change, creation, deletion, division, merge) to be performed over the condition.
*a character or string of characters, between quotes: ("a");
+
*a [[regular expression]], between / /: (/a[bcd]e/)
+
*a tag or list of tags, extracted from the [[tagset|UNDL Foundation tagset]]: (VOW);
+
*a combination of characters and tags: ("a",PRE);
+
Examples:
+
*("Mr."):=("Mister"); (replace "Mr." by "Mister")
+
*("doctor"):=("dr."); (replace "doctor" by "dr.")
+
L-rules are normally sensitive to the context and apply over a set of conditions rather than over isolated word forms. In this case, each separate word form must be isolated between parentheses and described as a different condition.  
+
*("I")(BLK)("am"):=("I'm"); (replace "I am" by "I'm")
+
  
== Types of L-rules ==
+
== Examples ==
There are basically three types of L-rules:
+
{|border="1" align="center" cellpadding="2"
*'''replacement''', when the number of parentheses in the CONDITION field is equal to the number of parentheses in the ACTION field:
+
*'''addition''', when the number of parentheses in the CONDITION field is lower than the number of parentheses in the ACTION field;
+
*'''deletion''', when the number of parentheses in the CONDITION field is greater than the number parentheses in the ACTION field.
+
 
+
Parentheses are automatically co-indexed between the CONDITION and the ACTION field, so that the first pair of parentheses of the CONDITION field corresponds to the first pair of parentheses of the ACTION field, and so on. This means that <u>parentheses are to be repeated on the right side of a L-rule if their corresponding forms are not expected to be deleted</u>. In order to control the process of adding, deleting and reordering, forms may be referred by [[#Indexes|indexes]]:
+
{|border=1; cellpadding=2 align=center
+
 
|+Examples
 
|+Examples
!width=300|RULE
+
!width=20%|RULE
!width=200|BEFORE > AFTER
+
!width=15%|BEFORE > AFTER
!width=300|DESCRIPTION
+
!width=65%|DESCRIPTION
 
|-
 
|-
 
|("a")("b")("c"):=("d")("e")("f");  
 
|("a")("b")("c"):=("d")("e")("f");  
Line 48: Line 38:
 
|"a" will be replaced by "d"; "b" and "c" will be replaced by "" (i.e., blank)
 
|"a" will be replaced by "d"; "b" and "c" will be replaced by "" (i.e., blank)
 
|-
 
|-
|("a")("b")("c"):=("d")( );  
+
|("a")("b")("c"):=("d",%01)(%02);  
|abc >  ab
+
|abc >  db
 
|"a" will be replaced by "d"; "b" will be preserved; "c" will be deleted
 
|"a" will be replaced by "d"; "b" will be preserved; "c" will be deleted
 
|-
 
|-
|("a")("b")("c"):=("d");  
+
|("a")("b")("c"):=("d",%01);  
 
|abc > d
 
|abc > d
 
|"a" will be replaced by "d"; "b" and "c" will be deleted
 
|"a" will be replaced by "d"; "b" and "c" will be deleted
Line 60: Line 50:
 
|"a", "b" and "c" will be preserved, but reordered
 
|"a", "b" and "c" will be preserved, but reordered
 
|-
 
|-
|("a")("b")("c"):=("d")(%03);  
+
|("a")("b")("c"):=("d",%01)(%03);  
 
|abc > dc
 
|abc > dc
 
|"a" will be replaced by "d"; "b" will be deleted; "c" will be preserved
 
|"a" will be replaced by "d"; "b" will be deleted; "c" will be preserved
 
|-
 
|-
|("a")("b")("c"):=("d")("g")( )( );  
+
|("a")("b")("c"):=("d",%01)("g")(%02)(%03);  
|abc > dgc
+
|abc > dgbc
|"a" will be replaced by "d"; "b" will be replaced by "g"; "c" will be preserved; and a new form will be generated after it
+
|"a" will be replaced by "d"; "b" and "c" will be preserved; and a new node "g" will be created between "a" and "b"
 
|-  
 
|-  
|("a")("b")("c"):=("d")("g")(%02)(%03);
+
|("a",ART)(BLK)("/[aeiou].*/"):=("an")( )( );
|abc > dgbc
+
|"a" will be replaced by "d"; "g" will be generated after it; and then "b" and "c", which will be preserved
+
|}
+
== Examples ==
+
{|border="1" align="center" cellpadding="2"
+
|+Examples
+
!width=300|RULE
+
!width=200|BEFORE > AFTER
+
!width=300|DESCRIPTION
+
|-
+
|("a",ART)(BLK)(VOW):=("an")( )( );
+
 
|'''a''' adjective > '''an''' adjective
 
|'''a''' adjective > '''an''' adjective
|replace the article (ART) "a" by "an" before a blank space (BLK) and a vowel (VOW); preserve the second (BLK) and the third form (VOW) without any change
+
|replace the article (ART) "a" by "an" before a blank space (BLK) and a node starting with "a", "e", "i", "o" or "u"; preserve the second node (BLK) and the third node without any change
 
|-
 
|-
|("a",PRE)(BLK)("a",ART):=("à",+ART,+CTC);
+
|("a",PRE)(BLK)("a",ART):=("à",PRE,ART,CTC);
 
|'''a''' '''a''' > '''à'''
 
|'''a''' '''a''' > '''à'''
|replace the preposition (PRE) "a" in front of blank (BLK) and the article (ART) "a" by "à"; add the features ART (article) and CTC (contraction) to the first form; and delete the second (BLK) and the third form ("a",ART)
+
|replace the preposition (PRE) "a" + blank (BLK) + article (ART) "a" by "à"; add the features PRE (preposition), ART (article) and CTC (contraction) to the node "à"
 
|-
 
|-
|("de",PRE)(BLK)("le",ART):=("du",+ART,+CTC);
+
|("de",PRE)(BLK)("le",ART):=("du",PRE,ART,CTC);
 
|'''de''' '''le''' > '''du'''
 
|'''de''' '''le''' > '''du'''
|replace the preposition (PRE) "de" in front of blank (BLK) and the article (ART) "le" by "du"; add the features ART and CTC to the first form; and delete the second (BLK) and the third form ("le",ART)
+
|replace the preposition (PRE) "de" + blank (BLK) + article (ART) "le" by "du"; add the features PRE, ART and CTC to the node "du"
 
|-
 
|-
 
|("a",VER)(BLK)("il",PPR):=( )("-t-",-BLK)( );
 
|("a",VER)(BLK)("il",PPR):=( )("-t-",-BLK)( );
Line 95: Line 74:
 
|replace the blank space (BLK) between the verb (VER) "a" and the pronoun (PPR) "il" by "-t-"; remove the feature BLK from the second form; preserve the first and the third form without any change
 
|replace the blank space (BLK) between the verb (VER) "a" and the pronoun (PPR) "il" by "-t-"; remove the feature BLK from the second form; preserve the first and the third form without any change
 
|-
 
|-
|("de",PRE)(BLK)(VOW):=("d'")(%03);
+
|("de",PRE)(BLK)("/[aeiou].*/"):=("d'",%01)(%03);
 
|'''de avoir''' > '''d'avoir'''
 
|'''de avoir''' > '''d'avoir'''
|replace the preposition (PRE) "de" before a blank space (BLK) and a vowel (VOW) by "d'"; delete the second form (BLK); and preserve the third form (%03) without any change
+
|replace the preposition (PRE) "de" + blank space (BLK) + a node starting with "a", "e", "i", "o" or "u" by "d'"; delete the second form (BLK); and preserve the third form (%03) without any change
 
|-
 
|-
 
|}
 
|}
== Observations ==
+
 
;L-Rules may have the following arguments:
+
== Transformations ==
:*strings (between quotes or brackets): "de", "d'", [sense], etc.
+
{{:Transformation_over_nodes}}
:*features: PRE, BLK, VOW, etc.
+
 
:*indexes (preceded by "%"): %03, %head, etc.
+
== Transformations over hyper-nodes ==
:*regular expressions (between / /, only in the left side): /a[bcde]/, /a*/, etc.
+
{{:Transformation_over_hyper-nodes}}
:*[[A-rule]]s (only in the right side): 0>"s", "a":"b"
+
 
;Arguments may be combined (but strings, regular expressions and A-rules are mutually exclusive):
+
== Properties ==
:*("X",%x,X)("Y",%y,Y):=("Z",%x,-X,+A)(0>"s",%y,+B);
+
#L-rules are recursive<nowiki>:</nowiki> rules will apply while conditions are true:
;A node may contain one single string.
+
#:The rule "(BLK):=("-");" will transform "a b c d e" into "a-b-c-d-e" (and not only in "a-b c d e")
:*("a"):=("b");
+
#:The rule "(X):=(+Y);" will never stop (i.e., it contains an infinite loop): the feature Y will keep been added eternally (X,Y,Y,Y,Y,Y,Y,Y,...)
:*<strike>("a","b"):=("c");</strike>
+
#The symbol '''^''' is used for negation and may be used to prevent infinite loops:
;Strings in the right side always replace strings in the left side:
+
#:*(X,^Y):=(+Y); (= add the feature Y to a node containing the feature X that does not contain the feature Y yet)
:In the rule ("x"):=("y"); the string "x" is replaced by the string "y".
+
#:*(^".")(STAIL):=(%01)(".")(%02); (Add a period before the end of the sentence if there is not a period yet)
;Strings are represented between "quotes" while lemmas are represented between [brackets].
+
#Rules are conservative. No feature is changed or deleted unless explicitly indicated through "-".
:The UNL<sup>arium</sup> distinguishes between strings (to be represented between "quotes") and lemmas (to be represented between [brackets]). The difference between strings and lemmas has to do with variance and the dictionary status: if the constituent is expected to figure as an entry in the dictionary (e.g., "in", "the", "after", "love", "sense", etc) or if may vary (e.g., if it may be inflected, or further composed by specification, adjunction or complementation), it must be represented between brackets; if it's a full phrase whose internal structure is not relevant, because invariant, it must come between quotes:
+
#:In the rule ("x",A):=("y"); the string "x" is replaced by the string "y", but the feature A is not altered (i.e.,the final state will be ("y",A));
:*("into account"); (the string "into account" does not vary: ''take'' > ''take into account'', ''<strike>take into more account</strike>'')
+
#:In the rule ("x",A):=("y",A); the string "x" is replaced by the string "y" and the feature A is added to the node (i.e., the final state will be ("y",A,A))
:*([sense]); (the term "sense" may be further specified: ''make'' > ''make sense'', ''make any sense'', ''make no sense'', etc).
+
#:The rule "("a",ART)(BLK)("/a[bcd]e/"):=("an")( )( );" does not affect the status of the second and the third nodes. On the other hand, the rule "("a",VER)(BLK)("il",PPR):=( )("-t-",-BLK)( );" alters the status of the second node by deleting the feature BLK.
;Features are added through "+" and deleted through "-":
+
#Regular expressions may be used in order to make reference to the elements of a node, but only in the left (condition) side.<br />
:*(X):=(+Y); (= add the feature Y to the node containing the feature X)
+
#:("/[A-Z]/",%x)(".",%y):=(%x);  
:*(X):=(-X); (= delete the feature X from any node containing the feature X)
+
#:<strike>("/[A-Z]/")("."):=("/[A-Z]/");</strike>
;L-rules are recursive<nowiki>:</nowiki> rules will apply while conditions are true:
+
#In the ACTION field, changes to the elements of a node may be expressed by the right side of [[A-rule]]s
:The rule "(BLK):=("-");" will transform "a b c d e" into "a-b-c-d-e" (and not only in "a-b c d e")
+
#:The rule "("a",ART)(BLK)("/[aeiou].*/"):=("an")( )( );" could also be expressed as "("a",ART)(BLK)("/[aeiou].*/"):=(0>"n")( )( );", i.e., the change from "a" to "an" could be expressed either by "an" or 0>"n".
:The rule *(X):=(+Y);" will never stop (i.e., it contains an infinite loop): the feature Y will keep been added eternally (X,Y,Y,Y,Y,Y,Y,Y,...)
+
#Rules apply only if all conditions are true.
;The symbol '''^''' is used for negation and may be used to prevent infinite loops:
+
#:The rule "("a")(BLK)("/[aeiou].*/"):=("an")( )( );" will apply only in case of "a" before a blank and a node starting with "a", "e", "i", "o" or "u".
:*(X,^Y):=(+Y); (= add the feature Y to a node containing the feature X that does not contain the feature Y yet)
+
:(^".")(STAIL):=(".")(%02); (Add a period before the end of the sentence if there is not a period yet)
+
;Rules are conservative. No feature is changed or deleted unless explicitly indicate through "-".
+
:In the rule ("x",FEA):=("y"); the string "x" is replaced by the string "y", but the feature FEA is not altered (i.e.,the final state will be ("y",FEA));
+
:The rule "("a",ART)(BLK)(VOW):=("an")( )( );" does not affect the status of the second and the third word forms, which continue to be BLK and VOW. On the other hand, the rule "("a",VER)(BLK)("il",PPR):=( )("-t-",-BLK)( );" alters the status of the second form by deleting the feature BLK.
+
;Indexes are used to control rules:
+
:*(%a)(%b)(%c):=(%b); (delete the first and the third nodes, and keep the second)
+
:*(%a)(%b)(%c):=(%c)(%b)(%a); (reverse the order)
+
;In the ACTION field, changes may be expressed by the right side of [[A-rule]]s (i.e., by prefixation, infixation, suffixation or replacement) inside each form. The default is replacement.
+
:The rule "("a",ART)(BLK)(VOW):=("an")( )( );" could also be expressed as "("a",ART)(BLK)(VOW):=(0>"n")( )( );", i.e., the change from "a" to "an" could be expressed either by "an" or 0>"n".
+
;Rules apply only if all conditions are true.
+
:The rule "("a")(BLK)(VOW):=("an")( )( );" will apply only in case of "a" before a blank and a vowel.
+
;In order to enhance its power, conditions (but not actions) may be replaced by [[regular expression]]s between //.
+
:(/a[bcd]e/):=(""); (Delete the words "abe", "ace" and "ade")
+
  
 
== Indexes ==
 
== Indexes ==
;Nodes are always indexed in L-rules
+
See: [[Indexation]]
:Indexes (%) are used for indexing nodes, attributes and values between the left (condition) and the right side of rules.
+
:*('''%a''')('''%b'''):=('''%b''')('''%a'''); (change the order of the constituents)
+
;If omitted, indexes are assigned by default, according to the position:
+
:*(A)(B):=(C)(D); is the same as (A,'''%01''')(B,'''%02'''):=(C,'''%01''')(D,'''%02''');
+
;Indexes can be replaced by user-defined labels made of any sequence of alphabetic characters and underscore:
+
:(A,%a)(B,%b):=(C,%a)(D,%b);
+
;Numeric characters cannot be used as user-defined indexes:
+
:(A,%03)(B,%05):=(C,%03)(D,%05);
+
::%01 = A, %02 = B (there is no %03 nor %05)
+
;Indexes may also be used to transfer attribute values expressed in the format ATTRIBUTE=VALUE:
+
:(A,%a,ATT1=VAL1)(B,%b):=()(B,ATT1=%a); (the value "VAL1" of "ATT1" of %a is copied to the node %b)
+
  
 
== Common mistakes ==
 
== Common mistakes ==
Line 161: Line 115:
 
*<strike>("Mr"):=("Mister")</strike>  
 
*<strike>("Mr"):=("Mister")</strike>  
 
**Rules must end in semicolon: ("Mr"):=("Mister");  
 
**Rules must end in semicolon: ("Mr"):=("Mister");  
*<strike>("I am"):=("I'm);</strike>
+
*<strike>("I am"):=("I'm");</strike>
 
**Each separate word form must be isolated between parentheses and described as a different condition: ("I")(BLK)("am"):=("I'm");
 
**Each separate word form must be isolated between parentheses and described as a different condition: ("I")(BLK)("am"):=("I'm");
 
*<strike><nowiki>("a",ART)(BLK)(VOW):=("an");</nowiki></strike>  
 
*<strike><nowiki>("a",ART)(BLK)(VOW):=("an");</nowiki></strike>  
Line 168: Line 122:
 
**"de avoir">"d' ": coindexation is based on ordering and not on features. The third form is deleted because it's not present at the right side; the second form, which is BLK, receives the feature VOW;
 
**"de avoir">"d' ": coindexation is based on ordering and not on features. The third form is deleted because it's not present at the right side; the second form, which is BLK, receives the feature VOW;
  
== Formal syntax ==
 
L-rules comply with the following formal syntax:
 
 
<L-RULE>          ::= ( "("<CONDITION>")" )+ ":=" ( "("<ACTION>")" )+ ";"
 
<CONDITION>        ::= """<STRING>""" ("," <TAGLIST> )* | "["<STRING>"]" ("," <TAGLIST> )* | <TAGLIST>
 
<ACTION>          ::= (<INDEX>)? ( <AFFIXATION> ("," <AFFIXATION>)* )* ( <ATT_CHANGE> ("," <ATT_CHANGE>)* )*
 
<AFFIXATION>      ::= <PREFIXATION> | <SUFFIXATION> | <INFIXATION> | <REPLACEMENT> (cf. [[A-rule]])
 
<ATT_CHANGE>      ::= { "+" | "-" } <TAG>
 
<TAGLIST>          ::= <INDEX> | (<INDEX> ",")? <TAG> ("," <TAG>)*
 
<INDEX>            ::= "%"[01..99]
 
<TAG>              ::= {one of the tags defined in the [[Tagset|UNDLF Tagset]]}
 
<STRING>          ::= [a-Z]+
 
<INTEGER>          ::= [0-9]+
 
 
where
 
  
<a> = a is a non-terminal symbol<br />
+
== N-rules and L-rules ==
“a“ = a is a constant<br />
+
{{:Difference between N-rules and L-rules}}
a | b = a or b<br />
+
{ a | b } = either a or b<br />
+
(a)? = a can occur 0 or 1 time<br />
+
(a)* = a can be repeated 0 or more times<br />
+
(a)+ = a can be repeated 1 or more times<br />
+

Latest revision as of 11:41, 15 February 2014

L-rule (linear rule) is a specific type of transformation rule used for applying transformations over ordered sequences of isolated nodes.

Contents

When to use L-rules

L-rules are used for:

  • reordering nodes in a list: a b c > a c b
  • replacing nodes in a list: a b c > a x c
  • adding nodes in a list: a b c > a x b c
  • deleting nodes in a list: a b c > a c

When not to use L-rules

L-rules are not used in transformations over structures other than lists (i.e., trees and graphs). In these cases, we use S-rules (syntactic rules).

Syntax

L-rules comply with the syntax below:

(<NODE>)(<NODE>)...(<NODE>) := (<NODE>)(<NODE>)...(<NODE>);

Where:

  • <NODE> is a node
  • the left side of the operator := states the condition
  • the right side of the operator := states the action (replacement, change, creation, deletion, division, merge) to be performed over the condition.

Examples

Examples
RULE BEFORE > AFTER DESCRIPTION
("a")("b")("c"):=("d")("e")("f"); abc > def "a" will be replaced by "d"; "b" by "e"; and "c" by "f"
("a")("b")("c"):=("d")( )( ); abc > dbc "a" will be replaced by "d"; "b" and "c" will be preserved
("a")("b")("c"):=("d")("")(""); abc > d "a" will be replaced by "d"; "b" and "c" will be replaced by "" (i.e., blank)
("a")("b")("c"):=("d",%01)(%02); abc > db "a" will be replaced by "d"; "b" will be preserved; "c" will be deleted
("a")("b")("c"):=("d",%01); abc > d "a" will be replaced by "d"; "b" and "c" will be deleted
("a")("b")("c"):=(%03)(%02)(%01); abc > cba "a", "b" and "c" will be preserved, but reordered
("a")("b")("c"):=("d",%01)(%03); abc > dc "a" will be replaced by "d"; "b" will be deleted; "c" will be preserved
("a")("b")("c"):=("d",%01)("g")(%02)(%03); abc > dgbc "a" will be replaced by "d"; "b" and "c" will be preserved; and a new node "g" will be created between "a" and "b"
("a",ART)(BLK)("/[aeiou].*/"):=("an")( )( ); a adjective > an adjective replace the article (ART) "a" by "an" before a blank space (BLK) and a node starting with "a", "e", "i", "o" or "u"; preserve the second node (BLK) and the third node without any change
("a",PRE)(BLK)("a",ART):=("à",PRE,ART,CTC); a a > à replace the preposition (PRE) "a" + blank (BLK) + article (ART) "a" by "à"; add the features PRE (preposition), ART (article) and CTC (contraction) to the node "à"
("de",PRE)(BLK)("le",ART):=("du",PRE,ART,CTC); de le > du replace the preposition (PRE) "de" + blank (BLK) + article (ART) "le" by "du"; add the features PRE, ART and CTC to the node "du"
("a",VER)(BLK)("il",PPR):=( )("-t-",-BLK)( ); a il > a-t-il replace the blank space (BLK) between the verb (VER) "a" and the pronoun (PPR) "il" by "-t-"; remove the feature BLK from the second form; preserve the first and the third form without any change
("de",PRE)(BLK)("/[aeiou].*/"):=("d'",%01)(%03); de avoir > d'avoir replace the preposition (PRE) "de" + blank space (BLK) + a node starting with "a", "e", "i", "o" or "u" by "d'"; delete the second form (BLK); and preserve the third form (%03) without any change

Transformations

Nodes are altered, replaced, created and deleted by T-rules:

Altering elements of nodes

Any changes to the elements of nodes must be stated in the right side of rules. Changes affect only the elements explicitly indicated in rules:

("a",[a],[[a]],A):=("b"); (only the string is affected by the rule; all other elements are preserved. The resulting node is ("b",[a],[[a]],A) )
"Strings"
Nodes may have one single string. This value is set through the operator "+", reset through the operator "-", or modified through A-rules. The operator "+" may be omitted. Changes to strings do not affect any other element (headwords, UWs and features)
  • (""):=(+"a"); (the string of the node is set from "" to "a")
  • (""):=("a"); (the same as above)
  • ():=("a"); (the same as above)
  • ("a"):=(+"b"); (the string of the node is set from "a" to "b")
  • ("a"):=("b"); (the same as above)
  • ("a"):=(-"a"); (the string of the node is reset, i.e., it changes from "a" to "")
  • ("a"):=(""); (the same as above)
  • ("a"):=("x"<0,0>"y"); (the string of the node is modified from "a" to "xay")
[headwords]
Nodes may have one single headword. This value is set through the operator "+" and reset through the operator "-". The operator "+" may be omitted. Headwords may not be modified through A-rules. Changes to headwords do not affect any other element (strings, UWs and features)
  • ([]):=(+[a]); (the headword of the node is set from [] to [a])
  • ([]):=([a]); (the same as above)
  • ():=([a]); (the same as above)
  • ([a]):=(+[b]); (the headword of the node is set from [a] to [b])
  • ([a]):=([b]); (the same as above)
  • ([a]):=(-[a]); (the headword of the node is reset, i.e., it changes from [a] to [])
  • ([a]):=([]); (the same as above)
  • ([a]):=("x"<0,0>"y"); (it is not possible to modify headwords through A-rules.
[[UWs]]
Nodes may have one single UW. This value is set through the operator "+" and reset through the operator "-". The operator "+" may be omitted. UWs may not be modified through A-rules. Changes to UWs do not affect any other element (strings, headwords and features)
  • ([[]]):=(+[[a]]); (the UW of the node is set from [[]] to [[a]])
  • ([[]]):=([[a]]); (the same as above)
  • ():=([[a]]); (the same as above)
  • ([[a]]):=(+[[b]]); (the UW of the node is set from [[a]] to [[b]])
  • ([[a]]):=([[b]]); (the same as above)
  • ([[a]]):=(-[[a]]); (the UW of the node is reset, i.e., it changes from [[a]] to [[]])
  • ([[a]]):=([[]]); (the same as above)
  • ([a]):=("x"<0,0>"y"); (it is not possible to modify UWs through A-rules.
Features
Nodes may have as many features as necessary. Features may come isolated in a list (POS,NOU,GEN,MCL,NUM,SNG) or as pairs of attribute=value (POS=NOU,GEN=MCL,NUM=SNG). Changes to features do not affect any other element (strings, headwords and UWs)
  • Adding features to nodes
    Features are added through the operator + (add). The operator "+" may be omitted.
    • ():=(+B); (add the feature B to the node)
    • ():=(B); (the same as above)
    Rules are recursive: the feature will be added to the node while the condition is true.
    • ():=(+B); (the resulting node is (B,B,B,...), i.e., this is an infinite loop)
    • (^B):=(+B); (the resulting node is (B), i.e., the feature B is added only if the node does not contain it yet)
    The operator + (add) does not create attribute=value pairs automatically (it simply adds features to the nodes)
    • (%x,^POS,^NOU):=(%x,+NOU); (the resulting node is (NOU) and not (POS=NOU) because POS has not been added)
    • (%x,^POS,^NOU):=(%x,+POS,+NOU); (the resulting node is (POS,NOU) and not (POS=NOU) because there was no assignment POS=NOU)
    • (%x,POS,^NOU):=(%x,+NOU); (the resulting node is (POS,NOU) because there was no assignment POS=NOU)
    • (%x,^POS,^NOU):=(%x,+POS=NOU); (the resulting node is (POS=NOU))
    • (%x,POS,^NOU):=(%x,+POS=NOU); (the resulting node is (POS, POS=NOU) because the feature POS has been duplicated)
  • Deleting features from nodes
    Features are deleted through the operator - (delete).
    ():=(-B); (delete the feature B from the node)
    Rules are recursive: the feature will be deleted from the node while the condition is true.
    ():=(-B); (the rule will delete all instances of the feature B from the node, i.e., the node (B,B,B,B,B) will become ()
    The operator "-" may also be used to reset attributes:
    • (%x,POS,NOU):=(%x,-NOU); (the resulting node is (POS) because the feature POS was not deleted)
    • (%x,POS,NOU):=(%x,-POS,-NOU); (the resulting node is () because both features POS and NOU were deleted)
    • (%x,POS=NOU):=(%x,-NOU); (the resulting node is (POS) because only the value of the attribute POS was deleted)
    • (%x,POS=NOU):=(%x,-POS); (the resulting node is () because the attribute POS was deleted with all its values)
  • Copying features
    Features can be copied from one to another node through indexes
    • (%x,GEN)(%y,^GEN):=(%x)(%y,GEN=%x); (the value of the attribute GEN is copied from the node %x to %y);
Indexes
Indexes are used to make reference to the whole node instead of its elements. Any change in the index means a completely new node, and no element is preserved.
  • (%x,"a"):=(%x,"b"); (the string of the node %x is set from "a" to "b"; all the other elements of the node %x are preserved)
  • (%x,"a"):=(%y,"b"); (the whole node %x is replaced by a new node %y whose string is "b"; no element from %x is copied to %y)

Deleting nodes

In linear rules, nodes are deleted if they are not repeated (co-indexed) in the right side:

  • (%x)(%y):=(%x); (the node %y will be deleted)

In other rules, nodes are deleted if they are not repeated (co-indexed) in the right side and are not part of any other relation:

  • rel(%x;%y):=rel(%x); (the node %y will be deleted if, and only if, it is not part of any other relation)

Creating nodes

Nodes are created through the use of new indexes in the right side:

  • ("a",%x)("b",%y):=(%x)(%y)("c",%z); (the node %z will be created)
  • ("a",%x)("b",%y):=(%x)("c",%z); (the node %z will be created, and %y will be deleted)

Duplicating (cloning) nodes

Nodes may be duplicated by repeating indexes on the right side along with the command #CLONE:

  • ("a",^CLONED,%x):=(%x,+CLONED)(%x,+CLONED,#CLONE);
    ("a") becomes ("a")("a")

In order to avoid infinite recursion, it is important to change the condition on the right side (in the example above, the feature +CLONED, assigned to all instances of the clone, prevents the rule from applying indefinitely)
Clones contain the same elements of the original nodes, unless they are explicitly altered during the cloning:

  • ("a",[a],[[a]],A,^CLONED,%x):=(%x,+CLONED)(%x,+CLONED,#CLONE);
    ("a",[a],[[a]],A) becomes ("a",[a],[[a]],A,CLONED)("a",[a],[[a]],A,CLONED)
  • (A,^CLONED,%x):=(%x,-A,+B,+CLONED)(%x,-A,+C,+CLONED,#CLONE);
    (A) becomes (B,CLONED)(C,CLONED)

Splitting nodes

One node may be split into two or more nodes through the use of splitting rules. Consider, for instance, the cases below:

Splitting rules deal only with strings and apply only to nodes with the feature TEMP.
Original node: ("abc",TEMP)
Split rule: ("abc"):=("ab")("c");
Resulting nodes: ("ab",TEMP)("c",TEMP);
However, if the original node was ("abc"), without TEMP, the rule would not have been applied (i.e., it is necessary to assign the feature TEMP to the node before splitting it)
Splitting rules are conservative: the elements of the original node, except the string, will be preserved unless explicitly altered.
Original node: ("abc",[abc],[[abc]],A,B,C,TEMP)
Split rule: ("abc"):=("ab")("c");
Resulting nodes: ("ab",[abc],[[abc]],A,B,C,TEMP)("c",[abc],[[abc]],A,B,C,TEMP) (i.e., the elements of the original node will be copied to the new nodes)
However, if the rule was: ("abc"):=("ab",-A,-B,-C,-TEMP,+AB)("c",-TEMP);
The result would be: ("ab",[abc],[[abc]],AB)("c",[abc],[[abc]],A,B,C)

Merging nodes (&)

Two or more nodes may be merged by the command &:

  • (%x)(%y)(%z):=(%x&%y&%z);

In the example above("a")("b")("c") becomes ("abc")

Merge operations concatenate headwords and UWs, and join features

("hw1",[[uw1]],F1,%x)("hw2",[[uw2]],F2,%y)("hw3",[[uw3]],F3,%z):=(%x&%y&%z);
The resulting node is ("hw1hw2hw3",[[uw1uw2uw3]],F1,F2,F3)

Compare the difference
  • (%x)(%y):=(%z); (the nodes %x and %y are replaced by %z, and their features are lost unless explicitly included in %z)
  • (%x)(%y):=(%x&%y); (the nodes %x and %y are merged)

Retrieving entries in the dictionary after tokenization (?)

During transformation (i.e., after tokenization), dictionary entries may be accessed from transformation rules by the command "?"

  • (?[headword]) retrieves the first entry in the dictionary with the headword "headword"
  • (?[[uw]]) retrieves the first entry in the dictionary with the UW "uw"
  • (?[headword],?[[uw]],?feature) retrieves the first entry in the dictionary with the headword "headword", the UW "uw" and the feature "feature"

Regular expressions, variables and disjunction may also be used in dictionary search

  • (?[/abcd./]) retrieves the first entry in the dictionary whose headword has 5 characters and begins with "abcd" (this works only in natural language generation)
  • (?[[/abcd./]]) retrieves the first entry in the dictionary whose UW has 5 characters and begins with "abcd" (this works only in natural language analysis)
Obligatory parameters
Due to the indexation algorithm, the headword is obligatory in IAN and the UW is obligatory in EUGENE:
  • (?[headword]) will work only in IAN
  • (?[[uw]]) will work only in EUGENE
  • (?feature) will not work in IAN or EUGENE
Variables
In order to avoid repetition, dictionary look-up may use the values of indexed nodes in the left side
  • (?[%x]) retrieves the first entry in the dictionary with the same headword of the node %x
  • (?[[%x]]) retrieves the first entry in the dictionary with the same UW of the node %x
  • (?[%x],ATT=%x) retrieves the first entry in the dictionary with the same headword of the node %x and whose attribute ATT has the same value of the attribute ATT of the node %x
Example

Dictionary search is used mainly in natural language generation

  • (N,NUM,GEN,@def,%noun):=(?[[]],?ART,?DEF,?NUM=%noun,?GEN=%noun)(%noun,-@def);

In case of node %noun with the features noun (N), number (NUM) and gender (GEN), and with the attribute @def (definite), search the first entry in the dictionary associated with the UW "" (empty UW) with the features ART and DEF, and whose attributes NUM and GEN have the same values of the ones of the node %noun, and insert it in front of the noun. Remove @def from the noun in order to avoid an infinite loop.

Triggering rules (!)

Inflectional rules are triggered in the grammar by the command "!"<ATTRIBUTE>.
Given the dictionary entry:

  • [foot] "foot" (POS=NOU, NUM(PLR:="oo":"ee")) <eng,0,0>;

The rule NUM(PLR:="oo":"ee") is triggered by !NUM
For instance:

  • (NUM=PLR,^inflected):=(!NUM,+inflected); or
  • (PLR,^inflected):=(!NUM,+inflected); or
  • (NUM,^inflected):=(!NUM,+inflected);

In the first case (NUM=PLR), the system verifies if the attribute "NUM" is set and if it has the value "PLR". In the second and in the third case, the system simply verifies if the word has any feature (attribute or value) equal to "PLR" or "NUM".
It's important to stress that, as the features of the dictionary are defined by the user, there is no way of pre-assigning attribute-value pairs. In that sense, it's not possible to infer that "PLR" will be a value of the attribute "NUM" except through an assignment of the form "NUM=PLR" (i.e., given only "PLR" or "NUM", is not possible to state "NUM=PLR").

Transformations over hyper-nodes

Changes

Hyper-nodes, as nodes, have elements, which may be altered by the use of the operators + (add) and - (delete). The operator + may be omitted. Changes affect only the scopes indicated.

Changes to the main scope
  • (%a,"a",[a],[[a]],A,(%b,"b")):=(%a,"c");(the string of the hyper-node is set to "c"; the internal node %b is not affected)
  • (%a,"a",[a],[[a]],A,(%b,"b")):=(%a,"");(the string of the hyper-node is set to ""; the internal node %b is not affected)
  • (%a,"a",[a],[[a]],A,(%b,"b")):=(%a,-"a");(the same as above)
  • (%a,"a",[a],[[a]],A,(%b,"b")):=(%a,[c]);(the headword of the hyper-node is set to [c]; the internal node %b is not affected)
  • (%a,"a",[a],[[a]],A,(%b,"b")):=(%a,[[c]]);(the UW of the hyper-node is set to [[c]]; the internal node %b is not affected)
  • (%a,"a",[a],[[a]],A,^B,(%b,"b")):=(%a,+B);(add the feature B to the hyper-node %a; the internal node %b is not affected)
  • (%a,"a",[a],[[a]],A,^B,(%b,"b")):=(%a,B); (the same as above: add the feature B to %a)
  • (%a,"a",[a],[[a]],A,(%b,"b")):=(%a,-A);(delete the feature A from the hyper-node %a; the internal node %b is not affected)
Changes to inner scopes
  • (%a,(%b,"b",[b],[[b]],B)):=(%a,(%b,"c"));(the string of the inner node %b is set to "c"; the hyper-node %a is not affected)
  • (%a,(%b,"b",[b],[[b]],B)):=(%a,(%b,""));(the string of the inner node %b is set to ""; the hyper-node %a is not affected)
  • (%a,(%b,"b",[b],[[b]],B)):=(%a,(%b,-"b"));(the same as above)
  • (%a,(%b,"b",[b],[[b]],B)):=(%a,(%b,[c]));(the headword of the inner node %bis set to [c]; the hyper-node %a is not affected)
  • (%a,(%b,"b",[b],[[b]],B)):=(%a,(%b,[[c]]));(the UW of the inner node %b is set to [[c]]; the hyper-node %a is not affected)
  • (%a,(%b,"b",[b],[[b]],B,^C)):=(%a,(%b,+C));(add the feature C to the inner node %b; the hyper-node %a is not affected)
  • (%a,(%b,"b",[b],[[b]],B,^C)):=(%a,(%b,C)); (the same as above: add the feature C to %b)
  • (%a,(%b,"b",[b],[[b]],B)):=(%a,(%b,-B));(delete the feature B from the inner node %b; the hyper-node %a is not affected)
Rules must have as many parentheses as the depth of the inner scope to be altered
  • (%a,(%b,(%c,(%d,(%e,"e",[e],[[e]],E))))):=(%a,(%b,(%c,(%d,(%e,"f"))))); (the string of inner node %e is set to "f"; the enclosing nodes %d, %c, %b and %a are not affected)
Hyper-nodes do not need to be represented if the changes apply to nodes instead of nodes inside hyper-nodes
  • (%a,(%b,"b",[b],[[b]],B)):=(%a,(%b,"c")); (the string of the inner node %b is set to "c"; the hyper-node %a is not affected)

could be represented simply as

  • (%b,"b",[b],[[b]],B)):=(%b,"c");

if the changes apply to all nodes ("b",[b],[[b]],B) and not only to those inside scopes.

Deletion

Hyper-nodes, as any node, are deleted if they are not repeated (co-indexed) in the right side. In this case, all the inner nodes are deleted as well:

  • (REL(%x;%y),%z):=; (the hyper-node %z will be deleted, and all its internal nodes and relations as well)

As any feature, inner nodes are conservative, and are not deleted even if they are not repeated (co-indexed) in the right side:

  • (%a,A,^B):=(%a,+B); (the feature A is not deleted from the node %a)
  • (%a,^B,(%b,"b")):=(%a,+B); (the node %b is not deleted from the hyper-node %a)

In order to delete inner nodes, the operator "-" must be used

  • (%a,A,(%b,B)):=(%a,-(%b)); (the node %b is deleted from the hyper-node %a)
  • (%a,A,rel(%b;%c)):=(%a,-rel(%b;%c)); (the relation rel(%b;%c) is deleted from the hyper-node %a)

Extraction

Nodes may be extracted from hyper-nodes by removing the corresponding parentheses. In this case, the hyper-node is deleted (along with its features), but the internal nodes and relations are preserved, if repeated on the right side.

  • ((%x),%y):=(%x); (the hyper-node %y is deleted, but its internal node %x is preserved; in case %y have nodes other than %x, these nodes will be deleted as well, because they are not repeated in the right side)
  • (REL(%x;%y),%z):=REL(%x;%y); (the hyper-node %z is deleted, but its internal relation REL(%x;%y) is preserved; in case %z have relations other than REL(%x;%y), and nodes other than %x and %y, these will be deleted as well, because they are not repeated in the right side.

Create

Hyper-nodes are created through the encapsulation of existing nodes

  • (%x):=((%x),%y); (the hyper-node %y is created, with the node %x there inside)
  • REL(%x;%y):=(REL(%x;%y),%z); (the hyper-node %z is created, with the relation REL between the nodes %x and %y inside)
  • (%x)(%y):=((%x)(%y),%z); (the hyper-node %z is created, with the linear relation between the nodes %x and %y there inside)
Attention
relations and nodes must be repeated in the right side or they will be deleted
  • (%x):=(%y); (the node %x will be simply replaced by %y; no hyper-node will be created)
  • REL(%x;%y):=(%z); (the relation REL between the nodes %x and %y will be replaced by the node %z; no hyper-node will be created)

Properties

  1. L-rules are recursive: rules will apply while conditions are true:
    The rule "(BLK):=("-");" will transform "a b c d e" into "a-b-c-d-e" (and not only in "a-b c d e")
    The rule "(X):=(+Y);" will never stop (i.e., it contains an infinite loop): the feature Y will keep been added eternally (X,Y,Y,Y,Y,Y,Y,Y,...)
  2. The symbol ^ is used for negation and may be used to prevent infinite loops:
    • (X,^Y):=(+Y); (= add the feature Y to a node containing the feature X that does not contain the feature Y yet)
    • (^".")(STAIL):=(%01)(".")(%02); (Add a period before the end of the sentence if there is not a period yet)
  3. Rules are conservative. No feature is changed or deleted unless explicitly indicated through "-".
    In the rule ("x",A):=("y"); the string "x" is replaced by the string "y", but the feature A is not altered (i.e.,the final state will be ("y",A));
    In the rule ("x",A):=("y",A); the string "x" is replaced by the string "y" and the feature A is added to the node (i.e., the final state will be ("y",A,A))
    The rule "("a",ART)(BLK)("/a[bcd]e/"):=("an")( )( );" does not affect the status of the second and the third nodes. On the other hand, the rule "("a",VER)(BLK)("il",PPR):=( )("-t-",-BLK)( );" alters the status of the second node by deleting the feature BLK.
  4. Regular expressions may be used in order to make reference to the elements of a node, but only in the left (condition) side.
    ("/[A-Z]/",%x)(".",%y):=(%x);
    ("/[A-Z]/")("."):=("/[A-Z]/");
  5. In the ACTION field, changes to the elements of a node may be expressed by the right side of A-rules
    The rule "("a",ART)(BLK)("/[aeiou].*/"):=("an")( )( );" could also be expressed as "("a",ART)(BLK)("/[aeiou].*/"):=(0>"n")( )( );", i.e., the change from "a" to "an" could be expressed either by "an" or 0>"n".
  6. Rules apply only if all conditions are true.
    The rule "("a")(BLK)("/[aeiou].*/"):=("an")( )( );" will apply only in case of "a" before a blank and a node starting with "a", "e", "i", "o" or "u".

Indexes

See: Indexation

Common mistakes

  • "Mr":="Mister";
    • Conditions and actions must always come between parentheses: ("Mr"):=("Mister");
  • (Mr):=(Mister);
    • Constants must come between quotes (inside the parentheses): ("Mr"):=("Mister");
  • ("Mr"):=("Mister")
    • Rules must end in semicolon: ("Mr"):=("Mister");
  • ("I am"):=("I'm");
    • Each separate word form must be isolated between parentheses and described as a different condition: ("I")(BLK)("am"):=("I'm");
  • ("a",ART)(BLK)(VOW):=("an");
    • "a adjective">"a": the blank and the following form are deleted because they are not present at the right side
  • ("de",PRE)(BLK)(VOW):=("d'")(VOW);
    • "de avoir">"d' ": coindexation is based on ordering and not on features. The third form is deleted because it's not present at the right side; the second form, which is BLK, receives the feature VOW;


N-rules and L-rules

N-rules and L-rules are basically the same. The only difference is that L-rules are part of the Transformation Grammar and, therefore, applies after tokenization, whereas N-rules constitute the N-grammar, and apply before tokenization. This means that N-rules may only deal with strings or regular expressions, whereas L-rules may also deal with other elements (such as features and UW's):

  • L-rule
    • ("I")(BLK)("am"):=("I'm"); (I am>I'm)
    • ("a",PRE)(BLK)("a",ART):=("à",+ART,+CTC); (a a>à)
    • ("de",PRE)(BLK)("le",ART):=("du",+ART,+CTC); (de le>du)
  • N-rule
    • ("I")(" ")("am"):=("I'm"); (replace "I am" by "I'm")

Note, in the above, that we may use dictionary features (such as BLK, PRE, ART) in L-rules, but we cannot use any dictionary feature in N-rules. The only features available in N-rules are the system-defined features, such as SHEAD (beginning of the sentence) and STAIL (end of the sentence).

Software