http://www.unlweb.net/wiki/index.php?title=D-rule&feed=atom&action=historyD-rule - Revision history2024-03-29T09:56:46ZRevision history for this page on the wikiMediaWiki 1.18.1http://www.unlweb.net/wiki/index.php?title=D-rule&diff=8016&oldid=prevMartins: /* #PREFERRED AND #FINAL */2015-01-30T11:53:22Z<p><span class="autocomment">#PREFERRED AND #FINAL</span></p>
<table class='diff diff-contentalign-left'>
<col class='diff-marker' />
<col class='diff-content' />
<col class='diff-marker' />
<col class='diff-content' />
<tr valign='top'>
<td colspan='2' style="background-color: white; color:black;">← Older revision</td>
<td colspan='2' style="background-color: white; color:black;">Revision as of 11:53, 30 January 2015</td>
</tr><tr><td colspan="2" class="diff-lineno">Line 87:</td>
<td colspan="2" class="diff-lineno">Line 87:</td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>== #PREFERRED AND #FINAL ==</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>== #PREFERRED AND #FINAL ==</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="background: #ffa; color:black; font-size: smaller;"><div>The features #PREFERRED and #FINAL are used to change the default order of replacements during [[tokenization]] <del class="diffchange diffchange-inline">when the best match is blocked:</del></div></td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div>The features #PREFERRED and #FINAL are used to change the default order of replacements during [[tokenization]] <ins class="diffchange diffchange-inline">in blocking rules.</ins></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>*<nowiki>#PREFERRED</nowiki> means "if this possibility is blocked, <b>try first other candidate tokens for the other strings</b> before trying other candidate tokens for this string"</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>*<nowiki>#PREFERRED</nowiki> means "if this possibility is blocked, <b>try first other candidate tokens for the other strings</b> before trying other candidate tokens for this string"</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>*<nowiki>#FINAL</nowiki> means "if this possibility is blocked, <b>do not try any other candidate token for this string</b>, i.e., try only other candidate tokens for the other strings"</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>*<nowiki>#FINAL</nowiki> means "if this possibility is blocked, <b>do not try any other candidate token for this string</b>, i.e., try only other candidate tokens for the other strings"</div></td></tr>
<tr><td colspan="2" class="diff-lineno">Line 113:</td>
<td colspan="2" class="diff-lineno">Line 113:</td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>Compare the behaviour of the system for the grammars below:</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>Compare the behaviour of the system for the grammars below:</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>*D-GRAMMAR #1</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>*D-GRAMMAR #1</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="background: #ffa; color:black; font-size: smaller;"><div>#<nowiki>(A1)(B1)=0;</nowiki> (blocks the sequence of tokens with the features A1 and B1<del class="diffchange diffchange-inline">)</del></div></td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div>#<nowiki>(A1)(B1<ins class="diffchange diffchange-inline">,#PREFERRED</ins>)=0;</nowiki> (blocks the sequence of tokens with the features A1 and B1<ins class="diffchange diffchange-inline">, but indicates that A1 must be changed prior to </ins>B1)</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="background: #ffa; color:black; font-size: smaller;"><div><del class="diffchange diffchange-inline">#<nowiki>("a")(</del>B1<del class="diffchange diffchange-inline">,#PREFERRED)=0;</nowiki> (alter the order of best matches</del>)</div></td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>*NEW ORDER</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>*NEW ORDER</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A2][B1][C1]</nowiki> (previously 5)</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A2][B1][C1]</nowiki> (previously 5)</div></td></tr>
<tr><td colspan="2" class="diff-lineno">Line 124:</td>
<td colspan="2" class="diff-lineno">Line 123:</td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>Note, in the above, that the options 1 and 2 are not tested because they are blocked, and the order of attempts is changed. However, if, for any reason (other blocking rules), these first alternatives are also blocked, the system still tries to find, within the same segmentation, other candidates. If all of them are blocked, and only then, the system will re-segment the string, according to the process defined at [[tokenization]].</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>Note, in the above, that the options 1 and 2 are not tested because they are blocked, and the order of attempts is changed. However, if, for any reason (other blocking rules), these first alternatives are also blocked, the system still tries to find, within the same segmentation, other candidates. If all of them are blocked, and only then, the system will re-segment the string, according to the process defined at [[tokenization]].</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>*D-GRAMMAR #2</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>*D-GRAMMAR #2</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="background: #ffa; color:black; font-size: smaller;"><div>#<nowiki>(A1)(B1)=0;</nowiki> (blocks the sequence of tokens with the features A1 and B1<del class="diffchange diffchange-inline">)</del></div></td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div>#<nowiki>(A1)(B1<ins class="diffchange diffchange-inline">,#FINAL</ins>)=0;</nowiki> (blocks the sequence of tokens with the features A1 and B1 <ins class="diffchange diffchange-inline">and prevents the system from trying </ins>other candidates for <ins class="diffchange diffchange-inline">B1</ins>)</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="background: #ffa; color:black; font-size: smaller;"><div><del class="diffchange diffchange-inline">#<nowiki>("a")(B1,#FINAL)=0;</nowiki> (blocks </del>other candidates for <del class="diffchange diffchange-inline">the second node</del>)</div></td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>*NEW ORDER</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>*NEW ORDER</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A2][B1][C1]</nowiki> (previously 5)</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A2][B1][C1]</nowiki> (previously 5)</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A2][B1][C2]</nowiki> (previously 6)</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A2][B1][C2]</nowiki> (previously 6)</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>Note, in the above, that the options 1 and 2 are not tested because they are blocked. Note, also, that other candidates for the second string (i.e., where the second string is B2) are not tested, because B1 is #FINAL. So, if these two matches fail, the system starts re-segmenting the sentence.<br /></div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>Note, in the above, that the options 1 and 2 are not tested because they are blocked. Note, also, that other candidates for the second string (i.e., where the second string is B2) are not tested, because B1 is #FINAL. So, if these two matches fail, the system starts re-segmenting the sentence.<br /></div></td></tr>
<tr><td class='diff-marker'>−</td><td style="background: #ffa; color:black; font-size: smaller;"><div>At last, note that <del class="diffchange diffchange-inline">neither </del>#PREFERRED <del class="diffchange diffchange-inline">nor </del>#FINAL <del class="diffchange diffchange-inline">prevails over </del>the <del class="diffchange diffchange-inline">default tokenization order IF NO BLOCKING RULE IS MATCHED, i</del>.<del class="diffchange diffchange-inline">e., if </del>the grammar was simply:</div></td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div>At last, note that #PREFERRED <ins class="diffchange diffchange-inline">and </ins>#FINAL <ins class="diffchange diffchange-inline">do not prevail other </ins>the <ins class="diffchange diffchange-inline">priority of application of rules</ins>. <ins class="diffchange diffchange-inline">If </ins>the grammar was simply:</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="background: #ffa; color:black; font-size: smaller;"><div>#<nowiki>(A1<del class="diffchange diffchange-inline">)(B2)=0;</nowiki> (blocks the sequence of tokens with the features A1 and B2)</del></div></td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div>#<nowiki>(A1)(B2,#PREFERRED)=0;</nowiki>  </div></td></tr>
<tr><td class='diff-marker'>−</td><td style="background: #ffa; color:black; font-size: smaller;"><div><del class="diffchange diffchange-inline">#<nowiki>("a"</del>)(B2,#PREFERRED)=0;</nowiki> <del class="diffchange diffchange-inline">(alter the order of best matches)</del></div></td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>or  </div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>or  </div></td></tr>
<tr><td class='diff-marker'>−</td><td style="background: #ffa; color:black; font-size: smaller;"><div>#<nowiki>(A1<del class="diffchange diffchange-inline">)(B2)=0;</nowiki> (blocks the sequence of tokens with the features A1 and B2</del></div></td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div>#<nowiki>(A1)(B2,#FINAL)=0;</nowiki></div></td></tr>
<tr><td class='diff-marker'>−</td><td style="background: #ffa; color:black; font-size: smaller;"><div><del class="diffchange diffchange-inline">#<nowiki>("a"</del>)(B2,#FINAL)=0;</nowiki> <del class="diffchange diffchange-inline">(alter </del>the <del class="diffchange diffchange-inline">order of best matches)</del></div></td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div>the <ins class="diffchange diffchange-inline">output would be still</ins></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A1][B1][C1]</nowiki>  </div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A1][B1][C1]</nowiki>  </div></td></tr>
<tr><td class='diff-marker'>−</td><td style="background: #ffa; color:black; font-size: smaller;"><div><del class="diffchange diffchange-inline">i.e., #FINAL and #PREFERRED only play a role when </del>the <del class="diffchange diffchange-inline">default </del>best match is blocked.</div></td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div><ins class="diffchange diffchange-inline">because this is </ins>the best match <ins class="diffchange diffchange-inline">and it </ins>is <ins class="diffchange diffchange-inline">not </ins>blocked <ins class="diffchange diffchange-inline">by any rule</ins>.</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>For a practical example in English, see below<ref></div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>For a practical example in English, see below<ref></div></td></tr>
</table>Martinshttp://www.unlweb.net/wiki/index.php?title=D-rule&diff=8008&oldid=prevMartins: /* #PREFERRED AND #FINAL */2015-01-30T11:24:17Z<p><span class="autocomment">#PREFERRED AND #FINAL</span></p>
<table class='diff diff-contentalign-left'>
<col class='diff-marker' />
<col class='diff-content' />
<col class='diff-marker' />
<col class='diff-content' />
<tr valign='top'>
<td colspan='2' style="background-color: white; color:black;">← Older revision</td>
<td colspan='2' style="background-color: white; color:black;">Revision as of 11:24, 30 January 2015</td>
</tr><tr><td colspan="2" class="diff-lineno">Line 131:</td>
<td colspan="2" class="diff-lineno">Line 131:</td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>Note, in the above, that the options 1 and 2 are not tested because they are blocked. Note, also, that other candidates for the second string (i.e., where the second string is B2) are not tested, because B1 is #FINAL. So, if these two matches fail, the system starts re-segmenting the sentence.<br /></div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>Note, in the above, that the options 1 and 2 are not tested because they are blocked. Note, also, that other candidates for the second string (i.e., where the second string is B2) are not tested, because B1 is #FINAL. So, if these two matches fail, the system starts re-segmenting the sentence.<br /></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>At last, note that neither #PREFERRED nor #FINAL prevails over the default tokenization order IF NO BLOCKING RULE IS MATCHED, i.e., if the grammar was simply:</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>At last, note that neither #PREFERRED nor #FINAL prevails over the default tokenization order IF NO BLOCKING RULE IS MATCHED, i.e., if the grammar was simply:</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="background: #ffa; color:black; font-size: smaller;"><div>#<nowiki>(A1)(B2)=0;</nowiki> (blocks the sequence of tokens with the features A1 and <del class="diffchange diffchange-inline">B1</del>)</div></td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div>#<nowiki>(A1)(B2)=0;</nowiki> (blocks the sequence of tokens with the features A1 and <ins class="diffchange diffchange-inline">B2</ins>)</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>("a")(B2,#PREFERRED)=0;</nowiki> (alter the order of best matches)</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>("a")(B2,#PREFERRED)=0;</nowiki> (alter the order of best matches)</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>or  </div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>or  </div></td></tr>
<tr><td class='diff-marker'>−</td><td style="background: #ffa; color:black; font-size: smaller;"><div>#<nowiki>(A1)(B2)=0;</nowiki> (blocks the sequence of tokens with the features A1 and <del class="diffchange diffchange-inline">B1)</del></div></td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div>#<nowiki>(A1)(B2)=0;</nowiki> (blocks the sequence of tokens with the features A1 and <ins class="diffchange diffchange-inline">B2</ins></div></td></tr>
<tr><td class='diff-marker'>−</td><td style="background: #ffa; color:black; font-size: smaller;"><div>#<nowiki>("a")(B2,#<del class="diffchange diffchange-inline">PREFERRED</del>)=0;</nowiki> (alter the order of best matches)</div></td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div>#<nowiki>("a")(B2,#<ins class="diffchange diffchange-inline">FINAL</ins>)=0;</nowiki> (alter the order of best matches)</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A1][B1][C1]</nowiki>  </div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A1][B1][C1]</nowiki>  </div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>i.e., #FINAL and #PREFERRED only play a role when the default best match is blocked.</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>i.e., #FINAL and #PREFERRED only play a role when the default best match is blocked.</div></td></tr>
</table>Martinshttp://www.unlweb.net/wiki/index.php?title=D-rule&diff=8005&oldid=prevMartins at 11:03, 30 January 20152015-01-30T11:03:01Z<p></p>
<table class='diff diff-contentalign-left'>
<col class='diff-marker' />
<col class='diff-content' />
<col class='diff-marker' />
<col class='diff-content' />
<tr valign='top'>
<td colspan='2' style="background-color: white; color:black;">← Older revision</td>
<td colspan='2' style="background-color: white; color:black;">Revision as of 11:03, 30 January 2015</td>
</tr><tr><td colspan="2" class="diff-lineno">Line 156:</td>
<td colspan="2" class="diff-lineno">Line 156:</td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>because D-rules apply from left to right, and the system will try to replace first the rightmost nodes, if possible.<br /></div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>because D-rules apply from left to right, and the system will try to replace first the rightmost nodes, if possible.<br /></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>In order to prevent the system from replacing the rightmost nodes, we have to assign #PREFERRED to the nodes to be preserved:</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>In order to prevent the system from replacing the rightmost nodes, we have to assign #PREFERRED to the nodes to be preserved:</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="background: #ffa; color:black; font-size: smaller;"><div>*(R)(N,#PREFERRED)=0; (there cannot be a pronoun before a noun)</div></td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div>*(R)(N,#PREFERRED)=0; (there cannot be a pronoun before a <ins class="diffchange diffchange-inline">noun, but try to replace the pronoun before trying to replace the </ins>noun)</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>In this case, the machine will try to replace first the node without #PREFERRED and will get, then:<br /></div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>In this case, the machine will try to replace first the node without #PREFERRED and will get, then:<br /></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>*(D)(N) (i.e., [this] = determiner and [book] = noun)<br /></div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>*(D)(N) (i.e., [this] = determiner and [book] = noun)<br /></div></td></tr>
</table>Martinshttp://www.unlweb.net/wiki/index.php?title=D-rule&diff=8004&oldid=prevMartins: /* #PREFERRED AND #FINAL */2015-01-30T11:01:43Z<p><span class="autocomment">#PREFERRED AND #FINAL</span></p>
<table class='diff diff-contentalign-left'>
<col class='diff-marker' />
<col class='diff-content' />
<col class='diff-marker' />
<col class='diff-content' />
<tr valign='top'>
<td colspan='2' style="background-color: white; color:black;">← Older revision</td>
<td colspan='2' style="background-color: white; color:black;">Revision as of 11:01, 30 January 2015</td>
</tr><tr><td colspan="2" class="diff-lineno">Line 131:</td>
<td colspan="2" class="diff-lineno">Line 131:</td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>Note, in the above, that the options 1 and 2 are not tested because they are blocked. Note, also, that other candidates for the second string (i.e., where the second string is B2) are not tested, because B1 is #FINAL. So, if these two matches fail, the system starts re-segmenting the sentence.<br /></div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>Note, in the above, that the options 1 and 2 are not tested because they are blocked. Note, also, that other candidates for the second string (i.e., where the second string is B2) are not tested, because B1 is #FINAL. So, if these two matches fail, the system starts re-segmenting the sentence.<br /></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>At last, note that neither #PREFERRED nor #FINAL prevails over the default tokenization order IF NO BLOCKING RULE IS MATCHED, i.e., if the grammar was simply:</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>At last, note that neither #PREFERRED nor #FINAL prevails over the default tokenization order IF NO BLOCKING RULE IS MATCHED, i.e., if the grammar was simply:</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="background: #ffa; color:black; font-size: smaller;"><div>#<nowiki>("a")(<del class="diffchange diffchange-inline">B1</del>,#PREFERRED)=0;</nowiki> (alter the order of best matches)</div></td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div><ins class="diffchange diffchange-inline">#<nowiki>(A1)(B2)=0;</nowiki> (blocks the sequence of tokens with the features A1 and B1)</ins></div></td></tr>
<tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div>#<nowiki>("a")(<ins class="diffchange diffchange-inline">B2</ins>,#PREFERRED)=0;</nowiki> (alter the order of best matches)</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>or  </div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>or  </div></td></tr>
<tr><td class='diff-marker'>−</td><td style="background: #ffa; color:black; font-size: smaller;"><div>#<nowiki>(<del class="diffchange diffchange-inline">"a"</del>)(<del class="diffchange diffchange-inline">B1,#FINAL</del>)=0;</nowiki> (blocks <del class="diffchange diffchange-inline">other candidates for </del>the <del class="diffchange diffchange-inline">second node</del>)</div></td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div>#<nowiki>(<ins class="diffchange diffchange-inline">A1</ins>)(<ins class="diffchange diffchange-inline">B2</ins>)=0;</nowiki> (blocks the <ins class="diffchange diffchange-inline">sequence of tokens with the features A1 and B1</ins>)</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="background: #ffa; color:black; font-size: smaller;"><div><del class="diffchange diffchange-inline">i.e., without</del></div></td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div>#<nowiki>(<ins class="diffchange diffchange-inline">"a"</ins>)(<ins class="diffchange diffchange-inline">B2,#PREFERRED</ins>)=0;</nowiki> <ins class="diffchange diffchange-inline">(alter </ins>the <ins class="diffchange diffchange-inline">order of best matches)</ins></div></td></tr>
<tr><td class='diff-marker'>−</td><td style="background: #ffa; color:black; font-size: smaller;"><div>#<nowiki>(<del class="diffchange diffchange-inline">A1</del>)(<del class="diffchange diffchange-inline">B1</del>)=0;</nowiki></div></td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div></div></td></tr>
<tr><td class='diff-marker'>−</td><td style="background: #ffa; color:black; font-size: smaller;"><div>the <del class="diffchange diffchange-inline">final output would be:</del></div></td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A1][B1][C1]</nowiki>  </div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A1][B1][C1]</nowiki>  </div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>i.e., #FINAL and #PREFERRED only play a role when the default best match is blocked.</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>i.e., #FINAL and #PREFERRED only play a role when the default best match is blocked.</div></td></tr>
</table>Martinshttp://www.unlweb.net/wiki/index.php?title=D-rule&diff=8003&oldid=prevMartins: /* #PREFERRED AND #FINAL */2015-01-30T10:59:45Z<p><span class="autocomment">#PREFERRED AND #FINAL</span></p>
<table class='diff diff-contentalign-left'>
<col class='diff-marker' />
<col class='diff-content' />
<col class='diff-marker' />
<col class='diff-content' />
<tr valign='top'>
<td colspan='2' style="background-color: white; color:black;">← Older revision</td>
<td colspan='2' style="background-color: white; color:black;">Revision as of 10:59, 30 January 2015</td>
</tr><tr><td colspan="2" class="diff-lineno">Line 138:</td>
<td colspan="2" class="diff-lineno">Line 138:</td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>the final output would be:</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>the final output would be:</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A1][B1][C1]</nowiki>  </div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A1][B1][C1]</nowiki>  </div></td></tr>
<tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div><ins style="color: red; font-weight: bold; text-decoration: none;">i.e., #FINAL and #PREFERRED only play a role when the default best match is blocked.</ins></div></td></tr>
<tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div><ins style="color: red; font-weight: bold; text-decoration: none;"></ins></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>For a practical example in English, see below<ref></div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>For a practical example in English, see below<ref></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>Input string:</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>Input string:</div></td></tr>
</table>Martinshttp://www.unlweb.net/wiki/index.php?title=D-rule&diff=8002&oldid=prevMartins: /* #PREFERRED AND #FINAL */2015-01-30T10:58:40Z<p><span class="autocomment">#PREFERRED AND #FINAL</span></p>
<table class='diff diff-contentalign-left'>
<col class='diff-marker' />
<col class='diff-content' />
<col class='diff-marker' />
<col class='diff-content' />
<tr valign='top'>
<td colspan='2' style="background-color: white; color:black;">← Older revision</td>
<td colspan='2' style="background-color: white; color:black;">Revision as of 10:58, 30 January 2015</td>
</tr><tr><td colspan="2" class="diff-lineno">Line 130:</td>
<td colspan="2" class="diff-lineno">Line 130:</td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A2][B1][C2]</nowiki> (previously 6)</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A2][B1][C2]</nowiki> (previously 6)</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>Note, in the above, that the options 1 and 2 are not tested because they are blocked. Note, also, that other candidates for the second string (i.e., where the second string is B2) are not tested, because B1 is #FINAL. So, if these two matches fail, the system starts re-segmenting the sentence.<br /></div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>Note, in the above, that the options 1 and 2 are not tested because they are blocked. Note, also, that other candidates for the second string (i.e., where the second string is B2) are not tested, because B1 is #FINAL. So, if these two matches fail, the system starts re-segmenting the sentence.<br /></div></td></tr>
<tr><td class='diff-marker'>−</td><td style="background: #ffa; color:black; font-size: smaller;"><div>At last, note that neither #PREFERRED nor #FINAL prevails over the default tokenization order IF NO <del class="diffchange diffchange-inline">OTHER </del>BLOCKING RULE IS MATCHED, i.e., if the grammar was simply:</div></td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div>At last, note that neither #PREFERRED nor #FINAL prevails over the default tokenization order IF NO BLOCKING RULE IS MATCHED, i.e., if the grammar was simply:</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>("a")(B1,#PREFERRED)=0;</nowiki> (alter the order of best matches)</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>("a")(B1,#PREFERRED)=0;</nowiki> (alter the order of best matches)</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>or  </div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>or  </div></td></tr>
</table>Martinshttp://www.unlweb.net/wiki/index.php?title=D-rule&diff=8001&oldid=prevMartins: /* #PREFERRED AND #FINAL */2015-01-30T10:56:35Z<p><span class="autocomment">#PREFERRED AND #FINAL</span></p>
<table class='diff diff-contentalign-left'>
<col class='diff-marker' />
<col class='diff-content' />
<col class='diff-marker' />
<col class='diff-content' />
<tr valign='top'>
<td colspan='2' style="background-color: white; color:black;">← Older revision</td>
<td colspan='2' style="background-color: white; color:black;">Revision as of 10:56, 30 January 2015</td>
</tr><tr><td colspan="2" class="diff-lineno">Line 99:</td>
<td colspan="2" class="diff-lineno">Line 99:</td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>**<nowiki>[C]{}"c1"(C1)<,,>;</nowiki></div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>**<nowiki>[C]{}"c1"(C1)<,,>;</nowiki></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>**<nowiki>[C]{}"c2"(C2)<,,>;</nowiki></div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>**<nowiki>[C]{}"c2"(C2)<,,>;</nowiki></div></td></tr>
<tr><td class='diff-marker'>−</td><td style="background: #ffa; color:black; font-size: smaller;"><div>According to the default order (left to right), the tokenization will try the following alternatives (in this specific order)<del class="diffchange diffchange-inline">, if no disambiguation rule is provided</del>:</div></td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div>According to the default order (left to right), the tokenization will try the following alternatives (in this specific order):</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A1][B1][C1]</nowiki>  </div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A1][B1][C1]</nowiki>  </div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A1][B1][C2]</nowiki>  </div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A1][B1][C2]</nowiki>  </div></td></tr>
</table>Martinshttp://www.unlweb.net/wiki/index.php?title=D-rule&diff=8000&oldid=prevMartins: /* #PREFERRED AND #FINAL */2015-01-30T10:56:14Z<p><span class="autocomment">#PREFERRED AND #FINAL</span></p>
<table class='diff diff-contentalign-left'>
<col class='diff-marker' />
<col class='diff-content' />
<col class='diff-marker' />
<col class='diff-content' />
<tr valign='top'>
<td colspan='2' style="background-color: white; color:black;">← Older revision</td>
<td colspan='2' style="background-color: white; color:black;">Revision as of 10:56, 30 January 2015</td>
</tr><tr><td colspan="2" class="diff-lineno">Line 99:</td>
<td colspan="2" class="diff-lineno">Line 99:</td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>**<nowiki>[C]{}"c1"(C1)<,,>;</nowiki></div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>**<nowiki>[C]{}"c1"(C1)<,,>;</nowiki></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>**<nowiki>[C]{}"c2"(C2)<,,>;</nowiki></div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>**<nowiki>[C]{}"c2"(C2)<,,>;</nowiki></div></td></tr>
<tr><td class='diff-marker'>−</td><td style="background: #ffa; color:black; font-size: smaller;"><div>According to the default order (left to right), the tokenization will try the following alternatives (in <del class="diffchange diffchange-inline">that </del>specific order), if no disambiguation rule is provided:</div></td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div>According to the default order (left to right), the tokenization will try the following alternatives (in <ins class="diffchange diffchange-inline">this </ins>specific order), if no disambiguation rule is provided:</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A1][B1][C1]</nowiki>  </div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A1][B1][C1]</nowiki>  </div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A1][B1][C2]</nowiki>  </div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A1][B1][C2]</nowiki>  </div></td></tr>
</table>Martinshttp://www.unlweb.net/wiki/index.php?title=D-rule&diff=7999&oldid=prevMartins: /* #PREFERRED AND #FINAL */2015-01-30T10:38:15Z<p><span class="autocomment">#PREFERRED AND #FINAL</span></p>
<table class='diff diff-contentalign-left'>
<col class='diff-marker' />
<col class='diff-content' />
<col class='diff-marker' />
<col class='diff-content' />
<tr valign='top'>
<td colspan='2' style="background-color: white; color:black;">← Older revision</td>
<td colspan='2' style="background-color: white; color:black;">Revision as of 10:38, 30 January 2015</td>
</tr><tr><td colspan="2" class="diff-lineno">Line 129:</td>
<td colspan="2" class="diff-lineno">Line 129:</td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A2][B1][C1]</nowiki> (previously 5)</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A2][B1][C1]</nowiki> (previously 5)</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A2][B1][C2]</nowiki> (previously 6)</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>[A2][B1][C2]</nowiki> (previously 6)</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="background: #ffa; color:black; font-size: smaller;"><div>Note, in the above, that the options 1 and 2 are not tested because they are blocked. Note, also, that other candidates for the second string (i.e., where the second string is B2) are not tested, because B1 is #FINAL. So, if these two matches fail, the system starts re-segmenting the sentence.  </div></td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div>Note, in the above, that the options 1 and 2 are not tested because they are blocked. Note, also, that other candidates for the second string (i.e., where the second string is B2) are not tested, because B1 is #FINAL. So, if these two matches fail, the system starts re-segmenting the sentence.<ins class="diffchange diffchange-inline"><br /></ins></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>At last, note that neither #PREFERRED nor #FINAL prevails over the default tokenization order IF NO OTHER BLOCKING RULE IS MATCHED, i.e., if the grammar was simply:</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>At last, note that neither #PREFERRED nor #FINAL prevails over the default tokenization order IF NO OTHER BLOCKING RULE IS MATCHED, i.e., if the grammar was simply:</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>("a")(B1,#PREFERRED)=0;</nowiki> (alter the order of best matches)</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>("a")(B1,#PREFERRED)=0;</nowiki> (alter the order of best matches)</div></td></tr>
</table>Martinshttp://www.unlweb.net/wiki/index.php?title=D-rule&diff=7998&oldid=prevMartins: /* #PREFERRED AND #FINAL */2015-01-30T10:37:33Z<p><span class="autocomment">#PREFERRED AND #FINAL</span></p>
<table class='diff diff-contentalign-left'>
<col class='diff-marker' />
<col class='diff-content' />
<col class='diff-marker' />
<col class='diff-content' />
<tr valign='top'>
<td colspan='2' style="background-color: white; color:black;">← Older revision</td>
<td colspan='2' style="background-color: white; color:black;">Revision as of 10:37, 30 January 2015</td>
</tr><tr><td colspan="2" class="diff-lineno">Line 131:</td>
<td colspan="2" class="diff-lineno">Line 131:</td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>Note, in the above, that the options 1 and 2 are not tested because they are blocked. Note, also, that other candidates for the second string (i.e., where the second string is B2) are not tested, because B1 is #FINAL. So, if these two matches fail, the system starts re-segmenting the sentence.  </div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>Note, in the above, that the options 1 and 2 are not tested because they are blocked. Note, also, that other candidates for the second string (i.e., where the second string is B2) are not tested, because B1 is #FINAL. So, if these two matches fail, the system starts re-segmenting the sentence.  </div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>At last, note that neither #PREFERRED nor #FINAL prevails over the default tokenization order IF NO OTHER BLOCKING RULE IS MATCHED, i.e., if the grammar was simply:</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>At last, note that neither #PREFERRED nor #FINAL prevails over the default tokenization order IF NO OTHER BLOCKING RULE IS MATCHED, i.e., if the grammar was simply:</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="background: #ffa; color:black; font-size: smaller;"><div>#<nowiki>("a")(B1,#PREFERRED)=0;<nowiki> (alter the order of best matches)</div></td><td class='diff-marker'>+</td><td style="background: #cfc; color:black; font-size: smaller;"><div>#<nowiki>("a")(B1,#PREFERRED)=0;<<ins class="diffchange diffchange-inline">/</ins>nowiki> (alter the order of best matches)</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>or  </div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>or  </div></td></tr>
<tr><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>("a")(B1,#FINAL)=0;</nowiki> (blocks other candidates for the second node)</div></td><td class='diff-marker'> </td><td style="background: #eee; color:black; font-size: smaller;"><div>#<nowiki>("a")(B1,#FINAL)=0;</nowiki> (blocks other candidates for the second node)</div></td></tr>
</table>Martins