Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Settings #18

Open
wants to merge 4 commits into
base: master
Choose a base branch
from
Open

Settings #18

wants to merge 4 commits into from

Conversation

lucafavatella
Copy link

Following #17 (comment)
this PR rebases the settings branch on master
including settings normalization and strength (each with unit tests)
and keeping out backwards - for lack of tests.

lucafavatella and others added 4 commits October 24, 2017 10:22
Extracted from [`settings`
branch](jtauber@cf393b8)
by James Tauber.
Extracted - with amendments and integrations - from `settings` branch
by James Tauber:
* Settings initialization:
  * Commit ["beginnings of settings capability"](jtauber@cf393b8);
  * Commit ["support for strength setting"](jtauber@fb87e92).
* Documentation:
  * Commit ["initial settings documentation"](jtauber@8bd6a8c).
* `normalization` setting:
  * Commit "support for normalization setting"](jtauber@6187dd5).

Normalization test taken from UCA 5.2.0 conformance tests:
```
CollationTest/5.2.0/CollationTest_NON_IGNORABLE.txt:312:0332 0334;      # ...
```
Extracted - with minor amendments in tests - from `settings` branch by
James Tauber:
* Code:
  * Commit ["support for strength setting"](jtauber@fb87e92).
* Documentation:
  * Commit ["initial settings documentation"](jtauber@8bd6a8c).

----

Wrt the amended tests:

According to [the algorithm for computing the sort
key](https://www.unicode.org/reports/tr10/tr10-36.html#Step_3), the
sort key does not have to end with a level separator.  See also the
following examples:
* https://www.unicode.org/reports/tr10/tr10-36.html#Array_To_Sort_Key_Table
* https://www.unicode.org/reports/tr10/tr10-36.html#Comparison_Of_Sort_Keys_Table

However [the conformance
tests](https://www.unicode.org/Public/UCA/10.0.0/CollationTest.html)
include in (non-normative) comments "a representation of the sort key"
always ending with "|]" where the vertical bar stands for "the ZERO
separator".

Do not append a final unnecessary level separator.
@jtauber
Copy link
Owner

jtauber commented Oct 25, 2017

@lucafavatella thank you! I will get to all this later in the week

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants