Adapt collation in several locales to the new iso14651_t1_common file

[BZ #22550] - es_ES locale (and other es_* locales): collation should
treat ñ as a primary different character, sync the collation
for Spanish with CLDR
[BZ #21547] - Tibetan script collation broken (Dzongkha and Tibetan)

	* localedata/Makefile: Add new test files.
	* localedata/lv_LV.UTF-8.in: Adapt test file to new collation order.
	* localedata/sv_SE.ISO-8859-1.in: Adapt test file to new collation order.
	* localedata/uk_UA.UTF-8.in: Adapt test file to new collation order.
	* localedata/am_ET.UTF-8.in: New test file.
	* localedata/az_AZ.UTF-8.in: Likewise.
	* localedata/be_BY.UTF-8.in: Likewise.
	* localedata/ber_DZ.UTF-8.in: Likewise.
	* localedata/ber_MA.UTF-8.in: Likewise.
	* localedata/bg_BG.UTF-8.in: Likewise.
	* localedata/br_FR.UTF-8.in: Likewise.
	* localedata/cmn_TW.UTF-8.in: Likewise.
	* localedata/crh_UA.UTF-8.in: Likewise.
	* localedata/csb_PL.UTF-8.in: Likewise.
	* localedata/cv_RU.UTF-8.in: Likewise.
	* localedata/cy_GB.UTF-8.in: Likewise.
	* localedata/dz_BT.UTF-8.in: Likewise.
	* localedata/eo.UTF-8.in: Likewise.
	* localedata/es_ES.UTF-8.in: Likewise.
	* localedata/fa_IR.UTF-8.in: Likewise.
	* localedata/fi_FI.UTF-8.in: Likewise.
	* localedata/fil_PH.UTF-8.in: Likewise.
	* localedata/fur_IT.UTF-8.in: Likewise.
	* localedata/gez_ER.UTF-8@abegede.in: Likewise.
	* localedata/ha_NG.UTF-8.in: Likewise.
	* localedata/ig_NG.UTF-8.in: Likewise.
	* localedata/ik_CA.UTF-8.in: Likewise.
	* localedata/kk_KZ.UTF-8.in: Likewise.
	* localedata/ku_TR.UTF-8.in: Likewise.
	* localedata/ky_KG.UTF-8.in: Likewise.
	* localedata/ln_CD.UTF-8.in: Likewise.
	* localedata/mi_NZ.UTF-8.in: Likewise.
	* localedata/ml_IN.UTF-8.in: Likewise.
	* localedata/mn_MN.UTF-8.in: Likewise.
	* localedata/mr_IN.UTF-8.in: Likewise.
	* localedata/mt_MT.UTF-8.in: Likewise.
	* localedata/nb_NO.UTF-8.in: Likewise.
	* localedata/om_KE.UTF-8.in: Likewise.
	* localedata/os_RU.UTF-8.in: Likewise.
	* localedata/ps_AF.UTF-8.in: Likewise.
	* localedata/ro_RO.UTF-8.in: Likewise.
	* localedata/ru_RU.UTF-8.in: Likewise.
	* localedata/sc_IT.UTF-8.in: Likewise.
	* localedata/se_NO.UTF-8.in: Likewise.
	* localedata/sq_AL.UTF-8.in: Likewise.
	* localedata/sv_SE.UTF-8.in: Likewise.
	* localedata/szl_PL.UTF-8.in: Likewise.
	* localedata/tg_TJ.UTF-8.in: Likewise.
	* localedata/tk_TM.UTF-8.in: Likewise.
	* localedata/tt_RU.UTF-8.in: Likewise.
	* localedata/tt_RU.UTF-8@iqtelif.in: Likewise.
	* localedata/ug_CN.UTF-8.in: Likewise.
	* localedata/uz_UZ.UTF-8.in: Likewise.
	* localedata/vi_VN.UTF-8.in: Likewise.
	* localedata/yi_US.UTF-8.in: Likewise.
	* localedata/yo_NG.UTF-8.in: Likewise.
	* localedata/zh_CN.UTF-8.in: Likewise.
	* localedata/locales/am_ET: Adapt collation rules to new iso14651_t1_common
        file and fix bugs in the collation.
	* localedata/locales/az_AZ: Likewise.
	* localedata/locales/be_BY: Likewise.
	* localedata/locales/ber_DZ: Likewise.
	* localedata/locales/ber_MA: Likewise.
	* localedata/locales/bg_BG: Likewise.
	* localedata/locales/br_FR: Likewise.
	* localedata/locales/br_FR@euro: Likewise.
	* localedata/locales/ca_ES: Likewise.
	* localedata/locales/cns11643_stroke: Likewise.
	* localedata/locales/crh_UA: Likewise.
	* localedata/locales/cs_CZ: Likewise.
	* localedata/locales/csb_PL: Likewise.
	* localedata/locales/cv_RU: Likewise.
	* localedata/locales/cy_GB: Likewise.
	* localedata/locales/da_DK: Likewise.
	* localedata/locales/dz_BT: Likewise.
	* localedata/locales/en_CA: Likewise.
	* localedata/locales/eo: Likewise.
	* localedata/locales/es_CU: Likewise.
	* localedata/locales/es_EC: Likewise.
	* localedata/locales/es_ES: Likewise.
	* localedata/locales/es_US: Likewise.
	* localedata/locales/et_EE: Likewise.
	* localedata/locales/fa_IR: Likewise.
	* localedata/locales/fi_FI: Likewise.
	* localedata/locales/fil_PH: Likewise.
	* localedata/locales/fur_IT: Likewise.
	* localedata/locales/gez_ER@abegede: Likewise.
	* localedata/locales/ha_NG: Likewise.
	* localedata/locales/hr_HR: Likewise.
	* localedata/locales/hsb_DE: Likewise.
	* localedata/locales/hu_HU: Likewise.
	* localedata/locales/ig_NG: Likewise.
	* localedata/locales/ik_CA: Likewise.
	* localedata/locales/is_IS: Likewise.
	* localedata/locales/iso14651_t1_pinyin: Likewise.
	* localedata/locales/kk_KZ: Likewise.
	* localedata/locales/ku_TR: Likewise.
	* localedata/locales/ky_KG: Likewise.
	* localedata/locales/ln_CD: Likewise.
	* localedata/locales/lt_LT: Likewise.
	* localedata/locales/lv_LV: Likewise.
	* localedata/locales/mi_NZ: Likewise.
	* localedata/locales/ml_IN: Likewise.
	* localedata/locales/mn_MN: Likewise.
	* localedata/locales/mr_IN: Likewise.
	* localedata/locales/mt_MT: Likewise.
	* localedata/locales/nb_NO: Likewise.
	* localedata/locales/om_KE: Likewise.
	* localedata/locales/os_RU: Likewise.
	* localedata/locales/pl_PL: Likewise.
	* localedata/locales/ps_AF: Likewise.
	* localedata/locales/ro_RO: Likewise.
	* localedata/locales/ru_RU: Likewise.
	* localedata/locales/ru_UA: Likewise.
	* localedata/locales/sc_IT: Likewise.
	* localedata/locales/se_NO: Likewise.
	* localedata/locales/si_LK: Likewise.
	* localedata/locales/sq_AL: Likewise.
	* localedata/locales/sv_FI: Likewise.
	* localedata/locales/sv_FI@euro: Likewise.
	* localedata/locales/sv_SE: Likewise.
	* localedata/locales/szl_PL: Likewise.
	* localedata/locales/tg_TJ: Likewise.
	* localedata/locales/ti_ER: Likewise.
	* localedata/locales/tk_TM: Likewise.
	* localedata/locales/tl_PH: Likewise.
	* localedata/locales/tr_TR: Likewise.
	* localedata/locales/tt_RU: Likewise.
	* localedata/locales/tt_RU@iqtelif: Likewise.
	* localedata/locales/ug_CN: Likewise.
	* localedata/locales/uk_UA: Likewise.
	* localedata/locales/uz_UZ: Likewise.
	* localedata/locales/uz_UZ@cyrillic: Likewise.
	* localedata/locales/vi_VN: Likewise.
	* localedata/locales/yi_US: Likewise.
	* localedata/locales/yo_NG: Likewise.

1 files changed, 90 insertions, 154 deletions

diff --git a/localedata/locales/tt_RU b/localedata/locales/tt_RU
index cc3cb8f263..b3b79b2ec2 100644
--- a/localedata/locales/tt_RU
+++ b/localedata/locales/tt_RU
@@ -63,167 +63,103 @@ END LC_CTYPE
 
 LC_COLLATE
 
-% The new (2000) latin tatar alphabet is:
-% a, sw, b, c, c,, d, e, f, g, g(, h, i (dotless i),
-% i. (i with dot), j, k, q, l, m, n, ng, o, o--, p, r, s, s,,
-% t, u, u:, v, w, x, y, z
-% <U0430>,<U04D9>,<U0431>,<U04B9>,<U0447>,<U0434>,<U0435>,<U0444>,<U049D>,<U0493>,<U04BB>,
-% <U044B>,             <U0438>,             <U0436>,<U043A>,<U0433>,<U043B>,<U043C>,<U043D>,<U04A3>,
-% <U043E>,<U04E9>,<U043F>,<U0440>,<U0441>,<U0448>,<U0442>,<U0443>,<U04AF>,<U0432>,???, <U0445>,<U0458>,<U0437>
+% There is no collation information for Tatar in CLDR.
 %
-% However, a commonly used alphabet in internet uses <U00E4>, <U00F6> and <U00F1>
-% for respectively <U0259>, <U0275> and <U014B>
+% Therefore, I use this:
+%
+% https://en.wikipedia.org/wiki/Tatar_language#Writing_system
+%
+% Tatar Cyrillic alphabet (letter order adopted in 1997):
+%
+% А а  Ә ә  Б б  В в  Г г  Д д  Е е  Ё ё
+% Ж ж  Җ җ  З з  И и  Й й  К к  Л л  М м
+% Н н  Ң ң  О о  Ө ө  П п  Р р  С с  Т т
+% У у  Ү ү  Ф ф  Х х  Һ һ  Ц ц  Ч ч  Ш ш
+% Щ щ  Ъ ъ  Ы ы  Ь ь  Э э  Ю ю  Я я
+%
+% 1999 Tatar Latin alphabet, made official by a law adopted by
+% Tatarstani authorities but annulled by the Tatar Supreme Court in 2004:[16]
+%
+% A a  Ə ə  B b  C c  Ç ç  D d  E e  F f
+% G g  Ğ ğ  H h  I ı  İ i  J j  K k  Q q
+% L l  M m  N n  Ꞑ ꞑ  O o  Ɵ ɵ  P p  R r
+% S s  Ş ş  T t  U u  Ü ü  V v  W w  X x
+% Y y  Z z  ’
+%
+% However, a commonly used alphabet in internet uses ä, ö and ñ
+% for respectively ə, ɵ and ŋ
 
 copy "iso14651_t1"
 
-collating-symbol <sw>
-collating-symbol <c,>
-collating-symbol <g(>
-collating-symbol <i.>
-collating-symbol <ng>
-collating-symbol <o-->
-collating-symbol <s,>
-collating-symbol <u:>
-
-collating-symbol <g-=>
-collating-symbol <sw=>
-collating-symbol <k//=>
-collating-symbol <o-=>
-collating-symbol <u'=>
-collating-symbol <h'=>
-collating-symbol <c%//=>
-collating-symbol <n,=>
-
-reorder-after <a>
-<sw>
-reorder-after <c>
-<c,>
-reorder-after <g>
-<g(>
-reorder-after <h>
-<i>
-<i.>
-<j>
-<k>
-<q>
-reorder-after <n>
-<ng>
-reorder-after <o>
-<o-->
-reorder-after <s>
-<s,>
-reorder-after <u>
-<u:>
-
-% FIXME: check order of cyrillic letters (I copied from cyr Azeri)
-reorder-after <CYR-GHE>
-<g-=>
-reorder-after <CYR-IE>
-<sw=>
-reorder-after <CYR-KA>
-<k//=>
-reorder-after <CYR-EN>
-<n,=>
-reorder-after <CYR-O>
-<o-=>
-reorder-after <CYR-OUBRE>
-<u'=>
-reorder-after <CYR-HA>
-<h'=>
-reorder-after <CYR-CHE>
-<c%//=>
-
-reorder-after <U0061>
-<U0259> <sw>;<PCL>;<MIN>;IGNORE
-<U00E4> <sw>;<REU>;<MIN>;IGNORE
-reorder-after <U0041>
-<U018F> <sw>;<PCL>;<CAP>;IGNORE
-<U00C4> <sw>;<REU>;<CAP>;IGNORE
-
-reorder-after <U0063>
-<U00E7> <c,>;<CDI>;<MIN>;IGNORE
-reorder-after <U0043>
-<U00C7> <c,>;<CDI>;<CAP>;IGNORE
-
-reorder-after <U0067>
-<U011F> <g(>;<BRE>;<MIN>;IGNORE
-reorder-after <U0047>
-<U011E> <g(>;<BRE>;<CAP>;IGNORE
-
-reorder-after <U0068>
-<U0131> <i>;<BAS>;<MIN>;IGNORE
-<U0069> <i.>;<PCT>;<MIN>;IGNORE
-reorder-after <U0048>
-<U0049> <i>;<BAS>;<CAP>;IGNORE
-<U0130> <i.>;<PCT>;<CAP>;IGNORE
-
-reorder-after <U006E>
-<U014B> <ng>;<PCL>;<MIN>;IGNORE
-<U00F1> <ng>;<TIL>;<MIN>;IGNORE
-reorder-after <U004E>
-<U014A> <ng>;<PCL>;<CAP>;IGNORE
-<U00D1> <ng>;<TIL>;<CAP>;IGNORE
-
-reorder-after <U006F>
-<U0275> <o-->;<REU>;<MIN>;IGNORE
-<U00F6> <o-->;<REU>;<MIN>;IGNORE
-reorder-after <U004F>
-<U019F> <o-->;<REU>;<CAP>;IGNORE
-<U00D6> <o-->;<REU>;<CAP>;IGNORE
-
-reorder-after <U0073>
-<U015F> <s,>;<CDI>;<MIN>;IGNORE
-reorder-after <U0053>
-<U015E> <s,>;<CDI>;<CAP>;IGNORE
-
-reorder-after <U0075>
-<U00FC> <u:>;<REU>;<MIN>;IGNORE
-reorder-after <U0055>
-<U00DC> <u:>;<REU>;<CAP>;IGNORE
-
-reorder-after <U0433>
-<U0493> <g-=>;<PCL>;<MIN>;IGNORE
-reorder-after <U0413>
-<U0492> <g-=>;<PCL>;<CAP>;IGNORE
-
-reorder-after <U0435>
-<U04D9> <sw=>;<PCL>;<MIN>;IGNORE
-reorder-after <U0415>
-<U04D8> <sw=>;<PCL>;<CAP>;IGNORE
-
-reorder-after <U043A>
-<U049D> <k//=>;<PCL>;<MIN>;IGNORE
-reorder-after <U041A>
-<U049C> <k//=>;<PCL>;<CAP>;IGNORE
-
-reorder-after <U043D>
-<U04A3> <n,=>;<PCL>;<MIN>;IGNORE
-reorder-after <U041D>
-<U04A2> <n,=>;<PCL>;<CAP>;IGNORE
-
-reorder-after <U043E>
-<U04E9> <o-=>;<PCL>;<MIN>;IGNORE
-reorder-after <U041E>
-<U04E8> <o-=>;<PCL>;<CAP>;IGNORE
-
-reorder-after <U0443>
-<U04AF> <u'=>;<PCL>;<MIN>;IGNORE
-reorder-after <U0423>
-<U04AE> <u'=>;<PCL>;<CAP>;IGNORE
-
-reorder-after <U0445>
-<U04BB> <h'=>;<PCL>;<MIN>;IGNORE
-reorder-after <U0425>
-<U04BA> <h'=>;<PCL>;<CAP>;IGNORE
-
-reorder-after <U0447>
-<U04B9> <c%//=>;<PCL>;<MIN>;IGNORE
-reorder-after <U0427>
-<U04B8> <c%//=>;<PCL>;<CAP>;IGNORE
+collating-symbol <latin-schwa>
+collating-symbol <latin-c-cedilla>
+collating-symbol <latin-g-breve>
+collating-symbol <latin-i-dotless>
+collating-symbol <latin-i-dot>
+collating-symbol <latin-n-descender>
+collating-symbol <latin-o-barred>
+collating-symbol <latin-s-cedilla>
+collating-symbol <latin-u-diaeresis>
+collating-symbol <right-single-quotation-mark>
+collating-symbol <cyrillic-small-io>
+
+reorder-after <AFTER-A>
+<latin-schwa>
+reorder-after <AFTER-C>
+<latin-c-cedilla>
+reorder-after <AFTER-G>
+<latin-g-breve>
+reorder-after <AFTER-H>
+<latin-i-dotless>
+<latin-i-dot>
+reorder-after <AFTER-K>
+<S0071> % LATIN SMALL LETTER Q
+reorder-after <AFTER-N>
+<latin-n-descender>
+reorder-after <AFTER-O>
+<latin-o-barred>
+reorder-after <AFTER-S>
+<latin-s-cedilla>
+reorder-after <AFTER-U>
+<latin-u-diaeresis>
+reorder-after <AFTER-Z>
+<right-single-quotation-mark>
+
+reorder-after <S0435> % CYRILLIC SMALL LETTER IE
+<cyrillic-small-io>
+
+<U0259>                 <latin-schwa>;"<BASE><BASE>";"<MIN><MIN>";IGNORE % ə
+<U018F>                 <latin-schwa>;"<BASE><BASE>";"<CAP><MIN>";IGNORE % Ə
+<U00E4>                 <latin-schwa>;"<BASE><VRNT1>";"<MIN><MIN>";IGNORE % ä
+<U00C4>                 <latin-schwa>;"<BASE><VRNT1>";"<CAP><MIN>";IGNORE % Ä
+<U00E7>             <latin-c-cedilla>;"<BASE><BASE>";"<MIN><MIN>";IGNORE % ç
+<U00C7>             <latin-c-cedilla>;"<BASE><BASE>";"<CAP><MIN>";IGNORE % Ç
+<U011F>               <latin-g-breve>;"<BASE><BASE>";"<MIN><MIN>";IGNORE % ğ
+<U011E>               <latin-g-breve>;"<BASE><BASE>";"<CAP><MIN>";IGNORE % Ğ
+<U0131>             <latin-i-dotless>;"<BASE><BASE>";"<MIN><MIN>";IGNORE % ı
+<U0049>             <latin-i-dotless>;"<BASE><BASE>";"<CAP><MIN>";IGNORE % I
+<U0069>                 <latin-i-dot>;"<BASE><BASE>";"<MIN><MIN>";IGNORE % i
+<U0130>                 <latin-i-dot>;"<BASE><BASE>";"<CAP><MIN>";IGNORE % İ
+<UA791>           <latin-n-descender>;"<BASE><BASE>";"<MIN><MIN>";IGNORE % ꞑ
+<UA790>           <latin-n-descender>;"<BASE><BASE>";"<CAP><MIN>";IGNORE % Ꞑ
+<U00F1>           <latin-n-descender>;"<BASE><VRNT1>";"<MIN><MIN>";IGNORE % ñ
+<U00D1>           <latin-n-descender>;"<BASE><VRNT1>";"<CAP><MIN>";IGNORE % Ñ
+<U014B>           <latin-n-descender>;"<BASE><VRNT2>";"<MIN><MIN>";IGNORE % ŋ
+<U014A>           <latin-n-descender>;"<BASE><VRNT2>";"<CAP><MIN>";IGNORE % Ŋ
+<U0275>              <latin-o-barred>;"<BASE><BASE>";"<MIN><MIN>";IGNORE % ɵ
+<U019F>              <latin-o-barred>;"<BASE><BASE>";"<CAP><MIN>";IGNORE % Ɵ
+<U00F6>              <latin-o-barred>;"<BASE><VRNT1>";"<MIN><MIN>";IGNORE % ö
+<U00D6>              <latin-o-barred>;"<BASE><VRNT1>";"<CAP><MIN>";IGNORE % Ö
+<U015F>             <latin-s-cedilla>;"<BASE><BASE>";"<MIN><MIN>";IGNORE % ş
+<U015E>             <latin-s-cedilla>;"<BASE><BASE>";"<CAP><MIN>";IGNORE % Ş
+<U00FC>           <latin-u-diaeresis>;"<BASE><BASE>";"<MIN><MIN>";IGNORE % ü
+<U00DC>           <latin-u-diaeresis>;"<BASE><BASE>";"<CAP><MIN>";IGNORE % Ü
+<U2019> <right-single-quotation-mark>;"<BASE><BASE>";"<MIN><MIN>";IGNORE % ’
+<U0451>           <cyrillic-small-io>;"<BASE><BASE>";"<MIN><MIN>";IGNORE % ё
+<U0401>           <cyrillic-small-io>;"<BASE><BASE>";"<CAP><MIN>";IGNORE % Ё
 
 reorder-end
 
-
 END LC_COLLATE
 
 LC_MESSAGES