ISO_IEC_14651_2020E.pdf

Information technology International string ordering and comparison Method for comparing character strings and description of the common template tailorable orderingTechnologies de linformation Classement international et comparaison de chanes de caractres Mthode de comparaison de chanes de caractres et description du modle commun et adaptable dordre de classement ISO/IEC 2020INTERNATIONAL STANDARDISO/IEC14651Reference numberISO/IEC 14651:2020(E)Sixth edition2020-12 ISO/IEC 14651:2020(E)ii ISO/IEC 2020 All rights reservedCOPYRIGHT PROTECTED DOCUMENT ISO/IEC 2020All rights reserved.Unless otherwise specified,or required in the context of its implementation,no part of this publication may be reproduced or utilized otherwise in any form or by any means,electronic or mechanical,including photocopying,or posting on the internet or an intranet,without prior written permission.Permission can be requested from either ISO at the address below or ISOs member body in the country of the requester.ISO copyright officeCP 401 Ch.de Blandonnet 8CH-1214 Vernier,GenevaPhone:+41 22 749 01 11Email:copyrightiso.orgWebsite:www.iso.orgPublished in Switzerland ISO/IEC 14651:2020(E)Foreword.ivIntroduction.v1 Scope.12 Normative references.23Termsanddefinitions.24 Symbols and conventions.35 Conformance.36 String comparison.46.1 Preparation of character strings prior to comparison.46.2 Key building and comparison.56.2.1 Preliminary considerations.56.2.2 Reference ordering key formation.66.2.3 Reference comparison method for ordering character strings.86.2.4 Key ordering definition.96.3 Common Template Table:Formation and interpretation.106.3.1 General.106.3.2 BNF syntax rules for the Common Template Table in Annex A.106.3.3 Well-formedness conditions.126.3.4 Interpretation of tailored tables.136.3.5 Evaluation of weight tables.156.3.6 Conditions for considering specific table equivalences.156.3.7 Conditions for results to be considered equivalent.156.4 Declaration of a delta.156.5 Name of the Common Template Table and name declaration.17Annex A(normative)Common Template Table.18Annex B(informative)Example tailoring deltas.20Annex C(informative)Preparation.29Annex D(informative)Tutorial on solutions brought by this document to problems of lexical ordering.45Annex E(informative)Searching and fuzzy matches.49Bibliography.51 ISO/IEC 2020 All rights reserved iiiContents Page ISO/IEC 14651:2020(E)ForewordISO(the International Organization for Standardization)and IEC(the International Electrotechnical Commission)form the specialized system for worldwide standardization.National bodies that are members of ISO or IEC participate in the development of International Standards through technical committees established by the respective organization to deal with particular fields of technical activity.ISO and IEC technical committees collaborate in fields of mutual interest.Other international organizations,governmental and non-governmental,in liaison with ISO and IEC,also take part in the work.The procedures used to develop this document and those intended for its further maintenance are described in the ISO/IEC Directives,Part 1.In particular,the different approval criteria needed for the different types of document should be noted.This document was drafted in accordance with the editorial rules of the ISO/IEC Directives,Part 2(see www.iso.org/directives).Attention is drawn to the possibility that some of the elements of this document may be the subject of patent rights.ISO and IEC shall not be held responsible for identifying any or all such patent rights.Details of any patent rights identified during the development of the document will be in the Introduction and/or on the ISO list of patent declarations received(see www.iso.org/patents)or the IEC list of patent declarations received(see patents.iec.ch).Any trade name used in this document is information given for the convenience of users and does not constitute an endorsement.For an explanation of the voluntary nature of standards,the meaning of ISO specific terms and expressions related to conformity assessment,as well as information about ISOs adherence to the World Trade Organization(WTO)principles in the Technical Barriers to Trade(TBT),see www.iso.org/iso/foreword.html.This document was prepared by Technical Committee ISO/IEC JTC 1,Information technology,Subcommittee SC 2,Coded character sets.This sixth edition cancels and replaces the fifth edition(ISO/IEC 14651:2019),which has been technically revised.The main changes compared to the previous edition are as follows:ordering data has been added for the new characters standardized in the sixth edition of ISO/IEC 10646(2020);the content of 6.2.2 has been revised for more completeness;the weights of character U+A9B5(JAVANESE VOWEL SIGN TOLONG)have been changed,as the latter is considered a variant of character U+A9B4(JAVANESE VOWEL SIGN TARUNG).This needed to be fixed.Any feedback or questions on this document should be directed to the user