1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
1001
1002
1003
1004
1005
1006
1007
1008
1009
1010
1011
1012
1013
1014
1015
1016
1017
1018
1019
1020
1021
1022
1023
1024
1025
1026
1027
1028
1029
1030
1031
1032
1033
1034
1035
1036
1037
1038
1039
1040
1041
1042
1043
1044
1045
1046
1047
1048
1049
1050
1051
1052
1053
1054
1055
1056
1057
1058
1059
1060
1061
1062
1063
1064
1065
1066
1067
1068
1069
1070
1071
1072
1073
1074
1075
1076
1077
1078
1079
1080
1081
1082
1083
1084
1085
1086
1087
1088
1089
1090
1091
1092
1093
1094
1095
1096
1097
1098
1099
1100
1101
1102
1103
1104
1105
1106
1107
1108
1109
1110
1111
1112
1113
1114
1115
1116
1117
1118
1119
1120
1121
1122
1123
1124
1125
1126
1127
1128
1129
1130
1131
1132
1133
1134
1135
1136
1137
1138
1139
1140
1141
1142
1143
1144
1145
1146
1147
1148
1149
1150
1151
1152
1153
1154
1155
1156
1157
1158
1159
1160
1161
1162
1163
1164
1165
1166
1167
1168
1169
1170
1171
1172
1173
1174
1175
1176
1177
1178
1179
1180
1181
1182
1183
1184
1185
1186
1187
1188
1189
1190
1191
1192
1193
1194
1195
1196
1197
1198
1199
1200
1201
1202
1203
1204
1205
1206
1207
1208
1209
1210
1211
1212
1213
1214
1215
1216
1217
1218
1219
1220
1221
1222
1223
1224
1225
1226
1227
1228
1229
1230
1231
1232
1233
1234
1235
1236
1237
1238
1239
1240
1241
1242
1243
1244
1245
1246
1247
1248
1249
1250
1251
1252
1253
1254
1255
1256
1257
1258
1259
1260
1261
1262
1263
1264
1265
1266
1267
1268
1269
1270
1271
1272
1273
1274
1275
1276
1277
1278
1279
1280
1281
1282
1283
1284
1285
1286
1287
1288
1289
1290
1291
1292
1293
1294
1295
1296
1297
1298
1299
1300
1301
1302
1303
1304
1305
1306
1307
1308
1309
1310
1311
1312
1313
1314
1315
1316
1317
1318
1319
1320
1321
1322
1323
1324
1325
1326
1327
1328
1329
1330
1331
1332
1333
1334
1335
1336
1337
1338
1339
1340
1341
1342
1343
1344
1345
1346
1347
1348
1349
1350
1351
1352
1353
1354
1355
1356
1357
1358
1359
1360
1361
1362
1363
1364
1365
1366
1367
1368
1369
1370
1371
1372
1373
1374
1375
1376
1377
1378
1379
1380
1381
1382
1383
1384
1385
1386
1387
1388
1389
1390
1391
1392
1393
1394
1395
1396
1397
1398
1399
1400
1401
1402
1403
1404
1405
1406
1407
1408
1409
1410
1411
1412
1413
1414
1415
1416
1417
1418
1419
1420
1421
1422
1423
1424
1425
1426
1427
1428
1429
1430
1431
1432
1433
1434
1435
1436
1437
1438
1439
1440
1441
1442
1443
1444
1445
1446
1447
1448
1449
1450
1451
1452
1453
1454
1455
1456
1457
1458
1459
1460
1461
1462
1463
1464
1465
1466
1467
1468
1469
1470
1471
1472
1473
1474
1475
1476
1477
1478
1479
1480
1481
1482
1483
1484
1485
1486
1487
1488
1489
1490
1491
1492
1493
1494
1495
1496
1497
1498
1499
1500
1501
1502
1503
1504
1505
1506
1507
1508
1509
1510
1511
1512
1513
1514
1515
1516
1517
1518
1519
1520
1521
1522
1523
1524
1525
1526
1527
1528
1529
1530
1531
1532
1533
1534
1535
1536
1537
1538
1539
1540
1541
1542
1543
1544
1545
1546
1547
1548
1549
1550
1551
1552
1553
1554
1555
1556
1557
1558
1559
1560
1561
1562
1563
1564
1565
1566
1567
1568
1569
1570
1571
1572
1573
1574
1575
1576
1577
1578
1579
1580
1581
1582
1583
1584
1585
1586
1587
1588
1589
1590
1591
1592
1593
1594
1595
1596
1597
1598
1599
1600
1601
1602
1603
1604
1605
1606
1607
1608
1609
1610
1611
1612
1613
1614
1615
1616
1617
1618
1619
1620
1621
1622
1623
1624
1625
1626
1627
1628
1629
1630
1631
1632
1633
1634
1635
1636
1637
1638
1639
1640
1641
1642
1643
1644
1645
1646
1647
1648
1649
1650
1651
1652
1653
1654
1655
1656
1657
1658
1659
1660
1661
1662
1663
1664
1665
1666
1667
1668
1669
1670
1671
1672
1673
1674
1675
1676
1677
1678
1679
1680
1681
1682
1683
1684
1685
1686
1687
1688
1689
1690
1691
1692
1693
1694
1695
1696
1697
1698
1699
1700
1701
1702
1703
1704
1705
1706
1707
1708
1709
1710
1711
1712
1713
1714
1715
1716
1717
1718
1719
1720
1721
1722
1723
1724
1725
1726
1727
1728
1729
1730
1731
1732
1733
1734
1735
1736
1737
1738
1739
1740
1741
1742
1743
1744
1745
1746
1747
1748
1749
1750
1751
1752
1753
1754
1755
1756
1757
1758
1759
1760
1761
1762
1763
1764
1765
1766
1767
1768
1769
1770
1771
1772
1773
1774
1775
1776
1777
1778
1779
1780
1781
1782
1783
1784
1785
1786
1787
1788
1789
1790
1791
1792
1793
1794
1795
1796
1797
1798
1799
1800
1801
1802
1803
1804
1805
1806
1807
1808
1809
1810
1811
1812
1813
1814
1815
1816
1817
1818
1819
1820
1821
1822
1823
1824
1825
1826
1827
1828
1829
1830
1831
1832
1833
1834
1835
1836
1837
1838
1839
1840
1841
1842
1843
1844
1845
1846
1847
1848
1849
1850
1851
|
Network Working Group K. Konishi
Request for Comments: 3743 K. Huang
Category: Informational H. Qian
Y. Ko
April 2004
Joint Engineering Team (JET) Guidelines for
Internationalized Domain Names (IDN) Registration and
Administration for Chinese, Japanese, and Korean
Status of this Memo
This memo provides information for the Internet community. It does
not specify an Internet standard of any kind. Distribution of this
memo is unlimited.
Copyright Notice
Copyright (C) The Internet Society (2004). All Rights Reserved.
IESG Note
The IESG congratulates the Joint Engineering Team (JET) on developing
mechanisms to enforce their desired policy. The Language Variant
Table mechanisms described here allow JET to enforce language-based
character variant preferences, and they set an example for those who
might want to use variant tables for their own policy enforcement.
The IESG encourages those following this example to take JET's
diligence as an example, as well as its technical work. To follow
their example, registration authorities may need to articulate
policy, develop appropriate procedures and mechanisms for
enforcement, and document the relationship between the two. JET's
LVT mechanism should be adaptable to different policies, and can be
considered during that development process.
The IETF does not, of course, dictate policy or require the use of
any particular mechanisms for the implementation of these policies,
as these are matters of sovereignty and contract.
Abstract
Achieving internationalized access to domain names raises many
complex issues. These are associated not only with basic protocol
design, such as how names are represented on the network, compared,
and converted to appropriate forms, but also with issues and options
for deployment, transition, registration, and administration.
Konishi, et al. Informational [Page 1]
^L
RFC 3743 JET Guidelines for IDN April 2004
The IETF Standards for Internationalized Domain Names, known as
"IDNA", focuses on access to domain names in a range of scripts that
is broader in scope than the original ASCII. The development process
made it clear that use of characters with similar appearances and/or
interpretations created potential for confusion, as well as
difficulties in deployment and transition. The conclusion was that,
while those issues were important, they could best be addressed
administratively rather than through restrictions embedded in the
protocols. This document defines a set of guidelines for applying
restrictions of that type for Chinese, Japanese and Korean (CJK)
scripts and the zones that use them and, perhaps, the beginning of a
framework for thinking about other zones, languages, and scripts.
Table of Contents
1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . . 3
2. Definitions, Context, and Notation . . . . . . . . . . . . . . 5
2.1. Definitions and Context. . . . . . . . . . . . . . . . . 5
2.2. Notation for Ideographs and Other Non-ASCII CJK
Characters . . . . . . . . . . . . . . . . . . . . . . . 9
3. Scope of the Administrative Guidelines . . . . . . . . . . . . 9
3.1. Principles Underlying These Guidelines . . . . . . . . . 10
3.2. Registration of IDL. . . . . . . . . . . . . . . . . . . 13
3.2.1. Using the Language Variant Table . . . . . . . . 13
3.2.2. IDL Package. . . . . . . . . . . . . . . . . . . 14
3.2.3. Procedure for Registering IDLs . . . . . . . . . 14
3.3. Deletion and Transfer of IDL and IDL Package . . . . . . 19
3.4. Activation and Deactivation of IDL Variants . . . . . . 19
3.4.1. Activation Algorithm . . . . . . . . . . . . . . 19
3.4.2. Deactivation Algorithm . . . . . . . . . . . . . 20
3.5. Managing Changes in Language Associations. . . . . . . . 21
3.6. Managing Changes to Language Variant Tables. . . . . . . 21
4. Examples of Guideline Use in Zones . . . . . . . . . . . . . . 21
5. Syntax Description for the Language Variant Table. . . . . . . 25
5.1. ABNF Syntax. . . . . . . . . . . . . . . . . . . . . . . 25
5.2. Comments and Explanation of Syntax . . . . . . . . . . . 25
6. Security Considerations. . . . . . . . . . . . . . . . . . . . 27
7. Index to Terminology . . . . . . . . . . . . . . . . . . . . . 27
8. Acknowledgments. . . . . . . . . . . . . . . . . . . . . . . . 28
9. References . . . . . . . . . . . . . . . . . . . . . . . . . . 29
9.1. Normative References . . . . . . . . . . . . . . . . . . 29
9.2. Informative References . . . . . . . . . . . . . . . . . 30
10. Contributors . . . . . . . . . . . . . . . . . . . . . . . . . 30
10.1. Authors' Addresses . . . . . . . . . . . . . . . . . . . 31
10.2. Editors' Addresses . . . . . . . . . . . . . . . . . . . 32
11. Full Copyright Statement . . . . . . . . . . . . . . . . . . . 33
Konishi, et al. Informational [Page 2]
^L
RFC 3743 JET Guidelines for IDN April 2004
1. Introduction
Domain names form the fundamental naming architecture of the
Internet. Countless Internet protocols and applications rely on
them, not just for stability and continuity, but also to avoid
ambiguity. They were designed to be identifiers without any language
context. However, as domain names have become visible to end users
through Web URLs and e-mail addresses, the strings in domain-name
labels are being increasingly interpreted as names, words, or
phrases. It is likely that users will do the same with languages of
differing character sets, such as Chinese, Japanese and Korean (CJK),
in which many words or concepts are represented using short sequences
of characters.
The introduction of what are called Internationalized Domain Names
(IDN) amplifies both the difficulty of putting names into identifiers
and the confusion that exists between scripts and languages.
Character symbols that appear (or actually are) identical, or that
have similar or identical semantics but that are assigned the
different code points, further increase the potential for confusion.
DNS internationalization also affects a number of Internet protocols
and applications and creates additional layers of complexity in terms
of technical administration and services. Given the added
complications of using a much broader range of characters than the
original small ASCII subset, precautions are necessary in the
deployment of IDNs in order to minimize confusion and fraud.
The IETF IDN Working Group [IDN-WG] addressed the problem of handling
the encoding and decoding of Unicode strings into and out of Domain
Name System (DNS) labels with the goal that its solution would not
put the operational DNS at any risk. Its work resulted in one
primary protocol and three supporting ones, respectively:
1. Internationalizing Host Names in Applications [IDNA]
2. Preparation of Internationalized Strings [STRINGPREP]
3. A Stringprep Profile for Internationalized Domain Names
[NAMEPREP]
4. Punycode [PUNYCODE]
IDNA, which calls on the others, normalizes and transforms strings
that are intended to be used as IDNs. In combination, the four
provide the minimum functions required for internationalization, such
as performing case mappings, eliminating character differences that
would cause severe problems, and specifying matching (equality).
They also convert between the resulting Unicode code points and an
ASCII-based form that is more suitable for storing in actual DNS
labels. In this way, the IDNA transformations improve a user's
chances of getting to the correct IDN.
Konishi, et al. Informational [Page 3]
^L
RFC 3743 JET Guidelines for IDN April 2004
Addressing the issues around differing character sets, a primary
consideration and administrative challenge involves region-specific
definitions, interpretations, and the semantics of strings to be used
in IDNs. A Unicode string may have a specific meaning as a name,
word, or phrase in a particular language but that meaning could vary
depending on the country, region, culture, or other context in which
the string is used. It might also have different interpretations in
different languages that share some or all of the same characters.
Therefore, individual zones and zone administrators may find it
necessary to impose restrictions and procedures to reduce the
likelihood of confusion, and instabilities of reference, within their
own environments.
Over the centuries, the evolution of CJK characters, and the
differences in their use in different languages and even in different
regions where the same language is spoken, has given rise to the idea
of "variants", wherein one conceptual character can be identified
with several different Code Points in character sets for computer
use. This document provides a framework for handling such variants
while minimizing the possibility of serious user confusion in the
obtaining or using of domain names. However, the concept of variants
is complex and may require many different layers of solutions. This
guideline offers only one of those solution components. It is not
sufficient by itself to solve the whole problem, even with zone-
specific tables as described below.
Additionally, because of local language or writing-system
differences, it is impossible to create universally accepted
definitions for which potential variants are the same and which are
not the same. It is even more difficult to define a technical
algorithm to generate variants that are linguistically accurate.
That is, that the variant forms produced make as much sense in the
language as the originally specified forms. It is also possible that
variants generated may have no meaning in the associated language or
languages. The intention is not to generate meaningful "words" but
to generate similar variants to be reserved. So even though the
method described in this document may not always be linguistically
accurate, nor does it need to be, it increases the chances of getting
the right variants while accepting the inherent limitations of the
DNS and the complexities of human language.
This document outlines a model for such conventions for zones in
which labels that contain CJK characters are to be registered and a
system for implementing that model. It provides a mechanism that
allows each zone to define its own local rules for permitted
characters and sequences and the handling of IDNs and their variants.
Konishi, et al. Informational [Page 4]
^L
RFC 3743 JET Guidelines for IDN April 2004
The document is an effort of the Joint Engineering Team (JET), a
group composed of members of CNNIC, TWNIC, KRNIC, and JPNIC as well
as other individual experts. It offers guidelines for zone
administrators, including but not limited to registry operators and
registrars and information for all domain names holders on the
administration of domain names that contain characters drawn from
Chinese, Japanese, and Korean scripts. Other language groups are
encouraged to develop their own guidelines as needed, based on these
guidelines if that is helpful.
2. Definitions, Context, and Notation
2.1. Definitions and Context
This document uses a number of special terms. In this section,
definitions and explanations are grouped topically. Some readers may
prefer to skip over this material, returning, perhaps via the index
to terminology in section 7, when needed.
2.1.1. IDN
IDN: The term "IDN" has a number of different uses: (a) as an
abbreviation for "Internationalized Domain Name"; (b) as a fully
qualified domain name that contains at least one label that contains
characters not appearing in ASCII, specifically not in the subset of
ASCII recommended for domain names (the so-called "hostname" or "LDH"
subset, see RFC1035 [STD13]); (c) as a label of a domain name that
contains at least one character beyond ASCII; (d) as a Unicode string
to be processed by Nameprep; (e) as a string that is an output from
Nameprep; (f) as a string that is the result of processing through
both Nameprep and conversion into Punycode; (g) as the abbreviation
of an IDN (more properly, IDL) Package, in the terminology of this
document; (h) as the abbreviation of the IETF IDN Working Group; (g)
as the abbreviation of the ICANN IDN Committee; and (h) as standing
for other IDN activities in other companies/organizations.
Because of the potential confusion, this document uses the term "IDN"
as an abbreviation for Internationalized Domain Name and,
specifically, in the second sense described in (b) above. It uses
"IDL," defined immediately below, to refer to Internationalized
Domain Labels.
2.1.2. IDL
IDL: This document provides a guideline to be applied on a per-zone
basis, one label at a time. Therefore, the term "Internationalized
Domain Label" or "IDL" will be used instead of the more general term
"IDN" or its equivalents. The processing specifications of this
Konishi, et al. Informational [Page 5]
^L
RFC 3743 JET Guidelines for IDN April 2004
document may be applied, in some zones, to ASCII characters also, if
those characters are specified as valid in a Language Variant Table
(see below). Hence, in some zones, an IDL may contain or consist
entirely of "LDH" characters.
2.1.3. FQDN
FQDN: A fully qualified domain name, one that explicitly contains all
labels, including a Top-Level Domain (TLD) name. In this context, a
TLD name is one whose label appears in a nameserver record in the
root zone. The term "Domain Name Label" refers to any label of a
FQDN.
2.1.4. Registrations
Registration: In this document, the term "registration" refers to the
process by which a potential domain name holder requests that a label
be placed in the DNS either as an individual name within a domain or
as a subdomain delegation from another domain name holder. In the
case of a successful registration, the label or delegation records
are placed in the relevant zone file, or, more specifically, they are
"activated" or made "active" and additional IDLs may be reserved as
part of an "IDL Package" (see below). The guidelines presented here
are recommended for all zones, at any hierarchy level, in which CJK
characters are to appear and not just domains at the first or second
level.
2.1.5. RFC3066
RFC3066: A system, widely used in the Internet, for coding and
representing names of languages [RFC3066]. It is based on an
International Organization for Standardization (ISO) standard for
coding language names [ISO639], but expands it to provide additional
precision.
2.1.6. ISO/IEC 10646
ISO/IEC 10646: The international standard universal multiple-octet
coded character set ("UCS") [IS10646]. The Code Point definitions of
this standard are identical to those of corresponding versions of the
Unicode standard (see below). Consequently, the characters and their
coding are often referred to as "Unicode characters."
2.1.7. Unicode Character
Unicode Character: The term "Unicode character" is used here in
reference to characters chosen from the Unicode Standard Version 3.2
[UNICODE] (and hence from ISO/IEC 10646). In this document, the
Konishi, et al. Informational [Page 6]
^L
RFC 3743 JET Guidelines for IDN April 2004
characters are identified by their positions, or "Code Points." The
notation U+12AB, for example, indicates the character at the position
12AB (hexadecimal) in the Unicode 3.2 table. For characters in
positions above FFFF, i.e., requiring more than sixteen bits to
represent, a five to eight-character string is used, such as U+112AB
for the character in position 12AB of plane 1.
2.1.8. Unicode String
Unicode String: "Unicode string" refers to a string of Unicode
characters. The Unicode string is identified by the sequence of the
Unicode characters regardless of the encoding scheme.
2.1.9. CJK Characters
CJK Characters: CJK characters are characters commonly used in the
Chinese, Japanese, or Korean languages, including but not limited to
those defined in the Unicode Standard as ASCII (U+0020 to U+007F),
Han ideographs (U+3400 to U+9FAF and U+20000 to U+2A6DF), Bopomofo
(U+3100 to U+312F and U+31A0 to U+31BF), Kana (U+3040 to U+30FF),
Jamo (U+1100 to 11FF and U+3130 to U+318F), Hangul (U+AC00 to U+D7AF
and U+3130 to U+318F), and the respective compatibility forms. The
particular characters that are permitted in a given zone are
specified in the Language Variant Table(s) for that zone.
2.1.10. Label String
Label String: A generic term referring to a string of characters that
is a candidate for registration in the DNS or such a string, once
registered. A label string may or may not be valid according to the
rules of this specification and may even be invalid for IDNA use.
The term "label", by itself, refers to a string that has been
validated and may be formatted to appear in a DNS zone file.
2.1.11. Language Variant Table
Language Variant Table: The key mechanisms of this specification
utilize a three-column table, called a Language Variant Table, for
each language permitted to be registered in the zone. Those columns
are known, respectively, as "Valid Code Point", "Preferred Variant",
and "Character Variant", which are defined separately below. The
Language Variant Tables are critical to the success of the guideline
described in this document. However, the principles to be used to
generate the tables are not within the scope of this document and
should be worked out by each registry separately (perhaps by adopting
or adapting the work of some other registry). In this document,
"Table" and "Variant Table" are used as short forms for Language
Variant Table.
Konishi, et al. Informational [Page 7]
^L
RFC 3743 JET Guidelines for IDN April 2004
2.1.12. Valid Code Point
Valid Code Point: In a Language Variant Table, the list of Code
Points that is permitted for that language. Any other Code Points,
or any string containing them, will be rejected by this
specification. The Valid Code Point list appears as the first column
of the Language Variant Table.
2.1.13. Preferred Variant
Preferred Variant: In a Language Variant Table, a list of Code Points
corresponding to each Valid Code Point and providing possible
substitutions for it. These substitutions are "preferred" in the
sense that the variant labels generated using them are normally
registered in the zone file, or "activated." The Preferred Code
Points appear in column 2 of the Language Variant Table. "Preferred
Code Point" is used interchangeably with this term.
2.1.14. Character Variant
Character Variant: In a Language Variant Table, a second list of Code
Points corresponding to each Valid Code Point and providing possible
substitutions for it. Unlike the Preferred Variants, substitutions
based on Character Variants are normally reserved but not actually
registered (or "activated"). Character Variants appear in column 3
of the Language Variant Table. The term "Code Point Variants" is
used interchangeably with this term.
2.1.15. Preferred Variant Label
Preferred Variant Label: A label generated by use of Preferred
Variants (or Preferred Code Points).
2.1.16. Character Variant Label
Character Variant Label: A label generated by use of Character
Variants.
2.1.17. Zone Variant
Zone Variant: A Preferred or Character Variant Label that is actually
to be entered (registered) into the DNS. That is, into the zone file
for the relevant zone. Zone Variants are also referred to as Zone
Variant Labels or Active (or Activated) Labels.
Konishi, et al. Informational [Page 8]
^L
RFC 3743 JET Guidelines for IDN April 2004
2.1.18. IDL Package
IDL Package: A collection of IDLs as determined by these Guidelines.
All labels in the package are "reserved", meaning they cannot be
registered by anyone other than the holder of the Package. These
reserved IDLs may be "activated", meaning they are actually entered
into a zone file as a "Zone Variant". The IDL Package also contains
identification of the language(s) associated with the registration
process. The IDL and its variant labels form a single, atomic unit.
2.2. Notation for Ideographs and Other Non-ASCII CJK Characters.
For purposes of clarity, particularly in regard to examples, Han
ideographs appear in several places in this document. However, they
do not appear in the ASCII version of this document. For the
convenience of readers of the ASCII version, and some readers not
familiar with recognizing and distinguishing Chinese characters, most
uses of these characters will be associated with both their Unicode
Code Points and an "asterisk tag" with its corresponding Chinese
Romanization [ISO7098], with the tone mark represented by a number
from 1 to 4. Those tags have no meaning outside this document; they
are a quick visual and reading reference to help facilitate the
combinations and transformations of characters in the guideline and
table excerpts.
3. Scope of the Administrative Guidelines
Zone administrators are responsible for the administration of the
domain name labels under their control. A zone administrator might
be responsible for a large zone, such as a top-level domain (TLD),
whether generic or country code, or a smaller one, such as a typical
second- or third-level domain. A large zone is often more complex
than its smaller counterpart. However, actual technical
administrative tasks, such as addition, deletion, delegation, and
transfer of zones between domain name holders, are similar for all
zones.
This document provides guidelines for the ways CJK characters should
be handled within a zone, for how language issues should be
considered and incorporated, and for how Domain Name Labels
containing CJK characters should be administered (including
registration, deletion, and transfer of labels).
Other IDN policies, such as the creation of new top-level domains
(TLDs), the cost structure for registrations, and how the processes
described here get allocated between registrar and registry if the
zone makes that distinction, also are outside the scope of this
document.
Konishi, et al. Informational [Page 9]
^L
RFC 3743 JET Guidelines for IDN April 2004
Technical implementation issues are not discussed here either. For
example, deciding which guidelines should be implemented as registry
actions and which should be registrar actions is left to zone
administrators, with the possibility that it will differ from zone to
zone.
3.1. Principles Underlying These Guidelines
In many places, in the event of a dispute over rights to a name (or,
more accurately, DNS label string), this document assumes "first-
come, first-served" (FCFS) as a resolution policy even though FCFS is
not listed below as one of the principles for this document. If
policies are already in place governing priorities and "rights", one
can use the guidelines here by replacing uses of FCFS in this
document with policies specific to the zone. Some of the guidelines
here may not be applicable to other policies for determining rights
to labels. Still other alternatives, such as use of UDRP [UDRP] or
mutual exclusion, might have little impact on other aspects of these
guidelines.
(a) Although some Unicode strings may be pure identifiers made up of
an assortment of characters from many languages and scripts, IDLs are
likely to be "words" or "names" or "phrases" that have specific
meaning in a language. While a zone administration might or might
not require "meaning" as a registration criterion, meaning could
prove to be a useful tool for avoiding user confusion.
Each IDL to be registered should be associated administratively
with one or more languages.
Language associations should either be predetermined by the zone
administrator and applied to the entire zone or be chosen by the
registrants on a per-IDL basis. The latter may be necessary for some
zones, but it will make administration more difficult and will
increase the likelihood of conflicts in variant forms.
A given zone might have multiple languages associated with it or it
may have no language specified at all. Omitting specification of a
language may provide additional opportunities for user confusion and
is therefore NOT recommended.
(b) Each language uses only a subset of Unicode characters.
Therefore, if an IDL is associated with a language, it is not
permitted to contain any Unicode character that is not within the
valid subset for that language.
Each IDL to be registered must be verified against the valid
subset of Unicode for the language(s) associated with the IDL.
Konishi, et al. Informational [Page 10]
^L
RFC 3743 JET Guidelines for IDN April 2004
That subset is specified by the list of characters appearing in
the first column of the language and zone-specific tables as
described later in this document.
If the IDL fails this test for any of its associated languages, the
IDL is not valid for registration.
Note that this verification is not necessarily linguistically
accurate, because some languages have special rules. For example,
some languages impose restrictions on the order in which particular
combinations of characters may appear. Characters that are valid for
the language, and hence permitted by this specification, might still
not form valid words or even strings in the language.
(c) When an IDL is associated with a language, it may have Character
Variants that depend on that language associated with it in addition
to any Preferred Variants. These variants are potential sources of
confusion with the Code Points in the original label string.
Consequently, the labels generated from them should be unavailable to
registrants of other names, words, or phrases.
During registration, all labels generated from the Character
Variants for the associated language(s) of the IDL should be
reserved.
IDL reservations of the type described here normally do not appear in
the distributed DNS zone file. In other words, these reserved IDLs
may not resolve. Domain name holders could request that these
reserved IDLs be placed in the zone file and made active and
resolvable.
Zones will need to establish local policies about how they are to be
made active. Specifically, many zones, especially at the top level,
have prohibited or restricted the use of "CNAME"s DNS aliases,
especially CNAMEs that point to nameserver delegation records (NS
records). And long-term use of long-term aliases for domain
hierarchies, rather than single names ("DNAME records") are
considered problematic because of the recursion they can introduce
into DNS lookups.
(d) When an IDL is a "name", "word", or "phrase", it will have
Character Variants depending on the associated language.
Furthermore, one or more of those Character Variants will be used
more often than others for linguistic, political, or other reasons.
These more commonly used variants are distinguished from ordinary
Character Variants and are known as Preferred Variant(s) for the
particular language.
Konishi, et al. Informational [Page 11]
^L
RFC 3743 JET Guidelines for IDN April 2004
To increase the likelihood of correct and predictable resolution
of the IDN by end users, all labels generated from the Preferred
Variants for the associated language(s) should be resolvable.
In other words, the Preferred Variant Labels should appear in the
distributed DNS zone file.
(e) IDLs associated with one or more languages may have a large
number of Character Variant Labels or Preferred Variant Labels. Some
of these labels may include combinations of characters that are
meaningless or invalid linguistically. It may therefore be
appropriate for a zone to adopt procedures that include only
linguistically acceptable labels in the IDL Package.
A zone administrator may impose additional rules and other
processing activities to limit the number of Character Variant
Labels or Preferred Variant Labels that are actually reserved or
registered.
These additional rules and other processing activities are based on
policies and/or procedures imposed on a per-zone basis and therefore
are not within the scope of this document. Such policies or
procedures might be used, for example, to restrict the number of
Preferred Variant Labels actually reserved or to prevent certain
words from being registered at all.
(f) There are some Character Variant Labels and Preferred Variant
Labels that are associated with each IDL. These labels are
considered "equivalent" to each another. To avoid confusion, they
all should be assigned to a single domain name holder.
The IDL and its variant labels should be grouped together into a
single atomic unit, known in this document as an "IDL Package".
The IDL Package is created upon registration and is atomic: Transfer
and deletion of an IDL is performed on the IDL Package as a whole.
That is, an IDL within the IDL Package may not be transferred or
deleted individually; any re-registration, transfers, or other
actions that impact the IDL should also affect the other variants.
The name-conflict resolution policy associated with this zone could
result in a conflict with the principle of IDL Package atomicity. In
such a case, the policy must be defined to make the precedence clear.
Konishi, et al. Informational [Page 12]
^L
RFC 3743 JET Guidelines for IDN April 2004
3.2. Registration of IDL
To conform to the principles described in 3.1, this document
introduces two concepts: the Language Variant Table and the IDL
Package. These are described in the next two subsections, followed
by a description of the algorithm that is used to interpret the table
and generate variant labels.
3.2.1. Using the Language Variant Table
For each zone that uses a given language, each language should have
its own Language Variant Table. The table consists of a header
section that identifies references and version information, followed
by a section with one row for each Code Point that is valid for the
language and three columns.
(1) The first column contains the subset of Unicode characters
that is valid to be registered ("Valid Code Point"). This is
used to verify the IDL to be registered (see 3.1b). As in the
registration procedure described later, this column is used as
an index to examine characters that appear in a proposed IDL
to be processed. The collection of Valid Code Points in the
table for a particular language can be thought of as defining
the script for that language, although the normal definition
of a script would not include, for example, ASCII characters
with CJK ones.
(2) The second column contains the Preferred Variant(s) of the
corresponding Unicode character in column one ("Valid Code
Point"). These variant characters are used to generate the
Preferred Variant Labels for the IDL. Those labels should be
resolvable (see 3.1d). Under normal circumstances, all of
those Preferred Variant Labels will be activated in the
relevant zone file so that they will resolve when the DNS is
queried for them.
(3) The third column contains the Character Variant(s) for the
corresponding Valid Code Point. These are used to generate
the Character Variant Labels of the IDL, which are then to be
reserved (see 3.1c). Registration, or activation, of labels
generated from Character Variants will normally be a
registrant decision, subject to local policy.
Each entry in a column consists of one or more Code Points, expressed
as a numeric character number in the Unicode table and optionally
followed by a parenthetical reference. The first column, or Valid
Code Point, may have only one Code Point specified in a given row.
The other columns may have more than one.
Konishi, et al. Informational [Page 13]
^L
RFC 3743 JET Guidelines for IDN April 2004
Any row may be terminated with an optional comment, starting with
"#".
The formal syntax of the table and more-precise definitions of some
of its organization appear in Section 5.
The Language Variant Table should be provided by a relevant group,
organization, or body. However, the question of who is relevant or
has the authority to create this table and the rules that define it
is beyond the scope of this document.
3.2.2. IDL Package
The IDL Package is created on successful registration and consists
of:
(1) the IDL registered
(2) the language(s) associated with the IDL
(3) the version of the associated character variant table
(4) the reserved IDLs
(5) active IDLs, that is, "Zone Variant Labels" that are to appear
in the DNS zone file
3.2.3. Procedure for Registering IDLs
An explanation follows each step.
Step 1. IN <= IDL to be registered and
{L} <= Set of languages associated with IN
Start the process with the label string (prospective IDL) to be
registered and the associated language(s) as input.
Step 2. Generate the Nameprep-processed version of the IN,
applying all mappings and canonicalization required by
IDNA.
The prospective IDL is processed by using Nameprep to apply the
normalizations and exclusions globally required to use IDNA. If the
Nameprep processing fails, then the IDL is invalid and the
registration process must stop.
Konishi, et al. Informational [Page 14]
^L
RFC 3743 JET Guidelines for IDN April 2004
Step 2.1. NP(IN) <= Nameprep processed IN
Step 2.2. Check availability of NP(IN). If not available, route to
conflict policy.
The Nameprep-processed IDL is then checked against the contents of
the zone file and previously created IDL Packages. If it is already
registered or reserved, then a conflict exists that must be resolved
by applying whatever policy is applicable for the zone. For example,
if FCFS is used, the registration process terminates unless the
conflict resolution policy provides another alternative.
Step 3. Process each language.
For each language (AL) in {L}
Step 3 goes through all languages associated with the proposed IDL
and checks each character (after Nameprep has been applied) for
validity in each of them. It then applies the Preferred Variants
(column 2 values) and the Character Variants (column 3 values) to
generate candidate labels.
Step 3.1. Check validity of NP(IN) in AL. If failed, stop
processing.
In step 3.1, IDL validation is done by checking that every Code Point
in the Nameprep-processed IDL is a Code Point allowed by the "Valid
Code Point" column of the Character Variant Table for the language.
This is then repeated for any other languages (and hence, Language
Variant Tables) specified in the registration. If one or more Code
Points are not valid, the registration process terminates.
Step 3.2. PV(IN,AL) <= Set of available Nameprep-processed Preferred
Variants of NP(IN) in AL
Step 3.2 generates the list of Preferred Variant Labels of the IDL by
doing a combination (see Step 3.2A below) of all possible variants
listed in the "Preferred Variant(s)" column for each Code Point in
the Nameprep-processed IDL. The generated Preferred Variant Labels
must be processed through Nameprep. If the Nameprep processing fails
for any Preferred Variant Label (this is unlikely to occur if the
Preferred Variants are processed through Nameprep before being placed
in the table), then that variant label will be removed from the list.
The remaining Preferred Variant Labels in the list are then checked
to see whether they are already registered or reserved. If any are
registered or reserved, then the conflict resolution policy will
apply. In general, this will not prevent the originally requested
IDL from being registered unless the policy prevents such
registration. For example, if FCFS is applied, then the conflicting
variants will be removed from the list, but the originally requested
Konishi, et al. Informational [Page 15]
^L
RFC 3743 JET Guidelines for IDN April 2004
IDL and any remaining variants will be registered (see steps 5 and 8
below).
Step 3.2A Generating variant labels from Variant Code Points.
Steps 3.2 and 3.3 require that the Preferred Variants and Character
Variants be combined with the original IDL to form sets of variant
labels. Conceptually, one starts with the original, Nameprep-
processed, IDL and examines each of its characters in turn. If a
character is encountered for which there is a corresponding Preferred
Variant or Character Variant, a new variant label is produced with
the Variant Code Point substituted for the original one. If variant
labels already exist as the result of the processing of characters
that appeared earlier in the original IDL, then the substitutions are
made in them as well, resulting in additional generated variant
labels. This operation is repeated separately for the Preferred
Variants (in Step 3.2) and Character Variants (in Step 3.3). Of
course, equivalent results could be achieved by processing the
original IDL's characters in order, building the Preferred Variant
Label set and Character Variant Label set in parallel.
This process will sometimes generate a very large number of labels.
For example, if only two of the characters in the original IDL are
associated with Preferred Variants and if the first of those
characters has three Preferred Variants and the second has two, one
ends up with 12 variant labels to be placed in the IDL Package and,
normally, in the zone file. Repeating the process for Character
Variants, if any exist, would further increase the number of labels.
And if more than one language is specified for the original IDL, then
repetition of the process for additional languages (see step 4,
below) might further increase the size of the set.
Konishi, et al. Informational [Page 16]
^L
RFC 3743 JET Guidelines for IDN April 2004
For illustrative purposes, the "combination" process could be
achieved by a recursive function similar to the following pseudocode:
Function Combination(Str)
F <= first codepoint of Str
SStr <= Substring of Str, without the first code point
NSC <= {}
If SStr is empty then
for each V in (Variants of code point F)
NSC = NSC set-union (the string with the code point V)
End of Loop
Else
SubCom = Combination(SStr)
For each V in (Variants of code point F)
For each SC in SubCom
NSC = NSC set-union (the string with the
first code point V followed by the string SC)
End of Loop
End of Loop
Endif
Return NSC
Step 3.3. CV(IN,AL) <= Set of available Nameprep-processed Character
Variants of NP(IN) in AL
This step generates the list of Character Variant Labels by doing a
combination (see Step 3.2A above) of all the possible variants listed
in the "Character Variant(s)" column for each Code Point in the
Nameprep-processed original IDL. As with the Preferred Variant
Labels, the generated Character Variant Labels must be processed by,
and acceptable to, Nameprep. If the Nameprep processing fails for a
Character Variant Label, then that variant label will be removed from
the list. The remaining Character Variant Labels are then checked to
be sure they are not registered or reserved. If one or more are,
then the conflict resolution policy is applied. As with Preferred
Variant Labels, a conflict that is resolved in favor of the earlier
registrant does not, in general, prevent the IDL from being
registered, nor the remaining variants from being reserved in step 6
below.
Step 3.4. End of Loop
Konishi, et al. Informational [Page 17]
^L
RFC 3743 JET Guidelines for IDN April 2004
Step 4. Let PVall be the set-union of all PV(IN,AL)
Step 4 generates the Preferred Variants Label for all languages. In
this step, and again in step 6 below, the zone administrator may
impose additional rules and processing activities to restrict the
number of Preferred (tentatively to be reserved and activated) and
Character (tentatively to be reserved) Label Variants. These
additional rules and processing activities are zone policy specific
and therefore are not specified in this document.
Step 5. {ZV} <= PVall set-union NP(IN)
Step 5 generates the initial Zone Variants. The set includes all
Preferred Variants for all languages and the original Nameprep-
processed IDL. Unless excluded by further processing, these Zone
Variants will be activated. That is, placed into the DNS zone. Note
that the "set-union" operation will eliminate any duplicates.
Step 6. Let CVall be the set-union of all CV(IN,AL), set-minus
{ZV}
Step 6 generates the Reserved Label Variants (the Character Variant
Label set). These labels are normally reserved but not activated.
The set includes all Character Variant Labels for all languages, but
not the Zone Variants defined in the previous step. The set-union
and set-minus operations eliminate any duplicates.
Step 7. Create IDL Package for IN using IN, {L}, {ZV} and CVall
In Step 7, the "IDL Package" is created using the original IDL, the
associated language(s), the Zone Variant Labels, and the Reserved
Variant Labels. If zone-specific additional processing or filtering
is to be applied to eliminate linguistically inappropriate or other
forms, it should be applied before the IDL Package is actually
assembled.
Step 8. Put {ZV} into zone file
The activated IDLs are converted via ToASCII with UseSTD13ASCIIRules
[IDNA] before being placed into the zone file. This conversion
results in the IDLs being in the actual IDNA ("Punycode") form used
in zone files, while the IDLs have been carried in Unicode form up to
this point. If ToASCII fails for any of the activated IDLs, that IDL
must not be placed into the zone file. If the IDL is a subdomain
name, it will be delegated.
Konishi, et al. Informational [Page 18]
^L
RFC 3743 JET Guidelines for IDN April 2004
3.3. Deletion and Transfer of IDL and IDL Package
In traditional domain administration, every Domain Name Label is
independent of all other Domain Name Labels. Registration, deletion,
and transfer of labels is done on a per-label basis. However, with
the guidelines discussed here, each IDL is associated with specific
languages, with all label variants, both active (zone) and reserved,
together in an IDL Package. This quite deliberately prohibits labels
that contain sufficient mixtures of characters from different scripts
to make them impossible as words in any given language. If a zone
chooses to not impose that restriction--that is, to permit labels to
be constructed by picking characters from several different languages
and scripts--then the guidelines described here would be
inappropriate.
As stated earlier, the IDL package should be treated as a single
atomic unit and all variants of the IDL should belong to a single
domain-name holder. If the local policy related to the handling of
disagreements requires a particular IDL to be transferred and deleted
independently of the IDL Package, the conflict policy would take
precedence. In such an event, the conflict policy should include a
transfer or delete procedure that takes the nature of IDL Packages
into consideration.
When an IDL Package is deleted, all of the Zone and Reserved Label
Variants again become available. The deletion of one IDL Package
does not change any other IDL Packages.
3.4. Activation and Deactivation of IDL variants
Because there are active (registered) IDLs and inactive (reserved but
not registered) IDLs within an IDL package, processes are required to
activate or deactivate IDL variants within an IDL Package.
3.4.1. Activation Algorithm
Step 1. IN <= IDL to be activated and PA <= IDL Package
Start with the IDL to be activated and the IDL Package of which it is
a member.
Step 2. NP(IN) <= Nameprep processed IN
Process the IDL through Nameprep. This step should never cause a
problem, or even a change, since all labels that become part of the
IDL Package are processed through Nameprep in Step 3.2 or 3.3 of the
Registration procedure (section 3.2.3).
Konishi, et al. Informational [Page 19]
^L
RFC 3743 JET Guidelines for IDN April 2004
Step 3. If NP(IN) not in CVall then stop
Verify that the Nameprep-processed version of the IDL appears as a
still-unactivated label in the IDL Package, i.e., in the list of
Reserved Label Variants, CVall. It might be a useful "sanity check"
to also verify that it does not already appear in the zone file.
Step 4. CVall <= CVall set-minus NP(IN) and {ZV} <= {ZV} set-union
NP(IN)
Within the IDL Package, remove the Nameprep-processed version of the
IDL from the list of Reserved Label Variants and add it to the list
of active (zone) label variants.
Step 5. Put {ZV} into the zone file
Actually register (activate) the Zone Variant Labels.
3.4.2. Deactivation Algorithm
Step 1. IN <= IDL to be deactivated and PA <= IDL Package
As with activation, start with the IDL to be deactivated and the IDL
Package of which it is a member.
Step 2. NP(IN) <= Nameprep processed IN
Get the Nameprep-processed version of the name (see discussion in the
previous section).
Step 3. If NP(IN) not in {ZV} then stop
Verify that the Nameprep-processed version of the IDL appears as an
activated (zone) label variant in the IDL Package. It might be a
useful "sanity check" at this point to also verify that it actually
appears in the zone file.
Step 4. CVall <= CVall set-union NP(IN) and {ZV} <= {ZV} set-minus
NP(IN)
Within the IDL Package, remove the Nameprep-processed version of the
IDL from the list of Active (Zone) Label Variants and add it to the
list of Reserved (but inactive) Label Variants.
Step 5. Put {ZV} into the zone file
Konishi, et al. Informational [Page 20]
^L
RFC 3743 JET Guidelines for IDN April 2004
3.5. Managing Changes in Language Associations
Since the IDL package is an atomic unit and the associated list of
variants must not be changed after creation, this document does not
include a mechanism for adding and deleting language associations
within the IDL package. Instead, it recommends deleting the IDL
package entirely, followed by a registration with the new set of
languages. Zone administrators may find it desirable to devise
procedures that prevent other parties from capturing the labels in
the IDL Package during these operations.
3.6. Managing Changes to the Language Variant Tables
Language Variant Tables are subject to changes over time, and these
changes may or may not be backward compatible. It is possible that
updated Language Variant Tables may produce a different set of
Preferred Variants and Reserved Variants.
In order to preserve the atomicity of the IDL Package, when the
Language Variant Table is changed, IDL Packages created using the
previous version of the Language Variant Table must not be updated or
affected.
4. Examples of Guideline Use in Zones
To provide a meaningful example, some Language Variant Tables must be
defined. Assume, then, for the purpose of giving examples, that the
following four Language Variant Tables are defined:
Note: these tables are not a representation of the actual tables, and
they do not contain sufficient entries to be used in any actual
implementation. IANA maintains a voluntary registry of actual tables
[IANA-LVTABLES] which may be consulted for complete examples.
a) Language Variant Table for zh-cn and zh-sg
Reference 1 CP936 (commonly known as GBK)
Reference 2 zVariant, zTradVariant, zSimpVariant in Unihan.txt [UNIHAN]
Reference 3 List of Simplified character Table (Simplified column)
Reference 4 zSimpVariant in Unihan.txt [UNIHAN]
Reference 5 variant that exists in GB2312, common simplified hanzi
Version 1 20020701 # July 2002
56E2(1);56E2(5);5718(2) # sphere, ball, circle; mass, lump
5718(1);56E2(4);56E2(2),56E3(2) # sphere, ball, circle; mass, lump
60F3(1);60F3(5); # think, speculate, plan, consider
654E(1);6559(5);6559(2) # teach
Konishi, et al. Informational [Page 21]
^L
RFC 3743 JET Guidelines for IDN April 2004
6559(1);6559(5);654E(2) # teach, class
6DF8(1);6E05(5);6E05(2) # clear
6E05(1);6E05(5);6DF8(2) # clear, pure, clean; peaceful
771E(1);771F(5);771F(2) # real, actual, true, genuine
771F(1);771F(5);771E(2) # real, actual, true, genuine
8054(1);8054(3);806F(2) # connect, join; associate, ally
806F(1);8054(3);8054(2),8068(2) # connect, join; associate, ally
96C6(1);96C6(5); # assemble, collect together
b) Language Variant Table for zh-tw
Reference 1 CP950 (commonly known as BIG5)
Reference 2 zVariant, zTradVariant, zSimpVariant in Unihan.txt
Reference 3 List of Simplified Character Table (Traditional column)
Reference 4 zTradVariant in Unihan.txt
Version 1 20020701 # July 2002
5718(1);5718(4);56E2(2),56E3(2) # sphere, ball, circle; mass, lump
60F3(1);60F3(1); # think, speculate, plan, consider
6559(1);6559(1);654E(2) # teach, class
6E05(1);6E05(1);6DF8(2) # clear, pure, clean; peaceful
771F(1);771F(1);771E(2) # real, actual, true, genuine
806F(1);806F(3);8054(2),8068(2) # connect, join; associate, ally
96C6(1);96C6(1); # assemble, collect together
c) Language Variant Table for ja
Reference 1 CP932 (commonly known as Shift-JIS)
Reference 2 zVariant in Unihan.txt
Reference 3 variant that exists in JIS X0208, commonly used Kanji
Version 1 20020701 # July 2002
5718(1);5718(3);56E3(2) # sphere, ball, circle; mass, lump
60F3(1);60F3(3); # think, speculate, plan, consider
654E(1);6559(3);6559(2) # teach
6559(1);6559(3);654E(2) # teach, class
6DF8(1);6E05(3);6E05(2) # clear
6E05(1);6E05(3);6DF8(2) # clear, pure, clean; peaceful
771E(1);771E(1);771F(2) # real, actual, true, genuine
771F(1);771F(1);771E(2) # real, actual, true, genuine
806F(1);806F(1);8068(2) # connect, join; associate, ally
96C6(1);96C6(3); # assemble, collect together
d) Language Variant Table for ko
Reference 1 CP949 (commonly known as EUC-KR)
Konishi, et al. Informational [Page 22]
^L
RFC 3743 JET Guidelines for IDN April 2004
Reference 2 zVariant and K-source in Unihan.txt
Version 1 20020701 # July 2002
5718(1);5718(1);56E3(2) # sphere, ball, circle; mass, lump
60F3(1);60F3(1); # think, speculate, plan, consider
654E(1);654E(1);6559(2) # teach
6DF8(1);6DF8(1);6E05(2) # clear
771E(1);771E(1);771F(2) # real, actual, true, genuine
806F(1);806F(1);8068(2) # connect, join; associate, ally
96C6(1);96C6(1); # assemble, collect together
Example 1: IDL = (U+6E05 U+771F U+6559) *qing2 zhen1 jiao4*
{L} = {zh-cn, zh-sg, zh-tw}
NP(IN) = (U+6E05 U+771F U+6559)
PV(IN,zh-cn) = (U+6E05 U+771F U+6559)
PV(IN,zh-sg) = (U+6E05 U+771F U+6559)
PV(IN,zh-tw) = (U+6E05 U+771F U+6559)
{ZV} = {(U+6E05 U+771F U+6559)}
CVall = {(U+6E05 U+771E U+6559),
(U+6E05 U+771E U+654E),
(U+6E05 U+771F U+654E),
(U+6DF8 U+771E U+6559),
(U+6DF8 U+771E U+654E),
(U+6DF8 U+771F U+6559),
(U+6DF8 U+771F U+654E)}
Example 2: IDL = (U+6E05 U+771F U+6559) *qing2 zhen1 jiao4*
{L} = {ja}
NP(IN) = (U+6E05 U+771F U+6559)
PV(IN,ja) = (U+6E05 U+771F U+6559)
{ZV} = {(U+6E05 U+771F U+6559)}
CVall = {(U+6E05 U+771E U+6559),
(U+6E05 U+771E U+654E),
(U+6E05 U+771F U+654E),
(U+6DF8 U+771E U+6559),
(U+6DF8 U+771E U+654E),
(U+6DF8 U+771F U+6559),
(U+6DF8 U+771F U+654E)}
Example 3: IDL = (U+6E05 U+771F U+6559) *qing2 zhen1 jiao4*
{L} = {zh-cn, zh-sg, zh-tw, ja, ko}
NP(IN) = (U+6E05 U+771F U+6559) *qing2 zhen1 jiao4*
Konishi, et al. Informational [Page 23]
^L
RFC 3743 JET Guidelines for IDN April 2004
Invalid registration because U+6E05 is invalid in L = ko
Example 4: IDL = (U+806F U+60F3 U+96C6 U+5718)
*lian2 xiang3 ji2 tuan2*
{L} = {zh-cn, zh-sg, zh-tw}
NP(IN) = (U+806F U+60F3 U+96C6 U+5718)
PV(IN,zh-cn) = (U+8054 U+60F3 U+96C6 U+56E2)
PV(IN,zh-sg) = (U+8054 U+60F3 U+96C6 U+56E2)
PV(IN,zh-tw) = (U+806F U+60F3 U+96C6 U+5718)
{ZV} = {(U+8054 U+60F3 U+96C6 U+56E2),
(U+806F U+60F3 U+96C6 U+5718)}
CVall = {(U+8054 U+60F3 U+96C6 U+56E3),
(U+8054 U+60F3 U+96C6 U+5718),
(U+806F U+60F3 U+96C6 U+56E2),
(U+806f U+60F3 U+96C6 U+56E3),
(U+8068 U+60F3 U+96C6 U+56E2),
(U+8068 U+60F3 U+96C6 U+56E3),
(U+8068 U+60F3 U+96C6 U+5718)
Example 5: IDL = (U+8054 U+60F3 U+96C6 U+56E2)
*lian2 xiang3 ji2 tuan2*
{L} = {zh-cn, zh-sg}
NP(IN) = (U+8054 U+60F3 U+96C6 U+56E2)
PV(IN,zh-cn) = (U+8054 U+60F3 U+96C6 U+56E2)
PV(IN,zh-sg) = (U+8054 U+60F3 U+96C6 U+56E2)
{ZV} = {(U+8054 U+60F3 U+96C6 U+56E2)}
CVall = {(U+8054 U+60F3 U+96C6 U+56E3),
(U+8054 U+60F3 U+96C6 U+5718),
(U+806F U+60F3 U+96C6 U+56E2),
(U+806f U+60F3 U+96C6 U+56E3),
(U+806F U+60F3 U+96C6 U+5718),
(U+8068 U+60F3 U+96C6 U+56E2),
(U+8068 U+60F3 U+96C6 U+56E3),
(U+8068 U+60F3 U+96C6 U+5718)}
Example 6: IDL = (U+8054 U+60F3 U+96C6 U+56E2)
*lian2 xiang3 ji2 tuan2*
{L} = {zh-cn, zh-sg, zh-tw}
NP(IN) = (U+8054 U+60F3 U+96C6 U+56E2)
Invalid registration because U+8054 is invalid in L = zh-tw
Example 7: IDL = (U+806F U+60F3 U+96C6 U+5718)
*lian2 xiang3 ji2 tuan2*
{L} = {ja,ko}
Konishi, et al. Informational [Page 24]
^L
RFC 3743 JET Guidelines for IDN April 2004
NP(IN) = (U+806F U+60F3 U+96C6 U+5718)
PV(IN,ja) = (U+806F U+60F3 U+96C6 U+5718)
PV(IN,ko) = (U+806F U+60F3 U+96C6 U+5718)
{ZV} = {(U+806F U+60F3 U+96C6 U+5718)}
CVall = {(U+806F U+60F3 U+96C6 U+56E3),
(U+8068 U+60F3 U+96C6 U+5718),
(U+8068 U+60F3 U+96C6 U+56E3)}
5. Syntax Description for the Language Variant Table
The formal syntax for the Language Variant Table is as follows, using
the IETF "ABNF" metalanguage [ABNF]. Some comments on this syntax
appear immediately after it.
5.1. ABNF Syntax
LanguageVariantTable = 1*ReferenceLine VersionLine 1*EntryLine
ReferenceLine = "Reference" SP RefNo SP RefDesciption [ Comment ] CRLF
RefNo = 1*DIGIT
RefDesciption = *[VCHAR]
VersionLine = "Version" SP VersionNo SP VersionDate [ Comment ] CRLF
VersionNo = 1*DIGIT
VersionDate = YYYYMMDD
EntryLine = VariantEntry/Comment CRLF
VariantEntry = ValidCodePoint ";"
PreferredVariant ";" CharacterVariant [ Comment ]
ValidCodePoint = CodePoint
RefList = RefNo 0*( "," RefNo )
PreferredVariant = CodePointSet 0*( "," CodePointSet )
CharacterVariant = CodePointSet 0*( "," CodePointSet )
CodePointSet = CodePoint 0*( SP CodePoint )
CodePoint = 4*8DIGIT [ "(" Reflist ")" ]
Comment = "#" *VCHAR
YYYYMMDD is an integer, in alphabetic form, representing a date,
where YYYY is the 4-digit year, MM is the 2-digit month, and DD is
the 2-digit day.
5.2. Comments and Explanation of Syntax
Any lines starting with, or portions of lines after, the hash
symbol("#") are treated as comments. Comments have no significance
in the processing of the tables; nor are there any syntax
requirements between the hash symbol and the end of the line. Blank
lines in the tables are ignored completely.
Konishi, et al. Informational [Page 25]
^L
RFC 3743 JET Guidelines for IDN April 2004
Every language should have its own Language Variant Table provided by
a relevant group, organization, or other body. That table will
normally be based on some established standard or standards. The
group that defines a Language Variant Table should document
references to the appropriate standards at the beginning of the
table, tagged with the word "Reference" followed by an integer (the
reference number) followed by the description of the reference. For
example:
Reference 1 CP936 (commonly known as GBK)
Reference 2 zVariant, zTradVariant, zSimpVariant in Unihan.txt
Reference 3 List of Simplified Character Table (Simplified column)
Reference 4 zSimpVariant in Unihan.txt
Reference 5 Variant that exists in GB2312, common simplified Hanzi
Each Language Variant Table must have a version number and its
release date. This is tagged with the word "Version" followed by an
integer then followed by the date in the format YYYYMMDD, where YYYY
is the 4-digit year, MM is the 2-digit month, and DD is the 2-digit
day of the publication date of the table.
Version 1 20020701 # July 2002 Version 1
The table has three columns, separated by semicolons: "Valid Code
Point"; "Preferred Variant(s)"; and "Character Variant(s)".
The "Valid Code Point" is the subset of Unicode characters that are
valid to be registered.
There can be more than one Preferred Variant; hence there could be
multiple entries in the "Preferred Variant(s)" column. If the
"Preferred Variant(s)" column is empty, then there is no
corresponding Preferred Variant; in other words, the Preferred
Variant is null, there is no corresponding preferred variant
codepoint, and no processing to add labels for preferred variants
occurs." Unless local policy dictates otherwise, the procedures
above will result in only those labels that reflect the valid code
point being activated (registered) into the zone file.
The "Character Variant(s)" column contains all Character Variants of
the Code Point. Since the Code Point is always a variant of itself,
to avoid redundancy, the Code Point is assumed to be part of the
"Character Variant(s)" and need not be repeated in the "Character
Variant(s)" column.
If the variant in the "Preferred Variant(s)" or the "Character
Variant(s)" column is composed of a sequence of Code Points, then
sequence of Code Points is listed separated by a space.
Konishi, et al. Informational [Page 26]
^L
RFC 3743 JET Guidelines for IDN April 2004
If there are multiple variants in the "Preferred Variant(s)" or the
"Character Variant(s)" column, then each variant is separated by a
comma.
Any Code Point listed in the "Preferred Variant(s)" column must be
allowed by the rules for the relevant language to be registered.
However, this is not a requirement for the entries in the "Character
Variant(s)" column; it is possible that some of those entries may not
be allowed to be registered.
Every Code Point in the table should have a corresponding reference
number (associated with the references) specified to justify the
entry. The reference number is placed in parentheses after the Code
Point. If there is more than one reference, then the numbers are
placed within a single set of parentheses and separated by commas.
6. Security Considerations
As discussed in the Introduction, substantially-unrestricted use of
international (non-ASCII) characters in domain name labels may cause
user confusion and invite various types of attacks. In particular,
in the case of CJK languages, an attacker has an opportunity to
divert or confuse users as a result of different characters (or, more
specifically, assigned code points) with identical or similar
semantics. These Guidelines provide a partial remedy for those risks
by supplying a framework for prohibiting inappropriate characters
from being registered at all and for permitting "variant" characters
to be grouped together and reserved, so that they can only be
registered in the DNS by the same owner. However, the system it
suggests is no better or worse than the per-zone and per-language
tables whose format and use this document specifies. Specific
tables, and any additional local processing, will reflect per-zone
decisions about the balance between risk and flexibility of
registrations. And, of course, errors in construction of those
tables may significantly reduce the quality of protection provided.
7. Index to Terminology
As a convenience to the reader, this section lists all of the special
terminology used in this document, with a pointer to the section in
which it is defined.
Activated Label 2.1.17
Activation 2.1.4
Active Label 2.1.17
Character Variant 2.1.14
Character Variant Label 2.1.16
CJK Characters 2.1.9
Konishi, et al. Informational [Page 27]
^L
RFC 3743 JET Guidelines for IDN April 2004
Code point 2.1.7
Code Point Variant 2.1.14
FQDN 2.1.3
Hostname 2.1.1
IDL 2.1.2
IDL Package 2.1.18
IDN 2.1.1
Internationalized Domain Label 2.1.2
ISO/IEC 10646 2.1.6
Label String 2.1.10
Language name codes 2.1.5
Language Variant Table 2.1.11
LDH Subset 2.1.1
Preferred Code Point 2.1.13
Preferred Variant 2.1.13
Preferred Variant Label 2.1.15
Registration 2.1.4
Reserved 2.1.18
RFC3066 2.1.5
Table 2.1.11
UCS 2.1.6
Unicode Character 2.1.7
Unicode String 2.1.8
Valid Code Point 2.1.12
Variant Table 2.1.11
Zone Variant 2.1.17
8. Acknowledgments
The authors gratefully acknowledge the contributions of:
- V. CHEN, N. HSU, H. HOTTA, S. TASHIRO, Y. YONEYA, and other Joint
Engineering Team members at the JET meeting in Bangkok, Thailand.
- Yves Arrouye, an observer at the JET meeting in Bangkok, for his
contribution on the IDL Package.
- Those who commented on, and made suggestions about, earlier
versions, including Harald ALVESTRAND, Erin CHEN, Patrik
FALTSTROM, Paul HOFFMAN, Soobok LEE, LEE Xiaodong, MAO Wei, Erik
NORDMARK, and L.M. TSENG.
Konishi, et al. Informational [Page 28]
^L
RFC 3743 JET Guidelines for IDN April 2004
9. References
9.1. Normative References
[ABNF] Crocker, D. and P. Overell, Eds., "Augmented BNF for
Syntax Specifications: ABNF", RFC 2234, November
1997.
[STD13] Mockapetris, P., "Domain names concepts and
facilities" STD 13, RFC 1034, November 1987.
Mockapetris, P., "Domain names implementation and
specification", STD 13, RFC 1035, November 1987.
[RFC3066] Alvestrand, H., "Tags for the Identification of
Languages," BCP 47, RFC 3066, January 2001.
[IDNA] Faltstrom, P., Hoffman, P. and A. M. Costello,
"Internationalizing Domain Names in Applications
(IDNA)", RFC 3490, March 2003.
[PUNYCODE] Costello, A.M., "Punycode: A Bootstring encoding of
Unicode for Internationalized Domain Names in
Applications (IDNA)", RFC 3492, March 2003.
[STRINGPREP] Hoffman, P. and M. Blanchet, "Preparation of
Internationalized Strings ("stringprep")", RFC 3454,
December 2002.
[NAMEPREP] Hoffman, P. and M. Blanchet, "Nameprep: A Stringprep
Profile for Internationalized Domain Names (IDN)",
RFC 3491, March 2003.
[IS10646] A product of ISO/IEC JTC1/SC2/WG2, Work Item
JTC1.02.18 (ISO/IEC 10646). It is a multipart
standard: Part 1, published as ISO/IEC 10646-
1:2000(E), covers the Architecture and Basic
Multilingual Plane, and Part 2, published as ISO/IEC
10646-2:2001(E), covers the supplementary
(additional) planes.
[UNIHAN] Unicode Han Database, Unicode Consortium
ftp://ftp.unicode.org/Public/UNIDATA/Unihan.txt.
[UNICODE] The Unicode Consortium, "The Unicode Standard Version
3.0," ISBN 0-201-61633-5. Unicode Standard Annex #28
(http://www.unicode.org/unicode/reports/tr28/)
defines Version 3.2 of the Unicode Standard, which is
definitive for IDNA and this document.
Konishi, et al. Informational [Page 29]
^L
RFC 3743 JET Guidelines for IDN April 2004
[ISO7098] ISO 7098;1991 Information and documentation
Romanization of Chinese, ISO/TC46/SC2.
9.2. Informative References
[IANA-LVTABLES] Internet Assigned Numbers Authority (IANA), IDN
Character Registry.
http://www.iana.org/assignments/idn/
[IDN-WG] IETF Internationalized Domain Names Working Group,
now concluded,idn@ops.ietf.org, James Seng, Marc
Blanchet, co-chairs, http://www.i-d-n.net/.
[UDRP] ICANN, "Uniform Domain Name Dispute Resolution
Policy", October 1999,
http://www.icann.org/udrp/udrp-policy-24oct99.htm
[ISO639] "ISO 639:1988 (E/F) Code for the representation of names
of languages", International Organization for
Standardization, 1st edition, 1988-04-01.
10. Contributors
The formal responsibility for this document and the ideas it contains
lie with K. Koniski, K. Huang, H. Qian, and Y. Ko. These authors are
listed on the first page as authors of record, and they are the
appropriate the long-term contacts for questions and comments on this
RFC. On the other hand, J. Seng, J. Klensin, and W. Rickard served
as editors of the document, transcribing and translating the ideas of
the four authors and the teams they represented into the current
written form. They were the primary contacts during the editing
process, but not in the long term.
Konishi, et al. Informational [Page 30]
^L
RFC 3743 JET Guidelines for IDN April 2004
10.1. Authors' Addresses
Kazunori KONISHI
JPNIC
Kokusai-Kougyou-Kanda Bldg 6F
2-3-4 Uchi-Kanda, Chiyoda-ku
Tokyo 101-0047
Japan
Phone: +81 49-278-7313
EMail: konishi@jp.apan.net
Kenny HUANG
TWNIC
3F, 16, Kang Hwa Street, Taipei
Taiwan
Phone: 886-2-2658-6510
EMail: huangk@alum.sinica.edu
QIAN Hualin
CNNIC
No.6 Branch-box of No.349 Mailbox, Beijing 100080
Peoples Republic of China
EMail: Hlqian@cnnic.net.cn
KO YangWoo
PeaceNet
Yangchun P.O. Box 81 Seoul 158-600
Korea
EMail: yw@mrko.pe.kr
Konishi, et al. Informational [Page 31]
^L
RFC 3743 JET Guidelines for IDN April 2004
10.2. Editors' Addresses
James SENG
180 Lompang Road
#22-07 Singapore 670180
Phone: +65 9638-7085
EMail: jseng@pobox.org.sg
John C KLENSIN
1770 Massachusetts Avenue, No. 322
Cambridge, MA 02140
U.S.A.
EMail: Klensin+ietf@jck.com
Wendy RICKARD
The Rickard Group
16 Seminary Ave
Hopewell, NJ 08525
USA
EMail: rickard@rickardgroup.com
Konishi, et al. Informational [Page 32]
^L
RFC 3743 JET Guidelines for IDN April 2004
11. Full Copyright Statement
Copyright (C) The Internet Society (2004). This document is subject
to the rights, licenses and restrictions contained in BCP 78 and
except as set forth therein, the authors retain all their rights.
This document and the information contained herein are provided on an
"AS IS" basis and THE CONTRIBUTOR, THE ORGANIZATION HE/SHE REPRESENTS
OR IS SPONSORED BY (IF ANY), THE INTERNET SOCIETY AND THE INTERNET
ENGINEERING TASK FORCE DISCLAIM ALL WARRANTIES, EXPRESS OR IMPLIED,
INCLUDING BUT NOT LIMITED TO ANY WARRANTY THAT THE USE OF THE
INFORMATION HEREIN WILL NOT INFRINGE ANY RIGHTS OR ANY IMPLIED
WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE.
Intellectual Property
The IETF takes no position regarding the validity or scope of any
Intellectual Property Rights or other rights that might be claimed to
pertain to the implementation or use of the technology described in
this document or the extent to which any license under such rights
might or might not be available; nor does it represent that it has
made any independent effort to identify any such rights. Information
on the procedures with respect to rights in RFC documents can be
found in BCP 78 and BCP 79.
Copies of IPR disclosures made to the IETF Secretariat and any
assurances of licenses to be made available, or the result of an
attempt made to obtain a general license or permission for the use of
such proprietary rights by implementers or users of this
specification can be obtained from the IETF on-line IPR repository at
http://www.ietf.org/ipr.
The IETF invites any interested party to bring to its attention any
copyrights, patents or patent applications, or other proprietary
rights that may cover technology that may be required to implement
this standard. Please address the information to the IETF at ietf-
ipr@ietf.org.
Acknowledgement
Funding for the RFC Editor function is currently provided by the
Internet Society.
Konishi, et al. Informational [Page 33]
^L
|