ETSI's Bug Tracker - Part 01: TTCN-3 Core Language
View Issue Details

ID | Project | Category | View Status | Date Submitted | Last Update
0006706 | Part 01: TTCN-3 Core Language | Technical | public | 27-03-2014 12:41 | 24-07-2014 14:47

Reporter | Tomas Urban |
Assigned To | Gyorgy Rethy |
Priority | urgent | Severity | minor | Reproducibility | N/A
Status | closed | Resolution | fixed |
Platform |  | OS |  | OS Version |
Product Version | v4.6.1 (published 2014-06) |
Target Version | v4.6.2 (interim 2014) | Fixed in Version | v4.6.2 (interim 2014) |
Clause Reference(s) | C.1.31, C.1.32, C.5.3, C.5.4
Source (company - Author) | Elvior

Summary | 0006706: Encoding in oct2unichar, unichar2oct, encvalue_unichar, decvalue_unichar

Description

This CR is related to TTCN-3:2014 (final draft, 4.5.3).
The TTCN-3:2014 standard introduced new conversion and codec functions handling universal strings and specified several encoding options. However, these encoding options are insufficient as the standard omits one important aspect of multibyte encoding: the endianness. According to the examples, it seems that little endian is assumed, but this should be formally declared in the rules. Besides, it should be possible to use big endian encodings, since they are at least as common as little endian encodings. For that reason, I propose to add additional encoding strings: UTF-16BE, UTF-32BE, UCS-2BE (and eventually UCS-4BE, but this is just a synonym for UTF-32BE).
There's also an error in the examples for oct2unichar and unichar2oct functions. The used encoding is not UCS-4, but UCS-2.

Steps To Reproduce |
Additional Information |
Tags | No tags attached.

Relationships

related to | 0006586 | closed | Ina Schieferdecker | How to encode to/decode from XML values containing non-ASCII characters?

Attached Files

CR6706_update_proposal.docx (28,926) 10-04-2014 12:58
http://oldforge.etsi.org/mantis/file_download.php?file_id=2995&type=bug
CR6706_resolution_v2.docx (31,470) 11-04-2014 13:47
http://oldforge.etsi.org/mantis/file_download.php?file_id=3017&type=bug
CR6706_resolution_v2-3.docx (32,261) 17-06-2014 09:21
http://oldforge.etsi.org/mantis/file_download.php?file_id=3037&type=bug
CR6706_resolution_v4.docx (44,774) 17-06-2014 17:51
http://oldforge.etsi.org/mantis/file_download.php?file_id=3041&type=bug
CR6706_resolution_v5.docx (47,295) 18-06-2014 13:29
http://oldforge.etsi.org/mantis/file_download.php?file_id=3050&type=bug
CR6706_resolution_v6.docx (51,972) 20-06-2014 09:55
http://oldforge.etsi.org/mantis/file_download.php?file_id=3069&type=bug
CR6706_resolution_v7.docx (52,494) 20-06-2014 10:17
http://oldforge.etsi.org/mantis/file_download.php?file_id=3070&type=bug

Issue History
Date Modified | Username | Field | Change
27-03-2014 12:41 | Tomas Urban | New Issue |
07-04-2014 11:48 | Jens Grabowski | Note Added: 0011935 |
08-04-2014 10:31 | Gyorgy Rethy | Note Added: 0011953 |
08-04-2014 10:34 | Gyorgy Rethy | Assigned To | => Axel Rennoch
08-04-2014 10:34 | Gyorgy Rethy | Status | new => assigned
08-04-2014 10:34 | Gyorgy Rethy | Product Version | v4.5.1 (published 2013-04) => v4.6.1 (published 2014-06)
08-04-2014 10:34 | Gyorgy Rethy | Target Version | => v4.7.1 (published 2015-06)
08-04-2014 10:36 | Gyorgy Rethy | Note Edited: 0011953 | bug_revision_view_page.php?bugnote_id=11953#r4
09-04-2014 14:11 | Gyorgy Rethy | Relationship added | related to 0006586
09-04-2014 14:11 | Gyorgy Rethy | Priority | normal => urgent
10-04-2014 12:58 | Axel Rennoch | File Added: CR6706_update_proposal.docx |
10-04-2014 12:58 | Axel Rennoch | Assigned To | Axel Rennoch => Tomas Urban
10-04-2014 12:59 | Axel Rennoch | Assigned To | Tomas Urban => Gyorgy Rethy
10-04-2014 13:03 | Axel Rennoch | Note Added: 0012000 |
10-04-2014 13:03 | Axel Rennoch | Status | assigned => confirmed
11-04-2014 13:46 | Gyorgy Rethy | Note Added: 0012028 |
11-04-2014 13:47 | Gyorgy Rethy | File Added: CR6706_resolution_v2.docx |
11-04-2014 13:48 | Gyorgy Rethy | Assigned To | Gyorgy Rethy => Axel Rennoch
11-04-2014 13:48 | Gyorgy Rethy | Status | confirmed => assigned
17-06-2014 09:21 | Axel Rennoch | File Added: CR6706_resolution_v2-3.docx |
17-06-2014 09:23 | Axel Rennoch | Assigned To | Axel Rennoch => Gyorgy Rethy
17-06-2014 09:23 | Axel Rennoch | Note Added: 0012097 |
17-06-2014 09:23 | Axel Rennoch | Status | assigned => confirmed
17-06-2014 15:58 | Gyorgy Rethy | Target Version | v4.7.1 (published 2015-06) => v4.6.2 (interim 2014)
17-06-2014 17:51 | Gyorgy Rethy | Note Added: 0012113 |
17-06-2014 17:51 | Gyorgy Rethy | File Added: CR6706_resolution_v4.docx |
18-06-2014 07:31 | Gyorgy Rethy | Assigned To | Gyorgy Rethy => Axel Rennoch
18-06-2014 07:31 | Gyorgy Rethy | Status | confirmed => assigned
18-06-2014 08:35 | Gyorgy Rethy | Note Edited: 0012113 | bug_revision_view_page.php?bugnote_id=12113#r29
18-06-2014 13:29 | Axel Rennoch | File Added: CR6706_resolution_v5.docx |
18-06-2014 13:31 | Axel Rennoch | Note Added: 0012123 |
19-06-2014 16:46 | Axel Rennoch | Assigned To | Axel Rennoch => Gyorgy Rethy
20-06-2014 09:20 | Gyorgy Rethy | Status | assigned => confirmed
20-06-2014 09:55 | Gyorgy Rethy | Note Added: 0012177 |
20-06-2014 09:55 | Gyorgy Rethy | File Added: CR6706_resolution_v6.docx |
20-06-2014 09:56 | Gyorgy Rethy | Assigned To | Gyorgy Rethy => Tomas Urban
20-06-2014 09:56 | Gyorgy Rethy | Status | confirmed => assigned
20-06-2014 09:56 | Gyorgy Rethy | Note Edited: 0012177 | bug_revision_view_page.php?bugnote_id=12177#r59
20-06-2014 09:57 | Gyorgy Rethy | Status | assigned => confirmed
20-06-2014 10:17 | Tomas Urban | File Added: CR6706_resolution_v7.docx |
20-06-2014 10:19 | Tomas Urban | Note Added: 0012180 |
20-06-2014 10:19 | Tomas Urban | Status | confirmed => resolved
20-06-2014 10:19 | Tomas Urban | Resolution | open => fixed
20-06-2014 10:19 | Tomas Urban | Assigned To | Tomas Urban => Gyorgy Rethy
24-07-2014 14:47 | Gyorgy Rethy | Note Added: 0012203 |
24-07-2014 14:47 | Gyorgy Rethy | Status | resolved => closed
24-07-2014 14:47 | Gyorgy Rethy | Fixed in Version | => v4.6.2 (interim 2014)

Notes

(0011935)
Jens Grabowski
07-04-2014 11:48

Agreed in principle.

(0011953)
Gyorgy Rethy
08-04-2014 10:31 (edited on: 08-04-2014 10:36)

STF478: Check where bid endian is specified in a reference-able way, e.g. in a standard. Also oct2int, unichar2oct are effected.

(0012000)
Axel Rennoch
10-04-2014 13:03

The list is not according to the latest version of ISO10646:2012 and has been updated. In addition abbreviations, attribute variants and references to ISO10646 have been updated.

(0012028)
Gyorgy Rethy
11-04-2014 13:46

Changes shall be marked with windows revision marking: easier to accept all, background colors has to be removed by sections (e.g. in tables we use background color intentionally).
1) I have extended the note in clause 27.5; depending on 2), itmay need be revised.
2) Old UCS-2 is a subset of UTF-16 (see also note in ISO 10646 p.16). So, in principle, deprecating UCS-2 should not cause any problem when testing SMS. However, this needed be cross-checked at the next session before the final decision is taken.
3) Descriptions of the new codepoints to be added to clause 27.5.
4) Deprecation of UCS-2 and UCS-4 shall be added to Annex G, as new clause G.10 (style of the previous clauses of Annex G can be used).
Updated text is uploaded in CR6706_resolution_v2.docx

(0012097)
Axel Rennoch
17-06-2014 09:23

background colors removed, cross-check with iso10646-2012-0 done

(0012113)
Gyorgy Rethy
17-06-2014 17:51 (edited on: 18-06-2014 08:35)

See some additions and corrections in CR6706_resolution_v4.docx. Also some issues are discovered: - description of codepoints UTF-16LE/BE and UTF-32LE/BE to be added to $27.5 - in predefined functions it has to be specified that the octets does not contain the BOMs - in the predefined functions the encoding string values UTF-16 and UTF-32 need to be defaulted to big endian explicitly

(0012123)
Axel Rennoch
18-06-2014 13:31

- discovered issues considered in uploaded version v5 - also: update of reference to ISO/IEC 10646 (2012)

(0012177)
Gyorgy Rethy
20-06-2014 09:55 (edited on: 20-06-2014 09:56)

CR6706_resolution_v6.docx. It is OK for me. Minor corrections and modifications are added (e.g. UCS Transformation Format -> UCS Encoding sccheme (the new name used in ISO/IEC 10646) note on BOMs moved to mandatory text etc.). Please cross-check and set to resolved if you agree (i.e. if you have only editorial changes).

(0012180)
Tomas Urban
20-06-2014 10:19

Cross-checked. Only minor editorial changes were made. The last version of the proposal solves the issue and it is ready for inclusion into the next version of the core language standard.

(0012203)
Gyorgy Rethy
24-07-2014 14:47

Added to master copy of V4.6.2.