Standard C++ provides a foundation for creating new, improved, and more powerful C++ components. IOStreams and locales are two such major components for text internationalization. As critical as these two APIs are, however, there are few resources devoted to explaining them.
Standard C++ IOStreams and Locales fills this informational gap. It provides a comprehensive description of, and reference to, the iostreams and locales classes, showing how to put them to use and offering advanced information on customizing and extending their basic operation. Written by two experts involved with the development of the standard, this book reveals the rationale behind the design of the APIs and points out their potential pitfalls.
This book serves as both a guide and a reference to C++ components. Part I explains iostreams, what they are, how they are used, their underlying architectural concepts, and the techniques for extending the iostream framework. Part II introduces internationalization and shows you how to adapt your program to local conventions. Readers seeking an initial overview of the problem domain will find an explanation of what internationalization and localization are, how they are related, and how they differ. With examples, the authors show the differences among cultural conventions, how C++ locales can be used to address such differences, and how locale framework can be extended to handle further, nonstandard cultural conventions.Standard C++ IOStreams and Locales:
IOStreams and locales serve as a foundation library that provides a number of ready-to-use interfaces, as well as frameworks that can be customized and extended. The class reference to C++ IOStreams and locales completes this comprehensive resource, which belongs in the libraries of all intermediate and advanced C++ programmers.
Guide to Readers.
PART I. STREAM INPUT AND OUTPUT.1. IOStreams Basics.
Input and Output.
The Predefined Global Streams.
The Input and Output Operators.
The Format Parameters of a Stream.
The Locale of a Stream.
Comparison Between Formatted Input and Output.
Peculiarities of Formatted Input.
The Stream State.
The Stream State Flags.
Checking the Stream State.
Catching Stream Exceptions.
Resetting the Stream State.
Creating, Opening, Closing and Destroying File Streams.
The Open Modes.
Bidirectional File Streams.
Synchronization of Streams.
Means of Synchronization.
Synchronization via flush() and sync().
Synchronization using the unitbuf Format Flag.
Synchronization by Tying Streams.
Synchronizing the Predefined Standard Streams.
Synchronization Among the Predefined Standard Streams.
Synchronization with the C Standard I/O.
Synchronization with the External Device.
Synchronization Between Predefined Standard for Narrow and Wide Characters.2. The Architecture of IOStreams.
The Stream Class.
The Stream Base Classes.
The General Stream Classes.
The Concrete Stream Classes.
How Streams Maintain their Stream Buffer.
Copying and Assignment of Streams.
How Streams Maintain Their Locale.
Collaboration Among Streams, Stream Buffers, and Locales.
The Stream Buffer Classes.
The Stream Buffer Abstraction.
String Stream Buffers.
File Stream Buffers.
Character Types and Character Traits.
Requirements of a Character Traits Type.
The End-of-File Character.
Copying, Finding, and Comparing Characters.
The Predefined Standard Character Traits.
Requirements for Character Types.
Stream Iterators and Stream Buffer Iterators.
The Concepts of Iterators in the Standard Library.
Output Stream Iterator.
Input Stream Iterator.
Stream Iterators are One-Pass Iterators.
Stream Buffer Iterators.
Output Stream Buffer Iterator.
Input Stream Buffer Iterator.
Additional Stream Storage and Stream Callbacks.
Additional Stream Storage.
Stream Callbacks.3. Advanced IOStreams Usage.
Input and Output of User-Defined Types.
The Signature of Inserters and Extractors.
First Inserters and Extractors.
Prefix and Suffix Operations.
Refined Inserters and Extractors.
Prefix and Suffix Operations.
Using the Refined Inserter and Extractor.
Generic Inserters and Extractors.
Simple Versus Refined Approach.
Manipulators Without Parameters.
Manipulators with Parameters.
Straightforward Manipulator Implementations.
Generalized Technique: Using a Manipulator Base Template.
Variants of a Manipulator Implementation.
Manipulator Base Template with Error Handling.
Manipulators with State.
The Standard Manipulator Base Type smanip.
Extending Stream Functionality.
Using Stream Storage for Private Use: iword, pword, and xalloc.
Initializing and Maintaining the iword/pword Index.
Implementing the Date Inserter.
Implementing the Maniuplator.
Using Stream Callbacks for Memory Management.
Error Indication of Stream Callback Functions.
Extending the Example.
Using the New Functionality.
Evaluation of the iword/pword Approach.
Creating New Stream Classes by Derivation.
Deriving the New Stream Classes by Derivation.
Implementing the Date Inserter and the Manipulator.
Implementing the Date Inserter.
Implementing the Manipulator.
Using the New Functionality.
Comparing Both Solutions—iword/pword Versus Derivation.
Adding Stream Buffer Functionality.
Deriving from the Stream Buffer Base Class.
Core Functionality of Stream Buffers Character Transportation.
Stream Buffer for Unbuffered Character Transport.
Stream Buffer for Buffered Character Transport.
Optional Functionality of Stream Buffers.
Providing New Stream Classes Along with New Stream Buffer Classes.
Deriving from Concrete Stream Buffer Classes.
II. INTERNATIONALIZATION.4. Introduction to Internationalization and Localization.
Internationalization and Localization.
Time and Date.
Terms and Definitions.
Character Encoding Schemes.
Japanese Multibyte Encoding Schemes.
Uses of Multibyte Encodings and Wide Characters.
Code Conversions.5. Locales.
Creating Locale Objects.
The Global Locale.
Retrieving Facets from a Locale.
use_facet.6. Standard Facets.
Alphabet- and Language-Related Facets.
Character Conversion to Upper- and Lowercase.
Character Conversion Between charT and char.
Special Properties of ctype<char>.
Formatting and Parsing Facets.
Numerical and Boolean Values.
The numpunct Facet.
The num_put Facet.
The num_get Facet.
The moneypunct Facet.
The money_put Facet.
The money_get Facet.
Date and Time Values.
The time_put Facet.
The time_get Facet.
Grouping of Standard Facets in a Locale.
The Standard Facet Families.
The Standard Facet Base Class Templates.
The Derived by name Facets.
Behavior of the Base Class Facets.
Mandatory Facet Types.
Diagram: Facets and Categories.
Advanced Usage of the Standard Facets.
Indirect Use of a Facet Through a Stream.
Use of a Facet Through a Locale.
Direct Use of the Facet Independent of a Locale.7. The Archtecture of the Locale Framework.
Identification and Lookup of Facets in a Locale.
Retrieval of Facets from a Locale.
Storing Facets in a Locale.
The Rationale Behind the Use of the Two-Phase Polymorphism.
Memory Management of Facets in Locale.
The Facet Reference Counter.
Immutability of Facets in a Locale.8. User-Defined Facets.
Adding a User-Defined Facet to an Existing Facet Family.
Defining a New Facet Family.Reference Guide.
tm.2. Character Traits.
global type definitions.
manipulators.4. Stream Iterators.
iterator category tags.
ostream_iterator<T,charT,traits,Distance>.5. Other I/O Operations.
basic_string<charT,traits,Allocator>.Appendix A: Parsing and Extraction of Numerical and bool Values.
A.1 Parsing Numerical Values.
A.2 Parsing bool Values.
A.3 Conversion Specifier and Length Modifier.Appendix B: Formatting of Numerical and bool Values.
B.1 Formatting Numerical Values.
B.2 Formatting bool Values.
B.3 Conversion Specifiers, Qualifiers, and Length Modifiers.Appendix C: strftime() Conversion Specifiers.
D.1 File Open Modes.
D.2 Stream Positions.Appendix E: Differences Between Classic and Standard IOStreams.
E.1 Templatizing the IOStreams Classes.
E.2 Splitting Base Class ios.
E.3 Indicating Errors.
E.4 Internationalizing IOStreams.
E.5 Removing_withassign Classes.
E.6 Removing File Descriptors.
E.7 String Streams: Replacing strstream by stringstream.
E.8 Changes to the Stream Buffer Classes.
E.9 Minor changes.Appendix F: Relationship Between C and C++ Locales.
F.1 Locale Categories in C and C++.
F.2 The Global Locale in C and C++.Appendix G: New C++ Features and Idoms.
G.1 Bitmask Types.
G.2 POD--Plain Old Data.
G.3 Explicit Constructors.
G.4 Template Specialization.
G.5 Default Template Arguments.
G.6 Explicit Template Argument Specification.
G.7 The Typename Keyword.
G.8 Dynamic Cast.
G.9 Function try Blocks.
G.10 Standard Exceptions.
G.11 Numeric Limits.
G.12 C++ Strings.Bibliography.
Since 1998, the programming language C++ has been formerly specified in the form of the ISO/IEC International Standard 14882, a document that for historical reasons is often referred to as the ANSI C++ Standard. Integral to this standard is a rich set of abstractions known as the C++ Standard Library. In fact, half of the standard is devoted to the library. This book covers two major domains of the standard library: IOStreams and locales.
During the process of standardization from 1989 to 1998, the new language features and the standard library created a fair amount of interest in the C++ community. To address this need for the information, several books were published during and after standardization. Some cover standard C++ in general, typically including a brief introduction to some of the library abstractions; one textbook is devoted exclusively to the standard library. However, the only part of the library that has been discussed in depth so far is the STL, a set of collections and algorithms that was developed at Hewlett-Packard independent of the standardization effort and was later integrated into C++ standard library. While the STL is, without doubt, the most popular part of the standard library, it represents less than a third of the library as a whole (counting the pages in the standards document and considering the time that the committee spent on it), whereas IOStreams and locales form another third of the library.
When we got involved with the standardization of C++ through our professional occupations in 1993, hardly anything had been published about IOStreams, and C++ locales had not yet been invented. The only book on IOStreams was the C++ IOStreams Handbook by Steve Teale, which describes the classic, prestandard IOStreams; and there was a definite lack of information regarding the standardized IOStreams. The situation has not radically changed since then. Even now, at the time of this writing in 1999, little has been published about the standardized IOStreams, and even less about C++ locales. The few books that exist about IOStreams are out of date; they all cover the classic, pre-standard IOStreams. The C++ textbooks provide introductory information about IOStreams but rarely anything about locales. For this reason, we felt the need for a book exclusively devoted to these topics that begins where the tutorials leave off.
This book is a programmer's guide to the standard IOStreams and locales, together with a complete reference of all relevant classes, functions, templates, headers, etc. It is neither a tutorial nor a textbook. It does not aim to teach the reader C++ or the basics of IOStreams. We expect of the readers that they know, at least roughly, what happens when they type a line of C++ code such as
cout << "Hello" << endl;
Hence this book is not for absolute beginners, but rather for C++ programmers who have been studying a C++ textbook, or have comparable practical experience, and who intend to use IOStreams and locales in more than a casual way.
As locales are an abstraction that is new to C++, as opposed to IOStreams, which has been around for more than a decade, we cover locales from the ground up. Some knowledge of locales in C will aid understanding, but it is not required. We do not aim to cover internationalization in a comprehensive way. Internationalization is too broad a topic, and an adequate discussion of it would fill another whole book. However, IOStreams and locales are closely related, and for this reason the book explains the concept of C++ locales, with emphases on usage of locales in conjunction with IOStreams.
Regarding IOStreams, we acknowledge the fact that the classic IOStreams library has been in existence since the early days of C++. We assume that readers are familiar with the basic features as they are explained in every C++ textbook. Instead of repeating the basics, we aim to go beyond that introductory level. For instance, we demonstrate advanced features--such as user-defined shift operators and manipulators, extending streams by use of iword/pword, and derivation of new stream and stream buffer classes--as well as less ambitious topics like format control and error handling.
Overall, the goal of this book is to provide as much information about the general principles as is needed to enable readers to accomplish their concrete programming tasks using IOStreams and locales. The focus is on the underlying concepts and the more advanced programming techniques that IOStreams and locales support, rather than on the details of each and every interface. For this reason we refrain from presenting extensive and lengthy case studies and code examples. IOStreams and locales are general purpose tools and can be used to solve a sheer abundance of problems. It would have been impossible to find a representative and comprehensive set of case studies. Instead, we concentrate on a few condensed examples that we use to explain programming techniques and concepts, and we deliberately refrain from blowing them up to full applications in order to avoid unnecessary distractions. We trust that readers will be astute enough to figure out concrete applications once the principles are clear.
We have received a considerable number of queries such as, "Why is this and that so and so?" seeking an explanation of why IOStreams and locales are designed the way they are. Where we know of an underlying rationale, we explain it. Yet there are inconsistencies and "interesting" design decisions that can be explained only by "historical reasons" or "design by committee." Where we feel that certain features introduce potential pitfalls, we point them out, so that the reader can avoid them. Beyond that, we neither aim to defend the standard nor intend to discuss alternative designs. We describe it as it is.
Writing this book took us more than three years, and during this long period many people helped us to endure and finish the task. As with any book, the authors are only part of the story, and we would like to thank all those people who contributed in one way or another.
At Addison-Wesley, we would like to thank Mike Hendrickson, Deborah Lafferty, and in particular Marina Lang; they believed in the value of this book and accompanied us through the entire process from proposal to print.
We would like to thank all those knowledgeable and patient people at the standards committee and elsewhere who answered our countless and sometimes stupid questions: Nathan Myers, who invented the C++ locales and proposed them to the standards com-mittee, told us everything about locales and helped us understand his proposal as well as any resulting discussions. Jerry Schwarz, who is the "father of IOStreams," that is, the author of the first version of IOStreams (or "streams" as they were called in C++ 1.0), gave us invaluable insights into the intent of many of the IOStreams features, and we thank him for his patience and support. Bill Plauger, author of the Microsoft version of the C++ standard library, helped us find bugs in the implementation resulting from misunder-standings on our side; he was also invaluable in helping us understand and interpret the standard correctly. Philippe LeMouel, a former colleague at RogueWaveSoftware, imple-mented IOStreams there and explained his implementation to us. Joe Delaney worked on RogueWave's implementation of locales. Dietmar Kuehl, worked on the implementation of IOStreams and locales for the gnu compiler. John Spicer of EdisonDesignGroup and Erwin Unruh of Siemens answered questions regarding templates and other language features. Beman Dawes, who maintains the library issue list for the standards committee helped clarify countless open issues in the standard.
Thanks also to our reviewers, some of whom spent a considerable amount of effort and time compiling thorough and helpful comments: (in alphabetical order) Chuck Allison, Stephen Clamage, Mary Dageforde, Amelia Lewis, Stan Lippman, Dietmar Kuehl, Werner Mossner, and Patrick Thompson, as well as others who preferred to stay anonymous.--Angelika Langer
I would like to thank Bernd Eggink, author of a book about the classic IOStreams written in German. Our email correspondence about IOStreams spawned the idea of a joint book project on the standard IOStreams. The original idea had been to translate his book into English and upgrade to the standard, but his sudden, serious illness thwarted our plans.
I would like to thank Thomas Keffer, the founder of RogueWaveSoftware, for coming up with the idea of writing a book of my own and for supporting and encouraging me ever since. I had been working at his company when he suggested the book project. I was a German alien working at a US corporation when he proposed that I write a book about internationalization in C++. I would like to thank Roland Hartinger, my former supervisor and head of the C++ compiler construction group at Siemens Nixdorf, who threw me into the library project and encouraged me to join the standards committee.
Last, but not least, I thank Klaus Kreft for joining me on this project. Without him this book would have never been finished, and not much is worth doing without him.--Angelike Langer
First of all, I would like to thank my parents for recognizing and fostering my interest and talent in mathematics and natural sciences. Without their support I would not be who I am. Next I thank two individuals whom I met through my professional work who were true sources of inspiration and insight: Gerhard Draxler, whom I miss tremendously since he retired from his professional life, and Werner Mossner, with whom I had my first contact with IOStreams. Together we implemented a logging facility by derivation from the IOStreams classes.
Finally, I thank Angelika Langer, who is a constant source of ideas and an overwhelmingly persistent workers. Without her effort this book would not have been finished, yet the significance of her contribution is nothing compared to what she means me to me in private life.--Klaus Kreft