Home > Store

Multilingual Natural Language Processing Applications: From Theory to Practice

Register your product to gain access to bonus material or receive a coupon.

Multilingual Natural Language Processing Applications: From Theory to Practice

eBook (Watermarked)

  • Your Price: $103.99
  • Includes EPUB and PDF
  • About eBook Formats
  • This eBook includes the following formats, accessible from your Account page after purchase:

    ePub EPUB The open industry format known for its reflowable content and usability on supported mobile devices.

    Adobe Reader PDF The popular standard, used most often with the free Acrobat® Reader® software.

    This eBook requires no passwords or activation to read. We customize your eBook by discreetly watermarking it with your name, making it uniquely yours.

Not for Sale

Description

  • Copyright 2012
  • Dimensions: 7" x 9-1/8"
  • Edition: 1st
  • eBook (Watermarked)
  • ISBN-10: 0-13-704785-1
  • ISBN-13: 978-0-13-704785-7

Multilingual Natural Language Processing Applications is the first comprehensive single-source guide to building robust and accurate multilingual NLP systems. Edited by two leading experts, it integrates cutting-edge advances with practical solutions drawn from extensive field experience.

Part I introduces the core concepts and theoretical foundations of modern multilingual natural language processing, presenting today’s best practices for understanding word and document structure, analyzing syntax, modeling language, recognizing entailment, and detecting redundancy.

Part II thoroughly addresses the practical considerations associated with building real-world applications, including information extraction, machine translation, information retrieval/search, summarization, question answering, distillation, processing pipelines, and more.

This book contains important new contributions from leading researchers at IBM, Google, Microsoft, Thomson Reuters, BBN, CMU, University of Edinburgh, University of Washington, University of North Texas, and others.

Coverage includes

Core NLP problems, and today’s best algorithms for attacking them

  • Processing the diverse morphologies present in the world’s languages
  • Uncovering syntactical structure, parsing semantics, using semantic role labeling, and scoring grammaticality
  • Recognizing inferences, subjectivity, and opinion polarity
  • Managing key algorithmic and design tradeoffs in real-world applications
  • Extracting information via mention detection, coreference resolution, and events
  • Building large-scale systems for machine translation, information retrieval, and summarization
  • Answering complex questions through distillation and other advanced techniques
  • Creating dialog systems that leverage advances in speech recognition, synthesis, and dialog management
  • Constructing common infrastructure for multiple multilingual text processing applications

This book will be invaluable for all engineers, software developers, researchers, and graduate students who want to process large quantities of text in multiple languages, in any environment: government, corporate, or academic.

Sample Content

Table of Contents

Preface         xxi

Acknowledgments         xxv

About the Authors         xxvii

Part I: In Theory         1

Chapter 1: Finding the Structure of Words         3

1.1 Words and Their Components   4

1.2 Issues and Challenges   8

1.3 Morphological Models   15

1.4 Summary   22

Chapter 2: Finding the Structure of Documents         29

2.1 Introduction   29

2.2 Methods   33

2.3 Complexity of the Approaches   40

2.4 Performances of the Approaches   41

2.5 Features   41

2.6 Processing Stages   48

2.7 Discussion   48

2.8 Summary   49

Chapter 3: Syntax         57

3.1 Parsing Natural Language   57

3.2 Treebanks: A Data-Driven Approach to Syntax   59

3.3 Representation of Syntactic Structure   63

3.4 Parsing Algorithms 70

3.5 Models for Ambiguity Resolution in Parsing   80

3.6 Multilingual Issues: What Is a Token?   87

3.7 Summary   92

Chapter 4: Semantic Parsing         97

4.1 Introduction   97

4.2 Semantic Interpretation   98

4.3 System Paradigms   101

4.4 Word Sense   102

4.5 Predicate-Argument Structure 118

4.6 Meaning Representation   147

4.7 Summary   152

Chapter 5: Language Modeling          169

5.1 Introduction   169

5.2 n-Gram Models   170

5.3 Language Model Evaluation   170

5.4 Parameter Estimation   171

5.5 Language Model Adaptation   176

5.6 Types of Language Models   178

5.7 Language-Specific Modeling Problems  188

5.8 Multilingual and Crosslingual Language Modeling   195

5.9 Summary   198

Chapter 6: Recognizing Textual Entailment         209

6.1 Introduction   209

6.2 The Recognizing Textual Entailment Task   210

6.3 A Framework for Recognizing Textual Entailment   219

6.4 Case Studies   238

6.5 Taking RTE Further   248

6.6 Useful Resources   252

6.7 Summary   253

Chapter 7: Multilingual Sentiment and Subjectivity Analysis         259

7.1 Introduction   259

7.2 Definitions   260

7.3 Sentiment and Subjectivity Analysis on English   262

7.4 Word- and Phrase-Level Annotations   264

7.5 Sentence-Level Annotations   270

7.6 Document-Level Annotations   272

7.7 What Works, What Doesn’t   274

7.8 Summary   277

Part II: In Practice         283

Chapter 8: Entity Detection and Tracking         285

8.1 Introduction   285

8.2 Mention Detection   287

8.3 Coreference Resolution   296

8.4 Summary   303

Chapter 9: Relations and Events         309

9.1 Introduction   309

9.2 Relations and Events   310

9.3 Types of Relations   311

9.4 Relation Extraction as Classification   312

9.5 Other Approaches to Relation Extraction   317

9.6 Events   320

9.7 Event Extraction Approaches   320

9.8 Moving Beyond the Sentence   323

9.9 Event Matching   323

9.10 Future Directions for Event Extraction   326

9.11 Summary   326

Chapter 10: Machine Translation         331

10.1 Machine Translation Today   331

10.2 Machine Translation Evaluation   332

10.3 Word Alignment   337

10.4 Phrase-Based Models   343

10.5 Tree-Based Models   350

10.6 Linguistic Challenges   354

10.7 Tools and Data Resources   356

10.8 Future Directions   358

10.9 Summary   359

Chapter 11: Multilingual Information Retrieval         365

11.1 Introduction   366

11.2 Document Preprocessing   366

11.3 Monolingual Information Retrieval   372

11.4 CLIR   378

11.5 MLIR   382

11.6 Evaluation in Information Retrieval   386

11.7 Tools, Software, and Resources   391

11.8 Summary   393

Chapter 12: Multilingual Automatic Summarization         397

12.1 Introduction   397

12.2 Approaches to Summarization   399

12.3 Evaluation   412

12.4 How to Build a Summarizer   420

12.5 Competitions and Datasets   424

12.6 Summary   426

Chapter 13: Question Answering         433

13.1 Introduction and History   433

13.2 Architectures   435

13.3 Source Acquisition and Preprocessing   437

13.4 Question Analysis   440

13.5 Search and Candidate Extraction   443

13.6 Answer Scoring   450

13.7 Crosslingual Question Answering   454

13.8 A Case Study   455

13.9 Evaluation   460

13.10 Current and Future Challenges   464

13.11 Summary and Further Reading   465

Chapter 14: Distillation         475

14.1 Introduction   475

14.2 An Example   476

14.3 Relevance and Redundancy   477

14.4 The Rosetta Consortium Distillation System   479

14.5 Other Distillation Approaches   488

14.6 Evaluation and Metrics   491

14.7 Summary   495

Chapter 15: Spoken Dialog Systems         499

15.1 Introduction   499

15.2 Spoken Dialog Systems   499

15.3 Forms of Dialog   509

15.4 Natural Language Call Routing   510

15.5 Three Generations of Dialog Applications   510

15.6 Continuous Improvement Cycle   512

15.7 Transcription and Annotation of Utterances   513

15.8 Localization of Spoken Dialog Systems   513

15.9 Summary   520

Chapter 16: Combining Natural Language Processing Engines         523

16.1 Introduction   523

16.2 Desired Attributes of Architectures for Aggregating Speech and NLP Engines   524

16.3 Architectures for Aggregation   527

16.4 Case Studies   531

16.5 Lessons Learned   540

16.6 Summary   542

16.7 Sample UIMA Code   542

Index         551

Updates

Submit Errata

More Information

InformIT Promotional Mailings & Special Offers

I would like to receive exclusive offers and hear about products from InformIT and its family of brands. I can unsubscribe at any time.

Overview


Pearson Education, Inc., 221 River Street, Hoboken, New Jersey 07030, (Pearson) presents this site to provide information about products and services that can be purchased through this site.

This privacy notice provides an overview of our commitment to privacy and describes how we collect, protect, use and share personal information collected through this site. Please note that other Pearson websites and online products and services have their own separate privacy policies.

Collection and Use of Information


To conduct business and deliver products and services, Pearson collects and uses personal information in several ways in connection with this site, including:

Questions and Inquiries

For inquiries and questions, we collect the inquiry or question, together with name, contact details (email address, phone number and mailing address) and any other additional information voluntarily submitted to us through a Contact Us form or an email. We use this information to address the inquiry and respond to the question.

Online Store

For orders and purchases placed through our online store on this site, we collect order details, name, institution name and address (if applicable), email address, phone number, shipping and billing addresses, credit/debit card information, shipping options and any instructions. We use this information to complete transactions, fulfill orders, communicate with individuals placing orders or visiting the online store, and for related purposes.

Surveys

Pearson may offer opportunities to provide feedback or participate in surveys, including surveys evaluating Pearson products, services or sites. Participation is voluntary. Pearson collects information requested in the survey questions and uses the information to evaluate, support, maintain and improve products, services or sites, develop new products and services, conduct educational research and for other purposes specified in the survey.

Contests and Drawings

Occasionally, we may sponsor a contest or drawing. Participation is optional. Pearson collects name, contact information and other information specified on the entry form for the contest or drawing to conduct the contest or drawing. Pearson may collect additional personal information from the winners of a contest or drawing in order to award the prize and for tax reporting purposes, as required by law.

Newsletters

If you have elected to receive email newsletters or promotional mailings and special offers but want to unsubscribe, simply email information@informit.com.

Service Announcements

On rare occasions it is necessary to send out a strictly service related announcement. For instance, if our service is temporarily suspended for maintenance we might send users an email. Generally, users may not opt-out of these communications, though they can deactivate their account information. However, these communications are not promotional in nature.

Customer Service

We communicate with users on a regular basis to provide requested services and in regard to issues relating to their account we reply via email or phone in accordance with the users' wishes when a user submits their information through our Contact Us form.

Other Collection and Use of Information


Application and System Logs

Pearson automatically collects log data to help ensure the delivery, availability and security of this site. Log data may include technical information about how a user or visitor connected to this site, such as browser type, type of computer/device, operating system, internet service provider and IP address. We use this information for support purposes and to monitor the health of the site, identify problems, improve service, detect unauthorized access and fraudulent activity, prevent and respond to security incidents and appropriately scale computing resources.

Web Analytics

Pearson may use third party web trend analytical services, including Google Analytics, to collect visitor information, such as IP addresses, browser types, referring pages, pages visited and time spent on a particular site. While these analytical services collect and report information on an anonymous basis, they may use cookies to gather web trend information. The information gathered may enable Pearson (but not the third party web trend services) to link information with application and system log data. Pearson uses this information for system administration and to identify problems, improve service, detect unauthorized access and fraudulent activity, prevent and respond to security incidents, appropriately scale computing resources and otherwise support and deliver this site and its services.

Cookies and Related Technologies

This site uses cookies and similar technologies to personalize content, measure traffic patterns, control security, track use and access of information on this site, and provide interest-based messages and advertising. Users can manage and block the use of cookies through their browser. Disabling or blocking certain cookies may limit the functionality of this site.

Do Not Track

This site currently does not respond to Do Not Track signals.

Security


Pearson uses appropriate physical, administrative and technical security measures to protect personal information from unauthorized access, use and disclosure.

Children


This site is not directed to children under the age of 13.

Marketing


Pearson may send or direct marketing communications to users, provided that

  • Pearson will not use personal information collected or processed as a K-12 school service provider for the purpose of directed or targeted advertising.
  • Such marketing is consistent with applicable law and Pearson's legal obligations.
  • Pearson will not knowingly direct or send marketing communications to an individual who has expressed a preference not to receive marketing.
  • Where required by applicable law, express or implied consent to marketing exists and has not been withdrawn.

Pearson may provide personal information to a third party service provider on a restricted basis to provide marketing solely on behalf of Pearson or an affiliate or customer for whom Pearson is a service provider. Marketing preferences may be changed at any time.

Correcting/Updating Personal Information


If a user's personally identifiable information changes (such as your postal address or email address), we provide a way to correct or update that user's personal data provided to us. This can be done on the Account page. If a user no longer desires our service and desires to delete his or her account, please contact us at customer-service@informit.com and we will process the deletion of a user's account.

Choice/Opt-out


Users can always make an informed choice as to whether they should proceed with certain services offered by InformIT. If you choose to remove yourself from our mailing list(s) simply visit the following page and uncheck any communication you no longer want to receive: www.informit.com/u.aspx.

Sale of Personal Information


Pearson does not rent or sell personal information in exchange for any payment of money.

While Pearson does not sell personal information, as defined in Nevada law, Nevada residents may email a request for no sale of their personal information to NevadaDesignatedRequest@pearson.com.

Supplemental Privacy Statement for California Residents


California residents should read our Supplemental privacy statement for California residents in conjunction with this Privacy Notice. The Supplemental privacy statement for California residents explains Pearson's commitment to comply with California law and applies to personal information of California residents collected in connection with this site and the Services.

Sharing and Disclosure


Pearson may disclose personal information, as follows:

  • As required by law.
  • With the consent of the individual (or their parent, if the individual is a minor)
  • In response to a subpoena, court order or legal process, to the extent permitted or required by law
  • To protect the security and safety of individuals, data, assets and systems, consistent with applicable law
  • In connection the sale, joint venture or other transfer of some or all of its company or assets, subject to the provisions of this Privacy Notice
  • To investigate or address actual or suspected fraud or other illegal activities
  • To exercise its legal rights, including enforcement of the Terms of Use for this site or another contract
  • To affiliated Pearson companies and other companies and organizations who perform work for Pearson and are obligated to protect the privacy of personal information consistent with this Privacy Notice
  • To a school, organization, company or government agency, where Pearson collects or processes the personal information in a school setting or on behalf of such organization, company or government agency.

Links


This web site contains links to other sites. Please be aware that we are not responsible for the privacy practices of such other sites. We encourage our users to be aware when they leave our site and to read the privacy statements of each and every web site that collects Personal Information. This privacy statement applies solely to information collected by this web site.

Requests and Contact


Please contact us about this Privacy Notice or if you have any requests or questions relating to the privacy of your personal information.

Changes to this Privacy Notice


We may revise this Privacy Notice through an updated posting. We will identify the effective date of the revision in the posting. Often, updates are made to provide greater clarity or to comply with changes in regulatory requirements. If the updates involve material changes to the collection, protection, use or disclosure of Personal Information, Pearson will provide notice of the change through a conspicuous notice on this site or other appropriate way. Continued use of the site after the effective date of a posted revision evidences acceptance. Please contact us if you have questions or concerns about the Privacy Notice or any objection to any revisions.

Last Update: November 17, 2020