Representation and Inference for Natural Language

Representation and Inference for Natural Language
Author: Patrick Blackburn
Publisher: Center for the Study of Language and Information Publica Tion
Total Pages: 0
Release: 2005
Genre: Computational linguistics
ISBN: 9781575864969

How can computers distinguish the coherent from the unintelligible, recognize new information in a sentence, or draw inferences from a natural language passage? Computational semantics is an exciting new field that seeks answers to these questions, and this volume is the first textbook wholly devoted to this growing subdiscipline. The book explains the underlying theoretical issues and fundamental techniques for computing semantic representations for fragments of natural language. This volume will be an essential text for computer scientists, linguists, and anyone interested in the development of computational semantics.

Representation Learning for Natural Language Processing

Representation Learning for Natural Language Processing
Author: Zhiyuan Liu
Publisher: Springer Nature
Total Pages: 319
Release: 2020-07-03
Genre: Computers
ISBN: 9811555737

This open access book provides an overview of the recent advances in representation learning theory, algorithms and applications for natural language processing (NLP). It is divided into three parts. Part I presents the representation learning techniques for multiple language entries, including words, phrases, sentences and documents. Part II then introduces the representation techniques for those objects that are closely related to NLP, including entity-based world knowledge, sememe-based linguistic knowledge, networks, and cross-modal entries. Lastly, Part III provides open resource tools for representation learning techniques, and discusses the remaining challenges and future research directions. The theories and algorithms of representation learning presented can also benefit other related domains such as machine learning, social network analysis, semantic Web, information retrieval, data mining and computational biology. This book is intended for advanced undergraduate and graduate students, post-doctoral fellows, researchers, lecturers, and industrial engineers, as well as anyone interested in representation learning and natural language processing.

Embeddings in Natural Language Processing

Embeddings in Natural Language Processing
Author: Mohammad Taher Pilehvar
Publisher: Morgan & Claypool Publishers
Total Pages: 177
Release: 2020-11-13
Genre: Computers
ISBN: 1636390226

Embeddings have undoubtedly been one of the most influential research areas in Natural Language Processing (NLP). Encoding information into a low-dimensional vector representation, which is easily integrable in modern machine learning models, has played a central role in the development of NLP. Embedding techniques initially focused on words, but the attention soon started to shift to other forms: from graph structures, such as knowledge bases, to other types of textual content, such as sentences and documents. This book provides a high-level synthesis of the main embedding techniques in NLP, in the broad sense. The book starts by explaining conventional word vector space models and word embeddings (e.g., Word2Vec and GloVe) and then moves to other types of embeddings, such as word sense, sentence and document, and graph embeddings. The book also provides an overview of recent developments in contextualized representations (e.g., ELMo and BERT) and explains their potential in NLP. Throughout the book, the reader can find both essential information for understanding a certain topic from scratch and a broad overview of the most successful techniques developed in the literature.

Natural Language Processing and Knowledge Representation

Natural Language Processing and Knowledge Representation
Author: Łucja M. Iwańska
Publisher: AAAI Press
Total Pages: 490
Release: 2000-06-19
Genre: Computers
ISBN:

"Traditionally, knowledge representation and reasoning systems have incorporated natural language as interfaces to expert systems or knowledge bases that performed tasks separate from natural language processing. As this book shows, however, the computational nature of representation and inference in natural language makes it the ideal model for all tasks in an intelligent computer system. Natural language processing combines the qualitative characteristics of human knowledge processing with a computer's quantitative advantages, allowing for in-depth, systematic processing of vast amounts of information.

Neural Network Methods in Natural Language Processing

Neural Network Methods in Natural Language Processing
Author: Yoav Goldberg
Publisher: Morgan & Claypool Publishers
Total Pages: 311
Release: 2017-04-17
Genre: Computers
ISBN: 162705295X

Neural networks are a family of powerful machine learning models and this book focuses on their application to natural language data. The first half of the book (Parts I and II) covers the basics of supervised machine learning and feed-forward neural networks, the basics of working with machine learning over language data, and the use of vector-based rather than symbolic representations for words. It also covers the computation-graph abstraction, which allows to easily define and train arbitrary neural networks, and is the basis behind the design of contemporary neural network software libraries. The second part of the book (Parts III and IV) introduces more specialized neural network architectures, including 1D convolutional neural networks, recurrent neural networks, conditioned-generation models, and attention-based models. These architectures and techniques are the driving force behind state-of-the-art algorithms for machine translation, syntactic parsing, and many other applications. Finally, we also discuss tree-shaped networks, structured prediction, and the prospects of multi-task learning.

Computational Semantics with Functional Programming

Computational Semantics with Functional Programming
Author: Jan van Eijck
Publisher: Cambridge University Press
Total Pages: 422
Release: 2010-09-23
Genre: Language Arts & Disciplines
ISBN: 1139490907

Computational semantics is the art and science of computing meaning in natural language. The meaning of a sentence is derived from the meanings of the individual words in it, and this process can be made so precise that it can be implemented on a computer. Designed for students of linguistics, computer science, logic and philosophy, this comprehensive text shows how to compute meaning using the functional programming language Haskell. It deals with both denotational meaning (where meaning comes from knowing the conditions of truth in situations), and operational meaning (where meaning is an instruction for performing cognitive action). Including a discussion of recent developments in logic, it will be invaluable to linguistics students wanting to apply logic to their studies, logic students wishing to learn how their subject can be applied to linguistics, and functional programmers interested in natural language processing as a new application area.

Building Large Knowledge-based Systems

Building Large Knowledge-based Systems
Author: Douglas B. Lenat
Publisher: Addison Wesley Publishing Company
Total Pages: 408
Release: 1989
Genre: Computers
ISBN:

Chapter one presents the Cyc "philosophy" or paradigm. Chapter 2 presents a global overview of Cyc, including its representation language, the ontology f its knowledge base, and teh environment which it functions. Chapter 3 goes into much more detail on the representation language, including the structure and function of Cyc's metalevel agenda mechanism. Chapter 4 presents heuristics for ontological engineering, the pricnples upon whcihc Cyc's ontology is based. Chapter 5 the provides a glimpse into the global ontology of knowledge. Chapter 6 explains how we "solve" (i.e., adequately handle) the various tough representation thorns (substances, time, space, structures, composite mental/physical objects, beliefs, uncertainty, etc. ). Chapter 7 surveys the mistakes that new knowledge tnereres most often commit. Chapter 8, the concluding chapter, includes a brief status report on the project, and a statement of goals and a timetable for the coming five years.

Enriched Meanings

Enriched Meanings
Author: Ash Asudeh
Publisher: Oxford Studies in Semantics an
Total Pages: 202
Release: 2020
Genre: Language Arts & Disciplines
ISBN: 0198847858

This book develops a theory of enriched meanings for natural language interpretation that uses the concept of monads and related ideas from category theory, a branch of mathematics that has been influential in theoretical computer science and elsewhere. Certain expressions that exhibit complex effects at the semantics/pragmatics boundary live in an enriched meaning space, while others live in a more basic meaning space. These basic meanings are mapped to enriched meanings only when required compositionally, which avoids generalizing meanings to the worst case. Ash Asudeh and Gianluca Giorgolo show that the monadic theory of enriched meanings offers a formally and computationally well-defined way to tackle important challenges at the semantics/pragmatics boundary. In particular, they develop innovative monadic analyses of three phenomena - conventional implicature, substitution puzzles, and conjunction fallacies - and demonstrate that the compositional properties of monads model linguistic intuitions about these cases particularly well. The analyses are accompanied by exercises to aid understanding, and the computational tools used are available on the book's companion website. The book also contains background chapters on enriched meanings and category theory. The volume is interdisciplinary in nature, with insights from semantics, pragmatics, philosophy of language, psychology, and computer science, and will appeal to graduate students and researchers from a wide range of disciplines with an interest in natural language understanding and representation.

Imagination and Convention

Imagination and Convention
Author: Ernest LePore
Publisher:
Total Pages: 305
Release: 2015
Genre: Language Arts & Disciplines
ISBN: 0198717180

How do hearers manage to understand speakers? And how do speakers manage to shape hearers' understanding? Lepore and Stone show that standard views about the workings of semantics and pragmatics are unsatisfactory. They advance an alternative view which better captures what is going on in linguistic communication.