The Formal Complexity of Natural Language

The Formal Complexity of Natural Language
Author: W.J. Savitch
Publisher: Springer Science & Business Media
Total Pages: 462
Release: 2012-12-06
Genre: Computers
ISBN: 9400934017

Ever since Chomsky laid the framework for a mathematically formal theory of syntax, two classes of formal models have held wide appeal. The finite state model offered simplicity. At the opposite extreme numerous very powerful models, most notable transformational grammar, offered generality. As soon as this mathematical framework was laid, devastating arguments were given by Chomsky and others indicating that the finite state model was woefully inadequate for the syntax of natural language. In response, the completely general transformational grammar model was advanced as a suitable vehicle for capturing the description of natural language syntax. While transformational grammar seems likely to be adequate to the task, many researchers have advanced the argument that it is "too adequate. " A now classic result of Peters and Ritchie shows that the model of transformational grammar given in Chomsky's Aspects [IJ is powerful indeed. So powerful as to allow it to describe any recursively enumerable set. In other words it can describe the syntax of any language that is describable by any algorithmic process whatsoever. This situation led many researchers to reasses the claim that natural languages are included in the class of transformational grammar languages. The conclu sion that many reached is that the claim is void of content, since, in their view, it says little more than that natural language syntax is doable algo rithmically and, in the framework of modern linguistics, psychology or neuroscience, that is axiomatic.

The Handbook of Computational Linguistics and Natural Language Processing

The Handbook of Computational Linguistics and Natural Language Processing
Author: Alexander Clark
Publisher: John Wiley & Sons
Total Pages: 802
Release: 2013-04-24
Genre: Language Arts & Disciplines
ISBN: 1118448677

This comprehensive reference work provides an overview of the concepts, methodologies, and applications in computational linguistics and natural language processing (NLP). Features contributions by the top researchers in the field, reflecting the work that is driving the discipline forward Includes an introduction to the major theoretical issues in these fields, as well as the central engineering applications that the work has produced Presents the major developments in an accessible way, explaining the close connection between scientific understanding of the computational properties of natural language and the creation of effective language technologies Serves as an invaluable state-of-the-art reference source for computational linguists and software engineers developing NLP applications in industrial research and development labs of software companies

Foundations of Computational Linguistics

Foundations of Computational Linguistics
Author: Roland Hausser
Publisher: Springer Science & Business Media
Total Pages: 541
Release: 2013-03-09
Genre: Computers
ISBN: 3662039206

The central task of future-oriented computational linguistics is the development of cognitive machines which humans can freely speak to in their natural language. This will involve the development of a functional theory of language, an objective method of verification, and a wide range of practical applications. Natural communication requires not only verbal processing, but also non-verbal perception and action. Therefore, the content of this book is organized as a theory of language for the construction of talking robots with a focus on the mechanics of natural language communication in both the listener and the speaker.

Regulated Rewriting in Formal Language Theory

Regulated Rewriting in Formal Language Theory
Author: Jürgen Dassow
Publisher: Walter de Gruyter GmbH & Co KG
Total Pages: 308
Release: 1990-01-14
Genre: Computers
ISBN: 3112737873

No detailed description available for "Regulated Rewriting in Formal Language Theory".

Mathematical Aspects Of Natural And Formal Languages

Mathematical Aspects Of Natural And Formal Languages
Author: Gheorghe Paun
Publisher: World Scientific
Total Pages: 502
Release: 1994-10-25
Genre: Computers
ISBN: 9814518158

This book contains original reviews by well-known workers in the field of mathematical linguistics and formal language theory, written in honour of Professor Solomon Marcus on the occasion of his 70th birthday.Some of the papers deal with contextual grammars, a class of generative devices introduced by Marcus, motivated by descriptive linguistics. Others are devoted to grammar systems, a very modern branch of formal language theory. Automata theory and the algebraic approach to computer science are other well-represented areas. While the contributions are mathematically oriented, practical issues such as cryptography, grammatical inference and natural language processing are also discussed.

Quantifiers in Language and Logic

Quantifiers in Language and Logic
Author: Stanley Peters
Publisher: Oxford University Press
Total Pages: 549
Release: 2006-04-27
Genre: Language Arts & Disciplines
ISBN: 019929125X

Quantification is a topic which brings together linguistics, logic, and philosophy. Quantifiers are the essential tools with which, in language or logic, we refer to quantity of things or amount of stuff. In English they include such expressions as no, some, all, both, and many. Peters and Westerstahl present the definitive interdisciplinary exploration of how they work - their syntax, semantics, and inferential role.Quantifiers in Language and Logic is intended for everyone with a scholarly interest in the exact treatment of meaning. It presents a broad view of the semantics and logic of quantifier expressions in natural languages and, to a slightly lesser extent, in logical languages. The authors progress carefully from a fairly elementary level to considerable depth over the course of sixteen chapters; their book will be invaluable to a broad spectrum of readers, from those with a basicknowledge of linguistic semantics and of first-order logic to those with advanced knowledge of semantics, logic, philosophy of language, and knowledge representation in artificial intelligence.

Language Complexity as an Evolving Variable

Language Complexity as an Evolving Variable
Author: Geoffrey Sampson
Publisher: OUP Oxford
Total Pages: 328
Release: 2009-02-26
Genre: Language Arts & Disciplines
ISBN: 0191567663

This book presents a challenge to the widely-held assumption that human languages are both similar and constant in their degree of complexity. For a hundred years or more the universal equality of languages has been a tenet of faith among most anthropologists and linguists. It has been frequently advanced as a corrective to the idea that some languages are at a later stage of evolution than others. It also appears to be an inevitable outcome of one of the central axioms of generative linguistic theory: that the mental architecture of language is fixed and is thus identical in all languages and that whereas genes evolve languages do not. Language Complexity as an Evolving Variable reopens the debate. Geoffrey Sampson's introductory chapter re-examines and clarifies the notion and theoretical importance of complexity in language, linguistics, cognitive science, and evolution. Eighteen distinguished scholars from all over the world then look at evidence gleaned from their own research in order to reconsider whether languages do or do not exhibit the same degrees and kinds of complexity. They examine data from a wide range of times and places. They consider the links between linguistic structure and social complexity and relate their findings to the causes and processes of language change. Their arguments are frequently controversial and provocative; their conclusions add up to an important challenge to conventional ideas about the nature of language. The authors write readably and accessibly with no recourse to unnecessary jargon. This fascinating book will appeal to all those interested in the interrelations between human nature, culture, and language.

Efficiency and Complexity in Grammars

Efficiency and Complexity in Grammars
Author: John A. Hawkins
Publisher: OUP Oxford
Total Pages: 324
Release: 2004-11-05
Genre: Language Arts & Disciplines
ISBN: 019151442X

This book addresses a question fundamental to any discussion of grammatical theory and grammatical variation: to what extent can principles of grammar be explained through language use? John A. Hawkins argues that there is a profound correspondence between performance data and the fixed conventions of grammars. Preferences and patterns found in the one, he shows, are reflected in constraints and variation patterns in the other. The theoretical consequences of the proposed 'performance-grammar correspondence hypothesis' are far-reaching — for current grammatical formalisms, for the innateness hypothesis, and for psycholinguistic models of performance and learning. Drawing on empirical generalizations and insights from language typology, generative grammar, psycholinguistics, and historical linguistics, Professor Hawkins demonstrates that the assumption that grammars are immune to performance is false. He presents detailed empirical case studies and arguments for an alternative theory in which performance has shaped the conventions of grammars and thus the variation patterns found in the world's languages. The innateness of language, he argues, resides primarily in the mechanisms human beings have for processing and learning it. This important book will interest researchers in linguistics (including typology and universals, syntax, grammatical theory, historical linguistics, functional linguistics, and corpus linguistics), psycholinguistics (including parsing, production, and acquisition), computational linguistics (including language-evolution modelling and electronic corpus development); and cognitive science (including the modeling of the performance-competence relationship, pragmatics, and relevance theory).

Information Theory and Language

Information Theory and Language
Author: Łukasz Dębowski
Publisher: MDPI
Total Pages: 244
Release: 2020-12-15
Genre: Mathematics
ISBN: 3039360264

“Information Theory and Language” is a collection of 12 articles that appeared recently in Entropy as part of a Special Issue of the same title. These contributions represent state-of-the-art interdisciplinary research at the interface of information theory and language studies. They concern in particular: • Applications of information theoretic concepts such as Shannon and Rényi entropies, mutual information, and rate–distortion curves to the research of natural languages; • Mathematical work in information theory inspired by natural language phenomena, such as deriving moments of subword complexity or proving continuity of mutual information; • Empirical and theoretical investigation of quantitative laws of natural language such as Zipf’s law, Herdan’s law, and Menzerath–Altmann’s law; • Empirical and theoretical investigations of statistical language models, including recently developed neural language models, their entropies, and other parameters; • Standardizing language resources for statistical investigation of natural language; • Other topics concerning semantics, syntax, and critical phenomena. Whereas the traditional divide between probabilistic and formal approaches to human language, cultivated in the disjoint scholarships of natural sciences and humanities, has been blurred in recent years, this book can contribute to pointing out potential areas of future research cross-fertilization.

Encyclopaedia of Mathematics, Supplement III

Encyclopaedia of Mathematics, Supplement III
Author: Michiel Hazewinkel
Publisher: Springer Science & Business Media
Total Pages: 564
Release: 2007-11-23
Genre: Mathematics
ISBN: 0306483734

This is the third supplementary volume to Kluwer's highly acclaimed twelve-volume Encyclopaedia of Mathematics. This additional volume contains nearly 500 new entries written by experts and covers developments and topics not included in the previous volumes. These entries are arranged alphabetically throughout and a detailed index is included. This supplementary volume enhances the existing twelve volumes, and together, these thirteen volumes represent the most authoritative, comprehensive and up-to-date Encyclopaedia of Mathematics available.