Word Frequency Distributions

Word Frequency Distributions
Author: R. Harald Baayen
Publisher: Springer Science & Business Media
Total Pages: 374
Release: 2001-07-31
Genre: Computers
ISBN: 9780792370178

This book is a comprehensive introduction to the statistical analysis of word frequency distributions, intended for computational linguists, corpus linguists, psycholinguists, and researchers in the field of quantitative stylistics. It aims to make these techniques more accessible for non-specialists, both theoretically, by means of a careful introduction to the underlying probabilistic and statistical concepts, and practically, by providing a program library implementing the main models for word frequency distributions.

Frequency in Language

Frequency in Language
Author: Dagmar Divjak
Publisher: Cambridge University Press
Total Pages: 343
Release: 2019-10-10
Genre: Language Arts & Disciplines
ISBN: 1107085756

Re-examines frequency, entrenchment and salience, three foundational concepts in usage-based linguistics, through the prism of learning, memory, and attention.

Frequency of Use and the Organization of Language

Frequency of Use and the Organization of Language
Author: Joan Bybee
Publisher: Oxford University Press
Total Pages: 374
Release: 2006-12-07
Genre: Language Arts & Disciplines
ISBN: 0198041292

This volume collects three decades of articles by the distinguished linguist Joan Bybee. Her articles essentially argue for the importance off frequency of use as a factor in the analysis and explanation of language structure. Her work has been very influential for a broad range of researchers in linguistics, particularly in discourse analysis, corpus linguistics, phonology, phonetics, and historical linguistics.

Word Frequency Studies

Word Frequency Studies
Author: Ioan-Ioviț Popescu
Publisher: Walter de Gruyter
Total Pages: 291
Release: 2009
Genre: Electronic books
ISBN: 3110218526

The present book finds and collects absolutely new aspects of word frequency. First, eminent characteristics (such as the h-point, first used in scientometrics, the k-, m-, and n-points) are introduced - it can be shown that the geometry of word frequency is fundamentally based on them. Furthermore, various indicators of text properties are proposed for the first time, such as thematic concentration, autosemantic text compactness, autosemantic density, etc. In detail, the autosemantic structure of a given text is evaluated by means of a graph representation and its properties (according to a problem from network research). Special emphasis is given to the part-of-speech differentiation, which plays a significant role in stylistics. On the basis of a general theory, which has been developed especially for linguistic research, problems of the frequency structure of texts with respect to word occurrence are investigated and discussed in detail. Methodologically, specific reference is made to synergetic linguistics, including some exemplary analyses, showing that there are points of contact with this field. A separate chapter is dedicated to within-sentence word position; this issue considers grammar as well as language genesis; another chapter is dedicated to the type-token ratio, discussing all established methods and their relevance for word frequency analysis. All methods presented in the book are statistically tested; to this end, some new tests have been developed. All procedures and calculations are conducted for 20 languages, ranging from Polynesia, Indonesia, India, and Europe to a North American Indian language. The broad distribution of the data and texts from all genres allows generalizations with respect to language typology.

Frequency and the Emergence of Linguistic Structure

Frequency and the Emergence of Linguistic Structure
Author: Joan L. Bybee
Publisher: John Benjamins Publishing
Total Pages: 502
Release: 2001-10-15
Genre: Language Arts & Disciplines
ISBN: 9027298033

A mainstay of functional linguistics has been the claim that linguistic elements and patterns that are frequently used in discourse become conventionalized as grammar. This book addresses the two issues that are basic to this claim: first, the question of what types of elements are frequently used in discourse and second, the question of how frequency of use affects cognitive representations. Reporting on evidence from natural conversation, diachronic change, variability, child language acquisition and psycholinguistic experimentation the original articles in this book support two major principles. First, the content of people’s interactions consists of a preponderance of subjective, evaluative statements, dominated by the use of pronouns, copulas and intransitive clauses. Second, the frequency with which certain items and strings of items are used has a profound influence on the way language is broken up into chunks in memory storage, the way such chunks are related to other stored material and the ease with which they are accessed to produce new utterances.

Text Mining with R

Text Mining with R
Author: Julia Silge
Publisher: "O'Reilly Media, Inc."
Total Pages: 193
Release: 2017-06-12
Genre: Computers
ISBN: 1491981628

Chapter 7. Case Study : Comparing Twitter Archives; Getting the Data and Distribution of Tweets; Word Frequencies; Comparing Word Usage; Changes in Word Use; Favorites and Retweets; Summary; Chapter 8. Case Study : Mining NASA Metadata; How Data Is Organized at NASA; Wrangling and Tidying the Data; Some Initial Simple Exploration; Word Co-ocurrences and Correlations; Networks of Description and Title Words; Networks of Keywords; Calculating tf-idf for the Description Fields; What Is tf-idf for the Description Field Words?; Connecting Description Fields to Keywords; Topic Modeling.