Cross-Lingual Word Embeddings

Cross-Lingual Word Embeddings
Author: Anders Søgaard
Publisher: Springer Nature
Total Pages: 120
Release: 2022-05-31
Genre: Computers
ISBN: 3031021711

The majority of natural language processing (NLP) is English language processing, and while there is good language technology support for (standard varieties of) English, support for Albanian, Burmese, or Cebuano--and most other languages--remains limited. Being able to bridge this digital divide is important for scientific and democratic reasons but also represents an enormous growth potential. A key challenge for this to happen is learning to align basic meaning-bearing units of different languages. In this book, the authors survey and discuss recent and historical work on supervised and unsupervised learning of such alignments. Specifically, the book focuses on so-called cross-lingual word embeddings. The survey is intended to be systematic, using consistent notation and putting the available methods on comparable form, making it easy to compare wildly different approaches. In so doing, the authors establish previously unreported relations between these methods and are able to present a fast-growing literature in a very compact way. Furthermore, the authors discuss how best to evaluate cross-lingual word embedding methods and survey the resources available for students and researchers interested in this topic.

EuroWordNet: A multilingual database with lexical semantic networks

EuroWordNet: A multilingual database with lexical semantic networks
Author: Piek Vossen
Publisher: Springer Science & Business Media
Total Pages: 180
Release: 2013-11-11
Genre: Computers
ISBN: 9401714916

This book describes the main objective of EuroWordNet, which is the building of a multilingual database with lexical semantic networks or wordnets for several European languages. Each wordnet in the database represents a language-specific structure due to the unique lexicalization of concepts in languages. The concepts are inter-linked via a separate Inter-Lingual-Index, where equivalent concepts across languages should share the same index item. The flexible multilingual design of the database makes it possible to compare the lexicalizations and semantic structures, revealing answers to fundamental linguistic and philosophical questions which could never be answered before. How consistent are lexical semantic networks across languages, what are the language-specific differences of these networks, is there a language-universal ontology, how much information can be shared across languages? First attempts to answer these questions are given in the form of a set of shared or common Base Concepts that has been derived from the separate wordnets and their classification by a language-neutral top-ontology. These Base Concepts play a fundamental role in several wordnets. Nevertheless, the database may also serve many practical needs with respect to (cross-language) information retrieval, machine translation tools, language generation tools and language learning tools, which are discussed in the final chapter. The book offers an excellent introduction to the EuroWordNet project for scholars in the field and raises many issues that set the directions for further research in semantics and knowledge engineering.

Embeddings in Natural Language Processing

Embeddings in Natural Language Processing
Author: Mohammad Taher Pilehvar
Publisher: Morgan & Claypool Publishers
Total Pages: 177
Release: 2020-11-13
Genre: Computers
ISBN: 1636390226

Embeddings have undoubtedly been one of the most influential research areas in Natural Language Processing (NLP). Encoding information into a low-dimensional vector representation, which is easily integrable in modern machine learning models, has played a central role in the development of NLP. Embedding techniques initially focused on words, but the attention soon started to shift to other forms: from graph structures, such as knowledge bases, to other types of textual content, such as sentences and documents. This book provides a high-level synthesis of the main embedding techniques in NLP, in the broad sense. The book starts by explaining conventional word vector space models and word embeddings (e.g., Word2Vec and GloVe) and then moves to other types of embeddings, such as word sense, sentence and document, and graph embeddings. The book also provides an overview of recent developments in contextualized representations (e.g., ELMo and BERT) and explains their potential in NLP. Throughout the book, the reader can find both essential information for understanding a certain topic from scratch and a broad overview of the most successful techniques developed in the literature.

Further with Knowledge Graphs

Further with Knowledge Graphs
Author: M. Alam
Publisher: IOS Press
Total Pages: 284
Release: 2021-09-23
Genre: Computers
ISBN: 1643682016

The field of semantic computing is highly diverse, linking areas such as artificial intelligence, data science, knowledge discovery and management, big data analytics, e-commerce, enterprise search, technical documentation, document management, business intelligence, and enterprise vocabulary management. As such it forms an essential part of the computing technology that underpins all our lives today. This volume presents the proceedings of SEMANTiCS 2021, the 17th International Conference on Semantic Systems. As a result of the continuing Coronavirus restrictions, SEMANTiCS 2021 was held in a hybrid form in Amsterdam, the Netherlands, from 6 to 9 September 2021. The annual SEMANTiCS conference provides an important platform for semantic computing professionals and researchers, and attracts information managers, IT­architects, software engineers, and researchers from a wide range of organizations, such as research facilities, NPOs, public administrations and the largest companies in the world. The subtitle of the 2021 conference’s was “In the Era of Knowledge Graphs”, and 66 submissions were received, from which the 19 papers included here were selected following a rigorous single-blind reviewing process; an acceptance rate of 29%. Topics covered include data science, machine learning, logic programming, content engineering, social computing, and the Semantic Web, as well as the additional sub-topics of digital humanities and cultural heritage, legal tech, and distributed and decentralized knowledge graphs. Providing an overview of current research and development, the book will be of interest to all those working in the field of semantic systems.

Representation Learning for Natural Language Processing

Representation Learning for Natural Language Processing
Author: Zhiyuan Liu
Publisher: Springer Nature
Total Pages: 319
Release: 2020-07-03
Genre: Computers
ISBN: 9811555737

This open access book provides an overview of the recent advances in representation learning theory, algorithms and applications for natural language processing (NLP). It is divided into three parts. Part I presents the representation learning techniques for multiple language entries, including words, phrases, sentences and documents. Part II then introduces the representation techniques for those objects that are closely related to NLP, including entity-based world knowledge, sememe-based linguistic knowledge, networks, and cross-modal entries. Lastly, Part III provides open resource tools for representation learning techniques, and discusses the remaining challenges and future research directions. The theories and algorithms of representation learning presented can also benefit other related domains such as machine learning, social network analysis, semantic Web, information retrieval, data mining and computational biology. This book is intended for advanced undergraduate and graduate students, post-doctoral fellows, researchers, lecturers, and industrial engineers, as well as anyone interested in representation learning and natural language processing.

Intelligent Data Engineering and Automated Learning – IDEAL 2021

Intelligent Data Engineering and Automated Learning – IDEAL 2021
Author: Hujun Yin
Publisher: Springer Nature
Total Pages: 663
Release: 2021-11-23
Genre: Computers
ISBN: 3030916081

This book constitutes the refereed proceedings of the 22nd International Conference on Intelligent Data Engineering and Automated Learning, IDEAL 2021, which took place during November 25-27, 2021. The conference was originally planned to take place in Manchester, UK, but was held virtually due to the COVID-19 pandemic. The 61 full papers included in this book were carefully reviewed and selected from 85 submissions. They deal with emerging and challenging topics in intelligent data analytics and associated machine learning paradigms and systems. Special sessions were held on clustering for interpretable machine learning; machine learning towards smarter multimodal systems; and computational intelligence for computer vision and image processing.

Early Years in Machine Translation

Early Years in Machine Translation
Author: W. John Hutchins
Publisher: John Benjamins Publishing
Total Pages: 412
Release: 2000-01-01
Genre: Language Arts & Disciplines
ISBN: 902724586X

This title details the history of the field of machine translation (MT) from its earliest years. It glimpses major figures through biographical accounts recounting the origin and development of research programmes as well as personal details and anecdotes on the impact of political and social events on MT developments.

Speech-to-Speech Translation

Speech-to-Speech Translation
Author: Yutaka Kidawara
Publisher: Springer Nature
Total Pages: 103
Release: 2019-11-22
Genre: Computers
ISBN: 9811505950

This book provides the readers with retrospective and prospective views with detailed explanations of component technologies, speech recognition, language translation and speech synthesis. Speech-to-speech translation system (S2S) enables to break language barriers, i.e., communicate each other between any pair of person on the glove, which is one of extreme dreams of humankind. People, society, and economy connected by S2S will demonstrate explosive growth without exception. In 1986, Japan initiated basic research of S2S, then the idea spread world-wide and were explored deeply by researchers during three decades. Now, we see S2S application on smartphone/tablet around the world. Computational resources such as processors, memories, wireless communication accelerate this computation-intensive systems and accumulation of digital data of speech and language encourage recent approaches based on machine learning. Through field experiments after long research in laboratories, S2S systems are being well-developed and now ready to utilized in daily life. Unique chapter of this book is end-2-end evaluation by comparing system’s performance and human competence. The effectiveness of the system would be understood by the score of this evaluation. The book will end with one of the next focus of S2S will be technology of simultaneous interpretation for lecture, broadcast news and so on.

A resource-light approach to morpho-syntactic tagging

A resource-light approach to morpho-syntactic tagging
Author: Anna Feldman
Publisher: BRILL
Total Pages: 199
Release: 2016-08-09
Genre: Language Arts & Disciplines
ISBN: 904202769X

While supervised corpus-based methods are highly accurate for different NLP tasks, including morphological tagging, they are difficult to port to other languages because they require resources that are expensive to create. As a result, many languages have no realistic prospect for morpho-syntactic annotation in the foreseeable future. The method presented in this book aims to overcome this problem by significantly limiting the necessary data and instead extrapolating the relevant information from another, related language. The approach has been tested on Catalan, Portuguese, and Russian. Although these languages are only relatively resource-poor, the same method can be in principle applied to any inflected language, as long as there is an annotated corpus of a related language available. Time needed for adjusting the system to a new language constitutes a fraction of the time needed for systems with extensive, manually created resources: days instead of years. This book touches upon a number of topics: typology, morphology, corpus linguistics, contrastive linguistics, linguistic annotation, computational linguistics and Natural Language Processing (NLP). Researchers and students who are interested in these scientific areas as well as in cross-lingual studies and applications will greatly benefit from this work. Scholars and practitioners in computer science and linguistics are the prospective readers of this book.

Towards Open and Trustworthy Digital Societies

Towards Open and Trustworthy Digital Societies
Author: Hao-Ren Ke
Publisher: Springer Nature
Total Pages: 483
Release: 2021-11-30
Genre: Computers
ISBN: 3030916693

This book constitutes the refereed proceedings of the 23rd International Conference on Asia-Pacific Digital Libraries, ICADL 2021, which was held in December 2021. Due to COVID-19 pandemic the conference was held virtually. The 17 full, 14 short, and 5 practice papers presented in this volume were carefully reviewed and selected from 87 submissions. The papers were organized in topical sections named: Knowledge Discovery from Digital Collections; Search for Better User Experience; Information Extraction; Multimedia; Text Classification and Matching; Data Infrastructure for Digital Libraries; Data Modeling; Neural-based Learning.