ODSC Europe 2018

London, UK

Listen to our Chief Scientist speak on Sep 22 at 2pm.

INSIDE THE BLACK BOX: HOW DOES A NEURAL NETWORK UNDERSTAND NAMES?

Abstract: A cornerstone of customer relationship management, chatbot analytics, and research automation systems, Named Entity Recognition (NER) is a key commercial application of Natural Language Processing (NLP). State of the art approaches to NER are purely data driven, leveraging deep neural networks to identify named entity mentions—such as people, organizations, and locations—in lakes of text data. In this talk, I will present our latest research on NER and provide real-life examples of how we are applying these cutting-edge techniques to ten different languages, including Spanish, English, Arabic, Persian, Korean, and Japanese. We’ll look at accuracy, speed, and memory footprint, while comparing some of the best known deep architectures with a basic statistical approach. I will focus on the interpretation of the network, when assigned to learn names across many languages.

We’ll start with a detailed description of our neural architecture for NER, which is based on a generic Long Short-Term Memory (LSTM) implementation, a specific flavour of recurrent neural network for sequence tagging. We encode word as well as letter embeddings as a single neural pipeline. Our decoder is based on Conditional Random Fields (CRF), leveraging label distributions from across the entire input text. We will then look into the internal network activation values, on different input conditions, with a special focus on highly inflected languages. Our latest findings show key neurons that get activated for different linguistic aspects.


Region

Event Type

Event Date

No events were found matching the selected filters
London, UK
Salwa, Kuwait
Tampa, FL
Las Vegas, NV
Montreal, Canada
Herndon, VA
Tokyo, Japan
Tokyo, Japan
Tokyo, Japan
Doha, Qatar
Washington, DC
Honolulu, HI
Tysons Corner, VA
Bathesda, MD
Omaha, NE
Tel Aviv, Israel
Arlington, VA
Myrtle Beach, SC
Tampa, FL
Boston, MA
Madrid, Spain
Springfield, VA
Washington, DC
Madrid, Spain
Farnborough, England
Arlington, VA
San Francisco, CA
Rome, Italy
Tokyo, Japan
Washington, DC
Chantilly, VA
Las Vegas, NV
Tokyo, Japan
Washington, DC
Santa Clara, CA
Tokyo, Japan
Tokyo, Japan
Tokyo, Japan
Herndon, VA
London, UK
Springfield, VA
Amsterdam, The Netherlands
Washington, DC
Abu Dhabi, UAE
Washington, D.C.
St. Louis, MO
New York, NY
London, UK
Serock, Poland
London, UK
Abu Dhabi, UAE
Boston, MA
Olympia, London, UK
Falls Church, VA
Springfield, VA
Norwood, MA
Nashville, TN
London, UK
San Fransisco, CA
Rome, Italy
Tokyo, Japan
Santa Clara, CA
Tokyo, Japan
London, U.K.
Boston, MA
Melbourne, Australia
Tampa, FL
Tokyo, Japan
Washington, D.C.
Atlanta, GA
Sydney, Australia
London, U.K.
New York, NY
Fairfax, Virginia
Tampa, Florida
Boston, Massachusetts
Orlando, Florida
Orlando, Florida
Herndon, Virginia
Baltimore, Maryland
New Orleans, Louisiana
McLean, Virginia
San Fransisco, CA