Automatic language identifier

Information on the language identifier

Introduction

A language identifier is an automatic classifier. It calculates the similarity of a text with previously inserted reference texts.

Technology

It creates an n-dimensional representation of the text (Vector Space Model) by using the statistical properties of the byte sequences found in the text as coordinates. It performs the same operation on previously inserted reference texts. In the n-dimensional space, the inserted text will have a precise position. The reference text closest to it will be the one which most resembles it.

Why have we developed this?

This technology is an integral part of a spider able to extract useful information for our translators from the web.

As an automatic classifier, it can easily be used to say in which category a document belongs by providing example documents. For this, we are also using it to classify our correspondence and to identify the topic of a written text in a language we do not understand.

I want it!

If you are interested in this technology, please read more on Translated Labs and our services for natural language processing.

I can do better!

We are constantly looking to hire great engineers with a global mindset.
Get in touch if you think you can improve any of these these applications.

Get in touch

Explore our experiments

Spoken Language Identifier

The Spoken Language Identifier automatically detects the language of a spoken text. You can use it to classify recordings from 1 second to 1 minute. It currently supports 8 languages.

Learn more or Get API
Terminology Extractor

This tool automatically extracts the terminology of a technical topic from a written text. It can help translators identify the difficulties in a document, and simplify the process of creating glossaries.

Learn more or Get API
Readability analyzer

Written information, especially on the Internet, must be easy to read and well structured. This application helps you understand if a text is easily readable, or if it needs improvement.

Learn more or Get API
Language Identifier

The Language Identifier automatically detects the language of a written text. It can also be used to identify the topic of a written text in a language you do not understand.

Learn more
Semantic relationships

What do the words airplane, bird, and helicopter have in common? This application searches for semantic relationships in a text by analyzing the statistical properties of words.

Learn more
Translation Party

What happens when you translate an English sentence into Japanese, and then again into English, as if it was an infinite loop? Well, give it a try! And don't forget to share the funniest results with your friends.

Learn more