Baidu has a new trick for teaching AI the meaning of language

Earlier this month, a Chinese tech giant quietly dethroned Microsoft and Google in an ongoing competition in AI. The company was Baidu, China’s closest equivalent to Google, and the competition was the General Language Understanding Evaluation, otherwise known as GLUE.

GLUE is a widely accepted benchmark for how well an AI system understands human language. It consists of nine different tests for things like picking out the names of people and organizations in a sentence and figuring out what a pronoun like “it” refers to when there are multiple potential antecedents. A language model that scores highly on GLUE, therefore, can handle diverse reading comprehension tasks. Out of a full score of 100, the average person scores around 87 points. Baidu is now the first team to surpass 90 with its model, ERNIE.

The public leaderboard for GLUE is constantly changing, and another team will likely top Baidu soon. But what’s notable about Baidu’s achievement is that it illustrates how AI research benefits from a diversity of contributors. Baidu’s researchers had to develop a technique specifically for the Chinese language to build ERNIE. It just so happens, however, that the same technique makes it better at understanding English as well.

What is Baidu Ernie?

ERNIE 1.0 (Enhanced Representation through Knowledge Integration) was introduced by a Baidu research team in April 2019.

ERNIE 2.0, which debuted in July 2019, is a continual pretraining framework that incrementally builds and learns pretraining tasks through constant multi-task learning.

ERNIE’s predecessor

To appreciate ERNIE, consider the model it was inspired by: Google’s BERT. (Yes, they’re both named after the Sesame Street characters.)

Before BERT (“Bidirectional Encoder Representations from Transformers”) was created in late 2018, natural-language models weren’t that great. They were good at predicting the next word in a sentence—thus well suited for applications like Autocomplete—but they couldn’t sustain a single train of thought over even a small passage. This was because they didn’t comprehend meaning, such as what the word “it” might refer to.

But BERT changed that. Previous models learned to predict and interpret the meaning of a word by considering only the context that appeared before or after it—never both at the same time. They were, in other words, unidirectional.

BERT, by contrast, considers the context before and after a word all at once, making it bidirectional. It does this using a technique known as “masking.” In a given passage of text, BERT randomly hides 15% of the words and then tries to predict them from the remaining ones. This allows it to make more accurate predictions because it has twice as many cues to work from. In the sentence “The man went to the ___ to buy milk,” for example, both the beginning and the end of the sentence give hints at the missing word. The ___ is a place you can go and a place you can buy milk.

The use of masking is one of the core innovations behind dramatic improvements in natural-language tasks and is part of the reason why models like OpenAI’s infamous GPT-2 can write extremely convincing prose without deviating from a central thesis.

From English to Chinese and back again

When Baidu researchers began developing their own language model, they wanted to build on the masking technique. But they realized they needed to tweak it to accommodate the Chinese language.

In English, the word serves as the semantic unit—meaning a word pulled completely out of context still contains meaning. The same cannot be said for characters in Chinese. While certain characters do have inherent meaning, like fire (火, huŏ), water (水, shuĭ), or wood (木, ), most do not until they are strung together with others. The character 灵 (líng), for example, can either mean clever (机灵, jīlíng) or soul (灵魂, línghún), depending on its match. And the characters in a proper noun like Boston (波士顿, bōshìdùn) or the US (美国, měiguó) do not mean the same thing once split apart.

So the researchers trained ERNIE on a new version of masking that hides strings of characters rather than single ones. They also trained it to distinguish between meaningful and random strings so it could mask the right character combinations accordingly. As a result, ERNIE has a greater grasp of how words encode information in Chinese and is much more accurate at predicting the missing pieces. This proves useful for applications like translation and information retrieval from a text document.

The researchers very quickly discovered that this approach actually works better for English, too. Though not as often as Chinese, English similarly has strings of words that express a meaning different from the sum of their parts. Proper nouns like “Harry Potter” and expressions like “chip off the old block” cannot be meaningfully parsed by separating them into individual words.

ERNIE thus learns more robust predictions based on meaning rather than statistical word usage patterns.

A diversity of ideas

The latest version of ERNIE uses several other training techniques as well. It considers the ordering of sentences and the distances between them, for example, to understand the logical progression of a paragraph. Most important, however, it uses a method called continuous training that allows it to train on new data and new tasks without it forgetting those it learned before. This allows it to get better and better at performing a broad range of tasks over time with minimal human interference.

Baidu actively uses ERNIE to give users more applicable search results, remove duplicate stories in its news feed, and improve its AI assistant Xiao Du’s ability to accurately respond to requests. It has also described ERNIE’s latest architecture in a paper that will be presented at the Association for the Advancement of Artificial Intelligence conference next year. The same way their team built on Google’s work with BERT, the researchers hope others will also benefit from their work with ERNIE.

When we first started this work, we were thinking specifically about certain characteristics of the Chinese language, But we quickly discovered that it was applicable beyond that.

Hao Tian, Chief Architect of Baidu Research

References

[Bowman et al. 2015] Bowman, S. R.; Angeli, G.; Potts, C.; and Manning, C. D. 2015. A large annotated corpus
for learning natural language inference. arXiv preprint arXiv:1508.05326.
[Chen and Liu 2018] Chen, Z., and Liu, B. 2018. Lifelong machine learning. Synthesis Lectures on Artificial Intelligence and Machine Learning 12(3):1–207.
[Chen et al. 2018] Chen, J.; Chen, Q.; Liu, X.; Yang, H.; Lu, D.; and Tang, B. 2018. The bq corpus: A large-scale domainspecific chinese corpus for sentence semantic equivalence identification. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, 4946–4951.

Top 22 Best Artificial Intelligence And Robotics Movies

We feel the effects of artificial intelligence technology on our smartphones, computers, industry and healthcare sectors. In this list, we will remember the reflections of the artificial intelligence that directs our lives and the technology world in the cinema sector. 22 films that have been able to impressively reflect artificial intelligence technology.

Recently, we have started to hear the concept of artificial intelligence as often as we have never met. This technology, which is no longer a fantastic science fiction element but is included in our lives, is ranked first among the technology trends that will shape the years to come.

Artificial intelligence, which can be explained by the fact that computers can make use of human thinking, reasoning, perception, comprehension, judgment and inference abilities, is the understanding of information about the environment of a machine in practice.

In this way, an artificial intelligence system optimizes the acquired data and becomes usable in daily life. We can say that many studies have been done about artificial intelligence from past to present, some of them being shelved and some of them pioneering today’s technology.

My AI Movie TOP

I, ROBOT

I, Robot is a 2004 American neo-noir dystopian science fiction action film. Will Smith stars as Detective Del Spooner, who lives in the year 2035 when robots do everything.

MATRIX [1,2,3]

The Matrix is a 1999 science fiction action film written and directed by The Wachowskis, starring Keanu Reeves, Laurence Fishburne, Carrie-Anne Moss, Joe Pantoliano, and Hugo Weaving. The film received four Academy Awards in the technical categories. The film describes a future in which reality perceived by humans is actually the Matrix, a simulated reality created by sentient machines in order to pacify and subdue the human population while their bodies’ heat and electrical activity are used as an energy source.  A computer hacker learns from mysterious rebels about the true nature of his reality and his role in the war against its controllers.

A.I. ARTIFICIAL INTELLIGENCE

A.I. Artificial Intelligence, also known as A.I., is a 2001 American science fiction drama film directed by Steven Spielberg. A.I. tells the story a robot, a childlike android uniquely programmed with the ability to love. A robot boy programmed to experience human emotions embarks on a journey of self-discovery.

EX_MACHINA

Ex Machina is a 2015 British science fiction psychological thriller film written and directed by Alex Garland in his directing debut. It stars Domhnall Gleeson, Alicia Vikander and Oscar Isaac. Ex Machina tells the story of programmer Caleb Smith (Gleeson) who is invited by his employer, the eccentric billionaire Nathan Bateman (Isaac), to administer the Turing test to an android with artificial intelligence.

TRANSCENDENCE

Transcendence is a science fiction film costing $100 million to produce. Johnny Depp, Rebecca Hall, Paul Bettany, Kate Mara, Cillian Murphy, Cole Hauser, and Morgan Freeman are acting in this film. It was directed by Wally Pfister in 2014. This movie asks the question, “Will an artificial super-intelligence be created soon? If it is, are they able to upload consciousness into a computer? ”

WESTWORLD

Did you know that Westworld, a new television series from HBO, based on the Westworld (film) dated in 1973? At that time, Westworld was the first feature film to use digital image processing, to pixellate photography to simulate an android point of view.

CHAPPIE

If you have watched “Transcendence” before, when you watch “Chappie”, you will notice that both movies use the same concept. Visual effects are great and fantastic in this movie… The film has unbelievable special effects. It might even be worth watching just to see how impressive these special effects are.

The desire for immortality is quite fundamental to human nature. But seeing this desire on the robot with conscious is surprising in this movie…The new film “Chappie” features an artificially intelligent robot that becomes sentient and must learn to navigate the competing forces of kindness and corruption in the human world.

UNCANNY

Uncanny is a 2015 American science fiction film directed by Matthew Leutwyler and based on a screenplay by Shahin Chandrasoma. It is about the world’s first “perfect” artificial intelligence (David Clayton Rogers) that begins to exhibit startling and unnerving emergent behavior when a reporter (Lucy Griffiths) begins a relationship with the scientist (Mark Webber) who created it.

HER

“Her” is one of the top 20 artificial intelligence films – in pictures for The Guardian. According to Christopher Orr from The Atlantic, “Her” is the Best Film of the Year (2013). He says that “Thoughtful, elegant, and moving, Spike Jonze’s film about a man in love with his operating system is a work of sincere and forceful humanism”.

PASSENGERS

Passengers is a 2016 American science fiction film directed by Morten Tyldum and written by Jon Spaihts. It stars Jennifer Lawrence, Chris Pratt, Michael Sheen, and Laurence Fishburne. “Passengers” is the latest space adventure movie to hit theaters. It makes heavy use of robots and artificial intelligence to tell its story. While Passengers is set in the future, it shows us the robotics challenges that innovators and businesses face today.

SINGULARITY

Singularity is a 2017 American science fiction film written and directed by Robert Kouba, based on a story by Sebastian Cepeda. It stars John Cusack, Carmen Argenziano, Julian Schaffner, and Jeannine Wacker.

In 2020, Elias van Dorne (John Cusack), CEO of VA Industries, the world’s largest robotics company, introduces his most powerful invention–Kronos, a supercomputer designed to end all wars. When Kronos goes online, it quickly determines that mankind, itself, is the biggest threat to world peace and launches a worldwide robot attack to rid the world of the “infection” of man.

GHOST IN THE SHELL

Ghost in the Shell is an American science fiction crime drama film directed by Rupert Sanders and written by Jamie Moss, William Wheeler, and Ehren Kruger, based on the Japanese manga of the same name by Masamune Shirow. The film stars Scarlett Johansson, Takeshi Kitano, Michael Pitt, Pilou Asbæk, Chin Han and Juliette Binoche. 

2001: A SPACE ODYSSEY

2001: A Space Odyssey is a 1968 science-fiction film. The film deals with thematic elements of human evolution, technology, artificial intelligence, and extraterrestrial life, and is notable for its scientific realism, pioneering special effects, ambiguous and often surreal imagery, sound in place of traditional narrative techniques, and minimal use of dialogue. In 1991, it was deemed “culturally, historically, or aesthetically significant” by the United States Library of Congress and selected for preservation in their National Film Registry.

MORGAN

Morgan is a fantastic science fiction thriller material, great cinematography, acting, and great Artificial Intelligence Movie. Highly recommended. Morgan is different from the other AI movies. Here is the difference among the other Artificial Intelligence Movies; Morgan is the first-ever movie trailer made by artificial intelligence and so creepy. Scientists at IBM Research have collaborated with 20th Century Fox to create the first-ever cognitive movie trailer for the movie Morgan.

TOMORROWLAND

Tomorrowland is a 2015 American science-fiction mystery adventure film directed and co-written by Brad Bird. Bird co-wrote the film’s screenplay with Damon Lindelof, from an original story treatment by Bird, Lindelof and Jeff Jensen. The film stars George Clooney, Hugh Laurie, Britt Robertson, Raffey Cassidy, Tim McGraw, Kathryn Hahn, and Keegan-Michael Key. In the film, a disillusioned genius inventor and a teenage science enthusiast embark to an ambiguous alternate dimension known as “Tomorrowland” where their actions directly affect the world and themselves.

WALL-E

WALL-E is one of the last remaining robots, who develops a form of human-like intelligence toward the end of the 700 years spent on Earth. The film explores WALL-E’s love for a second robot named EVA. It is yet another examination of a scenario where artificial intelligence “evolves” into human-like form – complete with fears, anger, and of course love. This heartwarming story takes place in the distant future – 2805. Earth is nothing more than a massive garbage-heap, and Earth’s population has escaped the planet to live in starships, while the robots remain on Earth in order to clean up the planet.

THE MACHINE

The Machine is a 2013 British science fiction thriller film directed and written by Caradog W. James. It stars Caity Lotz and Toby Stephens as computer scientists who create artificial intelligence for the military. In efforts to construct perfect android killing machines in a war against China, UK scientists exceed their goal and create a sentient robot.

ANNIHILATION

Annihilation is a science fantasy action horror film written for the screen and directed by Alex Garland based on the novel of the same name by Jeff VanderMeer. The film stars Natalie Portman, Jennifer Jason Leigh, Gina Rodriguez, Tessa Thompson, Tuva Novotny, and Oscar Isaac.

BICENTENNIAL MAN

This movie starring Robin Williams is a drama about artificial life which strives to become human. In the early moments of the movie, a cyborg is being used as a butler for a wealthy family. This cyborg has a unique personality from the beginning. The youngest member of the family grows very close to the cyborg and grows up in his companionship. As time goes on, the little girl grows up and has a child of her own. The cyborg starts to go beyond the boundaries of artificial intelligence and begins to experience human emotions.

BLADE RUNNER

Blade Runner: 2049’s upcoming release is quickly approaching us. We will have to hold out two more months to learn what those mysteries maybe when the film hits theaters in Oct 2017. When we look at the new trailer dropped on Youtube, We see that the trailer is filled with action, aesthetic, and intrigue set 32 years in the future and Harrison Ford and Ryan Gosling are featuring stars and Denis Villeneuve directed this film. (He also directed Prisoners and Arrival). It seems that the Movie of November 2017 would be Blade Runner: 2049..

ROBOT AND FRANK

Robot & Frank is a 2012 American science fiction comedy-drama film directed by Jake Schreier and written by Christopher Ford. Perhaps most interesting for the way in which the film suggests that its protagonist finds a relative degree of peace through a friendship with a robot, at the same time that it rejects the notion that the robot possesses any kind of consciousness. A fascinating film that uses the idea of the robotic as a tool for reflection on the self, rather than on the mystery of the mechanical other.

METROPLIS

METROPOLIS… Artificial intelligence is nothing new, however. Screenwriters have been tinkering with the concept for nearly a century with varying degrees of success. While many credit Kubrick with popularizing AI in 2001: A Space Odyssey, the first known instance can be traced all the way back to Fritz Lang’s Metropolis from 1927

5 Dollars Logo vs AI-Generated for $7M

AI Logos for $150M.

Case

We are constantly looking for grows techniques. I decided to share with you a recently discovered arbitration case that is relatively easy and accessible to all.

Introduction

The $150 million logos were sold through the 99designs and Fiverr platforms in 2019. Okay, 99designs. At least real designers work there. But on Fiverr mostly work only low-level freelancers, generated logos on old-fashioned templates.

A bit of analysis

On Fiverr, in the Logo Design section, you need to sort by Best Selling and open many different Gigs, which (1K+). Some accounts have over 50K completed orders at prices ranging from $5 to $50 on average. Inside Gigs, there is another important open metric, “Orders in Queue” – orders in progress. Orders are executed under the conditions for 2-3 days. It is not difficult to calculate how much this Gig earns. Here are a couple of examples:

  1. Case 1: https://www.fiverr.com/weperfec…/design-an-impressive-logo In total 33K orders were fulfilled and currently there are 295 orders at 17.33 euros.
  2. Case 2: https://www.fiverr.com/ingeniousarts/design-unique-and-modern-minimalist-logo In total 3868 orders are executed, and in work at the moment 188 orders on 8.66 euros.

On the second example of the freelancer account for a year.

Where is the AI here, you ask?

We had to make the logo in 10 minutes. Google offered me a logo maker service https://looka.com/ The product turned out to be very cool.

What is a startup called Looka.com?

The startup started in 2016 and was originally called Logojoy. It was one of the top 5 most popular sites where you could assemble a logo in a minute using artificial intelligence.

Here you can read more about it: https://betakit.com/looka-lays-off-80-percent-of-staff-as-failed-rebrand-from-logojoy-cut-revenue-in-half/

The guys raised $7M and with this money developed a product that allows you to create endless variations of logos with the help of AI trained by an army of designers.

I suggest you go through onboarding and make your own impression.

How to create an own logo for 30 sec?

Create a modern logo for your business

Save money and time by creating an cool logo on your own! To make a logo template unique, you need to personalize it. Every element of your logo can be customized (custom gradient, cliparts, shadow effects, beautiful font and fill the background with your favorite colors).

  • Step 1
    Enter the brand’s name or company slogan. Make the search more specific by entering the keyword or choosing a proper category. Change the background color.
  • Step 2
    Pick a template from the variety of designs offered by the online logo generator.
  • Step 3
    Tweak each layer in the logo editor. Change the color of the whole logo or the separate elements. Change the font. Add shadow effects and combine the chosen design with cliparts (1M items) or with images uploaded from your device. Save all the logo drafts in your account.

TOP Logo Maker Services

#1 LogotypeMaker — this service is very similar to the previous one. You must select the appropriate category, and then edit it at your discretion. The site allows you to upload up to six logos for free. In addition, users can receive files in high resolution using LogotypeMaker, which can be used for printing, printing business cards and posters.Free Logo Maker & Logo Generator | Make a Logo OnlineThe best free logo maker & branding tool lets you create your company logo in minutes. Make your unique logo. No design…logotypemaker.com

#2 Logo Ease is a free online logo creation service. It is very easy to use. To start using it, click the Launch your logo button on the site toolbar and open the editor. To select a pattern, zoom, fill in different colors and more. After that, you need to download the file with the logo in ZIP format and use it on your website or blog.

http://www.logoease.com

Logo Ease Samples

#3 CoolText is one of the most popular free online publications. It allows you to create logos for free and without special knowledge in design. This service works only with text logos.

https://cooltext.com

#4 FlamingText is a text logo generator with over 200 different effects. The algorithm works: choose the effect, enter the desired text, edit the properties, save. By the way, besides the already familiar PNG, JPG and GIF, there is a PSD here.

FlamingText is free online logo generator that anyone can use to create a great logo in minutes! Just select one of our…flamingtext.com

Step-by-Step Guide to Using Your Logo on Social Media

Keep your brand looking professional and fresh, wherever it’s displayed! Read this step-by-step guide to using your logo on social media.