The virtual person Neon launched by Samsung at CES 2020 is the “embodiment” of artificial intelligence (AI) in the future.
At CES 2020 in Las Vegas (USA), the Samsung STAR Labs team introduced an artificial person called Neon.
“This is a great technology show, showing the future we make together,” said Pranav Mistry, the project leader of Neon in the beginning of the event. According to Mistry, Neon will be the way AI interacts, understands and shares with us in the future.
Artificial assistant in human form
Neon is not a robot or virtual voice assistant like Siri or Alexa. Instead, it is a smart assistant modeled after a human image, appearing on the screen to give feedback the same way the chatbot works.
Mistry introduces Neon with the desire that humans will interact with the virtual assistant emotionally, not mechanical commands like “Stop” or “(Play) the next (music) song”. I also want machines that can understand our emotions. When understood by machines, humans will interact with it like real people. That’s what Neon brings.
Neon’s booth at CES 2020 is covered with lots of screens showing people smiling, moving or whispering to visitors. All of them are Neon, a digital version of real people with AI-generated gestures and emotions. According to Mistry, his team brought Neon to CES just 4 months after the project began.
Neon was created by a technology called Core R3. R3 stands for 3 English letters starting with the letter R including reality (real), real time (real time) and responsive (quick response).
Core R3 has no ability to learn or memorize. Instead, the neural network will create the “person” of Neon by training it to simulate every gesture, emotion of the person, such as how to turn his head when happy, his mouth opened in surprise. .
When creating a Neon, Core R3 is considered to complete the task. From then on, Neon will continually rely on existing data to respond based on interaction with the real world, but it will not know or remember who you are.
Combined with cameras and sensors, Neon will react based on your emotions, and everything will disappear when the conversation is complete.
How does Neon help us?
Despite only being developed in 4 months, what Neon can do is very commendable. There are 2 modes that Neon has: auto mode to do whatever you want, direct mode will respond based on the opponent’s emotions.
Neon has many different ways to respond and will choose the appropriate way. He will laugh when you tell him to smile, but the way his eyes will be decided by Neon. Small details like eyebrows and head shakes are also emphasized. All are processed and responded to in just 20 milliseconds, almost immediately as people interact with each other.
A Neon can be customized for certain tasks such as yoga, language … Customer guide. Compared with robots or mere text screens, the advantage of Neon is that it appears before us as humans (even just through the screen).
There is still a long way to go
Of course, that’s not everything Neon can do.
Currently, Neon cannot know or remember who you are. When the interaction is over, everything will be deleted. However, the development team is working on a new version of Core R3 (Spectra project) to help Neon be able to remember and learn.
Combining these two capabilities with human-like interactivity, in the next few years Neon will become a true intelligent assistant.
At the presentation, Mistry talked a lot about vision, big thinking to create great things.
A member of the development team revealed to Digital Trends that in the future will create a unique image of each Neon instead of using images of real people to represent. When this happens, Neon will become a completely artificial person with his own appearance, voice, gestures and ability to learn and remember.
Mistry and STAR Labs are expected to launch the first test version of Neon and the Spectra project at the event called Neon 2020 in the near future.
“Over time, Neon can be developed to become a host, spokesperson or movie actor. Simply put, they can be companions,” representatives of STAR Labs said. .
What Neon did at CES 2020 is just the beginning, there is still a long way to go before Neon continues to grow. With STAR Labs’ ambition and vision, it will be interesting to look forward to new possibilities of Neon in the future.