Fresh dialogue
The documentary and ai stories have been voiced since innovation China

In January, a documentary about China's latest scientific and technological achievements and innovative spirit, "innovation in China," hit the CCTV documentary channel. From life science and technology, new energy to manufacturing in a big country, this six-episode documentary tells us the rapid development of science and technology in the motherland with fresh and true stories, which is regarded as "self-expansion series" by many netizens. After watching the proud little flame burning in the body, I just want to make a crazy call for the motherland.


When all kinds of dark technologies sound like legends, the documentary, once regarded as a "highbrow" cultural territory, has accidentally become the "debut show" of high technology.


Speech recognition technology as part of artificial intelligence, China has reached the world's leading level, "innovation China" specially filmed and produced a paragraph for this. Shi yan, deputy director of CCTV documentary channel and general director of innovation China, therefore had a brainwave and came up with an idea: can we use artificial intelligence technology to simulate li yi's voice? So, the creative team and ustc have teamed up to do the commentary dubbing of artificial intelligence.


As the world's first large-scale documentary that USES artificial intelligence to simulate human voice, the commentary part of "innovation in China" USES artificial intelligence to dub the whole process. The voice of the late "master dub" has been "recreated" with the support of information technology.



On May 29, 2018, at the third fresh proposal real video conference, CCTV documentary channel held a meeting 2018 -- dialogue between documentaries and artificial intelligence, inviting the main creative team and technical cooperation team of innovation China to talk about the things behind the interpretation and dubbing of innovation China.


Detonate the content of scientific documentary and take the first step of innovation


"'innovation China 'is actually a chance encounter between documentary and artificial intelligence, and many of these innovations were forced out. But after this attempt, we hope to see if we can combine artificial intelligence and documentary creation in a deeper way in the future." As the initiator of this innovation attempt, shi yan Shared the origin and process of the creation of "innovation in China" on the spot. "At least we're starting to take this step, and if we don't, we may never know what it will bring to our industry in the future."



"Innovation China" sound producer, director of Beijing mu boss continent culture development co., LTD., voice and the king said, "in the process of creative documentaries tend to have a link called the voice, may be when we were doing the editing grasp the rhythm of psychological tools, a link, but this matter to the last also is only presents voice, have no a way and now compared to the present. Teacher li's pronunciation every word is very clean, his mood change is very stable, his axis is very accurate. So from this point of view, we think it's still technically possible to shape, like I said, the actors change a lot, it's technically easier.



As the technical partner of dubbing, jiang yuan, a senior researcher at iflytek AI research institute, responded to the difficulty of applying speech synthesis technology to the interpretation level at the art level from the perspective of technical operation. He said, the speech synthesis itself is to restore a person's voice, let him to speak, but beyond the text, more emphasis is on the emotions of the emotions, the film's rhythm, ups and downs control, etc., which is very easy for people to understand, but the computer to hate difficult. Although the sound synthesized by artificial intelligence is also clear, smooth and accurate, by contrast, some things in the inner quality of human voice, such as the expression of emotion, will be more abundant, which cannot be made up by current technology. This makes us see the gap between artificial intelligence technology and the performance level of human art. "If teacher li's reality show is a mount Everest, we are standing on the middle of the mountain, we know the distance difference in what place, but if you do not do this thing may not even have the opportunity to climb the mountain.



Zhang xiaolin, professor and director of Microsystems and information technology at the Chinese academy of sciences in Shanghai, has experienced the ups and downs of AI in the world over the past 30 years. The site Shared its understanding of artificial intelligence.



Open up new creative thinking


In view of this wave of artificial intelligence, yushi technology CEO, CEO wu gansha expressed his views on the scene. He mentioned that there are two explanations for AI in the academic world. One is called enhanced intelligence. The other is called artificial intelligence. Artificial intelligence can help our human artists to make documentaries better. This is enhanced intelligence. The other is that artificial intelligence can create its own documentaries, which may be artificial intelligence. "Whether or not AI will be able to be real-time in the future, to help us make a documentary at the moment of an event, that's what makes it so powerful. Another enhancement is that I need to restore something that is difficult to restore. I can synthesize it through AI, which has already appeared in innovation China.



In "point of view, from the present level of development of artificial intelligence is not enough mature, the artificial intelligence in the biggest value to promote the development of the social productive forces, is at the current development level of artificial intelligence to see he can achieve first-class expert level through study of leading experts, more than ordinary expert ability, then help social production to use relatively cheap, fast, ordinary expert level, to improve the whole social productivity". "The documentary field can also try to use more from this Angle to improve the efficiency and effect of documentary production, such as making some auxiliary design, generating some shooting scripts, making some video rough cuts or selection or experience of music, etc."

Wang also mentioned that although the integration of documentaries and artificial intelligence is still in the stage of mutual understanding and learning. However, he hopes that the whole industry can give the AI industry loose soil and appropriate rational attention, which may be more conducive to the next step of development.

After making this attempt, "innovation China" expresses its expectation to open up trans-boundary thinking and improve scientific literacy. However, how to make scientific documentaries bigger and stronger is what so many documentary makers need to discuss.