Last week, VR Network (WeChat public number: VR platform) editors participated in the ACT TALK|Arts, Creativity, and Technology lecture series hosted by Tsinghua x-lab. In this class, the theme of “The feeling and imagination of sound art of scientific and technological creativityâ€, Dou Weizheng, professor and doctoral tutor of the Department of Electronics of Tsinghua University, and the main R&D team of the 97th alumni and former Qualcomm Audio Group of Tsinghua University, is the founder of Mizuo Technology. Xiang Xiangyi, together with the teacher-student representative of Tsinghua University and the enterprise representatives from Enlighten Digital Inc. / Enlighten Virtual Reality, discussed the combination of audio technology and sound art. Tsinghua x-lab Executive Director Mao Donghui delivered a speech before the formal opening of the lecture.
After the lecture, VR editors conducted an exclusive interview with the founder of Mi-Meng Technology on the main business of Meteor Technology, the difficulty and breakthrough of audio technology in VR, and the status quo of the development of VR industry. Perhaps the difference between XI and general VR industry practitioners is that he also respects the combination of technology and art.
The literary school hegemony originates and establishes Mi Yu technology to insist on using technology to enhance artBorn in a musical family, Xiang Xiang studied piano and oboe when he was young. After entering the Department of Electronic Engineering at Tsinghua University, he still maintained this habit. In addition to serving as the chief oboe of the Tsinghua University Symphony Orchestra, he also produced a solo album “To The Moments†in 2011. The achievement in music is also a basis for his later entrepreneurship. Later, he studied with real-time audio system expert Miller Puckette at the University of California, San Diego (UCSD), and successfully obtained a doctorate in computer music and modern digital audio technology.
“At that time, I liked to stay in various audio labs in the school every day. It was really quiet and easy to think about. At the same time, I listened to music there very well, and I made sounds in an array of speakers in a circle. Enjoy. The school's open academic atmosphere, various art forums and concerts also allow me to feel and learn like a sponge,†said Xiang Xu.
After that, he successfully entered Qualcomm and focused on audio post-processing and 3D audio. During this time, he participated in a large number of chip-level audio post-processing work, including Audio+ audio processing components used in almost all Qualcomm chip phones, HTC M9 mobile phone stereo speakers, experimental 8-speaker surround array, MPEG-H standard group HOA algorithm source code and more.
When the VR editor and the “literary literary tyrant†talked about the experience of creating Mint Muse Meehan Technology, he believes that entrepreneurship and music, are the first to have ideas, and then carefully polished, research methods. Michelin Science and Technology team began to do a variety of applications related to sounds long ago. After investing time in researching markets and products, it finally determined the direction: specializing in the editing and production of spatial audio.
At the beginning of the venture, he tried to do some audio-related apps, such as Loopless Relax Sound, a white noise generator, Binaural Beats Mint, which controls the frequency of sound waves to change the user's listening experience, and Oiday, a watermark camera that can record the current environment. . After that, he registered Mi Yee Technology and developed products and content based on 3D audio and VR audio in Shanghai and California.
“We firmly believe that good sounds need to be designed, software can polish the sound better, and good hardware can further consolidate these designs.†said Xiang Yu. According to VR network editors, currently Mi-Tech has developed software products such as game audio SDK, VR virtual cinema and the first VR audio workstation, as well as a microphone capable of recording panoramic sounds, as well as multi-channel speaker rendering and 3D content. Channel layout.
Develop VR audio editing tools for audio editorsIn recent years, with the fiery development of the VR industry, many companies have invested heavily in the development of space audio technology. For example, Facebook acquired the famous space audio technology company Two Big Ears, and released the Facebook 360 space audio workstation. Google, NVIDIA and Valve also provide VR audio editor SDK for VR content creators, but there are still many restrictions on the production of 3D audio source files.
First of all, traditional 3D audio production requires the use of "head recording" equipment to record 3D audio that can be used directly, but is expensive and complicated to operate. In the traditional film shooting process, it is not realistic to directly implement 3D recording. Another limiting factor is that the current editing tools for post-production 3D audio are too complex to operate, requiring audio producers to manually adjust the coordinate values ​​of each node based on the imagination of the sound field space settings. Depending on the software, the 3D audio production cycle is also It will become very long.
In response to this problem, Meteor Technology developed the world's first VR audio workstation "Sound Flare" and logged on to the Steam platform. With this application, editors can use HTC Vive to edit 3D audio visually in a VR environment, greatly reducing the 3D audio production cycle.
"Videos are generally captured by shooting, and not every object has its own positioning information as in the game. In order to allow editors to more easily perform WYSIWYG editing of sound objects, we believe that the best interaction The method is to put the editor into the VR environment, and then put the editing interface in. In this way, the adjustment of the displacement of the sound object can be directly operated in the VR environment, and the sound change caused by the rotation of the head can also be performed in real time. It is reflected in the VR environment."
According to the introduction, the content creator can wear VR heads, drag audio files directly on the software interface they see, in addition to adjusting basic functions such as duration, editing, volume adjustment, etc., by dragging and dragging key frames. In other ways, it is also possible to change the distance of the sound according to the vocal path, so that the vocal characters match the sound effects. In this way, the position information of the characters is consistent in both the sound and the picture, and VR video will be a truly personal “can forget the real sense of space of the worn deviceâ€.
"The "Sound Flare" editor is arguably the world's first audio post-processing tool that works directly on the VR interface." He said he hopes that "Sound Flare" will not only provide convenience to VR content creators, but also hope to use it. Popularization has brought new outbreaks in the VR content area.
VR Content Explosion Still Takes Time VR Audio Technology Still Needs ExplorationWhen VR Network (WeChat Public Number: VR Platform) edited and talked to the current VR industry, Xiang Xiang stated that VR has challenging technologies in the fields of vision, positioning, interaction and sound. The end result of the application is to give people a unique way to experience a virtual real world, or a virtual world that cannot be created in a real environment and is completely created. Let's re-experience it from a completely new perspective. Feelings.
Although with the development of virtual reality technology, we can easily have an immersive video viewing experience, but the audio content of VR has not kept pace with the video. Regardless of the breakthrough in VR in equipment and technology, if audio production has been in a state of lag, VR will still be restricted in its development. In other words, the industry landscape of VR content will depend to a large extent on the development of VR audio.
At present, Meteor Technology focuses on the development of panoramic sound and 3D audio technology, as well as related applications in VR. We are looking forward to the popularity of our products and we will use the panoramic sound and 3D audio technology to bring new breakthroughs in the production and dissemination of VR content.
"VR is an exciting new industry. Sound is an important part of the senses. It also needs better technology and special design."
About ACT TALK | Arts, Creativity, Science and Technology Lecture SeriesThe "ACT TALK | Art, Creativity, and Technology Seminar Series" was sponsored by Tsinghua x-lab. It was jointly initiated by professors from Tsinghua University's School of Economics and Management, the School of Humanities, and the Academy of Fine Arts. It has broken through inviting speeches from celebrities and scholars in various fields. At the same time as the boundaries of academic majors and industrial fields, students are encouraged to jump out of the mindset and learn and master the “thinking balance†of artistic creativity and technological creativity. This lecture series focuses on stimulating the imagination, creativity and action of students and teams, thereby innovating the beauty and crystallization of art and technology, and ultimately has a wide range of social influence through the promotion of commercialization. From the concept of activity to the presentation of form will fully reflect the educational philosophy of Tsinghua x-lab interdisciplinary, unexplored, experiential learning and team cooperation.
This article is original by VR net, please indicate VR net and chain back.
Insulation Silicone Fiberglass Sleeve
Insulation Silicone Fiberglass Sleeve,Acrylic Coated Fiberglass Sleeving,Silicone Fibreglass Cable Sleeve,Insulation Silicone Fibreglass Cable Sleeve
Longkou Libo Insulating Material Co.,Ltd. , https://www.liboinsulation.com