Developers have been struggling to devise compelling uses for the Apple Vision Pro virtual reality headset, but the creators of the Flight Sight app believe they have cracked the code with their Robinson R44 immersive training content. Rogue Labs, which is developing the app, is using the Blackmagic Ursa Cine Immersive digital film camera and the DaVinci Resolve Studio to capture and edit the training material. Rogue Labs expects to release the app in the third quarter.
The app takes advantage of the Vision Pro to deliver immersive video “to put pilots in training in real-world scenarios so they can familiarize themselves with maneuvers and procedures without ever leaving the ground,” according to Blackmagic Design. There will also be interactive learning using 3D helicopter models and an immersive airport environment, airport procedure maps to help students visualize arrival and departure procedures, and sightseeing experiences.
“This format enables us to present flight training in a way that feels both physically engaging and instructionally effective,” said Rogue Labs senior product manager Corey Walter. “Capturing maneuvers from the pilot’s point of view introduces performance training objectives in an unparalleled way, where the brain registers the event as something the student has done in real life. Research shows that immersive first-person video can create a powerful sense of presence and trigger memory systems in the brain, helping learners feel like they’ve ‘already done it once’ before stepping into a real aircraft.”
Students will be able to watch an experienced instructor flying the R44 while the Ursa Cine camera captures the action from the right (pilot’s) seat. Maneuvers and procedures range from startup to advanced autorotations and include the preflight inspection process.
“The helicopter shots require a wide 3D field of view of the cockpit so viewers can see everything in the aircraft in detail, including what the instructor is doing with their hands and feet, the changing gauges, and the 180-degree world outside the helicopter’s windows,” said Rogue Labs founder Matt Barnes. “Shooting inside a helicopter is challenging because it is a tight fit. We found that completely eliminating the natural helicopter shake makes it feel fake. However, we can’t have too much shake, or you aren’t able to read the gauges, and people might become sick.”
“Only the resolution and quality provided by the combination of the Ursa Cine Immersive, DaVinci Resolve, and Apple Immersive Video met the strict requirements we set for this project, and, in fact, exceeded our requirements. We are very happy with the tools we have at our disposal, and we feel like we are living in the future.”