CAE has developed the first immersive pilot training app for Apple Vision Pro. The app, which CAE is demonstrating at NBAA-BACE, harnesses the power of spatial computing to improve how pilots train for flight deck interactions.
With this solution, CAE aims to shift aspects of pilot training from traditional training centers to remote environments. By providing pilots the ability to engage with flight deck controls and practice critical procedures from anywhere, the app could enhance flexibility and convenience in pilot training. CAE's app promises to not only improve the speed and effectiveness of training but also help pilots build muscle memory for operating various aircraft systems.
“The power and unique capabilities of Apple Vision Pro, combined with CAE’s training environment, will give pilots more flexibility and better prepare them for the transition from ground school to the simulator,” said Alexandre Prévost, CAE’s division president of business aviation training.
Emmanuel Levitte, CAE’s chief technology and product officer, said the app “will allow pilots to familiarize themselves with the flight deck, practice critical procedures, and develop muscle memory for key functions from anywhere. It will allow pilots to engage with realistic flight deck environments to further ensure they are ready for their full-flight simulator sessions and become even better prepared for any situation.”
The app offers three interactive modes. Exploration mode allows pilots to touch a specific control and view a description of its function. Guided mode walks them through procedures in a step-by-step sequence. The flight deck interaction mode lets pilots simulate natural interactions with the virtual flight deck, replicating real-world tasks such as activating the main battery switch.
CAE’s app, now in testing for the Bombardier Global 7500, will be available by the spring of 2025 and is set to complement existing training programs for both business and commercial pilots. With a growing demand for new pilot training, CAE’s innovation can enhance pilot readiness and efficiency.
I had the opportunity to try out the app using an Apple Vision Pro headset during a demonstration at NBAA-BACE. Erick Fortin, senior director of incubation at CAE, told AIN, “When the Apple Vision Pro came on the market last year, we wanted to know if we can give a virtual cockpit to every learner to learn how to fly the next aircraft.”
“For example, if you’re the pilot and you need to fly a different aircraft, you need to go back and train. That's a good thing—learning to fly a new aircraft,” Fortin explained. Now, those learning to fly could learn in the classroom with CAE and also continue learning and practicing at home or in their hotel room.
“The other question is, can you interact with a cockpit and a controller that you cannot touch? In the past, maybe you saw some people using joysticks. Now, we [just] do it with our hands.”
The device first needs to calibrate to the individual user’s eyes, which takes about a minute and a half. When the demonstration started, I used simple gestures to navigate, including tapping the air and touching my thumb and index finger together—a “pinching” motion—to interact with the flight deck and activate the main battery switch with ease.
While wearing the headset, I was able to read nearly everything on the virtual flight deck. “A few years ago, that was impossible,” Fortin said.
“It’s a new tool, and so far, we received great feedback,” he added, saying, “We are still developing this application; it’s not fully released yet.”
CAE plans to make the app available for other aircraft in addition to the Global 7500, according to Fortin, who told AIN, “At the moment, we do not need to work on more aircraft. The goal is to fine-tune the application.”