Telecom & Tech
Alaska Airlines | Airspace Intelligence
Tools for the Future, Today
Capitalizing on VR, AR, and AI
By Tracy Barbour
V

irtual reality (VR) was supposed to be the next big thing in the early ‘90s. Then the World Wide Web happened, and VR was sidelined for almost thirty years. Now, the technology to immerse users in a simulated setting is the next, next big thing, rebranded in some quarters as the “metaverse,” which blends innovations in hardware, networking, and artificial intelligence (AI).

VR’s sleeker and more pragmatic sister technology, augmented reality (AR), blends digital elements into the real world; it projects information on top of what the user is already seeing. The most familiar example is the 2016 game Pokémon Go, which superimposed imaginary creatures onto the environment viewed through a smartphone screen. AR, VR, and AI have since graduated beyond their initial uses in gaming and entertainment to much broader business applications.

For example, AR is being combined with excavator systems that use cameras mounted on heavy equipment to visually drape what is being built on top of what is there at the job site. This enables the operator to work more accurately, efficiently, quickly—and safely.

By 2024, more than 50 percent of user interface interactions will use AI-enabled computer vision, speech, and natural language processing, as well as AR and VR, according to market researcher International Data Corporation (IDC). And IDC predicts that at least 90 percent of new enterprise apps will embed AI by 2025.

“An immersive environment can be desirable to place the user in various scenarios and significantly improves knowledge retention over simple computer-based training.”
Daniel Sawyer, Principal Consultant, CTG
“AI and machine learning have applicability in a wide variety of industries, from cybersecurity to fisheries management, and have solutions for business processes,” says Alaska Developers Alliance Executive Director Andre Andrews. “AR and VR are innovations that can enhance the user experience and have changed how people might interact with products and people in the future.”

AI, VR, and AR can be particularly useful in Alaska. “A key benefit for any technology relevant to Alaska is in removing the need to travel—or if travel is needed, to know exactly why and what is needed to reduce the possibility of multiple trips—and to reduce the time onsite and maximize the value of the time spent,” says Daniel Sawyer, a principal consultant at Computer Task Group (CTG). “Advancements in technology such as AI and visualization through VR and AR can help meet the challenge in efficiency of identification, diagnosis, planning, and execution of work.”

There’s an obvious benefit to using VR for employee training. Sawyer, who specializes in deploying cost-efficient technology with a focus on user workflow to increase business productivity, says, “An immersive environment can be desirable to place the user in various scenarios and significantly improves knowledge retention over simple computer-based training.”

Digital twin technology creates a simulation of real-world equipment or facilities, enabling long-distance troubleshooting, training, or control.

Kartorium

Simulation of a facility
Digital twin technology creates a simulation of real-world equipment or facilities, enabling long-distance troubleshooting, training, or control.

Kartorium

Learning Simulators
Virtual training has existed in some form since the first flight simulators of the 1920s. From a barrel rigged with sticks and wires to the hydraulically actuated capsules of today, pilots have learned to fly using cockpit mock-ups tied to realistic displays of their surroundings. The latest version shrinks the system to a more affordable scale.
Alaska Airlines uses VR headsets to enhance its pilot training program. The headsets allow pilots to immerse themselves in a virtual cockpit so they can prepare for simulator training. The technology creates visuals that are shockingly realistic and convincing, says Pasha Saleh, head of corporate development at Alaska Airlines. “If you can have a student enter that simulator with a much better sense of the controls, it brings the training to life more,” he says. “You get a better training outcome.”

The use of VR headsets does not replace traditional training; it’s a supplemental study aid. “I’ve been a pilot for over thirty years, and had this been available when I was flying, it would have greatly reduced the time for learning,” Saleh says. “I expect great benefits.”

Headshot of Pasha Saleh
Pasha Saleh
Alaska Airlines
Alaska Airlines is also employing VR to support its maintenance training efforts. VR is a tremendous tool, Saleh says, and the company is just scratching the surface of what the technology can do. “It’s a really exciting time to be innovating in aviation,” he says.

Kartorium, an Alaskan-owned software startup founded in 2019, is developing VR in the form of 3D digital twins. A digital twin is a virtual representation of a physical environment, asset, or process. Anyone looking at the digital twin can see information about how the physical thing is doing in the real world.

A primary application for Kartorium’s digital twins is training. Not having to send trainees to a remote site saves on travel and assets. Or, conversely, a less-experienced worker can be sent to the field while an expert uses a digital twin to coach them through a procedure. “The thing I’ve been most encouraged by has been the ability to promote a less technical workforce,” says Jay Byam, Kartorium’s founder and CEO. “There is a huge turnover in workforce problems in Alaska. Either positions go unfilled or they are filled by experts Outside. The more we can empower local individuals to take care of utilities, I really see this as transformative.”
Headshot of Jay Byam
Jay Byam
Kartorium
The company’s digital-twin platform is also being used to address issues related to data availability. Businesses often have people using different systems and computers to manage their data, and not everyone will have access to that information. Digital twins can solve this problem. “If I can navigate to this 3D environment and get all the information I need to know, that cuts down on trouble-shooting time and a loss of assets—and it allows for greater efficiency,” Byam says.
The Flyways AI system by Airspace Intelligence recommends route changes for an Alaska Airlines dispatcher to choose.

Alaska Airlines | Airspace Intelligence

The Flyways AI system by Airspace Intelligence recommends route changes for an Alaska Airlines dispatcher to choose.

Alaska Airlines | Airspace Intelligence

Airline dispatcher simulation
Machine Control
Kartorium’s online drag-and-drop, digital twin platform helps visualize data and physical assets. Using a cloud-based tool, the user can access the VR construct through their web browser. One of the most basic ways to use digital twin technology is to navigate through an environment without having to physically go there. Byam explains, “It might be a power plant that you’re navigating through. From there, you can call out hotspots or assets in the environment that you want the user to know about. You can click on these things and the camera will go there. A side panel will pop up and give more details, which could include images and video.”

VR, AR, and AI have potential benefits for any facility or equipment control scenario. That’s the case at GPS Alaska, which provides machine control solutions in the construction, surveying, engineering, and natural resource development industries. “We take different positioning technology and we automate heavy equipment with that technology,” says Vice President Michael Williams. “We take paper plans and have them digitized… and put them into a computer.”

“Even smaller companies have the ability to harness these technologies because industry has been generous with free trainings, allowing businesses to understand which problems have already been solved and where they can’t help yet.”
Andre Andrews, Executive Director, Alaska Developers Alliance
Machine automation used to be an after-market add-on, but it’s becoming standard equipment. “It has really taken hold in the industry,” Williams says. “The OEMs [original equipment manufacturers] like John Deere and Caterpillar are starting to design their own system and install it at the factory.”
In addition to selling, installing, and calibrating infrastructure technology, GPS Alaska also provides service, training, and support. It is the only authorized Topcon Dealer in Alaska, and it offers additional products from other vendors such as Sokkia, Carlson Software, Pfreundt Scales, and RDS Technology.

Machine control software can automate graders, dozers, excavators, and other heavy equipment. For example, 3D machine control combines inputs from lasers, slope sensors, or sonic trackers, along with mounted sensors and satellite receivers. “The operator still has to drive the machine and understand how to move dirt around, but the blade is still controlled by that system,” Williams says.
However, with fewer details drawing their attention, operators make fewer mistakes and are less fatigued at the end of the day, according to Williams. They can improve their material placement speed and quality by 50 percent or more—and create a safer work environment and cost savings in the process.

Headshot of Andre Andrews
Andre Andrews
Alaska Developers Alliance
Machine control systems also improve accuracy, reducing the number of people needed to measure and set up grade stakes. “Bringing in automation frees up those guys and gets them out of harm’s way,” Williams says. “For construction companies, when you can increase how you ‘get to grade’ by 50 percent and the more accurately you can get something done, it’s money in the pocket.”

Such automation might threaten to take away a construction worker’s job, if not for the persistent shortage of skilled labor. “There’s simply not enough people out there to get the work done that needs to be done,” Williams says. Adding AI, AR, and VR to the crew multiplies the productivity of human workers.

McKinley CEO Rob Gillam, UAA Chancellor Sean Parnell, and members of team McKinley and UAA gathered outside the ADSAIL space at UAA’s College of Business and Public Policy.

McKinley Management

McKinley CEO Rob Gillam, UAA Chancellor Sean Parnell, and members of team McKinley and UAA gathered outside the ADSAIL space at UAA’s College of Business and Public Policy.

McKinley Management

members of team McKinley and UAA standing in UAA's College of Business and Public Policy
Ear to the Ground
Once confined to Isaac Asimov’s robot fantasies, AI is a commonplace tool, though often hidden from users. Machine learning has made great strides in visual perception, speech recognition, language translation, and decision-making.

Number crunching is still the most natural task for computers. McKinley Management, an investment, research, and consulting firm, employs AI for analytics services from its offices in Anchorage, Juneau, and Chicago. Financial services face a problem of managing massive amounts of data. “There are subsets of tools that help us deal with that problem,” says McKinley Management CEO Robert Gillam. “Tools like machine learning and natural language processing can read through all that data.”

McKinley partnered in 2019 with UAA’s Alaska Data Science and Artificial Intelligence Lab (ADSAIL) to focus on the use of data science and AI in finance. Under the academic partnership, student researchers earn college credits by exploring the application of AI and machine-learning skills to solve real-world problems in global financial markets.

“We need young people who are well-trained, and the tools for the future are not the tools of the past.”
Robert Gillam, CEO, McKinley Management
The ADSAIL program—which went on hiatus during the COVID-19 pandemic and is expected to restart next spring—selects two to four participants each semester. So far, ten students have completed the program, and Gillam is optimistic about its broad potential. “We’re thrilled about it,” he says. “It is going well—and I think it is getting even better.”

Student researchers work under the supervision of McKinley’s manager of data science in the firm’s Anchorage headquarters. Space for ADSAIL is currently designated at UAA on the third floor of the College of Business and Public Policy. As part of its contribution, McKinley is outfitting the space with technology to assist students in their data science and AI projects.

Headshot of Rob Gillam
Rob Gillam
McKinley Management
Participants of the ADSAIL program apply AI and machine learning to financial markets in a professional environment. McKinley, in turn, receives access to “smart kids with different perspectives” to conduct research. “It helps us keep our ear to the ground to explore new techniques,” Gillam says. “It also creates a conduit for us to give feedback to the university with skills development.”

AI is the tool of the future for financial services, Gillam says. Perhaps the most compelling insight he has gained from McKinley’s partnership with UAA is how important that tool is to workforce development. “We need young people who are well-trained,” he says, “and the tools for the future are not the tools of the past.”

“The thing I’ve been most encouraged by has been the ability to promote a less technical workforce. There is a huge turnover in workforce problems in Alaska. Either positions go unfilled or they are filled by experts Outside. The more we can empower local individuals to take care of utilities, I really see this as transformative.”
Jay Byam, Founder and CEO, Kartorium
Smart Routes
Optimizing finances led Alaska Airlines to adopt AI analytics last year. Alaska Airlines became the first commercial airline in the world to fully implement the new Flyways AI technology created by Silicon Valley-based Airspace Intelligence. The flight monitoring and routing platform uses machine learning to help dispatchers choose the best route structures to avoid congested airspace or bad weather. During 2021, the technology helped the airline optimize 20,869 flights; save 2.8 minutes of flight time per optimized flight; achieve a net savings of 241 pounds of fuel per flight optimized; and avoid 17.3 tons of estimated carbon dioxide emissions, according to Alaska Airlines’ 2021 Care Report.
“Flyways makes aviation faster, safer, and more environmentally friendly,” says Saleh. “It also makes aviation more predictable, and predictable arrival times are key to running an airline smoothly.”

Saleh says Flyways originated as a project by a few Google employees trying to solve problems around self-driving cars. Alaska Airlines felt their application would be ideal for the aviation industry. “The primary reason behind that is there’s nothing random that happens in the sky; the airline has to file a flight plan,” he explains.

Alaska Airlines has always been one of the most technologically advanced airlines in the world, Saleh says. It was the first airline to use GPS and to sell tickets on the internet.

Headshot of Daniel Sawyer
Daniel Sawyer
CTG
“Even smaller companies have the ability to harness these technologies,” says Andrews, “because industry has been generous with free trainings, allowing businesses to understand which problems have already been solved and where they can’t help yet.”

Companies should be wary of choosing a technology solution before evaluating alternatives, though. “Implementation of systems should be grounded in the size of the opportunity for business improvement, following a solid process of gathering requirements, solution selection, implementation, integration, and ongoing support and benefits realization,” says CTG’s Sawyer.

Streamlining tasks with VR, AR, and AI enables humans to focus on higher-order thinking that these technologies are not ready for. “These technologies are currently providing real value to businesses and have not yet peaked,” Andrews says. “There is still much to learn about this new frontier.”