Imagine a world where shipyards and vessels aren't just physical spaces but vibrant digital realms where engineers and operators collaborate effortlessly from afar—transforming how we build and maintain ships for a greener future. That's the exciting reality Turku University of Applied Sciences is pioneering, and it's sparking a revolution in industrial efficiency. But here's where it gets controversial: Is this metaverse magic truly a game-changer for sustainability, or could it inadvertently widen the gap between tech-savvy giants and smaller players in the maritime world? Stick around to explore this groundbreaking teleoperation solution on Nokia's platform, and you might just rethink how we navigate the seas of innovation.
Objective
At the heart of this initiative is Turku University of Applied Sciences' Necoverse project, aptly named Next Generation Training, Design, and Operation. Funded by Business Finland, this ambitious research aims to harness the power of an industrial metaverse—a virtual shared space where digital and physical worlds merge seamlessly. For beginners, think of the metaverse as an immersive online universe, like a supercharged video game, but designed for real-world applications such as training, designing, and operating equipment. Specifically, Necoverse focuses on integrating people, ships, and shipyards into this virtual environment to boost energy efficiency throughout the entire ship lifecycle, from initial design sketches to daily operations and ongoing maintenance.
The project cleverly blends cutting-edge technologies: sensor data that monitors everything from engine performance to environmental conditions, intuitive user interface designs that make complex tasks feel simple, and a multi-user virtual world where teams can interact as if they're in the same room. This fusion isn't just tech for tech's sake; it's about creating smarter, more sustainable practices that reduce waste and energy consumption in shipbuilding. For instance, by simulating ship designs virtually, engineers can test energy-saving modifications without wasting real materials, leading to greener outcomes like lower carbon footprints in construction and operation.
Solution
The star of the show is a teleoperation system built around a remotely controlled mobile robot—an Omron LD-60 model that's versatile enough to adapt to vessels, drones, or other moving platforms. This robot acts like an extension of the operator's eyes and hands, thanks to two 360-degree live cameras: one mounted directly on the robot for a first-person perspective, letting you see exactly what the robot sees, and another for a third-person overhead view of the surroundings, providing context like a drone's aerial feed.
To make decisions on the fly, the system incorporates a Heads-Up Display (HUD) developed by Turku UAS, which overlays real-time sensor data—such as temperature readings to detect overheating or humidity levels to prevent corrosion—straight into the user's Head-Mounted Display (HMD), computer screen, or even mobile device. This means operators can react instantly to issues, optimizing energy use in real-time. Picture a scenario where a remote engineer spots a leaky valve via the robot's camera and adjusts ship operations to conserve fuel, all without traveling to the site.
As the Research Group Leader for Futuristic Interactive Technologies at Turku University of Applied Sciences puts it, 'We are pleased to have the opportunity to develop the unique application on Nokia’s Real-time eXtended Reality Multimedia (RXRM) solution platform. Our cooperation with Nokia has been seamless at every step of the process. Moving forward we will continue to have the opportunity to further develop our own industrial metaverse environments by simultaneously leveraging the best features of the metaverse platform, Nokia’s RXRM technology and the Unity physics engine.' This quote highlights the smooth partnership, and it's the part most people miss—the way open collaboration between academia and industry accelerates innovation, potentially democratizing access to advanced tools.
But here's where it gets controversial: While this technology promises efficiency, critics might argue it prioritizes digital immersion over human jobs, potentially leading to job displacement in traditional shipyards. Is teleoperation a tool for empowerment or a step toward automation that leaves workers behind? Let's dive deeper.
Results
Turku UAS built this hybrid physical-virtual workspace on Nokia's RXRM technology, which excels at delivering crystal-clear multimedia in real-time while smartly managing bandwidth—a crucial factor for handling massive data streams without overwhelming networks. For those new to this, bandwidth refers to the amount of data that can travel through a connection, like a highway's capacity; RXRM optimizes it like a traffic controller to keep things flowing smoothly.
In the Turku UAS application, the RXRM viewport slashes the bandwidth needed for 360-degree video streaming by over 95%, making data transfers incredibly efficient in shared virtual spaces. This isn't just a minor tweak—it's a major leap that supports today's needs and future demands for huge data volumes, such as integrating AI-driven analytics into ship maintenance.
The proof? At the Imagine The Metaverse event in Finland, the system was put to the test, remotely operating between two cities about 160 kilometers apart. Over two days, it generated more than 1.8 terabytes of content while using just around 82 gigabytes for uplink—a staggering efficiency that kept 360-degree videos streaming flawlessly, without a single stutter. Imagine training a global team of shipbuilders in a virtual shipyard, all in real-time, cutting down on travel costs and carbon emissions from flights.
Beyond efficiency, Nokia RXRM fosters seamless collaboration among users from diverse locations or companies. Its high-fidelity real-time 360-degree streams create lifelike environments around robots, vessels, drones, or vehicles, enabling true remote operations. Each participant connects to the same camera feeds but enjoys a personalized viewport, tailoring their view to focus on specific tasks. Plus, wide LED walls, as used by Turku UAS, allow group visualizations, perfect for educational settings where trainees can practice emergency responses in a simulated ship fire without real risks.
Mobile real-time teleoperation unlocks endless possibilities, driving efficiencies in sectors like maritime, manufacturing, and even healthcare. For example, it could revolutionize offshore wind farm maintenance, where drones inspect blades remotely, reducing downtime and energy losses.
In wrapping this up, one can't help but ponder: Will this metaverse approach redefine maritime industries, making them more inclusive and eco-friendly, or does it risk creating digital divides where only the wealthy can afford such tech? And this is the part most people miss—the potential ethical dilemmas, like privacy concerns with constant sensor monitoring or the environmental trade-offs of producing all this tech. What do you think? Does teleoperation herald a brighter, more sustainable future, or are we overlooking hidden costs? Share your thoughts in the comments—agree, disagree, or add your own twist!
