Ongoing projects
Active research collaborations.
Initiatives where ORamaVR currently contributes as a technology provider, work-package lead, or use-case owner. Click a project to read the full description.
INDUX-R
OngoingA human-centric XR ecosystem for European industrial sectors, combining advances in light-field HMDs, XR media streaming, egocentric perception, and a zero-touch 5G architecture. ORamaVR leads the SDK for realistic animation and motion modelling.
Read more
INDUX-R envisions a human-centric XR ecosystem that will revolutionize European industrial sectors by empowering individuals and creating innovative XR products and services with significant added value. The project aims for concrete scientific breakthroughs integrated into technological enablers, applied in real-life use cases with potential for replication across applications.
Breakthroughs focus on core XR technologies, including the digitization and creation of XR assets, realistic animation, light-field HMDs, XR media streaming, and egocentric perception. To tackle the challenges of multi-user XR applications, INDUX-R develops a highly scalable, zero-touch 5G architecture and a secure, interoperable IoT network that can handle fluctuating demands and minimize resource waste.
Use cases span event planning, Industry 4.0, virtual medical training, cultural tourism, and sports event broadcasting. End-users are involved in every phase, from user requirements to final qualification of the ecosystem.
ORamaVR’s role. Leads the task of designing and developing an SDK for realistic animation and motion modeling in XR worlds. As a technology provider, ORamaVR offers advanced mesh operations on deformable surfaces, enabling user interaction with soft tissues such as human skin and other soft bodies, and provides algorithms for facial expressions on deformable avatars.
OMEN-E
OngoingDemocratizing VR medical metaverse content with an open, generative-AI, no-code neural authoring platform that enables medical organizations to mass-produce high-fidelity VR training simulations.
Read more
OMEN-E aims to democratize VR medical metaverse content creation and offer an open, generative-AI, no-code neural VR authoring platform to medical organizations, enabling the mass production of high-fidelity medical VR training simulations.
The vision is a unique authoring tool for the medical VR training metaverse that combines the ground-breaking creation features of “Wix/Wordpress” with generative-AI of “DALL-E/Get3D” methods, built on top of our existing Creator platform. Based on text prompts, mouse clicks, and recorded user gestures in VR, medical experts will be able to generate medical VR training simulations in a matter of hours.
OMEN-E will use this platform to author a rich Open Access collection of versatile medical VR training simulations, as a base for a leap forward in the currently forming medical metaverse. The Creator platform is positioned to become the de-facto world leader in the medical neural metaverse.
Viva-VOsCE
OngoingA VR platform to help medical schools deliver and assess Objective Structured Clinical Examinations (OSCEs) more efficiently, automating procedural aspects so examiners can focus on interpersonal and communication skills.
Read more
Viva-VOsCE, an Innosuisse project, aspires to develop a Virtual Reality platform to assist medical schools in delivering and assessing Objective Structured Clinical Examinations (OSCEs).
Physical OSCEs play a fundamental role in the practical assessment of medical degree learning outcomes but they are time- and asset-intensive. Viva-VOsCE will produce a VR-based OSCE platform to support medical schools and national accreditation bodies in reforming student assessment, significantly reducing logistical effort and lowering overall expenditure.
The project aims to automate procedural aspects of the assessment so clinical examiners can focus on interpersonal and communication skills during an OSCE. ORamaVR’s role: upscale its SDK with innovative features that enable the OSCE examiner to optimally and objectively assess an examinee’s overall performance.
FIDAL
OngoingAdvanced future-proof Evolved-5G test infrastructures with Zero-Touch orchestration and secure AI-as-a-Service. ORamaVR leads the XR-assisted services for public safety use case.
Read more
FIDAL, a Horizon Europe project, aspires to extend and deliver:
(i) advanced future-proof Evolved-5G test infrastructures, anticipating evolution into the next SNS phase;
(ii) open and accessible test environments to support 3rd-party vertical experiments;
(iii) rapid prototyping and large-scale validation of advanced, forward-looking applications.
Building on 5G-PPP Phase 3 success, FIDAL produces a unified experimentation framework with Zero-Touch orchestration, reusable network applications, and secure AI-as-a-Service capabilities, validating evolved 5G technologies in a user context that maximizes downstream take-up. This cultivates the ground for 6G and facilitates the convergence of cyber and physical worlds via the very low latency and high data capacity of Beyond-5G and 6G networks.
ORamaVR’s role. Leads the XR-assisted services for public safety use case.
PROFICIENCY
OngoingStandardised, proficiency-based surgical training curricula interfaced with simulation tools, spanning online VR, augmented box trainers, high-end simulators, AR-enabled open surgery, and immersive remote OR participation.
Read more
Training on patients according to “see one, do one, teach one” no longer matches today’s requirements and technical opportunities for surgical resident education. During the Covid-19 pandemic, most hands-on training had to be discontinued, leading to an almost complete interruption of surgical education.
Under the lead of three clinical partners—Kantonsspital St. Gallen, Centre Hospitalier Universitaire Vaudois, and Balgrist University Hospital, endorsed by the Swiss Surgical Societies—novel standardized and proficiency-based surgical training curricula are defined and interfaced to simulation tools. Implementation partners VirtaMed AG, Microsoft Mixed Reality, AI Zurich Lab, ORamaVR SA, and Atracsys LLC, in collaboration with ETHZ and ZHAW, develop innovative training tools across online VR, augmented box trainers, high-end simulators, AR-enabled open surgery, and immersive remote OR participation.
The developments introduce a fully novel, integrative training paradigm demonstrated on laparoscopy and arthroscopy, while generalizable to other interventions, setting new standards in Switzerland and abroad.
ORamaVR’s role. Leads the VR platform work-package in the Online/VR simulation subproject; contributes to AR Surgery training via expertise in surgical-phase detection; and provides visualizations, OR modelling, and multi-user cooperation for the AR/VR trainee application of the Virtual Surgery participation subproject.
Completed projects
Past research milestones.
Concluded R&D collaborations where ORamaVR delivered XR use cases, integrations, and prototype platforms.
REVIRES-MED
CompletedRevolutionary VR simulation-based medical training platform: productising the no-code Creator stack so doctors can author new VR training content rapidly and affordably, and addressing the global shortage of surgical training capacity.
Read more
There is a growing lack of surgeons globally and not enough surgeons are trained today for future needs. Access to quality medical services is very limited—5 billion people lack affordable surgical or anaesthesia care due to high medical costs and shortage of physicians.
The problem lies in the out-dated paradigm of surgical training that has not changed for 150 years despite technological advances. Time- and resource-intensive surgical apprenticeship is still the norm: a surgeon operates and the trainee observes. This is extremely costly and not an efficient way of preparing future surgeons.
Virtual reality can change the paradigm. Creator, developed by ORamaVR, is the world’s first hyper-realistic VR-based software platform for accelerated surgical training and assessment. With Creator, trainees perform life-like surgery simulations in a risk-free environment to improve patient outcomes. We have clinically proven that our software enhances skills acquisition compared to traditional methods.
We have developed a revolutionary technology that enables code-free creation of VR medical training content by medical professionals, removing the biggest obstacle to VR uptake—the lack of affordable content. By giving doctors the tools to create new training content rapidly and at a fraction of the cost of alternative technologies, REVIRES-MED productised our SDK to bring about long-expected proliferation of VR usage and tackle the €3 Billion Serviceable Obtainable Market. Trials further clinically validated the efficiency of training content created with Creator.
The project was implemented within the framework of the National Recovery and Resilience Plan “Greece 2.0”, with funding from the European Union – NextGenerationEU (Implementing Agency: MIA RI).
Intelligent Digital Surgeon
CompletedAn embodied virtual agent inside Creator that identified a trainee’s behavioural model and delivered personalised, real-time feedback, assessment, and recommendations—like a real surgical instructor.
Read more
The Intelligent Digital Surgeon was an Innosuisse-funded research project that designed and implemented an embodied virtual agent within the Creator medical training platform. Its main objective was to identify and analyse the immersed trainee’s behavioural model and provide personalized real-time feedback, assessment, and recommendations, like a real surgical instructor.
A deep-learning model identified the trainee’s behavioural model by recognizing and analysing hand/arm gestures and assisted the feedback decision engine with personalized assessment, real-time feedback, instructions, and recommendations. IDS could present each training module’s actions using the correct gestures. Creator also embedded methods of cutting and tearing on physics-based deformable surfaces that advanced state-of-the-art, with a distributed VR system architecture leveraging edge computing and 5G networks to support even low-spec HMDs.
ORamaVR’s role. Main implementation partner.
5G-EPICENTRE
CompletedAn open end-to-end 5G experimentation platform for public protection and disaster relief (PPDR). ORamaVR led the AR-assisted emergency surgical care use case.
Read more
5G is the next-decade mainstream broadband wireless technology and can leverage the efficiency and effectiveness of high-demand operations such as public protection and disaster relief (PPDR). ITU considers LTE-Advanced and 5G as mission-critical PPDR technologies able to address mission-critical voice, data, and video as an IMT radio interface.
5G-EPICENTRE delivers an open end-to-end 5G experimentation platform focusing on software solutions that serve the needs of PPDR. The platform enables SMEs and developers to acquire knowledge on the latest 5G applications and approaches for first responders and crisis management, and to build and experiment with their solutions. Based on an open service-oriented architecture and DevOps best practices (containerization of micro-services), the platform accommodates and provides open access to 5G network resources, acting as a 5G open-source repository for PPDR NetApps.
ORamaVR’s role. Responsible for the AR-assisted emergency surgical care use case.
CHARITY
CompletedCloud for Holography and Cross Reality: a complete framework for VR, AR, and holographic apps using an edge-native cloud architecture with autonomous computing/network-continuum orchestration. ORamaVR led the VR medical training use case.
Read more
Advanced media applications enabling immersive communication—Virtual Reality, Augmented Reality, and Holography—are becoming ubiquitous, but their requirements on compute and network are extreme. CHARITY proposes a complete framework that overcomes these challenges via an innovative cloud architecture exploiting edge solutions, autonomous compute-and-network-continuum orchestration, application-driven interfacing, smart and efficient resource management, strong community involvement, and broad compatibility with infrastructure vendors.
The framework is tested across holographic events, virtual reality training, and mixed reality entertainment, delivering a working prototype validated by demanding applications and exploitable by a wide community.
ORamaVR’s role. Use-cases work-package leader and main responsible for the VR Medical training use case.
ACCORDION
CompletedAn opportunistic edge-computing approach that pools public clouds, on-premise infrastructure, telco resources, and end-devices into latency-defined pools to support next-generation applications including collaborative VR.
Read more
Edge computing is poised to play a dominant role in upcoming technology developments. Its distributed and localized nature is intrinsically more “democratic” than cloud computing and, paired with 5G, gives the EU an opportunity to capitalize on local resources and its SME-dominated application landscape.
ACCORDION establishes an opportunistic approach that brings together edge resources and infrastructures (public clouds, on-premise, telco, even end-devices) in pools defined in terms of latency, supporting NextGen application requirements. To mitigate sparseness, ACCORDION intelligently orchestrates the compute-and-network continuum between edge and public clouds, using the latter as a capacitor. Deployment decisions are taken on privacy, security, cost, time, and resource criteria. An application framework leveraging DevOps and SecOps eases SME adoption.
ORamaVR’s role. Responsible for the collaborative VR use case, supporting cloud/edge network and compute resources.
VipGPU
CompletedA custom FPGA prototype combining low-power, multi-core GPUs with hardware accelerators tailored to two application scenarios: computer vision for mobile robotics, and VR medical surgical training. ORamaVR built a custom mobile VR prototype headset optimised for low-energy GPUs.
Read more
VipGPU develops new hardware and software technology to support cutting-edge scenarios: a computer-vision application for mobile robotics, and a VR application for medical training of surgical procedures. The project delivers an FPGA prototype based on Think Silicon’s multicore heterogeneous GPUs, optimized for both use cases.
Enhanced low-power GPUs and hardware accelerators. An FPGA prototype with very low-power multi-GPU, supporting OpenCL 2.0 and Vulkan; customized low-level libraries optimized for the Think Silicon architecture; and hardware accelerators tailored to the most performance-critical functions of the two applications.
Machine vision in mobile robotics. Accurate, real-time positioning and mapping for an autonomous robot under poor lighting and changing scenes, in a low-power processing subsystem that does not consume the robot’s processing power.
Virtual reality. An innovative environment for next-generation training games that exploits new real-time VR and motion-detection technologies, including: simulation of an orthopaedic surgeon training application; stereoscopic display in a new portable personal projection system based on the very-low-power GPUs (no PC required); and simplified creation of educational games for medical surgeon training.
ORamaVR’s role. Developing a custom mobile VR prototype headset optimized for low-energy GPUs. Funded by EYDE-ETAK (GR).
STARS PCP
CompletedAn innovative, sustainable platform supporting patient-centred perioperative education, stress management, and self-empowerment to reduce anxiety and improve outcomes throughout the surgical care path.
Read more
STARS PCP provides patients planned for surgery with a personalised platform aimed at reducing perioperative stress and anxiety and improving their condition along the complete care path. The solution adapts dynamically to patient preferences, needs, and medical history, with intelligent alerts, recommendations, motivation, and clinically validated educational content.
Key characteristics: combines services into a single personalisable platform; enables effective patient–physician interaction with timely outcome reports; supports return to normal daily life after surgery; promotes adherence to treatment and patient involvement in decision-making; offers psychological and emotional assessment and encouragement; supports lifestyle, diet, and activity management; multichannel anxiety-relief content; supports clinical-data collection for research; built around a cost-effective and sustainable model; operates in each buyer’s language and is extensible to additional EU languages; advanced security and data-management; sustainable framework for medium- and long-term large-scale deployment; uses state-of-the-art technologies adaptable to user needs and cultural profiles; compatible with current developments in European eHealth and mobile-health space; coherent iterative project-management plan; multidisciplinary, experienced consortium with multi-year R&D presence in personalised, predictive, preventive medicine, coaching, and virtual reality.
The solution is partially based on the continuation of R&D activities previously funded by the EU.
VRADA
CompletedAn attractive, self-regulating exercise program in a virtual environment integrated with an exercise apparatus, designed to support physical and cognitive function in people with dementia and Alzheimer’s disease.
Read more
An extensive body of research supports the role of exercise in health, physical functioning, quality of life, and in the prevention and rehabilitation of many conditions including dementia. Worldwide, 46.8 million people live with dementia, with 7.7 million new cases each year. In Greece, around 200,000 people suffer from Alzheimer’s, projected to reach 500,000 by 2050. Inactivity alone accounts for 3.8% of all dementia cases worldwide. Exercise improves health and cognitive functioning in these populations, but only when delivered in an enjoyable, attractive environment.
VRADA develops an attractive, innovative, self-regulating exercise program in a virtual environment integrated with an exercise apparatus, drawing on the latest findings of psychology, physiology, and virtual reality. The application incorporates self-regulation strategies (goal setting, self-talk), highly personalised intensity/duration protocols, and live in-VR readouts of distance, speed, intensity, heart rate, perceived fatigue, satisfaction, and enjoyment. Visual and auditory cues prompt the participant towards personalised goals, including cognitive exercises targeting memory.
The program is designed exclusively around patients with dementia and Alzheimer’s. The system is integrated with exercise bikes suitable for elderly users, validated through trials at the gyms of the Hellenic Association of Alzheimer’s Disease & Related Disorders, and its effectiveness assessed via experimental methods and neuropsychological, psychomotor, and neuroimaging evaluations.
ORamaVR’s role. Implementing the virtual environment platform that synchronizes movement from an exercise bicycle into VR input. Funded by EYDE-ETAK (GR).