InterDigital, Blacknut, Nvidia Demonstrate Cloud Gaming Solution with AI-enabled User Interface
June 1, 2020
/ Posted By: Roya Stephens
The world’s first cloud-gaming solution with AI and machine learning-enabled user interface, developed by InterDigital and presented in collaborative partnership with Blacknut and in cooperation with Nvidia, represents the first time an AI/ML -driven user interface is utilized with a live cloud gaming solution, without the use of any wearables.
The technology demonstrates the incredible potential of integrating localized and far-Edge enabled AI capabilities into home gaming experiences. The solution leverages unique technologies, including real-time video analysis on home and local edge devices, dynamic adaptation to available compute resources, and shared AI models managed through an in-home AI hub to implement a cutting-edge gaming experience.
Users play a first-person view (FPV) snowboarding game displayed on a commercial television. Without need for a joystick or handheld controller, players’ movements and interactions are tracked by AI processing of the live video capture of their movements. The user’s presence is detected with an AI model and his or her body movements are matched with the snowboarder in the game, in real time, using InterDigital’s low latency Edge AI running on a local AI accelerator.
This groundbreaking solution addresses the challenges of ensuring the lowest possible end-to-end latency from gesture capture to game action, while accelerating inference of concurrent AI models serving multiple applications to deliver a more interactive and seamless gaming experience.
Cloud Gaming with Far Edge AI Deck
