Creation of the sequences:

10 sequences were created using the Unity game engine to load and play several games. We captured the frame buffers using Unity Recorder and custom post-processing shaders in both the built-in render pipeline and the High-Definition Render Pipeline. We captured the color buffer into an RGBA16 Signed Float texture as well as the depth and optical flow in a second similar texture (with the linear depth info encoded into the R channel, and the [X,Y] coordinates of the motion vectors into the [G,B] channels). The textures were recorded at 60FPS in 1080p and 4K resolutions and written into uncompressed EXR 16 bit images. Two YUVs sequences were then generated. The depth is stored in the Y channel and converted to 14 bits to avoid high bit-depth coding, vertical and horizontal motion vectors are stored at quarter pixel precision in U/V channels for the corresponding texture frame.

Figure 1 /3D_game _kit_Level-1 sequence Frame #10 top left YUV texture, top right, depth information (Y), bottom left vertical motion (V), bottom right horizontal motion (U)

3D_game_kit Sequences description

Two 10 seconds HD sequences representing two different levels in the 3D_game_kit and one 10 seconds 4K sequence were generated from the Unity Asset 3D game kit available at https://assetstore.unity.com/packages/templates/tutorials/3d-game-kit-115747. The sequence represents a FPS type of game, where a character is exploring an alien planet.

Figure 2: 3D -game kit level-1 screenshot

Figure 3: 3D_game_kit_level-2 screenshot

Figure 4: 3D_game_kit_4K

Darktree Sequence description:

Darktree is a typical first-person shooter (FPS) type of game in a realistic environment generated from the Unity Asset available at: https://assetstore.unity.com/packages/templates/systems/darktree-fps-v1-4-142383

Figure 5 : DarkTree screenshot

Fontainebleau Sequence description:

Two 10 seconds HD sequences representing two different modes (cinematic and first person view) in the Fontainebleau demo and one 10 seconds 4K sequence were generated from the Unity Asset available at https://github.com/Unity-Technologies/FontainebleauDemo The sequences represent the Fontainebleau forest under different lighting conditions.

Figure 6: Fontainebleau-Cinematic

Figure 7: Fonctainebleau_FPV

Figure 8: Fontainebleau_4K

Racing Sequence description:

This car racing 10 second-long 4K sequence is generated from a Unity Project from Pablo Labs. A video of the project is available at: https://www.youtube.com/watch?v=19vUeWcoD6I and the assets at https://www.mediafire.com/file/fvv2dpakkih4mum/Assets.zip/file.

The sequence contains textual overlays.

Figure 9 : Racing screenshot

Sequence characteristics:

Sequence nameResolutionInput bit-depthFrame rateFrame count

In order to get the data (GAMING SEQUENCE) you are asked to supply your name and email address. You will receive instructions on how to download the dataset via this email address. We may store the data you supplied in order to contact you later about benchmark related matters. The data will not be used in any other way.

To download the GAMING Sequence dataset please send an email to gamingmanagement@interdigital.com. By doing this you irrevocably agree to any and all provision of the license agreement on this page.

Copyright

This video sequences may only be used for the purpose of developing, testing and promulgating technology standards developed by a standardization group (“Purpose”), under InterDigital ("InterDigital") owned or controlled copyrights, by individual(s) or organization(s) that participates, contributes or is part of such standardization groups ("User(s)").

• The 3D_game_kit sequences contain the 3D-game-kit Unity assets created by Unity Technologies available at https://assetstore.unity.com/packages/templates/tutorials/3d-game-kit-115747.
• The racing sequence contains the “Unity Racing Game” Unity assets created by Pablo labs available at https://www.mediafire.com/file/fvv2dpakkih4mum/Assets.zip/file .
• The Fontainebleau sequences contain the FontainebleauDemo Unity assets created by Unity Technologies available at https://github.com/Unity-Technologies/FontainebleauDemo.
• The DarkTree sequence contains the DarkTree DPS v1.4 Unity assets created by DarkTreeDevelopment available at https://assetstore.unity.com/packages/templates/systems/darktree-fps-v1-4-142383.

All these sequences are licensed by their respective owners and it is the User responsability to comply with the license terms that are provided by such owner. InterDigital claims no ownership nor liability on these assets.

RESTRICTIONS: No license whatsoever is implied except from this expressed limited personal, non-sublicensable, non-transferrable authorization. In particular no right under any patent of InterDigital or its affiliates is granted.

Any other use is strictly prohibited. This video cannot be distributed (freely or not) or otherwise disposed of or made available (via internet or otherwise), broadcasted, disclosed to third parties (except to other User(s) who agreed with the present terms and conditions, the "Secondary Users"), used for providing any services to third parties or for any commercial use, nor copied (except as technically necessary for the Purpose), modified, adapted, translated, exchanged, publicly performed (even for research, demonstration or educational purposes), integrated, without limitation. This video and all intellectual property rights, titles and interests therein, are and remain the exclusive property of InterDigital or its affiliates or, regarding the Unity assets, of its legitimate owner.

NO WARRANTY: This video is supplied "as is" and without any warranty of any kind, expressed or implied, including but not limited to any warranty for accuracy or performance, fitness for a general or particular purposes, or any warranty arising by statute or by law, or non-infringement of any third parties's rights. In no event will InterDigital be liable for damages of any kind, including without limitation, any special, indirect, incidental, or consequential damages even if InterDigital has been advised of the possibility of such damages.

InterDigital may terminate this license it at any time for any reason upon notice to User(s). In such situation, the relevant User(s) shall inform any Secondary User of such termination and make sure that such Secondary User shall cease to use the video.

This authorization is governed by the laws of France without regard to conflict of laws. It shall be exclusively submitted to the first instance civil court of Paris, France in the event of a dispute not settled amicably.

BY USING THIS VIDEO USER(S) AGREES AND ACCEPTS THE ABOVE MENTIONED TERMS AND CONDITIONS. IF USER(S) DOES NOT AGREE TO THESE TERMS AND CONDITIONS, IT SHALL NOT USE THIS VIDEO. DO NOT REMOVE OR MODIFY INTERDIGITAL OR ITS AFFILIATES' NAMES, SIGNS, LOGOS, NOTICES.

Publication/Communication

Any publication or oral communication regarding the Database shall be elaborated in good faith and shall not be driven by a deliberate will to denigrate InterDigital or any of its products. In any publication and on any support joined to an oral communication (for instance a PowerPoint document) resulting from the use of the Database, the following statement/citation shall be inserted:

The dataset was provided by InterDigital and is described in the following publication:

Document JVET-Y0041, AhG-7 "Proposed new class of gaming sequences with depth and optical flow information" G. Martin-Cocher, M. badawi, T. Poirier, S. Puri, K. Naser (InterDigital), in proc. ff ITU-T/ISO/IEC Joint Video Experts Team, JVET meeting 25th, Online, Jan. 2022.