Explore the Features of Record3D

Wi-Fi Streaming & RGBD video export (mp4)

This feature is part of the paid Wi-Fi Streaming & RGBD video export Extension Pack.

TL;DR: Look at the Three.js 3D Video demo.

With the Extension Pack, you will be able to stream 3D Videos into (not only) your browser and export your 3D Videos into a special .mp4 videos, that you can replay in your browser (see the Three.js 3D Video demo).

Those special mp4 videos are much smaller (order(s) of magnitude) than the 3D Videos.

Wi-Fi Streaming can be enabled in the Settings tab > Live RGBD Video Streaming > Wi-Fi. And to export a 3D Video into RGBD mp4 video, just slide your finger over that video, select Export and "RGBD Video (.mp4)".

There is also the "Looking Glass" export option, which will export into an mp4 video in a format suitable for the Looking Glass holographic displays.

Both Wi-Fi Streaming and RGBD mp4 Video Export convert 3D Videos into the same format as you can see in the video next to this text. Note that the RGBD Video does not replace USB Streaming or export into the .r3d format. People who need the most accurate depth data should still use USB streaming.

Wi-Fi Streaming does work only over your local Wi-Fi network, it does not work over the Internet. The Wi-Fi stream currently does not contain audio. The exported mp4 videos do contain audio though.

To learn more about these features, please read the README of the simple video streaming demo and inspect the Three.js 3D Video demo.

Note that Wi-Fi Streaming is currently NOT compatible with the Unity USB Streaming Demo.


True3D

Optical illusion that makes you think your iPhone or iPad is a window into the 3D world behind your screen (parallax effect)! This feature is included only in the Full Version. You need to move your head to experience it.

The effect is best visible when you pause your 3D Video, but you can have it enabled even when your video is playing.

Colormaps

By default, you will see only boring white-ish live video preview. With Colormaps you can colorize the live video preview based on the depth of the objects in scene — there are 8 different colormaps to choose from! This feature is included only in the Full Version.

Change the depth range slider (between the red toggle button and the live video preview) to experience color changes like in the video preview.

Augmented Reality

Replay your 3D Videos in AR! The controls might be a bit unusual; to move and rotate your model in space, simply hold your finger anywhere on the screen and move with your iPhone or iPad in the same way you want your video to be moved. If the analogy helps, imagine you are "grabbing" the video "through your screen". You can scale your video by pinching.

Non-AR 3D Video Viewer

By default, when you open your 3D Video in the Library tab, you will get into the non-AR viewer. You can access many features from the vertical toolbar. To reveal the vertical toolbar, just tap anywhere on the screen (tap again to hide the toolbar).

The vertical toolbar gives you access to these features (buttons from top to down):

  • Play/Pause
  • Change 3D Video point size (the video is an animated point cloud)
  • Change depth range (can cut background and foreground)
  • True3D Button (enables the True3D effect — move your head to experience it)
  • AR button — toggles AR viewer

There is one more feature: double-tap anywhere on the screen to reset the view.

Exporting and Sharing your Videos

You can export your videos either into either sequence of PLY files or glTF animation (links to Sketchfab: example 1, example 2 — be careful, the animations are resource intensive and can crash your browser, view example 2 first). To export a video, simply go to the Library tab and slide your finger over the 3D Video you wish to export.

To share a video, you first need to export it into either of the two formats (PLY or glTF). After you have exported your video, you can share or download your video by 3 different ways:

  • sliding your finger over the 3D Video in the Library tab and selecting the "Export" action,
  • or you can open the iOS Files app > Record3D and do whatever you want with the exported files,
  • lastly, you can share your scans via iTunes File Sharing.

If you wish to upload your 3D Video to Sketchfab, you will need to enable the "Use float (32bit) Colors in glTF" toggle (and maybe even the "Generate and Save Normals" toggle).

USB Live Streaming Mode (RGBD Streaming)

This feature is intended for Digital Artists and Developers. It enables you to stream depth maps and RGB images (RGBD frames) live to your computer via USB cable. To use it on your computer, you will need to install either C++ or Python libraries. They are open source and multiplatform!

To use the feature, you need to purchase Record3D. After you have purchased it, follow these instructions:

  1. Install e.g. the Python library (both Python 2.7 and 3.x is supported) from the record3d repo (follow the instructions on github).
  2. Download the record3d repo to your computer.
  3. Connect your iPhone or iPad to your computer via USB cable (to make things easier, make sure you have only single iOS device connected — you can stream simultaneously from multiple devices, but we want to ensure smooth demo experience).
  4. Enable the USB Streaming in the Settings tab in Record3D > Live RGBD Video Streaming > USB.
  5. Go to the Record tab and press the red toggle button.
  6. Run the "demo-main.py" script. Two windows should pop-up with live stream of RGB and Depth map.

Read the demo-main.py script to learn how to use the library.