Setting Up ARFX Free D Tracking Method

Section 7. Setting Up ARFX Free D Tracking Method

FreeD is an open protocol used to track devices, such as cameras, in real-time, over a network. It is widely compatible with systems like Vive Mars, Mo-Sys, Stype, and others. What makes FreeD especially useful in ARFX is that it works seamlessly without Live Link, allowing you to set up tracking either during play or in packaged builds. This flexibility extends to both LAN and internet connections, giving you a wide range of options for virtual production.

There are two primary approaches to setting up ARFX FreeD tracking: one using the component within the Unreal Editor and the other within the ARFX Scenepacks.

Section 7.1 Setting Up FreeD in the Unreal Editor

Note

If you are in the editor it would be better to use LiveLinkFreeD over the ARwall FreeD component. The

tracking functionality is the same, but you will be locked out of being able to assign tracking other actors in the

scene.

1. Add an ARFX Pro Camera Actor to your scene either from the Place Actors menu (Window > Place Actors) or Quick Place dropdown menu (White 3D cube with a green plus symbol)

2. With the camera selected and in the Details panel, add an ARwall Tracking Component FreeD

3. Now with the newly added Tracking Component selected in the camera's component list, you should see the settings found in the first provided screenshot above

4. The IP Address here is the address of the tracking system in your local network.

Please refer to your tracking system manual on how to obtain the system's local IP address.

5. Depending on your system, you may have to either copy the UDP port that is used on the tracking system or you can specify a unique number that shall be used by both. (Default: 41000)

Since this is still using FreeD, we are open to any system that can make use of it (Mo-Sys, Stype, Vive Mars, and more).

Note

• As a reminder, FreeD can work over both LAN and internet addresses!

• Make sure that whatever port you use is not being used by another program!

• If you are in the editor it would be better to use LiveLinkFreeD over the ARwall FreeD component. The tracking functionality is the same, but you will be locked out of being able to assign tracking other actors in the scene.

6. On the tracking system, enter the IP address of the machine hosting the scene. You can get this address by using IPConfig in command prompt.

Note

• Please refer to your tracking system manual on how to set the FreeD IP address that the data is being sent to.

• FreeD can work across the internet but requires you do port forwarding on your local network. Please make sure your firewall will not block the connection!

7. Turn on "Auto Start"

8. If you have only one tracker turn on the following:

• Use Hero Tracker as Calibrator

• Use Any Received Tracker

9. If you have multiple trackers:

• Refer to your tracking system to determine which tracker is the first tracker and which is the second

• Set the Hero Tracker ID to the tracker whose order is provided by your system (example: first in the list is 1 as an ID)

• Set the Calibration Tracker ID to the tracker whose order is provided by your system (example: second in the list is 2 as an ID)

• Alternatively, turning on Use Any Received Tracker will always assign the first found as hero and second found as calibrator.

10. Play the scene and see if you have tracking. If you do, begin calibration process and you are good to go.

• If you do not, you may need allow Unreal and the IP addresses through your firewalls.

• You can use the in PIE options menu (backslash or ) to verify your connection.

11. Refer to Flipping XYZ Directions if your tracking directions are incorrect.

• Always calibrate in the same direction every time! Depending on what tracking system used, you may need to mark the tracker in the +X/forward axis

Section 7.2 Setting Up FreeD in ARFX Scenepacks

1. Start the scene and open up the ARFX options menu with backslash (\) or ESC button.

2. In the setup section, scroll down to find Free-D Setup.

3. Set the IP address to the PC's LAN port that is connected to the same network as your Free-D tracking provider.

• You can get this address by using IPConfig in the command prompt.

4. Set the UDP port to either the one provided by the tracking system (if you cannot set it manually) or to a unique number (Default: 41000)

5. On the tracking system, set the IP address to that of the system running the scene and the UDP port you have settled on in Step 4.

• Please refer to your tracking system manual on how to set the FreeD IP address to which the data is being sent.

• FreeD can work across the internet but requires you to do port forwarding on your local network

• Please make sure your firewall will not block the connection!

6. Back on your machine running your scene, press "Start FreeD"

• If the button does not change to "Stop FreeD", you may have either not set the correct IP address for your PC or the port that was set is already in use by another program (such as an Unreal Editor instance).

7. You should get a list of valid trackers below the UDP port.

• If you do not, press Refresh to get it to populate

• If you still do not see anything, you may need to allow the program through your firewall.

8. Finally set which tracker will be your hero and calibration trackers.

• If you only have one tracker, set it as your hero and enable "Use Hero Tracker as Calibrator"

9. Save your settings and try calibrating!

• Refer to Flipping XYZ Directions if your tracking directions are incorrect.

• Always calibrate in the same direction every time! Depending on what tracking system used, you may need to mark the tracker in the +X/forward axis

6. Calibration: After configuring the trackers, start the calibration process. Make sure you always calibrate in the same direction for consistent tracking results.