Ar sandbox post installation instructions

To run our software on you will need:

Minimal setup (FULL HD):

From KinectSandbox ver. 1.9.7. software runs smoothly on integrated graphics - VEGA8. Tested on Ryzen 3 3200G

Computer:

Operating system: Windows 10 Home/ Windows 11
Processor: AMD Ryzen 3 1200, 3.1 GHz, 8MB
https://cpu.userbenchmark.com/AMD-Ryzen-3-1200/Rating/3931
Mainboard: Port USB 3.0, DDR4,
eg. GA-AB350M-DS3H V2
Graphic card: GTX 1030 2GB
https://gpu.userbenchmark.com/SpeedTest/283726/NVIDIA-GeForce-GT-1030
RAM Memory: 8GB DDR4
Hard Disk: SSD 64 Gb

Sensor: Kinect 2 PC, Kinect X-BOX ONE with PC Adapter

Projector:

• Short throw
• Projection ratio from 0.7 to 1.5
• Brightness 2000+ lumens
• Resolution 1024x800
• Lens distance from the sandbox: 1 - 2,5m

eg.: Ricoh PJ WX5461, Acer P5530, Optoma EH400+, BenQ mh733

Recommended setup:

Computer:

Operating system: Windows 10 PRO 64 bit/ Windows 11
Processor: AMD Ryzen 5 2600X, 3.6GHz, 16 MB
https://cpu.userbenchmark.com/AMD-Ryzen-5-2600X/Rating/3956
Mainboard: Port USB 3.0, DDR4,
eg. Asus ROG STRIX B450-F GAMING
Graphic card: GTX 1060 3Gb
https://gpu.userbenchmark.com/Nvidia-GTX-1060-3GB/Rating/3646
RAM Memory: 16GB DDR4
Hard Disk: M2 SSD 256 Gb

Sensor: Kinect 2 PC, Kinect X-BOX ONE with PC Adapter

Projector:

• Short throw
• Projection ratio from 0.7 to 1.5
• Lens shift
• Brightness 4500+ lumens
• Resolution 1920x1200
• Lens distance from the sandbox: 1 - 2,5m

eg.: Viewsonic PG800HD, Optoma WU515, NEC PE455UL

Software will also run on older machines like Intel i3 processor + middle class graphic card. Indispensable are: Windows 10, graphic card with DX 11 support, USB 3.0 port, Kinect 2, projector.

Projector picks for the by ar-sandbox.eu team UPDATE 11.10.2023

Hardware setup

How to correctly place both Kinect sensor and the projector.

Sensor and projector placement without (left) and with (right) lens shift.
There are two things you'll have to bear in mind: the Augmented Reality Sandbox Software works best when the sensor is close to the light beam source and at the same time, it [sensor] should be placed approximately above the center of the sandpit. To meet both of these requirements we suggest using a lens shift projector. It may be slightly costlier, but will provide great quality of simulation and minimize errors.

Having the projector and Kinect far apart may result in parallel shifts in the projection. Those are usually not significant, but visible. We found that the best way to avoid this issue is to mount a lens shift projector close to the kinect and place them above the center of the sandpit. Such solution is only possible with this certain type of projector.

Remember that the Kinect sensor should be placed exactly above the center of the sandpit, facing downwards. See the overhead view image for clarification.

Example setup

Software requirements

Drivers and packages necessary to run KinectSandbox and modules

Operating system:

Windows 10 Home 64 bit( 32 bit should also run) or Windows 11

KinectSandbox

Our software KinectSandbox

Kinect for Windows SDK 2.0

Download and install:

FBX Export

To run export module you will need to install additional packages:

Check if your Kinect 2 is working properly

Before running our software check if your hardware is connected properly. Click the link to check problems and solutions when connecting the sensor.

Quick Setup

Before you go to next steps check if software is working. Start software with given calibration. You will make your own later.press TAB

1. Set the Sandbox Bottom Level

Measure distance from the kinect to the bottom of the sandpit. Write down the result in mm and add 100. (for eg. 1720mm +100 = 1820)

2. Set Terrain Bottom Level

Set the Terrain Bottom Level - use arrows to decrease the value (negative number) until you will see the blue colour (the deepest colour)

3. Set Borders

Change left, right, top, bottom borders to fit the shape of the sandpit.

Software Calibration

Step by step tutorial.

1. Prepare the surroundings

For best results the application requires scrupulous calibration. The outcome of the process depends heavily on surrounding conditions, especially the lighting. It should be constant, evenly distributed and very slightly dimmed, soft daylight-like.

Make sure there are no flashing lights nearby, such as TV screens, or faulty light bulbs. Also cover the windows in case weather conditions (clouds, etc.) could affect lighting in the room.

The areas right next to the sandbox have to be nonreflective – avoid things such as oil-painted walls or tile floors. If necessary, cover them with white paper sheets.

2. Set up calibration boxes

To correctly gather calibration data, sensor needs smooth, flat and preferably white surfaces.

Our suggestion is to use cardboard boxes of three different sizes listed below. They should be arranged so that the edges of the same length contact each other and only the height varies. It’s best to not leave any gaps between boxes, however if they occur (eg. because of size of the sandpit), fill them with white paper sheets, so that the lowest surface is also plain white. Also, keep in mind that the boxes should cover all the space lit by your projector and ideally even stick out a bit.

Box 1 – 20x20x20cm

Box 2 – 20x20x15cm

Box 3 – 20x20x10cm

Use this scheme to set up the boxes, starting from the edge of the sandpit:

Boxes in sandpit 100cm x 60cm

3. Run the calibration software

During the calibration process you should be able to see a changing pattern, looking like the one on the right. Make sure it is on top of the projection and no other window is displayed above it.

Before running the calibration check if your display’s resolution matches that of your projector.

Automatic mode

Windows 11

When using Windows 11 operating system you need to run ProjectorServer server in “compatibility mode”

Right click on the AR_Sandbox_Calibration\ProjectorServer.exe

Windows 8″ and check boxes: “Run us administrator” and “use legacy display ICC color management’

Calibration automatic mode:

1. Backup the existing calibration file (D:\ar-sandbox.eu KinectSandbox…\KinectSandbox_Data\StreamingAssets\calib.xml) to your chosen location outside D:\ar-sandbox.eu KinectSandbox… folder; if the calibration software doesn’t work as intended, you can always restore the original file,
2. Go to “Calibration_ar-sandbox.eu” folder,
3. Run “autocalibration – start programs.exe” app as administrator,
4. Wait about 30 seconds until you see a ‘Programs ready‘ notification,
5. Run “autocalibration – calibration.exe” app as administrator,
6. Wait about 2-3 minutes, until you see a ‘Calibration saved‘ notification,
7. Copy the calib.xml file to D:\ar-sandbox.eu KinectSandbox…\KinectSandbox_Data\StreamingAssets\calib.xml(replace)
8. Run AR-Sandbox app to determine whether the calibration process worked; keep in mind the AR-Sandbox app is designed to work with sand and it may glitch at sharp edges. If you are unsure about the result, try removing the boxes and applying sand instead. Also, slight projection shifts towards outer edges of the sandpit are possible and are a natural thing.

Manual mode

Calibration manual mode:

1. Backup the existing calibration file (D:\ar-sandbox.eu KinectSandbox…\KinectSandbox_Data\StreamingAssets\calib.xml) to your chosen location outside D:\ar-sandbox.eu KinectSandbox… folder; if the calibration software doesn’t work as intended, you can always restore the original file,
2. Go to D:\Calibration_ar-sandbox.eu\AR_Sandbox_Calibration folder,
3. Run KinectServerapp as administrator,
4. Run ProjectorServer app as administrator,
5. Run CalibrateEnsemble app as administrator,
6. In CalibrateEnsemble open the calibration file (menu File > Open… >D:\Calibration_ar-sandbox.eu\calib.xml),
7. Run calibration (menu Calibrate > Acquire) and wait until you see ‘Acquire complete’ message at the bottom of log window on the right side of the app window; you may need to left-click with your cursor outside the app window, as the Acquire screen will by default run in the background; this step should take approximately 1 minute, and you should be able to see changing vertical and horizontal pattern across the screen, implying the program is running correctly,
8. Solve calibration (menu Calibrate >Solve) and wait until you see ‘Solve complete’ message at the bottom of log window on the right side of the app window,
9. Save calibrated file (menu File > Save),
10. Copy the calib.xml file to D:\ar-sandbox.eu KinectSandbox…\KinectSandbox_Data\StreamingAssets\calib.xml (replace),
11. Run AR-Sandbox app to determine whether the calibration process worked; keep in mind the AR-Sandbox app is designed to work with sand and it may glitch at sharp edges. If you are unsure about the result, try removing the boxes and applying sand instead. Also, slight projection shifts towards outer edges of the sandpit are possible and are a natural thing.

• In case the original calib.xml file doesn’t exist or the results of calibration are very poor: in CalibrateEnsemble create new file (menu File > New, make sure Number of Projectors and Number of Cameras is 1) and save it to D:\Calibration_ar-sandbox.eu\

Troubleshooting

Troubleshooting

It may happen that the calibration process doesn’t immediately give perfect results. This is mainly because it uses and depends on physical objects and can be affected by their imperfections. Usually it’s a matter of few simple steps to reach the wanted level of accuracy.

• The most common problem is projection being shifted compared to the actual shape of the sand. Reason behind this is the program misinterpreting or having wrong input data. First thing to do in such situation is to re-run the calibration software. If it doesn’t help, you should try repeating the actions described in the first paragraph. As the lighting plays crucial role in the process, try changing it. Firstly, lower the projector’s brightness. Then, if necessary, brighten up the room. Avoid direct light sources and letting sunlight in.
• Shift in the projection may also be a software issue. Check if resolutions match: projector’s resolution, Windows display, KinectSandbox resolution (you can find and edit it here D:\ar-sandbox.eu KinectSandbox…\KinectSandbox_Data\StreamingAssets\GlobalSettings) and finally the resolution described in the calib.xml file (find and edit lines 1080and1920). Re-run the calibration.
• If you encounter glitches in the KinectSandbox app, it doesn’t necessarily mean there is a problem with the calibration itself. Check the most important settings inside the app: borders and levels. You will find detailed instructions below.
• Another problem that can occur is the projection going completely dark after launching the KinectSandbox app with a new calib.xml file (sometimes it is just a matter of tweaking levels settings -decrease the ‘Terrain Bottom Level’ until you start seeing a picture). In such case go to D:\Calibration_ar-sandbox.eu\AR_Sandbox_Calibration, run the CalibrateEnsemble program as administrator, open the calib.xml file (menu File > Open…) from D:\ar-sandbox.eu KinectSandbox…\KinectSandbox_Data\StreamingAssets and check the number assigned to the display (menu Setup > Show Projector Server Connect Displays). You will see a number on the screen (should be either 0 or 1). Remember this number and then manually edit the calib.xml file (Open with Notepad). Find the line: … and write the display number in place of the dots.
• If the projected image looks nothing like the objects in your sandbox, check the number of lines in the newly prepared calib.xml file. It should be precisely 187. If it is not, it means the calibration process malfunctioned and has to be repeated. It can either be a matter of physical input (too high brightness, obstacles), or a software problem. Pay close attention to all the steps. Restore the default calibration folder and re- run the calibration.
• One last issue you can encounter is the calibration programs windows closing by itselves right after being started. This can happen, when another program, e.g. an antivirus software is blocking a TCP port. In such case, run task manager and end all tasks, then restart the calibration software.

Should you still have problems with your calibration, keep the old and new calib files and contact us at [email protected]