Dashboard

To better understand what's going on we need a convenient tool to view both videos and telemetry data. It contains video view and line charts with data.

At first you need to select a csv data file in the format specified in the wiki page. We create this csv file with the Sensor Recording program for android.

The data is loaded and will be kept in memory until you upload other csv file.

The chart will show data as soon as you upload srt (Subtitles file) for the video. It will only display the data for the period of video. To show video itself, upload video file that corresponds to the srt file uploaded.

Once everything is set up you can now view video and data for it. Double clicking on chart will play video at the very same moment, where the chart was clicked. You can zoom and scroll chart as you wish.

Additionaly you are able to create a preprocessor for the data if you wish to display say moving average of the gyroscope sensor. You cannot modify the number of axes displayes: x,y,z for accelerometer and gyroscope and one axis for speed, but you can change the values of those axis. The preprocessor will get only data for the interval selected. It is programmed in CoffeeScript.

A preprocessor example (multiplies all accelerometer values by 1.5 and gyro by 1.2):

window.dataPreprocessor = (data) =>
    for el in data

        switch el[0]
            when 1 #accelerometer
                el[3] = el[3] * 1.5 #x
                el[4] = el[4] * 1.5 #y
                el[5] = el[5] * 1.5 #z
            when 4 #gyroscope
                el[3] = el[3] * 1.2 #x
                el[4] = el[4] * 1.2 #y
                el[5] = el[5] * 1.2 #z
            when 'geo' #geodata
                el[9] = el[9] / 2 #speed
                    
    return data

Dashboard should work in any modern browser, however we recommend to use browser on the base of Chromium because it works faster.

Hotkeys

s - pause/resume video

a - rewind back

d - rewind forward

Hotkeys work only when event target is body. If it does not work, click somewhere on the page.

Instruments to create a training set

A user can create training set with the help of dashboard. It means he can record events and save it in json format for further training of model.

To do it he first needs to load video and srt files. After it event capturing panel will be activated.

At the end we will get a list of events. Each event represents the following structure:

{
type int
direction int
start time
end time
}

To start capturing an event a user presses W, the right panel will be activated with ability to select the type of event and the direction of event. After they are selected, the save button will become visible. The start time is fixed when W is pressed, the end time will be fixed and the event will be saved after ENTER press. You can cancel capture of specific event at any time pressing ESC.

When you captured all events you wanted and reached the end of the video, then press E to export all data as a json file. The file name will be as same as the name of the video + json resolution. You can reset all captured events at any time by pressing R. After export action the events will be reset too.