VisiSonics 5/64 Manual de usuario

VisiSonics 5/64 Audio/Visual Camera

User Guide

Version 2.2 - July 2018

This document provides instructions on use of the VisiSonics 5/64 Audio-Visual Panoramic

Camera and associated software. License terms are also provided.

The VisiSonics 5/64 Audio-Visual Panoramic Camera uses software and technology from the University of Maryland,

used under license.

Table of Contents

1. List of Components Supplied.........................................................................................................................3

2. Notices and Warning .....................................................................................................................................3

3. Camera Overview..........................................................................................................................................3

3.1. Physical camera setup............................................................................................................................3

3.2. Cable connections...................................................................................................................................4

4. Audio Camera Software Guide......................................................................................................................5

4.1 General Overview ....................................................................................................................................5

4.2 GUI Layout...............................................................................................................................................6

4.2.1 Video Window (Center Screen)..........................................................................................................6

4.2.2. Timeline (Bottom-Center Box)...........................................................................................................7

4.2.4 Control Panel (Bottom-Right).............................................................................................................7

4.2.5. Spectrogram Window (Upper-Right).................................................................................................7

4.2.6 Session Browser (Upper/Lower Left) .................................................................................................8

4.2.7 Camera Controls (Right-Middle) ........................................................................................................9

4.2.8 Acoustic Image Controls (Lower-Right)..............................................................................................9

4.2.9 Realtime Controls..............................................................................................................................9

4.3 Realtime Display....................................................................................................................................10

4.3.1 Starting the Camera.........................................................................................................................10

4.3.2 Realtime Mode ................................................................................................................................10

4.3.3 Recording a Session........................................................................................................................11

4.4 Post Analysis .........................................................................................................................................12

4.4.1 Loading a Session...........................................................................................................................12

4.4.2. Processing a Selection ...................................................................................................................12

4.4.3 Exporting Results ............................................................................................................................12

4.5 Beamforming..........................................................................................................................................13

4.6 Extra Modules........................................................................................................................................13

4.6.1 Virtual Reality ..................................................................................................................................13

4.6.2 Order Analysis.................................................................................................................................13

4.6.3 External Triggering Module..............................................................................................................13

5. Technical Support Contact Information........................................................................................................13

6. Copyrights and Intellectual Property............................................................................................................13

7. VisiSonics Corporation End User License Agreement .................................................................................13

1. List of Components Supplied

❖VisiSonics 5/64 Audio/Visual Camera

❖Acquisition Computer with a Powerful GPU

❖Table Top Tripod

❖USB 3.0-B to USB 3.0-A Cable (black)

❖Laptop Power Supply (large)

❖Audio/Visual Camera Power Supply (small)

❖Pelican Carrying Case

2. Notices and Warning

This device and software are supplied under license given at the end of this document. Use of the device is

subject to agreement with the terms of this license. The VisiSonics 5/64 Audio/Visual camera is a delicate

electronic device. It should not be shaken, dropped, or subject to stress, jerky motion, or extreme

temperatures. The device storage and operating temperature is from 5 to 40 degrees Celsius. Always use the

included Pelican case to store and transport the Audio Camera. Failure to handle with care or to properly store

the device voids all warranties. The device contains no user serviceable components. Opening the device

immediately voids all warranties. Should the device fail to function under normal operational conditions,

VisiSonics will cover repair at its cost (less shipping) during the first year after purchase, subject to the

condition that the device has been properly maintained. Repairs will be covered in subsequent years only if an

appropriate service agreement is in place. Otherwise, repairs are billable for both time and materials; contact

VisiSonics for further details.

Warranties cover the physical camera only; they do not extend to the laptop, tripod, and cables. Some of these

items are covered by their respective manufacturers’ warranties.

3. Camera Overview

The VisiSonics 5/64 Audio/Visual Camera (“Audio Camera”) consists of five (5) USB 3.0 cameras and sixty-

four (64) omnidirectional electret microphones arranged in a specific pattern on the surface of an aluminum

sphere (8’’ or 20 cm in diameter). The Audio Camera interfaces with a laptop computer provided by and

certified by VisiSonics. The laptop comes with the FINDr software installed. The unit and all accessories are

shipped in a waterproof, foam-filled wheeled case. The case is equipped with four latches that must be

securely fastened for transportation. The laptop, tripod, cables and Audio Camera are all located in cavities in

the foam. The cables include the USB 3.0 cable and power supplies for both the Audio Camera and the laptop.

3.1. Physical camera setup

With Included Tripod

oCarefully take out the laptop from its slot and place it in a secure location

oExtract the tripod from its slot

oExtract the camera from its slot and affix to the tripod

oPlace the camera/tripod stably on a flat surface, taking care to ensure that the suction cup is

adhered firmly to the surface below

With Optional Audio Camera Mount

oRemove quick release plate from swivel head on the Audio Camera mount

oAttach the quick release plate to the bottom of the Audio Camera, ensuring the the quick

release plate is squarely aligned with the base of the Camera

oInsert the quick release plate into the swivel head

oWhile supporting the Audio Camera, release tension on the swivel head ball joint, position the

Camera straight up and down and retighten the mount

oPlace Audio Camera mount against a secure surface in the desired structure or vehicle. In

automobiles, this is typically the passenger seat or on top of the center console

oUse the four straps at the corners to secure the mount in place by stretching them underneath

the car seat (or other location) and then tighten them up by ratcheting the orange levers until the

mount feels secure

oReadjust the Audio Camera position to compensate for any tilt caused by the mounting position

3.2. Cable connections

Boot the computer. [Username: VisiSonics Password: changeme]

Plug in computer power supply for optimum performance

Plug the USB 3.0 -A jack into the laptop

Plug the USB 3.0 -B jack into the appropriate port in the Audio Camera handle

Plug the Audio Camera labeled power supply into the Audio Camera handle

Warning: Switching the Audio Camera power supply and computer power supply can damage the devices.

The Audio Camera power supply is 12V, 3-4A.

4. Audio Camera Software Guide

Navigate to C:\VisiSonics and run FINDr.exe (a shortcut can be found on the desktop). This window shows all

the functionality of the Audio Camera. Each button and its use will be explained in detail in the following

sections.

4.1 General Overview

Quick Reference:

① Video Window (4.2.1)

② Timeline Window (4.2.2)

③ Control Panel (4.2.3)

④ Spectrogram Window (4.2.4)

⑤ Session Browser (4.2.5)

⑥ Reference Waveform (SPL of all frequencies, visually lined-up with spectrogram for quick reference)

⑦ Boxed selection in spectrogram, ready to be processed into an Audio Movie or Image (4.2.4)

⑧ Camera Controls: Start/Stop, Record, Gain (4.2.6)

⑨ Selection Processing options (4.4.2)

⑩ Realtime Settings (these controls may be adjusted only in Realtime Mode, “Stitch Depth” is set here and

persists in recorded sessions) (4.3.2)

⑪ Image Settings (These controls effect the color gradient information shown in the Acoustic Image) (4.2.7)

⑫ Blue Position Line (This line demarcates the time focus of the session in the video window and the

spectrogram; moving this line will alter the Time axis of the spectrogram)

⑬ Timeline Ruler (This area indicates the length of a recorded session as a timespan. The Blue Position Line

indicates the current position in time in conjunction with the Ruler. The mouse can be used to select any range

of time from this area (CTRL+hold left mouse button) to be displayed in the Video and Spectrogram Windows)

(4.2.2)

⑭ Video Controls (Controls to Start/Stop video playback, turn HMD on/off (see VR Module), and change the

POV of the Video Window)

⑮ Color Gradient Scale (This color bar indicates the SPL represented by a specific color in the spectrogram.

The color-SPL relationship can be shifted by moving the slider to the right of the color bar in order to make

target frequencies more visible in the Spectrogram) (4.2.4)

⑯ Acoustic Image Hotspot (Typical hotspot in the Acoustic Image indicating the location of a high SPL of some

frequency) (4.4.2)

⑰ Drop Down Menu (This menu contains various options and extra module controls)

4.2 GUI Layout

4.2.1 Video Window (Center Screen)

The large center window shows the video with the overlaid gradient Acoustic Image. There are 3 view options

for the video: Mercator (default view), Spherical, and Globe projections. (The Planar Array Device can only

show the Mercator view)

While in Realtime mode, or when viewing recordings taken with the Audio/Visual Camera, the center of the

video can be repositioned; click-and-hold on the video window in order to drag to the left or right. Clicking the

button in the top right of the video window will put the panel into full screen mode, so it takes up the entire

application window. (this button is transparent to minimize obstruction of the scene and is difficult to see)

While the Mercator view is generally the best way to see an Acoustic Image, there are specific situations in

which other views can be preferred. In order to project a flat image, the Mercator view warps areas in the north

and south poles (top and bottom). Sound sources in the warped regions will still be overlaid accurately, but it

will be more difficult to translate those sources from the Video Window to the physical objects recorded. For

this reason, it is recommended that the Spherical or Globe projections be used when important objects in the

scene lie in the extreme top and bottom areas. (For example, when setup in a cramped location)

4.2.2. Timeline (Bottom-Center Box)

The “Timeline” represents a recorded video as a continuous waveform over its length. All frequencies are

represented in the one waveform and it grows and shrinks relative to the total SPL in the recording. Inside the

Timeline, a blue line marks the current position of the video. Above the Timeline are controls to play, stop, and

jump around the video in time, as well as a display of the current position. The position of the video may also

be fine-tuned; click and hold on the triangle above the blue marker and drag it back and forth to change the

current position. The Spectrogram Window (4.2.4) and video will always stay in sync with the blue marker; in

this way, different time segments of the video can be loaded into the Spectrogram Window for more detailed

analysis.

Specific segments of the video may be selected by clicking in the Timeline Ruler (4.1 #13); while holding Ctrl,

click and drag across and area to be analyzed; the selected area will appear in the Audio Spectrogram.

There are also toggle buttons to enable/disable the Virtual Reality Module (4.6.1), and to switch the

projection mode of the video (4.2.1). In the bottom left, there is a gain display and volume meter for the

final stereo output of the program . Click and drag the gain text to edit the output

gain level; double-click the level meter to open volume controls in a separate window. The horizontal slider at

the bottom can be used to look at different sections of the timeline. Clicking and holding on the end of the slider

adjusts the timeline scale. Click and drag on the blue waveform icon between the volume meter and slider

to adjust the height of the audio tracks and the height of the audio waveforms to see finer detail.

4.2.3 Control Panel (Bottom-Right)

This window contains controls for Acoustic Image generation. It also has a separate Beamform tab to show the

currently active beamforms. More information on how each of these controls affect the image can be found in

sections 4.2.7 and 4.2.8. Beamform information can be found in section 4.3.2.

4.2.4 Spectrogram Window (Upper-Right)

When Realtime mode is active or a recorded session has been loaded, this window displays a color gradient

spectrum indicating the SPL of all viewable frequencies (250Hz-7000 Hz) over time. The color guide on the

right side of the spectrogram shows the specific SPL of a given color and may be adjusted with the vertical

slider next to it. Sliding down/up will increase/decrease the gain of SPL across the entire frequency range in

the spectrogram. Adjusting this slider can make all frequencies more visible by highlighting weaker frequencies

and reducing the gradient noise of very loud frequencies. To zoom the visible frequency range of the

Spectrogram Window in or out, use the mouse wheel while holding the cursor over the window.

●Selecting a Time/Frequency Range

From the spectrogram, users can select a time/frequency range for more detailed analysis of recorded

sessions. An area of interest may be selected with the mouse; left-click and drag to draw a box in the

spectrogram.

⑦Boxed selection in spectrogram, ready to be processed into an Audio Movie or Image

The entire Spectrogram Window may be selected from to create a box. The selection box can be dragged

around and also resized by dragging borders of the box. (Please note that, due to the physical limitations the

actionable frequency range of the Audio/Visual Camera is 200 Hz to 7000 Hz)

The cursor position boxes show the current time and frequency at any given position of the cursor. Portions of

the spectrogram may also be selected using the range text boxes or the ⅓ Octave Selection slider. To

manually input a selection, click on the labeled white text boxes labelled “Time Range” and “Frequency Range”

and type any values currently visible in the spectrogram. The ⅓ Octave Selection automatically selects

frequency ranges in ⅓ octave bands and will scroll through bands one at a time. In order to use this method, a

time range must first be set by drawing a box or inputting the time manually via the Time Range text box.

The time axis of the spectrogram is synced with, and adjusts in reference to, the Timeline Window (4.2.2). By

default, the spectrogram displays a 3 second portion of a loaded session with the Blue Position Line in the

Timeline Window as the central point. To alter the length of the time axis in the spectrogram, use the mouse to

select an arbitrary range from the Timeline; left-click with mouse while holding down CTRL and drag the cursor

across any range in the Timeline Ruler to highlight the area.

●Processing a Selection

Below the spectrogram, in the box labeled “Process Selection,” are controls to compute an Audio Image or

Audio Movie. Controls to play/stop an Audio Movie appear after one has been computed. See 4.4.2 for more

details.

4.2.5 Session Browser (Upper/Lower Left)

The session browser has two components. The top portion displays the current directory and allows for the

session directory to be changed to another location in your file system. The default directory is

C:\Users\UserName\Documents\CameraSessions. The bottom area shows thumbnails of recorded Audio

Camera sessions located in the current directory. Double clicking on any of the session thumbnails will close

the current session and open the new session. The opened session name will be added to the title bar of the

application.

4.2.6 Camera Controls (Right-Middle)

This contains the Start/Stop button, the Record button, and a drop-down menu which allows for the gain setting

of the Audio Camera to be adjusted. This must be selected prior to starting the camera. Details of the gain

settings are as follows:

a) -20 to -10 dB (signal saturates at approximately 129 dBFS)

b) -10 to 10 dB (signal saturates at approximately 115 dBFS)

c) 10 to 20 dB (signal saturates at approximately 95 dBFS)

Trigger button: See 4.6.3 External Triggering Module for more detail.

4.2.7 Acoustic Image Controls (Lower-Right)

The “Image Settings” box contains controls to manipulate the color gradient Acoustic Image in both Realtime

mode and in a loaded session.

“Generate Image” checkbox toggles the display of the overlaid Acoustic Image. If not checked, only

stitched video will be visible in the video viewer.

The “Max dB Displayed” slider controls the point at which the SPL will be displayed at “maximum” red in

the color gradient Acoustic Image. For example, if you set the slider to 50dB, then any sound in the

room louder than 50dB will be shown as red in the Image. Dragging this slider will disable the Auto

Select button.

With “Auto Select” checked, FINDr will search for the loudest frequency in the scene and auto-set the

“Max dB” slider to that value. When it is selected, whether in Realtime mode or during playback of a

recorded video, the “Max dB” slider will adjust as the SPL in the scene changes. Additionally, the

“Threshold” slider will turn from grey to black and become unusable.

The “Dynamic Range” slider defines the range of SPL that you will see in the Acoustic Image with the

“Max dB Displayed” as the top value of that range. For example, if the “Max dB displayed” is set to 50,

and the “Dynamic Range” is set to 20, then the Acoustic Image will display all received frequencies with

a SPL of roughly 30 dB to 50 dB. Lowering the range will effectively narrow the appearance of

“hotspots” (4.2.1 12) as the quieter outer edges will not be displayed, resulting in a tighter Audio Image.

The “Threshold” slider provides a way set the low bound of the dynamic range by simply setting the

slider to the lowest volume sound that you want displayed in decibels. “Threshold” is only available

when “Auto Select” is in use.

4.2.8 Realtime Controls

The Realtime Controls also effect the Acoustic Image, but are grouped here because they are most useful

when using the camera in Realtime Mode.

The “Frequency” slider alters the frequencies reported in the Acoustic Image in 500Hz ranges. The

display window to the right of the slider reports the middle value of the range in Hz averaging 250Hz

above and 250Hz below to generate the Audio Image. For example, if you place the slider all the way to

the left, the value displayed will be “250Hz,” meaning the Acoustic Image is reporting frequencies from

0-500Hz.

“Time Averaging” has the effect of smoothing out the refresh rate Acoustic Image by averaging the

currently visible Acoustic Image “frame” together with those frames preceding it. Moving the slider to

the left increases the effect of time averaging. This makes it easier to observe the changes in SPL in a

scene, but also introduces some delay. Moving the slider to the right will show all the instantaneous

sources and reflections captured by the camera but the visual cacophony can be overwhelming.

The “Stitch Depth” slider changes the distance at which the camera images are properly stitched

together in the Video Window. When the slider is moved all the way to the right, the cameras are

stitching together at 20’ to infinity. When recording in a tight space, like the inside of a car, the slider will

need to be adjusted until the video cameras edges line-up with each other at the distance of the

suspected noise source. The “Stitch Depth” slider must be set before making a recording to

ensure the accuracy of the Audio Image overlay. This cannot be altered once a recording is

made.

4.3 Realtime Display

4.3.1 Starting the Camera

1. Connect your Audio Camera to the laptop running FINDr with the included USB 3.0 cable.

2. Connect the included power supply to your Audio camera and turn the power switch to the “on”

position.

3. Open the FINDr software. The FINDr icon should be in the system tray on the bottom of your Windows

10 home screen.

4. Select the SPL range for your recording with the Camera Gain button, located in the Camera Controls

box in the right-hand window of the FINDr software.

5. Click on the “Start Camera” button in the “Camera Controls” dialog box. The Audio Camera will take a

few moments to start up so please be patient.

4.3.2 Realtime Mode

This mode is active when the camera is started in FINDr; the stitched video image and overlaid color gradient

Acoustic Image will be visible in the Video Window. Use of the Control Panel functions allow for the Acoustic

Image to be tweaked and can help to focus on frequencies of interest. Realtime mode can be used on its own

to detect and analyze sound, but also serves to refine Acoustic Image settings in preparation for a recorded

session.

A description of useful functions for Realtime Mode is in the sections which follow.

4.3.2.1 Beamforming with Virtual Microphones

While in Mercator projection, a double left click in the Video Window places a red dot in the Acoustic Image.

The dot represents a virtual microphone with steered isolation of up to 24 dB, approximated using

beamforming. Multiple virtual mics can be placed in the Video/Acoustic Image. Click and drag on the red dot to

alter the position of a previously placed virtual microphone. Right click to remove the last virtual microphone

placed. All virtual microphones will be combined into one track while listening in Realtime Mode.

The Beamforming tab in the Control Panel (4.2.3) houses the controls and display for the Virtual Microphone

features.

The contents of the Beamforming tab are as follows:

Tabla de contenidos

Manuales populares de Cámara digital de otras marcas

Mercury

Mercury 350K Manual de usuario

Pentax

Pentax Optio LS 465 Manual de usuario

Sanyo

Sanyo VPC-S1085 Manual de usuario

GE SMART A1255 Manual de usuario

Point Grey

Point Grey Gazelle Manual de usuario

Nikon

Nikon COOLPIX A Manual de usuario

Pentax

Pentax P-5 Manual de usuario

BlazeVideo

BlazeVideo A280 Manual de usuario

Sony

Sony MCA-20 Manual de usuario

Sony

Sony Alpha DSLR-A290 Manual de usuario

ATIK Cameras

ATIK Cameras One Manual de usuario

CohuHD Costar

CohuHD Costar 3930 Series Manual de usuario

Leica

Leica M10-R Manual de usuario

FujiFilm

FujiFilm FinePix A700 Manual de usuario

Lorex

Lorex LNZ81P25 Series Manual de usuario

GE J1470S Manual de usuario

Sony

Sony A6700 Guía del usuario

Canon

Canon EOS ELAN7 Manual de usuario