Chapter 1: System Connection and Application
1.1 System Connection
This section describes the system connection for the AI-Box1. The diagram illustrates the following components:
Key components and connections:
- PC: The central processing unit.
- PoE Switch: Provides power and network connectivity to devices.
- Lumens CamConnect Processor (AI-Box1): The core device managing cameras and microphones.
- Lumens PTZ Cameras: Multiple cameras (2-4 recommended) for video capture.
- Array Microphone: At least one microphone is required for audio input and voice tracking.
- Large Screen: Displays the output.
- Video Conferencing Software: Zoom, Microsoft Teams, Google Meet are integrated.
- Connections: Ethernet, USB, HDMI are used for connectivity.
1.2 AI-Box1 IO Interface
The AI-Box1 features various ports for connectivity:
- Front Panel: POWER, RESERVE, HDMI OUT, USB OUT.
- Rear Panel: ETHERNET, USB3.0, USB2.0.
- Indicators: Power LED.
Chapter 2: Operation Interface Introduction
2.1 (A) Device Settings
This section details the device settings within the CamConnect Processor software.
CamConnect Processor IP: Typically 192.168.4.72.
Profile and Device Configuration:
- Profile: Select a pre-configured profile (e.g., Default).
- Device Numbers: Specify the number of devices to be used.
- Voice Tracking: Enable or disable voice tracking functionality.
- Supported Devices & Settings: Lists connected devices, their IP addresses, and status.
Advanced Settings:
- Time To Trigger Preset: Sets the delay before triggering a preset after audio is detected.
- Back To Home Time: Time elapsed before cameras return to the Home position when no audio is detected.
- Back to Home Camera: Select which cameras return to the Home position.
- Back To Home Position: Specify the Home position or a specific preset.
- Apply: Button to save changes.
Camera Control & Status:
This table displays the status of connected cameras:
No | Item | Function Description |
---|---|---|
1 | Device Name | Displays the current camera name. |
2 | IP/USB | Camera's IP address or USB connection. |
3 | Status | Connection status (e.g., Connected, Stream Error). |
4 | Connect | Connect/disconnect the camera. Status shown in blue when connected. |
5 | Operation | PTZ control or other operations. |
Device & Camera Mapping:
This section maps microphone input angles to specific cameras and presets.
No | Item | Function Description |
---|---|---|
1 | Mapping Qty. | Select the number of preset positions (8, 16, 32, 64, 128). Note: Shure MXA310/MXA910/MXA920/Audio-Technica do not support quantity switching. |
2 | Indicator Lights | Orange light: Audio received, but camera trigger condition not met. Green light: Audio received and trigger threshold met, camera is being triggered. |
3 | Azimuth Angle | Defines the angle range for microphone input. For Shure/Audio-Technica, it's an array number. For Sennheiser/Nureva/Yamaha, it can be manually adjusted. |
4 | Primary Camera | Select the primary camera for a given angle. |
5 | Secondary Camera | Select the secondary camera. It takes priority if the primary camera is already assigned to another preset. |
6 | Preset No. | Select the camera's preset position. |
7 | AI Setting | Enable/disable AI tracking. Center Stage: Camera centers the subject for 5 seconds after moving to a preset. Continuous Tracking: Camera continuously tracks the subject. |
8 | Mic. Array No./ Mic. Azimuth Angle | Displays the current preset number/angle information. |
2.2 (B) Camera Control & Status
This section provides a detailed view and control over connected cameras.
No | Item | Function Description |
---|---|---|
1 | Resolution/FPS | Set resolution and FPS to match camera output. |
2 | Refresh / Add | Click to re-scan for devices or manually add a device by IP address. Note: Ensure cameras and AI-Box1 are on the same network segment. |
3 | Device Name | Displays the current camera name. |
4 | Connect | Connect or disconnect the camera. Connection status is indicated by a blue background. |
5 | PTZ Control | Click to open the camera's PTZ control interface. Refer to section 2.2.1 for details. |
6 | Delete | Remove a camera from the list. |
2.2.1 (C) PTZ Control
This section details the Pan-Tilt-Zoom (PTZ) controls for the cameras.
PTZ Controls:
- Preview Window: Displays the live feed from the selected camera.
- Mirror / Flip: Options to mirror or flip the video feed.
- Camera Movement / Home: Button to return the camera to its center position (Home).
- Preset Setting:
- To recall a preset: Select the preset number, then click the corresponding button.
- To save a preset: Select the preset number, then click "Store".
- AF/MF: Switch between Auto Focus (AF) and Manual Focus (MF). Manual mode allows focus adjustment.
- Zoom: Controls the zoom level, magnifying or reducing the image.
No | Item | Function Description |
---|---|---|
1 | Preview Window | Displays the current camera's captured image. |
2 | Mirror / Flip | Sets the image mirroring/flipping. |
3 | Camera Movement / Home | Click the [Home] button to return to the center position. |
4 | Preset Setting | Recall presets by number, then click the button. Save presets by number, then click Store. |
5 | AF/MF | Switch between auto and manual focus; manual mode allows focus adjustment. |
6 | Zoom | Adjusts the magnification level. |
2.3 (D) Device and Camera Mapping
This feature allows mapping microphone detection locations to specific camera presets.
Mapping Configuration:
- Mapping Qty.: Select the number of preset positions (8, 16, 32, 64, 128).
- Indicator Lights: Orange indicates audio received but camera not triggered; Green indicates audio received and trigger threshold met, camera is being triggered.
- Array No. / Azimuth Angle: Defines the angle for microphone input. For Sennheiser/Nureva/Yamaha, this can be manually adjusted.
- Primary Camera: Select the primary camera for a given angle.
- Secondary Camera: Select a secondary camera. It will be prioritized if the primary camera is already assigned to another preset. This feature requires Seamless Switching to be enabled.
- Preset No.: Select the specific preset position for the camera.
- AI Setting: Enable or disable AI tracking. "Center Stage" centers the subject for 5 seconds after moving to a preset. "Continuous Tracking" continuously tracks the subject.
- Mic. Array No./ Mic. Azimuth Angle: Displays current preset number/angle information.
2.4 (E) System Settings
This section covers general system configurations.
System Settings:
- Language: Set the system language (e.g., English).
- Max Microphone Qty.: Maximum number of microphones supported (up to 24).
- Auto Connection: Automatically connect to devices upon startup.
- Profile Setting:
- Save/Load: Import or export configuration profiles.
- AutoSave Interval: Set the interval for automatic profile saving.
- System Startup Waiting Time: Configure the delay for device discovery during startup. This is important if microphones or cameras take longer to initialize.
- Firmware Auto Check: Automatically check for the latest firmware version.
- Reset: Reset settings to default or apply current settings.
- Disk Check: Verify the operation of the SD card.
- Error Notification: Enable or disable error message alerts.
- Apply: Save selected settings.
Network Settings:
- Method: Choose between DHCP (automatic IP assignment) or Static IP (manual configuration).
- If Static IP is selected, you can configure the IP Address, Netmask, Gateway, and DNS.
- Apply: Save network configuration.
2.5 (F) Video Output Settings
Configure how video is outputted from the AI-Box1.
- Video Output Mode: Select output mode (HDMI, UVC, or HDMI+UVC).
- Video Output Layout: Choose layout type (Cross, Crop, PBP).
- Video Switching Mode: Enable or disable microphone-linked switching (Seamless Switching).
- Source Position: Set camera display positions (Custom/Auto).
- Layout: Assign cameras to specific positions on the screen.
- Start Video Output: Start or stop the video output.
2.5.1 Video Output Layout
This section illustrates different video layout configurations.
Layout Options:
- Video Output Mode: Set to UVC, HDMI, or UVC+HDMI.
- Video Output Layout:
- Cross: 4-way split screen.
- PBP: Picture-by-Picture display.
- Crop: Cropping function.
- Seamless Switching: Enables microphone-linked switching. The screen changes based on microphone signals.
- Source Position: Select camera display positions (Custom or Auto).
- Layout: Assign cameras to specific positions on the screen.
2.6 (G) Start Video Output
Click to start outputting camera video to HDMI or UVC/HDMI+UVC devices.
2.7 (H) Additional Settings
This section covers advanced settings, including Reference Audio.
Reference Audio:
Purpose: To prevent incorrect camera tracking caused by ambient noise or audio from the other end of a conference call. Reference Audio helps the system detect and suppress noise sources, reducing false camera triggers.
Connection Method: Connect the audio outputs from the CamConnect Pro (C) and the microphone (B) to a single audio input (A), and then connect this to the PC.
Settings:
- Audio Trigger Level (dB): Sets the threshold for audio detection (-100 to 0 dB).
- Detective Time (s): Sets the duration for audio detection (0 to 10 seconds).
- Enable: Turn the feature on or off.
PTZ Camera Trigger Set:
- Trigger Time: Sets the delay in seconds (0-99) before a camera is triggered. A setting of 0 disables camera triggering.
- Camera Selection: Choose to trigger all cameras or a specific camera.
- Position Type: Select to return to the Home position or a specific preset.
2.8 (I) Virtual Keyboard
Click to display the virtual keyboard for input.
2.9 (J) Version Information
This section displays the software version and related information.
- Version: Displays the current software version of the AI-Box1.
- Software Update: Click "Check" to verify the latest version and update if necessary.
- Serial Number: The unique serial number of the device.
- Get Help?: Provides access to support resources.
Chapter 3: Web Interface Functions
3.1 Device - Microphone Setting
Configure microphone settings through the web interface.
Microphone Configuration:
- Array Microphone Number: Select the number of microphones to connect.
- Devices: Choose the microphone device.
- Device IP: Enter the microphone's IP address.
- Port: Displays the port based on the connected device (e.g., Shure: 2202, Sennheiser: 45, Nureva: 8931, Yamaha: 49280, Audio-Technica: 17300). Note: Only Nureva allows custom port input.
- Connect: Enable or disable microphone connection.
- Advanced Function Settings: Access further configuration options.
Device & Camera Mapping:
This section maps microphone input angles to specific cameras and presets.
No | Item | Function Description |
---|---|---|
1 | Array Microphone | Array Microphone Number: Select the number of microphones to connect. Devices: Select the microphone device. Device IP: Enter the microphone's IP address. Port: Displays the port based on the connected device (Shure: 2202, Sennheiser: 45, Sennheiser TCCM: 443, Nureva: 8931, Yamaha: 49280, Audio-Technica: 17300). Note: Only Nureva allows custom port input. Connect: Enable or disable microphone connection. Advanced Function Settings: Access further configuration options. |
2 | Device & Camera Mapping | Audio Trigger Level > dB: Sets the audio threshold for triggering (e.g., Sennheiser: -90~0 dB, recommended -55). Time To Trigger Preset: Sets the delay before triggering a preset after audio detection. Back To Home Time: Sets the time before cameras return to Home position when no audio is detected. Back To Home Position: Sets the Home position or a specific preset. Voice Tracking: Enables microphone reception and camera preset triggering. Recommended to disable during preset setting to avoid accidental triggers. Mapping Q'ty: Select the number of preset positions. Different microphones support different quantities. Shure MXA310/MXA910/MXA920/Audio-Technica do not support quantity switching. Indicator Lights: Orange light indicates audio received but camera not triggered. Green light indicates audio received and trigger threshold met, camera is being triggered. Array No. / Azimuth Angle: Array No. is for Shure/Audio-Technica. Azimuth Angle is for Sennheiser/Nureva/Yamaha and can be manually adjusted. Primary Camera: Select the primary camera. Secondary Camera: Select the secondary camera. It is prioritized if the primary camera is already assigned to another preset. This feature requires Seamless Switching to be enabled. |
3.2 Device - Camera List
Manage and view connected cameras.
No | Item | Function Description |
---|---|---|
1 | Camera List | Resolution/FPS: Set resolution and FPS to match camera output. Refresh: Re-scan for devices. Add: Manually add a device by IP address. Ensure cameras and AI-Box1 are on the same network segment. Connect/Disconnect: Connect or disconnect from the camera. PTZ Control: Access the camera's web interface for PTZ settings (default credentials: admin/9999). Refer to the camera's user manual for details. |
3.3 Intelligent Director
This feature allows for advanced automation and scripting of camera and microphone actions.
Intelligent Director Modes:
- Conversation Mode: Provides pre-designed scripts for conversations.
- Presenter Mode: Not yet available.
- Cruise Mode: Not yet available.
- Customize: Allows creating up to two custom scripts.
- Edit: Edit script content.
- Run / Stop: Execute or halt a script.
- Execution Log: Displays logs of Intelligent Director activities.
Script Creation Example (Conversation Mode):
This section provides an example of creating a script.
Script Components:
- A. Camera: Set camera actions like triggering presets or returning to Home.
- B. Microphone:
- Trigger count: Number of triggers before camera action (1-100).
- All Mic off Stream: Defines actions when no microphone sound is detected (e.g., switch display, execute camera command).
- C. Layout:
- Select layout type (Cross/PBP).
- Select the number of cameras to display (1x1, 1x2, 1x3, 2x2).
- Assign specific cameras to display positions.
- D. Control:
- Script Start: The starting block for any script. Can have priority settings.
- Script End: The ending block for any script.
- Delay time: Insert delays in milliseconds, seconds, or minutes.
- Reschedule in _ seconds: Set a delay before the next action.
- Repeat Count: Set the number of times an action repeats.
- Script stop: Pause the script.
- Loop Script: Create script loops.
- E. Leave: Exit the current page.
- F. Save: Save the script.
- G. Run: Execute the script.
- H. Trash Can: Drag and drop blocks to delete them.
- I. Execution Log: View Intelligent Director logs.
Note: All scripts must have a "Start" and "End" block to be complete.
3.4 Video Output Settings
Configure video output parameters.
No | Item | Function Description |
---|---|---|
1 | Video Output Mode | Select HDMI, UVC, or HDMI+UVC output. |
2 | Seamless Switching | Enable microphone-linked switching. The screen changes based on microphone signals. |
3 | Start Video Output | Start or stop video output. |
4 | Source Position | Select Custom or Auto to determine which cameras are displayed. |
5 | Layout | Assign cameras to specific positions on the screen. |
6 | Start Video Output | Turn video output on or off. |
3.5 System - Network
Configure network settings for the AI-Box1.
Network Configuration:
- Method: Choose between DHCP (automatic IP assignment) or Static IP (manual configuration).
- If Static IP is selected, you can configure the IP Address, Netmask, Gateway, and DNS.
- Apply: Save network settings.
3.6 System - Profile
Manage system configuration profiles.
- Save as New Profile: Save the current configuration as a new profile.
- Load Profile: Load a previously saved profile.
- Profile: This option is available on each page and functions similarly to "Load Profile".
3.6.1 System - Settings - Device
Configure device-specific settings.
No | Item | Function Description |
---|---|---|
1 | Language | Set the system language (e.g., English). |
2 | Device Name | Displays the device name (e.g., CamConnect_Processor). |
3 | Location | Set a location identifier (e.g., Default_C615, or Default_XXXX with MAC address). |
4 | Max Microphone Qty. | Set the maximum number of microphones supported (e.g., 4/8/16/24). |
5 | System Startup Waiting Time | Configure the delay for device discovery during startup. This is important if microphones or cameras take longer to initialize, as it prevents connection failures. Adjust based on the environment. |
3.6.2 System - Settings - Auto Connection
Configure automatic connection settings.
- Auto Connection: Automatically connect to microphones, cameras, and video output upon AI-Box1 restart.
- Auto Save: Automatically save the configuration after a specified interval.
- Auto Run: Automatically start the Intelligent Director.
3.6.3 Additional Content Settings
Configure additional features like Reference Video and Reference Audio.
- Reference Video:
- Purpose: To enable AI facial recognition for camera triggering, ensuring that only targets with both sound and a detected face are tracked.
- Connection Method: Requires connecting to Lumens product BC200 (expected Q1 2025). Refer to the BC200 manual for details.
- Auxiliary Camera: Enable or disable the BC200 auxiliary camera.
- Vision Zone Detection: This feature is not currently available.
- Apply: Save settings.
- Reference Audio:
- Purpose: To prevent incorrect camera tracking caused by ambient noise or audio from the other end of a conference call. Reference Audio helps the system detect and suppress noise sources, reducing false camera triggers.
- Connection Method: Connect audio outputs from CamConnect Pro (C) and microphone (B) to a single audio input (A), then connect to the PC.
- Audio Trigger (dB): Sets the audio threshold for detection (-100 to 0 dB).
- Detective Time (s): Sets the duration for audio detection (0 to 10 seconds).
- PTZ Camera Trigger Set:
- Trigger Time: Sets the delay in seconds (0-99) before a camera is triggered. A setting of 0 disables triggering.
- Camera Selection: Choose to trigger all cameras or a specific camera.
- Position Type: Select to return to the Home position or a specific preset.
- Apply: Save settings.
3.6.4 System - Settings - Maintenance
Manage device maintenance and updates.
No | Item | Function Description |
---|---|---|
1 | Firmware Version | View the current device firmware version. |
2 | Auto Check | Automatically check for the latest firmware version. |
3 | Firmware Update | Upload firmware files from a computer for upgrading. |
4 | Event Log | Export a log file of past activities. |
5 | Reboot | Restart the device. |
6 | System Factory | Reset the device to factory default settings. |
7 | Configure File | Import or export configuration files. |
3.7 Related Information
This section displays related information about the AI-Box1.
- Manufacturer: Lumens Digital Optics Inc.
- Model Name: AI-Box1
- Firmware Version: Displays the current firmware version.
- MAC Address: The device's MAC address.
- Serial Number: The device's serial number.
- Website: www.MyLumens.com
- Support: Access help and support resources.
Chapter 4: Integration with Video Conferencing Software
This chapter explains how to integrate the AI-Box1 with popular video conferencing software.
After setting the AI-Box1 output mode to UVC or UVC+HDMI, click to start the video stream.
Open your video conferencing software (e.g., Skype, Zoom, Microsoft Teams). Select the camera source, which will be named "Lumens CamConnect Processor".
Chapter 5: Microphone Settings
This section provides configuration examples for supported microphones.
Refer to the Lumens website for the latest list of supported devices. The following are examples only.
Before installing the AI-Box1, configure your third-party microphone system using their respective manufacturer software.
5.1 Sennheiser
For TCC2 ceiling microphones used with CamConnect, first configure the channels in the Sennheiser Control Cockpit software. The CamConnect maps Sennheiser's horizontal angles into 8 segments, corresponding to CamConnect array positions 1 through 8.
If "Forbidden Zones" are enabled in Sennheiser Control Cockpit, this will affect the corresponding positions in CamConnect. For example, if a forbidden zone is set from 0° to 60°, audio signals from CamConnect array positions 1 (0°-45°) and 2 (45°-60°) will be ignored.
5.2 Shure
When Shure Designer Automatic Coverage is set to "On", it is suitable for large area positioning. For more precise positioning, disable Automatic Coverage and manually adjust Gain/Position to narrow the beamforming angle and improve location accuracy.
Chapter 6: Troubleshooting
This chapter addresses common issues encountered with the AI-Box1 and provides suggested solutions. If problems persist, contact your dealer or the service center.
NO | Problem | Solution |
---|---|---|
1. | Cannot search for camera devices. | 1. Check camera power or PoE supply. 2. Ensure the computer and camera are on the same network segment (e.g., 192.168.4.xx). 3. Replace cables if faulty. |
2. | Microphone detection position is unresponsive. | Ensure the microphone device is in a "Connected" state. |
3. | Specific angles do not respond with Sennheiser microphones. | 1. Verify the Azimuth Angle settings in the CamConnect software, including the angle position. 2. Check the Sennheiser Control Cockpit software to ensure the angle is not set as a forbidden zone. Refer to Section 5: Microphone Settings. |
4. | When setting camera presets, microphone detection of other angles triggers the camera to a different position, interrupting the setting process. | Refer to Section 2.1 Device Settings and disable "Voice Tracking". When enabled, microphones receive signals but do not trigger cameras to presets. |
5. | Cannot connect to the camera. | Go to the camera's web interface, navigate to the "Network" page, and check RTSP settings. Ensure "Multicast" is enabled. If Multicast is enabled, it may prevent the AI-Box1 from connecting to the camera. Screenshot showing RTSP settings with options for Enable Multicast and Require Password Authentication. RTSP URL example provided. |
6. | OTA cannot update automatically. | 1. Check if a static IP address is used. 2. Switch to DHCP and try updating again. |
Chapter 7: System Notification Messages
This chapter lists system warning messages and suggested actions.
No | Warning Message | Suggested Action |
---|---|---|
1 | Microphone cannot be found, please check Microphone connection status and try to connect it again. | Verify that the microphone's port is correctly configured and that the IP address is on the same network segment as the AI-Box1. Refer to the official website for supported microphone configurations: https://www.mylumens.com/en/Downloads/3?id2=5&keyword=ai%20box&keyword2=&pageSize=10&ord=. Also, refer to Section 3.1 Device - Microphone Setting to check the current microphone connection status. |
2 | Connection Loss | The connection between the AI-Box1 and the microphone has been lost. Check if the microphone was accidentally turned off or if there are other network issues. |
3 | Camera connect failed, please check camera Resolution / FPS settings or camera connection status. | Ensure the camera's resolution and frame rate (FPS) are set correctly. You can also check the relevant status and network connection via the camera's web interface. Refer to Section 3.2 Device - Camera List to check resolution status. |