ESPRESSIF EchoEar AI Development Kit

EchoEar AI Development Kit User Manual

Model: EchoEar AI Development Kit

Merek: ESPRESSIF

1. Bubuka

The EchoEar AI Development Kit is an intelligent AI development platform designed for voice interaction products that require large language model (LLM) capabilities. It is suitable for applications such as smart toys, smart speakers, and smart central control systems.

The device features an ESP32-S3-WROOM-1 module, a 1.85-inch QSPI circular touch screen, and a dual microphone array. It supports offline voice wake-up and sound source localization algorithms. By integrating with large model capabilities from services like OpenAI, Xiaozhi AI, and Gemini, EchoEar enables full-duplex voice interaction, multimodal recognition, and intelligent agent control. This kit provides a robust foundation for developers to create comprehensive edge-side AI application experiences.

Bewara penting:

  • This product has different model options regarding color and battery inclusion. Please ensure you select the correct model to match your preferences. It can be powered via USB or be paired with an optional 3.7V polymer lithium battery (model: 902530, 700mAh).
  • The motor base is not included in the default kit.
  • EchoEar is an AI development board for LLM. The features demonstrated in product videos are achievable implementations based on this board. You can realize these functions yourself using our open-source code, and we will continue to publish related examples on GitHub. Please consider this before purchasing—we welcome you to join us in exploring AI development!

2. komponén Leuwihview

The EchoEar AI Development Kit consists of several key components, including the CoreBoard, MicBoard, and BaseBoard, along with various connectors and indicators. Below is a detailed description of the main components and their functions, as well as their layout on the PCBs and housing.

2.1 CoreBoard Components

EchoEar CoreBoard PCB Front View

Image: EchoEar CoreBoard PCB Front View, showing ESP32-S3-WROOM-1, Speaker Connector, Touch Connector, Mic Board Connector, LCD FPC Connector, and Battery Connector.

EchoEar CoreBoard PCB Back View

Image: EchoEar CoreBoard PCB Back View, showing ES8311, NS4150B, BMI270, BaseBoard Connector, SY8088AAC, and ES7210.

2.2 MicBoard Components

EchoEar MicBoard PCB Front View

Image: EchoEar MicBoard PCB Front View, showing Green LED, MIC, and LCD Screen.

EchoEar MicBoard PCB Back View

Image: EchoEar MicBoard PCB Back View, showing FPC Connector.

2.3 BaseBoard Components

EchoEar BaseBoard PCB Front View

Image: EchoEar BaseBoard PCB Front View, showing Type-C port, BQ27220, TP4057, CoreBoard Connector, SAM8108, and TLV62569.

EchoEar BaseBoard PCB Back View

Image: EchoEar BaseBoard PCB Back View, showing SD Card slot, BOOT Button, RST Button, M1.6 Welded Nut, Magnetic Connector, and Power Switch.

2.4 Déskripsi komponén

komponénKaterangan
ESP32-S3-WROOM-1 (CoreBoard)Main controller chip, integrates 16 MB Flash and 16 MB PSRAM, supports 2.4 GHz Wi-Fi and Bluetooth 5 (LE) wireless connectivity.
Panyambung batréConnector for 3.7 V lithium battery (top pin positive, bottom negative).
LCD FPC ConnectorConnects to 1.85-inch circular LCD screen (360 x 360 resolution).
MicBoard ConnectorConnects MicBoard PCB, dual microphone array, and status indicator LED.
Toél PanyambungConnects touch copper foil for touch interaction.
Panyambung Speaker2-wire connector for built-in 3 W speaker.
NS4150B (Class D Ampliifier)Ultra-low EMI, filterless, 3W mono Class D audio amppangagung.
ES7210 (Audio Decoder Chip)High-performance 4-channel audio decoder chip, supports I2S/PDM/TDM data ports.
SY8088AAC (DCDC chip)Buck converter chip for converting 5 V to 3.3 V power, providing stable power for the Codec.
Green LED (MicBoard)Indikator LED héjo.
MIC (Microphone Array)Dual LMA3729T381-OY3S microphone array, supports local voice wake-up and sound source localization.
FPC Connector (MicBoard)Connects MicBoard with CoreBoard FPC connector.
BQ27220 (Battery Management Chip)Battery management chip for level detection, charging management, and power status monitoring.
TP4057 (Lithium Battery Charging Chip)Lithium battery charging chip for charging lithium batteries with 250 mA current.
CoreBoard Connector (BaseBoard)Connects core board with base board.
TLV62569 (DCDC Chip)Buck converter chip for converting 5 V to 3.3 V power, providing stable power for the system.
SAM8108 (Power Control Chip)Power control chip for controlling device power on/off. Single click of POWER button toggles power.
Type-C (USB-C Interface)USB-C interface for power supply, programming download, debugging, and charging lithium batteries.
BMI270 (IMU - Inertial Measurement Unit)6-axis intelligent low-power inertial measurement unit for high-performance applications.
ES8311 (Audio Codec Chip)Low-power mono audio codec with high-performance multi-bit Delta-Sigma audio ADC and DAC.
M1.6 Welded NutFor fixing main board to housing.
RST Button (Reset Button)For resetting the main board.
Panyambung magnétFor functional expansion, provides serial port and 5 V power interface, connects to rotating base and other devices.
Saklar DayaControls device power on/off.
Tombol BOOTHold this button when powering on to enter download mode.
Slot Kartu SDSupports up to 32 GB microSD card for storing audio, images, videos, and other data.

3. Setup jeung Konfigurasi Awal

This section provides guidance on the initial hardware setup and how to flash firmware onto your EchoEar AI Development Kit.

3.1 Hardware Assembly

The EchoEar kit typically comes pre-assembled. However, if you are working with individual components or need to reassemble, refer to the "Components Overview" section for the layout of the CoreBoard, MicBoard, and BaseBoard, and their respective connectors.

  • Ensure the CoreBoard is securely connected to the BaseBoard via the CoreBoard Connector.
  • Connect the MicBoard to the CoreBoard using the FPC Connector.
  • If using an optional 3.7V polymer lithium battery (model: 902530, 700mAh), connect it to the Battery Connector on the CoreBoard, ensuring correct polarity (top pin positive, bottom negative).
  • Insert a microSD card (up to 32 GB) into the SD Card Slot on the BaseBoard if you plan to store audio, images, or video data.
  • The main board is fixed to the housing using M1.6 Welded Nuts.

3.2 Powering On and Firmware Flashing

  1. Sasayogian tanaga: Connect the EchoEar to a power source using the USB-C interface. This interface also supports programming download and debugging, and charges lithium batteries.
  2. Hurungkeun/Pareuman: Use the POWER Switch on the BaseBoard to control the device's power. A single click toggles the power status.
  3. Entering Download Mode: To flash new firmware, hold down the BOOT Button on the BaseBoard while powering on the device. This will put the device into download mode, allowing you to upload firmware via the USB-C interface.
  4. Pangwangunan firmware: Refer to the official Espressif documentation and GitHub repositories for open-source code and examples to develop and flash your AI applications.

4. Parentah Operasi

The EchoEar AI Development Kit is designed for developers to implement and test AI-powered voice interaction applications. Its operation largely depends on the firmware and applications you develop and deploy.

4.1 Interaksi Dasar

  • Bangun Sora: The dual microphone array supports local voice wake-up. Once configured in your firmware, you can activate the device using a predefined wake-word.
  • Paréntah sora: After wake-up, the device can process voice commands. The specific commands and their responses are determined by your implemented LLM and AI agent logic.
  • Interaksi Toél: The 1.85-inch circular LCD screen supports touch functionality. Your applications can utilize this for graphical user interface (GUI) interactions.
  • Kaluaran Audio: The built-in 3W speaker provides audio feedback and responses from your AI applications.

4.2 Advanced Features (Developer-Dependent)

  • Full-Duplex Voice Interaction: With appropriate LLM integration, EchoEar can engage in natural, continuous conversations.
  • Multimodal Recognition: Develop applications that combine voice input with other sensor data (e.g., from the BMI270 IMU) for richer interaction.
  • Intelligent Agent Control: Utilize the kit to create AI agents capable of controlling external devices or performing complex tasks.
  • Panyimpenan Data: The SD Card Slot allows for storage of application data, logs, audio recordings, or other media.
  • Functional Expansion: The Magnetic Connector provides a serial port and 5V power interface for connecting to a rotating base or other external devices, enabling further functional expansion.

5. Pangropéa sarta perawatan

To ensure the longevity and optimal performance of your EchoEar AI Development Kit, follow these maintenance guidelines:

  • beberesih: Use a soft, dry cloth to clean the device. Avoid using liquid cleaners or solvents, as they may damage the electronic components or the screen.
  • Panyimpenan: Simpen alat ieu di tempat anu tiis sareng garing, jauh tina sinar panonpoé langsung, suhu anu ekstrim, sareng kalembaban anu luhur.
  • Perawatan batré: If using a lithium battery, avoid fully discharging it for extended periods. Charge it regularly, even if not in use, to maintain battery health.
  • Penanganan: Nanganan alat kalayan ati-ati pikeun nyegah karusakan fisik. Hindarkeun ragrag atanapi tunduk kana dampak anu kuat.
  • Pembaruan firmware: Regularly check the official Espressif GitHub repository for firmware updates and security patches to keep your development environment secure and up-to-date.

6. Cara ngungkulan

This section provides basic troubleshooting steps for common issues you might encounter with your EchoEar AI Development Kit. As a development kit, many issues may stem from software/firmware configuration rather than hardware faults.

6.1 Masalah kakuatan

  • Alat teu hurung:
    • Ensure the USB-C cable is securely connected to a working power source and the device.
    • If using a battery, check if it is charged. The TP4057 chip manages battery charging.
    • Verify the POWER Switch is in the 'on' position.
    • Inspect the Battery Connector for proper connection and polarity if a battery is installed.

6.2 Firmware and Connectivity Issues

  • Unable to flash firmware:
    • Ensure the device is in download mode by holding the BOOT Button while powering on.
    • Check your USB-C connection and drivers on your development machine.
    • Verify your flashing tool and firmware image are correct and compatible.
  • Masalah konektivitas Wi-Fi/Bluetooth:
    • Confirm your firmware includes the necessary Wi-Fi/Bluetooth drivers and configuration for the ESP32-S3-WROOM-1 module.
    • Check for interference from other 2.4 GHz devices.
    • Ensure your network credentials are correctly configured in your application.

6.3 Audio and Display Issues

  • Henteu aya sora tina spiker:
    • Check the Speaker Connector for a secure connection.
    • Verify that your firmware is correctly utilizing the NS4150B amplifier and ES8311 audio codec.
    • Ensure the volume is not set to zero in your application.
  • Microphones not responding:
    • Check the MicBoard Connector for a secure connection.
    • Confirm your firmware is correctly configured to use the LMA3729T381-OY3S microphone array.
  • Display not working or unresponsive touch:
    • Check the LCD FPC Connector and Touch Connector for secure connections.
    • Verify your firmware's display and touch drivers are correctly initialized for the 1.85-inch QSPI circular touch screen.

For more in-depth troubleshooting and development support, please refer to the official Espressif documentation, community forums, and GitHub repositories.

7. Spésifikasi

FiturRincian
Ngaran BrandESPRESIF
TipeVoltage Regulator (Development Kit)
kaayaanAnyar
AsalnaDaratan Cina
Controller UtamaESP32-S3-WROOM-1 (16 MB Flash, 16 MB PSRAM, 2.4 GHz Wi-Fi, Bluetooth 5 LE)
tampilan1.85-inch QSPI circular LCD, 360x360 resolution, touch screen
MikroponDual LMA3729T381-OY3S microphone array (supports offline voice wake-up, sound source localization)
SpeakerDiwangun-di 3 W spiker
Input kakuatanUSB-C (5V)
Rojongan batréOptional 3.7V polymer lithium battery (model: 902530, 700mAh)
Battery Charging ChipTP4057 (250 mA charging current)
Manajemén batréBQ27220 (level detection, charging, power status)
Kontrol kakuatanSAM8108 (power on/off toggle)
IMUBMI270 (6-axis inertial measurement unit)
Audio CodecES8311 (mono audio ADC/DAC), ES7210 (4-channel audio decoder)
Audio AmppangagungNS4150B (3W mono Class D)
PanyimpenanSD Card Slot (up to 32 GB microSD)
ÉkspansiMagnetic Connector (serial port, 5V power)

8. Tips pamaké

Bari euweuh ulang pamaké hususviews or Q&A were provided, here are some general tips for working with the EchoEar AI Development Kit:

  • Mimitian ku Examples: Begin by exploring the official open-source code and examples provided by Espressif on GitHub. This will help you understand the basic functionalities and development workflow.
  • Rojongan Komunitas: Engage with the Espressif developer community. Forums and online groups can be valuable resources for troubleshooting and sharing ideas.
  • Manajemén kakuatan: If using a battery, monitor its charge level, especially during intensive development or testing, to avoid unexpected shutdowns.
  • Dokuméntasi: Always refer to the latest official documentation for the ESP32-S3 and related components for detailed technical information.
  • Experiment Safely: When connecting external components via the Magnetic Connector or other interfaces, ensure proper wiring and power supply to prevent damage to the kit or peripherals.

9. Garansi jeung Rojongan

For warranty information, technical support, and further resources, please refer to the official Espressif Systems website and their dedicated support channels. As a development kit, support primarily focuses on hardware functionality and providing resources for software development.

Resmi Websitus: espressif.com

GitHub Repository: Check Espressif's official GitHub for open-source code, examples, and documentation related to the EchoEar AI Development Kit.

Dokumén Patali - EchoEar AI Development Kit

Praview Espressif ESP-Dev-Kits: Pituduh Papan Pangwangunan anu Dirojong
Jelajahi jajaran ESP-Dev-Kit Espressif, anu ngajelaskeun sacara rinci papan pamekaran anu dirojong, fitur-fiturna, spésifikasi perangkat keras, sareng pituduh ngamimitian pikeun insinyur sareng pamekar. Ngawengku inpormasi ngeunaan séri ESP32, kit HMI, sénsor toél, sareng alat pamekaran.
Praview ESP32-DevKitC V4 Ngamimitian Guide | Espressif
Pitunjuk komprehensif pikeun ngamimitian sareng papan pangembangan ESP32-DevKitC V4 ti Espressif. Diajar ngeunaan fitur, komponén, sareng pinouts pikeun panganteur sareng pamekaran aplikasi anu gampang.
Praview ESP32-S3-LCD-EV-Board: Development Board User Guide
Comprehensive user guide for the Espressif ESP32-S3-LCD-EV-Board, detailing its features, hardware components, LCD subboards, software support, and development setup.
Praview ESP32-DevKitC V4 Development Board - Espressif Specification and Overview
Komprehensif leuwihview and technical specifications for the Espressif ESP32-DevKitC V4 development board, featuring ESP32-WROOM modules. Includes hardware details, module variants, and links to getting started guides.
Praview Pituduh Pangguna Kit Pangwangunan AIoT ESP32-S3-BOX-3
Pituduh pangguna anu lengkep pikeun ESP32-S3-BOX-3 AIoT Development Kit, anu ngajelaskeun fitur-fiturna, komponén perangkat keras, setelan, sareng panggunaan pikeun rupa-rupa aplikasi AI sareng IoT.
Praview ESP32-S3-WROOM-1 & ESP32-S3-WROOM-1U Datasheet
Comprehensive datasheet for Espressif's ESP32-S3-WROOM-1 and ESP32-S3-WROOM-1U modules, detailing their Wi-Fi, Bluetooth 5, Xtensa LX7 processor, memory, GPIOs, and applications for IoT and embedded systems.