Getting started with CY8CKIT-062S2-AI: PSoC™ 6 AI Evaluation Kit
1 Introduction
The PSoC™ 6 AI Evaluation Kit is a cost-effective small form-factor development kit. It provides the best of Infineon's solutions to drive adoption of Imagimob Studio for different use cases of machine learning and Infineon's software products.
This kit features a PSoC™ 6 MCU, a AIROC™ CYW43439 Wi-Fi/Bluetooth® combo module, a 512 Mb NOR flash, an onboard programmer/debugger (KitProg3), PDM-PCM digital microphone interface, Full-Speed USB device, two user LEDs, and one user button. The board supports operating voltages from 1.8 V to 3.3 V for the PSoC™ 6 MCU.
The kit provides various sensors such as 6-axis motion sensor (BMI270), magnetometer (BMM350), barometric pressure sensor (DPS368), and RADAR sensor (BGT60TR13C) for data collection and creating the machine learning models.
For more information, see CY8CKIT-062S2-AI.
1.1 Kit contents
The kit includes the following:
- PSoC™ 6 AI Evaluation Board
- Inlay card (a printed QR code points to a getting started webpage)
Figure 1 Kit contents
1.2 Requirements
Following softwares are required for getting started:
- ModusToolbox™ software v3.1 or later (for developing PSoC™ 6 MCU-based applications)
- Imagimob Studio v 4.6 (for developing machine learning models)
- UART terminal software such as Tera Term or Minicom
2 Out-of-box (OOB) application
The kit is pre-programmed with mtb-example-imagimob-streaming-protocol code example, that demonstrates sensor data collection from the USB port and store the data in the Imagimob Studio ready for labelling and machine learning model creation.
It is designed to collect the data from the motion sensor (BMI270) at 50 Hz sample rate, and PDM/PCM audio data at 16 kHz. For more details on implementation, see README.
2.1 Testing OOB application with serial terminal
- Connect the board to the PC through PSoC™ 6 USB connector (J2) using a Type-C USB cable. This enables a serial port for sensor data collection.
- Ensure that the power LED (D1) turns ON, indicating the board is powered.
- In the terminal application, open the serial connection to the device. Connect to this port using Type-C USB cable with the following settings:
- Baud rate: 115200
- Data: 8-bit
- Parity: None
- Stop bit: 1-bit
- Flow control: None
Figure 2 Serial port settings
- Set the terminal settings as follows:
- Newlines should be transmitted as CR+LF
- Enable local echo
Figure 3 Terminal settings
Type config?, and press Enter key (to send CR+LF) and verify that the device responds with a JSON structure describing the protocol configuration.
Figure 4 Configuration
Type subscribe,1,16000 and verify that the device streams audio data. Observe that the sample collection stops after 5 seconds. The garbled text on the terminal is the audio data.
Type subscribe,2,50 and verify that the device streams IMU data. Observe that the sample collection stops after 5 seconds. The garbled text on the terminal is the IMU data.
Note: Currently backspace is not supported in terminal commands. If you encounter issues such as unable to see commands on the terminal or receiving unknown command errors, follow the steps below:
- Reset the terminal and clear the buffer
- Reset board to ensure a fresh execution
2.2 Testing OOB application with Imagimob Studio
2.2.1 Creating project in Imagimob Studio
- Open Imagimob Studio and select File > New Project. The New Project window appears.
Figure 5 Create Empty Project
- Under Graph UX > Generic, select Empty Project.
- In New Project Name, enter the name of the project.
- In Location, specify the location where you want to create the workspace and the project directory.
- Click OK to create the project. The project directory is downloaded to the workspace in IMAGIMOB Studio.
Figure 6 Project directory
2.2.2 Connecting and setting up Serial Capture and Predefined Labels units
Imagimob Studio provides the functionality to collect and label the real-time data simultaneously. Set the Serial Capture unit for collecting data and Predefined unit for labelling data on the canvas.
2.2.2.1 Setting up the Serial Capture
- Connect the board to the laptop or PC through PSoC™ 6 USB connector (J2) using a Type-C USB cable.
- Expand EmptyProject directory and double-click the
Main.imunitto open the canvas. - Expand Library > Devices and drag and drop the Serial Capture unit onto the canvas.
- Expand Visualization and drag and drop the Data Track unit onto the canvas.
- Goto Serial Capture > Properties and select “USB Serial Device” port. To check the COM port at which the board is connected, open Device Manager > Ports and look for USB Serial Device.
- Click on the red icon in the Serial Capture node and drag over to the gray icon in the Data Track node. This creates a connection between the two nodes.
Figure 7 Connection setup between two nodes
Note: The microphone collects data at a sampling rate of 16000 and an accelerometer collects data at a sampling rate of 50.
Note: The connection might not establish if the COM port is already in use in Imagimob Studio or another tool.
After setting up the Serial Capture, you can utilize the same graph to label the real-time data, by adding a Pre-defined Labels unit onto the canvas. Define the classes in the Predefined Labels node for one time and utilize the defined classes to label the data on a click of button.
2.2.2.2 Setting up the Predefined Labels
- Expand Project and drag and drop the Predefined Labels unit onto the canvas. The Predefined Labels unit displays the default classes.
- Define the classes in Predefined Labels node by entering every class in a new line.
Figure 8 Predefined Labels
After defining the classes, start collecting and labelling data simultaneously.
2.2.3 Real-time data collection and data labelling
- Navigate to the toolbar and click the Start button ▶️ to open the session file (
main.imsession). An empty session file opens displaying the pre-defined classes in the Labels bar. - Click the Record button ⏺️ to start capturing the real-time data.
Figure 9 Real time data collection
- In the Labels bar, select a class to start adding labels to the streaming data.
- Deselect the same class to stop adding the labels. Similarly, you can enable or disable the other classes and label the data.
- Click the Record button ⏺️ to stop collecting the data.
- Select File > Save to save the session file, data track and label track. The Save New Session window appears.
Figure 10 Save data track and label track
- In Location, click the three dot and select the desired location to save the files.
- In Session Name, enter the name of the session file.
- Under Track Options, set the following:
- In Wave Format Encoding, select the encoding format for the audio tracks
- In Track Name, double-click the column to edit the track name, if required
- In File Name, double-click the columns to edit the track name, if required
- Select the save checkbox corresponding to the tracks you want to save.
- Click OK to save the files.
- Repeat the instructions from step 2 to collect and save data in multiple session files.
After the required data is collected and labelled, add data to the project in Imagimob Studio and start with the machine learning workflow. To know how to add data, Create Classification project and Add data to project.
Revision history
| Document revision | Date | Description of changes |
|---|---|---|
| ** | 2024-05-27 | Initial release |
Disclaimers and Notices
Trademarks
All referenced product or service names and trademarks are the property of their respective owners. The Bluetooth® word mark and logos are registered trademarks owned by Bluetooth SIG, Inc., and any use of such marks by Infineon is under license.
Important notice
The information given in this document shall in no event be regarded as a guarantee of conditions or characteristics ("Beschaffenheitsgarantie").
With respect to any examples, hints or any typical values stated herein and/or any information regarding the application of the product, Infineon Technologies hereby disclaims any and all warranties and liabilities of any kind, including without limitation warranties of non-infringement of intellectual property rights of any third party.
In addition, any information given in this document is subject to customer's compliance with its obligations stated in this document and any applicable legal requirements, norms and standards concerning customer's products and any use of the product of Infineon Technologies in customer's applications.
The data contained in this document is exclusively intended for technically trained staff. It is the responsibility of customer's technical departments to evaluate the suitability of the product for the intended application and the completeness of the product information given in this document with respect to such application.
Warnings
Due to technical requirements products may contain dangerous substances. For information on the types in question please contact your nearest Infineon Technologies office.
Except as otherwise explicitly approved by Infineon Technologies in a written document signed by authorized representatives of Infineon Technologies, Infineon Technologies' products may not be used in any applications where a failure of the product or any consequences of the use thereof can reasonably be expected to result in personal injury.
mailto:erratum@infineon.com
Semiconductor & System Solutions | Infineon Technologies
DEEPCRAFT™ Studio documentation
mtb-example-imagimob-streaming-protocol/README.md at master · Infineon/mtb-example-imagimob-streaming-protocol · GitHub
Development Platform for AI / Machine Learning on edge devices - DEEPCRAFT™ Studio
