ESP32-S3-BOX: How to get phoneme for custom voice command

tushar@esp
Posts: 10
Joined: Thu Jun 16, 2022 3:38 pm

ESP32-S3-BOX: How to get phoneme for custom voice command

Postby tushar@esp » Tue Jun 21, 2022 8:35 pm

Hi, we started to experiment on ESP32-S3-BOX with inbuilt voice recognition.
We found below string with voice phoneme in the example from https://github.com/espressif/esp-box.

Code: Select all

[b]// cmd,                       Language,      id, string,                   phoneme,           next ref[/b]
    {SR_CMD_LIGHT_ON, SR_LANG_EN, 0, "Turn On the Light", "TkN nN jc LiT", {NULL}},
    {SR_CMD_LIGHT_ON, SR_LANG_EN, 0, "Switch On the Light", "SWgp nN jc LiT", {NULL}},
    {SR_CMD_LIGHT_OFF, SR_LANG_EN, 0, "Switch Off the Light", "SWgp eF jc LiT", {NULL}},
    {SR_CMD_LIGHT_OFF, SR_LANG_EN, 0, "Turn Off the Light", "TkN eF jc LiT", {NULL}},
.
.
.
when we create custom voice command, mobile application is creating phoneme and sending to device as per my understating from the example code.
If we want to implement the direct custom command with example, can someone please help to know how we can generate phoneme for desired string?
I tried to search and tried using some online convertor but the device is not recognizing that string as voice. Is there any specific phoneme conversation is required to make custom voice command?

ESP_Rachel
Posts: 96
Joined: Wed Nov 10, 2021 9:28 am

Re: ESP32-S3-BOX: How to get phoneme for custom voice command

Postby ESP_Rachel » Wed Jun 22, 2022 2:22 am

We have a tool that can convert word phrases into phoneme that speech recognition model can recognized. The tool has been deployed in the mobile App server.
Please refer to: https://github.com/espressif/esp-sr/tre ... ition/tool

tushar@esp
Posts: 10
Joined: Thu Jun 16, 2022 3:38 pm

Re: ESP32-S3-BOX: How to get phoneme for custom voice command

Postby tushar@esp » Wed Jun 22, 2022 8:14 pm

Okay - Got it.
thanks for the quick response.
IMO, It should be mentioned regarding this tool in https://github.com/espressif/esp-sr/README.md.

Who is online

Users browsing this forum: No registered users and 3 guests