The last couple of weeks Gizmo has continued testing, the goal has been to make it more reliable and autonomous and we are making progress in that part. The biggest change has been the addition of a microphone array on his head. This was not easy the software only runs on the latest Rasbian, and ROS needs to be installed from source it took about a week before it was all running.
Gizmos current status is
- navigation works but still passes to close to objects if we set way points Gizmo will navigate through doors and narrow corridors and still be localized correctly at the end.
- Moveit will move the arms to a location and track a moving target but the dynamixels servos will overheat after a short time.
- Auto-docking and battery management work in semi automatic mode only
The new external microphone opens a lot of potential ideas in a quite room Gizmo will recognize voices out to 2.5 meters with the TV running we are down to about 1 meter. We are using python speech recognizer and Google STT in default mode, snowboy for hot work recognition. it take about 8 seconds from start of command to returned text. the text is passed to a python chatbot for response and action requests are passed to the behavior tree.