Next‐generation human‐robot interaction with ChatGPT and robot operating system

下一代人机交互与ChatGPT和机器人操作系统

Anis Koubaa, Adel Ammar, Wadii Boulila

DOI: 10.1002/spe.3377

期刊: Software Practice and Experience

摘要

Abstract This article presents an innovative concept that harnesses the capabilities of large language models (LLMs) to revolutionize human‐robot interaction. This work aims to connect large language models with the Robot Operating System (ROS), the primary development framework for robotics applications. We develop a package for ROS that seamlessly integrates ChatGPT with ROS2‐based robotic systems. The core idea is to leverage prompt engineering with LLMs, utilizing unique properties such as ability eliciting, chain‐of‐thought, and instruction tuning. The concept employs ontology development to convert unstructured natural language commands into structured robotic instructions specific to the application context through prompt engineering. We capitalize on LLMs' zero‐shots and few‐shots learning capabilities by eliciting structured robotic commands from unstructured human language inputs. To demonstrate the feasibility of this concept, we implemented a proof‐of‐concept that integrates ChatGPT with ROS2, showcasing the transformation of human language instructions into spatial navigation commands for a ROS2‐enabled robot. Besides, we quantitatively evaluated this transformation over three use cases (ground robot, unmanned aerial vehicle, and Robotic arm) and five LLMs (LLaMA‐7b, LLaMA2‐7b, LLaMA2‐70b, GPT‐3.5, and GPT‐4) on a set of 3000 natural language commands. Our system serves as a new stride towards Artificial General Intelligence (AGI) and paves the way for the robotics and natural language processing communities to collaborate in creating novel, intuitive human‐robot interactions. The open‐source implementation of our system on ROS 2 is available on GitHub.

文章解读

研飞AI智能解析 PDF,回答研究者问题,助你秒懂论文

免费下载

期刊信息

期刊:

ISSN: 0038-0644

国际分区

类目分区
COMPUTER SCIENCE, SOFTWARE ENGINEERING2

国内分区

类目分区
计算机科学4
计算机科学, 计算机软件工程4
Built withby Ivy Science
Copyright © 2020-2024
版权所有:南京青藤格致信息科技有限公司
隐私和监管政策
苏ICP备20040574号-1
ICP许可证: 苏B2-20220377