Development of an AI-driven robotic manipulation framework

dc.contributor.advisorRen, Jing
dc.contributor.advisorLang, Haoxiang
dc.contributor.authorLiu, Xiaolong
dc.date.accessioned2024-10-21T20:30:36Z
dc.date.available2024-10-21T20:30:36Z
dc.date.issued2024-09-01
dc.description.abstractThis paper introduces a manipulator control system that leverages state-of-the-art artificial intelligence (AI), advanced robotics, and the latest computer vision techniques to enable intuitive and universal robotic control across different robotic manipulators. The intuitive user command interpretation is deployed in the system using ChatGPT API. The vision capabilities of the system rely on YOLOv7 for object detection, Semi-Global Block Matching (SGBM) for object localization, and Principal Component Analysis (PCA) for object orientation. Moreover, MoveIt is utilized for motion planning, and the simulation environment is powered by Gazebo. These components are seamlessly coordinated by a custom state machine integrating into a ROS-based framework. This system allows users to control manipulators completing complex tasks by commands without expert knowledge of robotics. Additionally, a cross-platform kinematics solver architecture is introduced to assess inverse kinematics algorithms for manipulators. Compared to the traditional kinematics solver implemented as ROS plugins, this architecture integrates the sophisticated mathematical capabilities of Matlab with the feasibility of ROS.
dc.identifier.urihttps://ontariotechu.scholaris.ca/handle/10155/1859
dc.subject.otherRobotic manipulator
dc.subject.otherChatGPT API
dc.subject.otherMoveIt
dc.subject.otherInverse kinematics
dc.subject.otherROS
dc.titleDevelopment of an AI-driven robotic manipulation framework
dc.typeThesis
thesis.degree.disciplineElectrical and Computer Engineering
thesis.degree.grantorUniversity of Ontario Institute of Technology
thesis.degree.nameMaster of Applied Science (MASc)

Files

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Liu_Xiaolong.pdf
Size:
2.85 MB
Format:
Adobe Portable Document Format

License bundle

Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.89 KB
Format:
Item-specific license agreed upon to submission
Description: