Skip to content

Commit a759eb4

Browse files
authored
Merge pull request #45 from BlazinBull/master
Added assets and MD file of VVM
2 parents b8233af + 93ef298 commit a759eb4

File tree

8 files changed

+62
-0
lines changed

8 files changed

+62
-0
lines changed
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,62 @@
1+
---
2+
layout: post
3+
title: Voice_Video_Manipulator
4+
tags:
5+
- Robotics
6+
- ROS2
7+
- Inverse kinematics
8+
- Machine Learning
9+
- Image Processing
10+
description: Developing a robotic manipulator system equipped with both video input capabilities and speech recognition.
11+
---
12+
13+
## Mentees :
14+
- [Yash Suthar](https://github.com/BlazinBull)
15+
- [Kartikey Pathak](https://github.com/NoobMaster-version)
16+
- [Aniket Desai](https://github.com/MASQUERADE-2005)
17+
18+
---
19+
# What is our project ?
20+
This project aims to develop a robotic manipulator system capable of recognizing objects from a video input and executing pick-and-place tasks based on spoken commands.
21+
22+
We will be designing and developing the Intelligent Video Manipulator with Voice Commands, an innovative system that seamlessly integrates video processing and speech recognition technologies. Our goal is to enable users to interact with and manipulate video content using spoken commands.
23+
24+
# What have we done so far?
25+
### Courses we completed
26+
Since last 2 Weeks we went through ample amount of resources. Starting with Linear Algebra which is quite important for this project coz in order to build this manipualtor , Understanding of algebra and its meaning Geometrically has played a crucial role till present date. Later we studied and implemented ROS2 (Robot Operating System 2) to deal with the Manipulator in real time.
27+
28+
29+
### Forward and Inverse Kinematics
30+
After competing this courses and it's implementation, We started with Forward Kinematics and Subsequently the Inverse. The Manipulator has various joints and links. To Control a Robot we can control it by Either Providing Joint Angles as input so that its End-effector reaches a particular point in it's Workspace or by providing Coordinates of the tip of the End-effector in Cartesian-Coordinate system.
31+
32+
The Latter is known as **Inverse Kinematics** and the former is known as **Forward kinematics**.
33+
34+
We have successfully completed the Forward and Inverse Kinematics Script of the 4-DOF manipulator.
35+
36+
![fk](/assets/posts/Voice-Video-Manipulator/F.K.png)
37+
38+
>The DH parameters are shown below:
39+
![dh](/assets/posts/Voice-Video-Manipulator/DH.jpg)
40+
41+
---
42+
43+
>The expected and the actual Position were differing so in solution to that problem, We used a Transformation matrix denoted by T Matrix in the below image
44+
![dh3](/assets/posts/Voice-Video-Manipulator/DH3.jpeg)
45+
46+
> The Final transformation Matrix
47+
![tm](/assets/posts/Voice-Video-Manipulator/Transformation_Matrix.jpg)
48+
where l1,l2,l3,l4,l5 are link lengths
49+
50+
# What are we dealing with now
51+
As of now we are learning and trying to implement the launch files for our inverse kinematics script and GAZEBO.
52+
53+
Also we have started with Machine learning(ML) courses simultaneously in order to enable the manipulator to recognize the *Objects* around it and take actions accordingly.
54+
55+
# Difficulties we faced
56+
We faced difficulty while finding DH Parameters for forward kinematics since there were various methods availaible across the web. Also inverse kinematics was a bit tricky. But with time, We figured it out.
57+
58+
>On running the inverse script,
59+
60+
![inv](/assets/posts/Voice-Video-Manipulator/inv.png)
61+
62+
1.31 MB
Loading
157 KB
Loading
11.7 KB
Loading
Loading
Loading
Loading
83 KB
Loading

0 commit comments

Comments
 (0)