visual writing ppt

1. VISUAL WRITING
SHIVAJIRAO S JONDHALE COLLEGE OF
ENGINEERING
BY
1) Harsh Badapure
2) Abhishek Nagare
3) Rohan Patel
4) Anirudh Navale
GUIDED BY
Prof. Samita Patil

2. ABSTRACT
In this project we have implemented the “VISUAL WRITING
USING CV” using OpenCV and object detection algorithm.
Virtual writing and controlling system is challenging
research areas in field of image processing and pattern
recognition in the recent years. It contributes extremely
to the advancement of an automation process and can improve
the interface between man and machine in numerous
applications. Several research works have been focusing on
new techniques and methods that would reduce the processing
time while providing higher recognition accuracy. Given the
real time webcam data, this jambord like python application
uses OpenCV library to track an object-of-interest (a human
palm/finger in this case) and allows the user to draw by
moving the finger, which makes it both awesome and
interesting to draw simple thing.

3. SR.NO. TITLE
1 Introduction
2 Literature Survey
3 Problem Definition
4 Existing System
5 Propose System
6 System Design
7 Result
8 Conclusion
9 References
CONTENTS

4. Introduction
VISUAL WRITING using AI, OpenCV and Mediapipe is an
application that tracks the movement of an object. Using this
tracking feature, the user can draw on the screen by moving
the object (which in our project is the human hand) in the air, in
front of the webcam. This real time webcam data generated by
tracking the movement of the object helps the user to draw
simple things which are both interesting and challenging.

5. Literature Survey
Author Published Focus on Advantage
Wang and Zhao October
2010
Detection of moving object background subtraction technique
Rakibe and Patil Dec 2012 new algorithm based upon the background
subtraction algorithm
remove the noise and solve the background
interruption difficulty
Kavitha and Tejaswini Feb 2014 to detect the shape of the hand It works well for tracking a large object
Nimisha K Pand Agnes
Jacob
July 2016 extracting features from accessible data
and improving feature extraction using
algorithms
The key advantage of this technique is the short
response time
S.U. Saoji,NisthaDua,
Akash Kumar
C,BharatPhogat
May 2019 the focus of study is on data learning, data
similarity, and a set of algorithms that are
best suited to the type of data being
obtained.
The project takes advantage of this gap by
concentrating on the development of a motion-to-
text converter that might be used as software for
intelligent wearable gadgets that allow users to
write from the air

6. Problem Definition
During pandemic as the world was forced to live in quarantine. The
deadly virus still wasn’t able to stop the busy world, as the work world
shifted almost 90% Online. As much as tough it was for everyone to
adjust in the world of technology completely; a lot of people got used to
it real soon.
While teaching was done online as well; it was tough for teachers as
well as students to go from blackboard to ppts. As a result, big meeting
sites like Google meet, Zoom, etc introduced a whiteboard feature. Here,
the meeting organizer can use an online whiteboard with the help of
input devices like trackpads or mouse. As the time goes by, this method
turns out of be very much time consuming and lags a lot.

7. HARDWARE /SOFTWARE
REQUIREMENTS
HARDWARE:
 Processor –
Intel I5
 RAM – 4GB
 Storage – 1GB
 Web Camera
SOFTWARE:
 Operating system
– Windows 10
 Programming
Language –
python
 Front End –
Python Tkinter
and OpenCV

8. Propose System
The objective is to create a free space where one can draw in air freely. The camera
detects the fingertip and tracks its motion throughout the screen. Whenever the hand
comes in front of the camera, the initial thing to do is detect the fingertip. There are
various ways of fingertip detection. Fingertip Detection We are aiming to develop a
system which can accurately detect the fingertips. First, we will detect the whole
hand and then the region segmentation is done. Region segmentation is a two-step
approach which includes skin segmentation and background subtraction. This system
will work accurately in real time. For background subtraction we may use faster
RCNN methods. Determining the center of gravity is important as it is used to detect
some particular hand gestures for operations to be done. The proposed system aims to
use two algorithms for centroid calculation and then take the average value of both as
the final result. Distance transformation is the algorithm used and the pixel with the
highest intensity is the center of gravity.

9. LIBRARIES USED
OPENCV NUMPY MEDIAPIPE

10. FLOWCHART
ARCHITECTURE

11. REFERENCES
[1] Virtual
Sketch using Open
CV,ISSN: 2278-
3075 (Online),
Volume-10 Issue-
8, June 2021
[2] AIR CANVAS
APPLICATION USING
OPENCV AND NUMPY
IN PYTHON,e- ISSN:
2395-005
[3]"Text Writing
in Air" Journal
of Information
Display Volume
14
[4] Jaydip Sen ,
Object
Detection and
Tracking Using
Opencv in
Python.
In [1] Author proposed
objects color detection
and masking it with
morphological operations
along with that providing
task bar for various color.
In[2]Author is using different
techniques of fingertip
recognition along with that
he is also creating a dataset
by cutting a video into
different separate images
and also labelling the
dataset manually. But it is
not that accurate.
In [3], the system
proposed used the depth
and color information
from the Kinect sensor to
detect the hand shape.
The information obtained by
frame differencing is useful,
but it is not possible to build a
robust tracker using that
approach. The method is also
very sensitive to noise and it
does not really track
an object completely.

12. CONCLUSION
This application can be put to use in many fields which doesn’t need a lot of
expertise in typing and also is efficient as it takes a brief amount of time to
convey the user's thoughts. It creates a space for the users to draw anything
they wish using a single finger among the available choice of colors while
using two fingers to make a choice in a very convenient and effortless
manner. The principal reason of the project is to demonstrate Human
computer interaction.

13. THANK YOU!
THANKING ALL THE FACULTY MEMBERS, HOD AND PRINCIPLE; FOR GIVING US THE
OPPORTUNITY TO LEARN SOMETHING NEW AND PRESENT IN FRONT OF THE EXTERNAL.