VisiLock: A Smart IoT-Based Face Recognition Door Lock System

"VisiLock: Smart Face Access System" is a college project I developed to enhance security using face recognition and IoT technology. It integrates an ESP32-CAM module, a face recognition algorithm, a door lock mechanism, and a web-based application for remote access control. The system captures and processes images to grant access upon successful recognition, eliminating the need for physical keys while providing real-time control via Wi-Fi.

1. VisiLock:
Smart Face Access System
IoT based group project by the students of
SKDAV, Govt Polytechnic, Rourkela

2. ●Project overview
●Existing system
●Proposed system
●Process model
●Feasibility study
●Hardware and
software requirements
TABLE OF CONTENTS
●Requirement
specifications
●System analysis
●Data flow diagram
●Design
●Development workflow
●Testing
●Further Advancements
●Summary

3. PROJECT
OVERVIEW
01
Few lines to capture the essence of overall project

4. Project Name: VisiLock: Smart Face Access System
Objective: Develop an advanced door locking system by integrating
face recognition technology and IoT capabilities.
Components:
●ESP32-CAM module
●Face recognition algorithm
●Door lock mechanism
●Web based application
Functionality:
●Captures images for face recognition.
●Processes images using the face recognition algorithm.
●Grants access upon successful recognition.
●Enables remote lock control via a web app connected through Wifi.
Benefits:
●Enhanced security through face recognition.
●Increased convenience by eliminating physical keys.
●Real-time remote access control via the web app.
●Potential for scalability and use in various access control scenarios.

5. EXISTING
SYSTEM
02
Taking a moment to analyze currently existing system.

6. Traditional key-based door access systems have served as the standard method for
controlling entry to spaces. However, they come with several significant drawbacks:

1.Security Vulnerabilities: Traditional keys can be easily lost, stolen, or duplicated,
compromising security. Unauthorized individuals can gain access if they possess a
copy of the key.
2.Inconvenience: Carrying physical keys is cumbersome, especially when multiple keys
are required for various entry points. Loss or misplacement of keys can result in
time-consuming and costly lock replacements.
3.Limited Access Control: Traditional keys offer limited control over who can access a
space. Once a key is distributed, it's challenging to track or revoke access rights.
4.Lack of Flexibility: Traditional systems lack the flexibility to grant temporary access
or adapt to changing access needs. This can be problematic in scenarios such as
short-term rentals or shared workspaces.
5.Risk of Lockouts: If a key is forgotten or misplaced, individuals can be locked out,
causing disruptions and inconveniences.
6.Difficulty in Management: Managing a large number of physical keys can be
challenging, requiring meticulous organization and oversight.

7. PROPOSED
SYSTEM
03
What do we bring out to replace the existing system…

8. The "VisiLock" project introduces a revolutionary door access solution
through the integration of cutting-edge face recognition technology. This
modern approach replaces traditional key-based entry systems with a
secure and user-friendly alternative.
The proposed system consists of several key components:
➔ESP32-CAM Module: Serving as the core processing unit, the ESP32-CAM combines
Wi-Fi capabilities and a camera module. It captures images of individuals in front of the door.
➔Face Recognition Algorithm: The heart of the system, the face recognition
algorithm, employs advanced computer vision techniques. It detects and matches faces in
captured images against an authorized database.
➔Door Lock Mechanism: Upon successful face recognition, the door lock mechanism
is activated. This mechanism ensures that only authorized individuals gain access, thereby
enhancing security.
➔Web App Interface: The system includes a web app interface that allows users to
remotely control the door lock. This app communicates with the ESP32-CAM module over
Wi-Fi, providing convenient access management within the range of wifi network.

9. Key Features:
●Secure Access: Face recognition ensures secure and
reliable entry.
●Convenience: Eliminate the need for physical keys or cards.
●Remote Control: web app allows users to control the door
lock remotely.
●Real-time Authentication: Captured images are instantly
processed for authentication.
●Real-time Monitoring: Monitor door access and manage
user permissions.
The "VisiLock" proposed system transforms the way we
approach door access, offering unparalleled security and
convenience.

10. PROCESS
MODEL
04
Why we chose waterfall model for our project…

11. Here's how the model's phases fit into the development of the "VisiLock"
system:
●Requirements Gathering: We thoroughly gather and document the functional and
non-functional requirements of the system. This includes capturing user needs,
features, and system interactions.
●System Design: Based on the requirements, we design the system's architecture,
components, and interfaces. This phase lays the foundation for the entire project.
●Implementation: With the design in place, we move to the implementation phase.
We code the ESP32-CAM module, integrate the face recognition algorithm, and
develop the web app.
●Testing: After implementation, rigorous testing is conducted. This includes unit
testing for individual components and integration testing to ensure smooth
interaction between modules.
●Deployment: Once testing is successful, the system is deployed for real-world
usage. This involves installing the ESP32-CAM module, connecting the door lock
mechanism, and making the web app available.
●Maintenance: Continuous monitoring and maintenance are crucial for system
stability and security. This phase involves addressing any issues that arise
post-deployment.

12. WATERFALL
PROCESS MODEL
For the "VisiLock" project, we've chosen the
Waterfall model as our process model due to
its suitability for well-defined and sequential
projects.

The Waterfall models structured approach
aligns with the project's clear objectives and
allows for a comprehensive development
process.

The Waterfall models linear and systematic
progression ensures that each phase is
completed before moving to the next.

13. FEASIBILITY
STUDY
05
Is it feasible ?

14. The feasibility study evaluates the practicality and viability of
implementing the "VisiLock" project. It assesses various aspects to ensure
the project's success:
●Technical Feasibility: The project utilizes proven technologies like ESP32-CAM,
face recognition algorithms, and web app development tools. These technologies are
well-documented and have successful implementations, indicating technical feasibility.
●Operational Feasibility: The project addresses the need for enhanced security
and convenience in door access. Its features align with user requirements, making it
operationally feasible.
●Economic Feasibility: While the costs associated with hardware components are
as minimal as 2200 rupees, software development only requires a working pc, and for
testing we kept additional 2000 rupees just in case something blows up. Hence, seeing
the basic cost we say it is feasible.
●Legal and Ethical Feasibility: The project respects privacy and ethical
considerations by utilizing face recognition data responsibly and ensuring user consent
for data usage.
●Schedule Feasibility: The project timeline accounts for each phase, from design to
testing and deployment. Realistic timeframes are set to ensure the project is completed
efficiently.
The feasibility study confirms that the "VisiLock" project is both
technically achievable and economically justifiable, positioning it for
successful implementation .

15. HARDWARE &
SOFTWARE
REQUIREMENTS
06
What do we need ?

16. ESP32 CAM
MODULE with
OVA2640
FTDI Programmer Solenoid lock 12v 3.7v Li-Ion
Rechargeable
battery
Female to female
jumper wires
5V Single
Channel Relay
Module 10A
Hardware requirements

17. Software Requirements:
●Arduino IDE: Programming environment for coding the
ESP32-CAM module.
●Espressif Systems ESP32 Library (version 1.0.1): Library used
in the Arduino IDE to program the ESP32.
●OpenCV Library: Employed for implementing the face recognition
algorithm.
●Programming Languages: C++ for Arduino IDE, HTML, CSS, JS
and PHP for webpage.
The integration of these hardware components and software
tools forms the basis for the development and operation of the
"VisiLock" project, ensuring a secure and efficient face
recognition door access system.

18. REQUIREMENT
SPECIFICATIONS
07

19. Functional Requirements:
●Face Recognition: The system must accurately detect and
recognize authorized individuals' faces.
●Image Capture: The ESP32-CAM must capture high-quality images
for processing.
●Authentication: Only recognized faces should trigger the door lock
mechanism.
●Web App Interface: The web app should enable remote door lock
control.
●Real-time Updates: The app should provide real-time notifications
about access events.
●User Management: The system should allow adding, modifying, and
removing authorized users.
●Emergency Override: A manual override should be available in case
of system failure.

20. Non Functional Requirements:
●Security: The system should maintain the privacy and security of
user data and access.
●Reliability: The face recognition accuracy should be high to prevent
unauthorized access.
●Response Time: The door lock mechanism should activate within a
defined time after recognition.
●Scalability: The system should handle a growing number of
authorized users and access events.
●Usability: The web app interface should be user-friendly and intuitive.
●Compatibility: The system should be compatible with common web
devices.
●Maintenance: The system should require minimal maintenance and
updates.
These detailed requirements guide the development of the " VisiLock" project,
ensuring that it meets both functional and non-functional criteria for a successful
and reliable face recognition door access system .

21. SYSTEM
ANALYSIS
08

22. The "VisiLock" system comprehensively addresses the identified requirements
and offers numerous advantages over traditional access methods:

Fulfilling Requirements:
●The face recognition algorithm
ensures accurate and reliable user
authentication.
●The ESP32 CAM Module captures
high quality images, essential for
effective face recognition.
●The web app interface facilitates
remote door lock control and user
management .
●Real-time notifications and updates
provide enhanced access monitoring.
●An emergency override mechanism
guarantees access in unforeseen
situations.


Advantages over Traditional Methods:
●Enhanced Security: Face recognition
provides a higher level of security compared to
traditional keys.
●Convenience: Users can access without
physical keys, reducing the risk of loss or
duplication.
●Remote Control: The web app enables
convenient and secure remote door access.
●Scalability: The system easily adapts to
accommodate new users and access
requirements.
●Reduced Maintenance: Mechanical wear
and tear associated with keys are eliminated.
●User Management: Administrators can
efficiently manage user access permissions.


The "VisiLock" system not only meets the established requirements but also
introduces a modern and effective approach to access control, significantly
improving security and user convenience.

23. CIRCUITRY AND
CONNECTIONS
09

24. Programming connections
Connections made while
uploading code to ESP - 32 Cam
IO0 removed from GND after
uploading code to ESP - 32 Cam

25. Final model circuit diagram

26. Design and
Circuit overlook
10

27. The design of the "VisiLock" system has several key elements that ensure its
functionality and security:
●Hardware Setup: The hardware components, including the ESP32-CAM, relay module,
solenoid lock, and power supply, are strategically integrated to facilitate accurate face
recognition and seamless door lock control.
●Software Architecture: The software architecture consists of two main parts: the face
recognition algorithm and the web app. The algorithm processes captured images for
authentication, while the app provides a user-friendly interface for remote control and access
management.
●Face Recognition Implementation: The face recognition algorithm, powered by the OpenCV
library, detects and matches faces. It uses pre-trained models and a database of authorized
faces for accurate recognition.
●Web App Interface: The web app made for real-time updates, offers intuitive navigation and
functionality for users to control the door lock remotely and manage access.
●Integration: The ESP32-CAM, face recognition algorithm, relay module, and web app are
integrated to create a cohesive system. The ESP32-CAM captures images, the algorithm
processes them, and the relay module controls the lock, all accessible via the web app
interface.
The design of the "VisiLock" system ensures its efficiency, accuracy, and user-friendly
experience, making it a robust and modern solution for secure door access.

28. VisiLink
Smart Face Access System
Lock
Enroll User
Stream Lv
Access Ctrl
Unlock door
Instructions for
failsafe
ESP32 CAM
MODULE with
OVA2640
Solenoid lock 12v
Female to female
jumper wires
5V Single
Channel Relay
Module 10A
Circuit Overlook
3.7v Li-Ion
Rechargeable
battery

29. Development
Workflow
11

30. DEVELOPMENT WORKFLOW
Design Integration
Requirement
analysis
Implementation
Phase 1
Phase 2
Phase 3
Phase 4

31. DEVELOPMENT WORKFLOW
Deployment
Testing
Maintenance
Phase 5
Phase 6
Phase 8

32. The development of the "VisiLock" system follows a systematic workflow that
encompasses key stages:
●Requirements Analysis: Gather and analyze functional and non-functional requirements to
define the scope and goals of the project.
●Design Phase: Create system architecture, hardware layout, and software structure to guide the
development process.
●Implementation: Code the ESP32-CAM module using Arduino IDE. Develop face recognition
using OpenCV. Design and develop the web app using relevant programming languages.
●Integration: Integrate hardware components and software modules, ensuring seamless
communication and functionality.
●Testing: Conduct thorough testing, including unit testing for individual components, integration
testing to validate system interactions, and user acceptance testing to ensure usability.
●Deployment: Install the system, connect the ESP32-CAM module, relay module, and solenoid lock.
Make the web app accessible to users.
●Maintenance: Continuously monitor the system's performance, address issues promptly, and
provide updates to enhance functionality.
This development workflow ensures a structured and efficient process, resulting in the
successful implementation of the "VisiLock" face recognition door access system.

33. TESTING
12

34. Thorough testing is an essential aspect of the "VisiLock" project, ensuring its reliability
and effectiveness:
●Unit Testing: Each hardware component and software module is tested individually
to verify its functionality and identify any bugs.
●Integration Testing: The integrated system is tested to ensure proper
communication and seamless interaction between hardware and software
components.
●Face Recognition Accuracy Testing: The face recognition algorithm is rigorously
tested with a variety of faces and conditions to validate its accuracy and
reliability.
●web App Testing: The web app's usability and functionality are tested, including
remote door lock control and user management features.
●Real-world Simulation: The system is tested in real-world scenarios to simulate
different access situations and identify potential issues.
●User Acceptance Testing: End-users participate in testing to ensure the system
meets their expectations and operates as intended.
Testing plays a crucial role in identifying and rectifying any inconsistencies, ensuring
that the "VisiLock" system functions accurately, securely, and seamlessly in various
situations.

35. Unit Testing:
Test Facial Recognition Algorithm:
Description: Verify that the facial recognition algorithm correctly identifies
enrolled faces.
Steps:
• Enroll a known face.
• Capture an image of the enrolled face.
• Confirm that the algorithm correctly matches the captured face.
Test Relay Control Function:
Description: Ensure that the relay control functions work as expected.
Steps:
• Activate the relay control function.
• Confirm that the relay switches to the open position.
• Deactivate the relay control function.
• Confirm that the relay switches back to the closed position.

36. Integration Testing:
Test ESP32 and Camera Module Interaction:
Description: Verify the interaction between ESP32 and the camera module.
Steps:
• Power on the system.
• Confirm that the ESP32 establishes a connection with the camera
module.
Test Facial Recognition and Relay Control Integration:
Description: Confirm that facial recognition triggers the relay control.
Steps:
• Enroll a known face.
• Present the enrolled face to the camera.
• Confirm that the relay switches to the open position.

37. Functional Testing:
Test Door Unlocking:
Description: Validate that the door unlocks upon successful facial recognition.
Steps:
• Enroll a known face.
• Present the enrolled face to the camera.
• Confirm that the door unlocks.
Test Incorrect Facial Recognition:
Description: Ensure that the door remains locked for unrecognized faces.
Steps:
• Present an unrecognized face to the camera.
• Confirm that the door remains locked.

38. Performance Testing:
Test Response Time:
Description: Evaluate the system's response time during face recognition.
Steps:
• Enroll a known face.
• Measure the time taken for the system to unlock the door upon
presenting
the enrolled face.
Test Unauthorized Access:
Description: Ensure that the system resists unauthorized access attempts.
Steps:
• Present an unrecognized face to the camera.
• Confirm that the door remains locked.

39. Alpha Testing:
Alpha testing involves controlled evaluation by developers or internal users.
Test scenarios include:
●Facial recognition algorithm
●Relay control function
●ESP32 & camera module interaction
●Integration of facial recognition &
relay control
●Door unlocking
●Incorrect facial recognition
●Response time
●Unauthorized access
●Data protection
Approach:
●Conduct tests in controlled
environment
●Developers & internal users perform
tests
●Identify & report bugs/issues
●Iterate on fixes based on feedback

40. Beta Testing:
Beta testing involves releasing the software to a limited number of external
users to gather feedback and identify any issues before the full release.
Test Scenarios for Beta Testing:
●Test Facial Recognition Algorithm
●Test Relay Control Function
●Test ESP32 and Camera Module
Interaction
●Test Facial Recognition and Relay
Control Integration
●Test Door Unlocking
●Test Incorrect Facial Recognition
●Test Response Time
●Test Unauthorized Access
●Test Data Protection

Beta Testing Approach:
●Recruit a group of external users.
●Provide them with access to the
system.
●Gather feedback on usability,
performance, and functionality.
●Monitor for any issues reported by
beta testers.
●Address reported issues and iterate
on improvements.

41. Acceptance Testing:
Acceptance testing involves validating that the software meets the
requirements and is ready for deployment.
Test Scenarios for Acceptance Testing:
●Test Facial Recognition Algorithm
●Test Relay Control Function
●Test ESP32 and Camera Module
Interaction
●Test Facial Recognition and Relay
Control Integration
●Test Door Unlocking
●Test Incorrect Facial Recognition
●Test Response Time
●Test Unauthorized Access
●Test Data Protection

Acceptance Testing Approach:
●Users or stakeholders perform the
tests.
●Ensure that the system meets all
specified requirements.
●Verify that all identified issues from
alpha and beta testing have been
resolved.
●Sign off on the system for
deployment if it meets the
acceptance criteria.

42. FURTHER
ENHANCEMENTS
13

43. In addition to the existing functionality, integrating a web app for access to the door lock
system can offer several enhancements:

●Remote Access: Users can remotely control the door lock from anywhere using their smartphones,
providing convenience and flexibility.
●User Management: The web app can allow administrators to manage user access rights, enroll new
users, and revoke access as needed, enhancing security and control.
●Real-time Notifications: Users can receive real-time notifications on their web devices for door
activities, such as successful unlocks or failed attempts, improving monitoring and security
awareness.
●Integration with Other Systems: The web app can be integrated with other systems, such as
attendance or visitor management systems, for seamless data exchange and enhanced functionality.
●Enhanced User Experience: With a web app interface, users can enjoy a more intuitive and
user-friendly experience, making it easier to interact with the door lock system.
●Biometric Authentication: Leveraging web device biometric features like fingerprint or face
recognition for authentication can further enhance security and user convenience.
●Audit Trail: The web app can provide access to an audit trail of door activities, allowing users to
review access logs and monitor usage history.
By implementing a web app for access to the door lock system, we can extend its functionality, improve user
experience, and provide additional features for enhanced security and convenience.

44. SUMMARY
13

45. The "VisiLock" project combines advanced technology and innovative
design to create a secure and convenient face recognition door access
system. Key highlights of the project include:
●Enhanced Security: Face recognition technology provides robust security by
accurately identifying authorized users.
●User Convenience: The web app offers remote door control, eliminating the
need for physical keys.
●Modern Approach: The system replaces traditional access methods with a
cutting-edge solution.
●Scalability: The system can adapt to accommodate a growing number of users
and access scenarios.
●Efficient Development: A structured workflow ensures a smooth development
process.
Reliable Testing: Rigorous testing guarantees the system's accuracy and effectiveness.
The "VisiLock" project revolutionizes door access control, setting a new
standard for security and convenience in modern environments.

46. ABOUT US
14

47. OUR TEAM
Shubham
Group Coordinator

48. OUR TEAM
Ankita
Valuable Group Member
Reetika
Valuable Group Member

49. OUR TEAM
Smrutik
Valuable Group Member
Sushil
Valuable Group Member