VSiD: Very Small Image Detection

The VSID system will be implemented in various locations on a Grand Canyon University's campus. Consisting of a camera connected to a microcontroller with onboard wifi, a TinyML model will detect thumbs up or thumbs down gestures from a video stream indicating a satisfaction rate from students and faculty.

Project Updates

November 10, 2024 - November 17, 2024

  • Delegated sections of research (Hardware/Embedded Systems & Machine Learning)
  • Began research in respective sections
  • Completed VSID website structure

November 17, 2024 - November 23, 2024

  • Documented TensorFlow LIte (LiteRT)
  • Purchased ESP32 w/Modular Camera
  • Documented Realtek AMB82 Mini

November 24, 2024 - November 30, 2024

  • Obtained ESP32 microcontroller
  • Tested ESP32 Board and WifiManager in Arduino IDE

December 1, 2024 - December 7, 2024

  • Began testing ESP32 Microcontroller with Arduino IDE

December 8, 2024 - December 14, 2024

  • Obtained additional ESP32 microcontroller to continue research
  • Added LinkedIn and Email links to VSiD website
  • Assigned research sections for Tiny ML research (Hand Gestures, Person Position, ML Research)

December 15, 2024 - December 21, 2024

  • Began research for assigned Tiny ML research sections

December 22, 2024 - December 28, 2024

  • Researched possible alternatives for camera module
  • Continued research on Tiny ML research sections

January 5, 2025 - January 11, 2025

  • Re-evaluated Model Choices
  • Club Meeting and Presentation

January 12, 2025 - January 18, 2025

  • Team Meeting to Re-Align Ideas and Motives
  • Started Looking at RoboFlow

January 19, 2025 - February 15, 2025

  • Started developing hand gesture object detection model in RoboFlow

February 16, 2025 - February 23, 2025

  • Roboflow used to train YOLO model with thumbs up/down image datasets
  • The model accurately detects thumb direction
  • Working to put model on ESP32

February 24, 2025 - March 2, 2025

  • Refined RoboFlow Model dataset to more accurately detect thumbs up and thumbs down
  • Created proof of concept demo using the Roboflow model

March 3, 2025 - March 9, 2025

  • Research into using Yolov4 Object Detection model
  • Working on getting a Tensorflow Yolov4 object detection framework using a general weights file

March 10, 2025 - March 16, 2025

  • Gathered/annotated a variety of thumbs up and thumbs down images and combined them with Roboflow dataset
  • Generated a custom weights file using the thumbs up and thumbs down dataset using a Google Collab Notebook

March 17, 2025 - March 23, 2025

  • Working on getting the custom weights file to work with the Tensorflow Yolov4 object detection framework
  • Prepared a presentation with the Roboflow demo to present at GCU's Canyon Undergraduate Research Symposium

March 24, 2025 - April 6, 2025

  • Presented the VSiD demo at GCU's Canyon Undergraduate Research Symposium
  • Gained feedback and support from GCU President Brian Muller

April 7, 2025 - April 13, 2025

  • Successfully got the Tensorflow Yolov4 Object Detection framework to work with the thumbs weights file
  • Prepared the presentation for the CAIR final showcase (used the Roboflow Demo)

April 20, 2025 - September 15, 2025

  • Currently working on getting the Tensorflow Yolov4 Thumbs Object Detection to work on the ESP32

September 15, 2025 - October 20, 2025

  • Quantizing Yolov4 Thumbs Object Detection model in order to fit the compatibility requirements of the ESP32
  • Developing Yolov4 Person Object Detection model to detect a person for the Thumbs model
  • Continuing to research alternative options for model implementations

October 21, 2025 - October 27, 2025

  • Continuing quatization of Yolov4 Thumbs Object Detection model
  • Continuing development of Yolov4 Person Object Detection model
  • Updated to new CAIR website format

October 29, 2025 - November 11, 2025

  • Working on getting quantized object detection model running on micro controller
  • Still progressing on development of Yolov4 person Object Detection model
  • Working on communication between two micro controllers

November 12, 2025 - November 20, 2025

  • Continuing progress on quantization, person object detection model, and microcontroller communication
  • Onboarding new member to VSiD team

October 29, 2025 - November 11, 2025

  • Working to get the communication between the micro controllers using the object detection code
  • Working to create a case for the physical ESP32 microcontroller

Meet the Team

Noah Calderon

Computer Science

Derick Ruiz

Computer Engineering

Noah Robbins

Computer Science

Hugo Nkusi Singiza

Software Development