https://github.com/everythingishacked/Semaphore

Skip to content Toggle navigation
 
Sign up

  * Product
      +  
        Actions
        Automate any workflow
      +  
        Packages
        Host and manage packages
      +  
        Security
        Find and fix vulnerabilities
      +  
        Codespaces
        Instant dev environments
      +  
        Copilot
        Write better code with AI
      +  
        Code review
        Manage code changes
      +  
        Issues
        Plan and track work
      +  
        Discussions
        Collaborate outside of code
      + Explore
      + All features
      + Documentation
      + GitHub Skills
      + Blog
  * Solutions
      + For
      + Enterprise
      + Teams
      + Startups
      + Education
      + By Solution
      + CI/CD & Automation
      + DevOps
      + DevSecOps
      + Case Studies
      + Customer Stories
      + Resources
  * Open Source
      +  
        GitHub Sponsors
        Fund open source developers
      +  
        The ReadME Project
        GitHub community articles
      + Repositories
      + Topics
      + Trending
      + Collections
  * Pricing

[                    ] 

  *  
    #
    In this repository All GitHub |
    Jump to |

  * No suggested jump to results

  *  
    #
    In this repository All GitHub |
    Jump to |
  *  
    #
    In this user All GitHub |
    Jump to |
  *  
    #
    In this repository All GitHub |
    Jump to |

Sign in
Sign up
{{ message }}
everythingishacked / Semaphore Public

  * Notifications
  * Fork 9
  * Star 1.3k

A full-body keyboard using gestures to type through computer vision

1.3k stars 9 forks
Star
Notifications

  * Code
  * Issues 5
  * Pull requests 0
  * Actions
  * Projects 0
  * Security
  * Insights

More

  * Code
  * Issues
  * Pull requests
  * Actions
  * Projects
  * Security
  * Insights

everythingishacked/Semaphore

This commit does not belong to any branch on this repository, and may
belong to a fork outside of the repository.
main
Switch branches/tags
[                    ]
Branches Tags
Could not load branches
Nothing to show
{{ refName }} default View all branches
Could not load tags
Nothing to show
{{ refName }} default
View all tags

Name already in use

A tag already exists with the provided branch name. Many Git commands
accept both tag and branch names, so creating this branch may cause
unexpected behavior. Are you sure you want to create this branch?
Cancel Create
1 branch 0 tags
Code

  * Local
  * Codespaces

  *  
    Clone
    HTTPS GitHub CLI
    [https://github.com/e]

    Use Git or checkout with SVN using the web URL.

    [gh repo clone everyt]

    Work fast with our official CLI. Learn more.

  * Open with GitHub Desktop
  * Download ZIP

Sign In Required

Please sign in to use Codespaces.

Launching GitHub Desktop

If nothing happens, download GitHub Desktop and try again.

Launching GitHub Desktop

If nothing happens, download GitHub Desktop and try again.

Launching Xcode

If nothing happens, download Xcode and try again.

Launching Visual Studio Code

Your codespace will open once ready.

There was a problem preparing your codespace, please try again.

Latest commit

@everythingishacked
everythingishacked Merge pull request #1 from mthvrs/patch-1
...
0913ba0 Apr 12, 2023
Merge pull request #1 from mthvrs/patch-1

Updated readme for pedantry

0913ba0

Git stats

  * 3 commits

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
README.md
Updated readme for pedantry
April 12, 2023 12:55
body_landmarks.png
first
March 26, 2023 22:34
demo.gif
first
March 26, 2023 22:34
hand_landmarks.png
first
March 26, 2023 22:34
semaphore.py
first
March 26, 2023 22:34
View code
Semaphore A full-body keyboard

README.md

 Semaphore

 A full-body keyboard

demo

View a fuller demo and more background on the project at https://
youtu.be/h376W93gQq4

Semaphore uses OpenCV and MediaPipe's Pose detection to perform
real-time detection of body landmarks from video input. From there,
relative differences are calculated to determine specific positions
and translate those into keys and commands sent via keyboard.

The primary input is to "type" letters, digits, and symbols via flag
semaphore by extending both arms at various angles. Rather than
waiting a set time after every signal, you can jump to repeat the
last sent symbol.

See the SEMAPHORES dictionary in the code for a full set of angles,
which mostly conform to standard US semaphore with some custom
additions. Most of the rest of the keyboard is included as other
modifier gestures, such as:

  * shift: open both hands, instead of fists
  * backspace: both hands over mouth
  * digits and other extra symbols: squat while signaling
  * command: lift left leg to ~horizontal thigh
  * control: lift right leg to ~horizontal thigh
  * arrow left/right/up/down: cross arms and raise each straight leg
    LEG_ARROW_ANGLE degrees
  * repeat previous letter/command: jump

Running on latest MacOS from Terminal, toggle the following for
keyboard access: System Settings -> Privacy & Security ->
Accessibility -> Terminal -> slide to allow

For Mac, this uses a custom keyboard library. This is built for a Mac
keyboard, but you can also swap e.g. Windows key for Command simply
enough.

About

A full-body keyboard using gestures to type through computer vision

Resources

Readme

Stars

1.3k stars

Watchers

7 watching

Forks

9 forks
Report repository

Releases

No releases published

Packages 0

No packages published

Contributors 2

  * @everythingishacked everythingishacked
  * @mthvrs mthvrs

Languages

  * Python 100.0%

Footer

 (c) 2023 GitHub, Inc.

Footer navigation

  * Terms
  * Privacy
  * Security
  * Status
  * Docs
  * Contact GitHub
  * Pricing
  * API
  * Training
  * Blog
  * About

You can't perform that action at this time.
You signed in with another tab or window. Reload to refresh your
session. You signed out in another tab or window. Reload to refresh
your session.