Skip to content

Update 00. 과제 기획서.md #12

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
whydizzy27 wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Update 00. 과제 기획서.md #12

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
51 changes: 51 additions & 0 deletions 2020/team3/hand_gesture_app_hoit/Tutorial/00. 과제 기획서.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -67,3 +67,54 @@ NNStreamer | nntstreamer와 nntrainer는 Convention부터 모듈 구조, 각종
프로젝트 구현 확인 | 프로젝트 내에서 핵심 기능이 제대로 구현되는지 확인한다.
제스처 인식 확인 | 제스처 인식 라이브러리를 사용해 손을 인식하고 분석한다.
* * *

# 4. 개발 결과
## 4-0 Application Icon
<img src="https://user-images.githubusercontent.com/67194249/94986964-ec749600-059d-11eb-8fb1-840872422c92.png" width="220" height="400">

## 4-1 Model Download
Install Models if you don't have models that App requires.<br><br>
<img src="https://user-images.githubusercontent.com/67194249/94987055-791f5400-059e-11eb-8480-5fbc97ea00fa.gif" width="220" height="400">

## 4-2 Detect Hand
Label : Up, Down, Left, Right (based on x & y location)<br>
we can see x y location's changes. <br><br>
<img src="https://user-images.githubusercontent.com/67194249/94987512-dec10f80-05a1-11eb-8bf9-624a104d4900.gif" width="220" height="400">

## 4-3 Mapping Android App actions with hand gestures
ex) Up - Camera App execute / Down - Play Store App execute <br><br>
<img src="https://user-images.githubusercontent.com/67194249/94987556-2182e780-05a2-11eb-8625-7a8befd97ce5.gif" width="220" height="400">

## 4-4 Mapping actions
Execute mapping App. <br><br>
<img src="https://user-images.githubusercontent.com/67194249/94987572-38293e80-05a2-11eb-99d6-1aa8e603a06c.gif" width="220" height="400">

## 4-5 Mapping Reset
Reset mapping App's actions by click reset button.<br><br>
<img src="https://user-images.githubusercontent.com/67194249/94987585-4ecf9580-05a2-11eb-8f4b-f16c72e8c972.gif" width="220" height="400">

## * Maintain Mapping Actions
Maintain mapping actions if you exit App.<br><br>
<img src="https://user-images.githubusercontent.com/67194249/94987651-dd441700-05a2-11eb-989c-567a4070eed6.gif" width="220" height="400">

## 4-6 Hand Detection ON/OFF Toggle
Toggle by toggle button. ( ON : detect hand / OFF : do not detect hand ) <br><br>
<div style="display:flex;">
<img src="https://user-images.githubusercontent.com/67194249/94987612-7fafca80-05a2-11eb-9726-7a4ae1b92da9.gif" width="220" height="400">
<img src="https://user-images.githubusercontent.com/67194249/94987613-83435180-05a2-11eb-94cf-2672623a2a0a.gif" width="220" height="400"></div>

## 4-7 Go to Google PlayStore's NNStreamer-multi page
we add a link button that is connected with reference App Play Store page. ( nnstreamer-multi ) <br><br>
<img src="https://user-images.githubusercontent.com/67194249/94987682-0e244c00-05a3-11eb-8749-a066637455f9.gif" width="220" height="400">


* * *

# 5. Installation
#### Setup NNStreamer example
First, setup nnstreamer example. Please see details [here](https://github.com/davichiar/nnstreamer-example/tree/master/android/example_app). ( some setup course have to be changed. see [here](https://github.com/davichiar/nnstreamer-example/blob/master/android/example_app/not-normal-streamer/02.%20NNStreamer%20%ED%8A%9C%ED%86%A0%EB%A6%AC%EC%96%BC.md))

#### Replace nnstreamer-multi
We only use nnstreamer-multi. Replace nnstreamer-multi file with this repository's one.