Detect Hand & Body Poses with Vision in iOS
source link: https://www.raywenderlich.com/21129427-detect-hand-body-poses-with-vision-in-ios
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
SwiftUI Apprentice, First Edition — Now Available!
Learn to build beautiful, fully functional apps using
Apple’s hottest user interface technology: SwiftUI.
Start reading for free — today!
This course is available as part of the raywenderlich.com Professional subscription. To learn more click here
Detect Hand & Body Poses with Vision in iOS
Jun 1 2021 · Video Course (37 mins) · Intermediate
Learn how to detect hand and body landmarks in live video with help from the Vision framework. Explore the kind of data Vision can provide, and use it to evaluate hand and body poses for simple gestures.
Version
- Swift 5.3, iOS 14, Xcode 12.4
Detect Hand & Body Poses with Vision in iOS
Learn About Vision in iOS
1:19 FreeLearn a bit about what the Vision framework is, how it relates to other Apple frameworks, and how we’ll use it in this course.
Get a short tour of the sample app, and prepare a live camera feed with AVFoundation.
Start detecting hands from live video with a VNDetectHumanHandPoseRequest, and get back data about all of the visible joints in your hands with VNHumanHandPoseObservation.
Learn Hand Anatomy
1:37Learn about how all your hand bones are connected together in this quick anatomy lesson!
Explore and organize the hand landmark data received from Vision’s VNHumanHandPoseObservations.
Display Fingertips
3:21Convert Vision’s landmarks for use in a SwiftUI view to display fingertip locations.
Evaluate Hand Poses
6:40Collect specific hand landmarks and evaluate their positions for potential hand gesture matches.
Handle Thumbs
3:44The thumbs are a bit different than the rest of the phalanges! Learn how to handle thumb data.
Detecting whole bodies with Vision is quite similar to the hand detection you’ve already done. Try it out!
Evaluate Body Poses
3:23Collect specific body landmarks and evaluate their positions for potential body pose matches.
Who is this for?
This course will be best for experienced iOS developers who are comfortable with Swift. It focuses exclusively on using the Vision framework to detect and evaluate hand and body poses via live video capture. The UI is not a focus of this course, but the project does use SwiftUI and UIKit.
Covered concepts
- Vision
- AVFoundation
- Hand Pose Request & Observation
- Hand Anatomy
- VNRecognizedPoint
Contributors
Catie makes things for, with, and about Apple tech in collaboration with her husband, Jessy! She is inspired by everyone at...
InstructorGraphic designer and illustrator based in Ukraine
IllustratorComments
Add a rating for this content
Sign in to add a ratingAll videos. All books.
One low price.
A raywenderlich.com subscription is the best way to learn and master mobile development — plans start at just $19.99/month!
Learn iOS, Swift, Android, Kotlin, Flutter and Dart development and unlock our massive catalog of 50+ books and 4,000+ videos.
The largest and most up-to-date collection of courses and books on iOS, Swift, Android, Kotlin, Flutter, Dart, Server-Side Swift, Unity and more!
All videos. All books. One low price.
A raywenderlich.com subscription is the best way to learn and master mobile development — plans start at just $19.99/month!
Learn iOS, Swift, Android, Kotlin, Flutter and Dart development and unlock our massive catalogue of 50+ books and 4,000+ videos.
- © 2021 Razeware LLC
- Made with ♥ from around the world
- 6000+ Tutorials and counting
raywenderlich.com and our partners use cookies to understand how you use our site and to serve you personalized content and ads. By continuing to use this site, you accept these cookies, our privacy policy and terms of service .
Recommend
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK