3

On-Device Machine Learning  |  Google Developers

 2 years ago
source link: https://developers.google.com/learn/topics/on-device-ml
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
neoserver,ios ssh client
On-Device Machine Learning  |  Google Developers

Google is committed to advancing racial equity for Black communities. See how.

Run machine learning models in your Android, iOS, and Web apps

Google offers a range of solutions to use on-device ML to unlock new experiences in your apps. To tackle common challenges, we provide easy-to-use turn-key APIs. For more custom use-cases, we help you train your model, integrate it in your app and deploy it in production.

This site helps guide you to the right Google solutions and tools that meet your needs.

The benefits of On-Device Machine Learning

odml_access_time_24.png

Low Latency

Unlock new user experiences by processing text, audio and video in real-time

odml_system_update_24.png

Keep data on-device

Perform inference locally without sending user data to the cloud

odml_wifi_off_24.png

Works offline

No need for a network connection or running a service in the cloud

Turn-key solutions

To tackle common tasks with ML, we offer easy-to-use, production-ready APIs through the ML Kit SDK. These are built on high quality pre-trained models and are easy to integrate in Android and iOS apps.

Custom solutions and tools

We offer off-the-shelf pre-trained models that can be deployed on mobile and web apps. For more specific use cases, we offer tools for retraining existing models or train them from scratch.

Pick or train a model

Integrate in your app

Productionize and Deploy

Build your first on-device ML app

The learning pathways below provide a step-by-step guide to help you write your first on-device machine learning app.

Audio Classification

Write an app that can classify sounds in the environment around you. In this example, identify birds based on their song.

Image Classification

Build an app that takes a picture and gives you a list of labels that describe the image. Train a model to recognize newer labels and integrate it in your app.

Object Detection

Detect specific objects within an image and draw bounding boxes around them. Train a model to identify new objects and integrate the model in your app.

Text Classification for Mobile

Create an app that determines if your users are spamming your chatroom.

Text Classification for Web

Use Machine Learning in your web site to help filter comment spam.

Visual Product Search

Take a picture with your camera and search for matching products.

On-device ML in the real world

Here are some examples of how on-device machine learning is used by developers to tackle real world challenges.

odml-lookout.png

Making the world more accessible for people with vision impairments

Lookout by Google helps make the physical world more accessible, for users who are blind or low-vision. From helping users to quickly skim text, to capturing full documents, to identifying objects and packaged food, Lookout takes advantage of on-device ML models powered by TensorFlow Lite.

odml-adidas.png

MLKIT

adidas uses on-device ML for augmented in-store shopping experience

Learn how adidas is using ML Kit’s Object Detection & Tracking API in their Android and iOS app to create an intuitive in-store visual search experience and make it easier for their customers to find and try-on their next set of adidas shoes. On-device ML makes it possible to seamlessly detect shoes in real-time and within seconds returns an image recognition match against hundreds of products.

odml-modiface.png

TensorFlow.js

Modiface uses TensorFlow.js for AR makeup try on in the browser

Modiface uses the TensorFlow.js face detection model to identify key facial features and combine them with WebGL shaders, allowing users to digitally try on makeup for L'Oreal brand products entirely in the browser, preserving user privacy.

odml-vsco.png

TENSORFLOW LITE

VSCO uses on-device ML to recommend image presets

With hundreds of VSCO photo presets to choose from, helping users find and try new presets was a challenge. But with on device ML, the VSCO app now understands uploaded images and suggests presets that best complement them via the "For this photo" feature.


About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK