Beyond the usual suspects, emerging Cognitive Services

Henk Boelman, NDC 2018

Cognitive services makes it easier for me to make smart apps without writing a bunch of code and understanding machine learning.

It's a great way to kickstart and prototype your projects, since a lot of stuff is done for you. If it pays off, you can invest time and money into training your own model.

In the Cognitive Services Labs web site, there are up and coming services. Check 'em out!

There's a content moderator service - image, text and video. This spits out recommendations - "you might want to review this", provides you with auto-corrected text and languge information.

It can extract texts from images, classify the adult content and point out where faces are.

You can hook up the computer vision api to this api to get more intelligent information. Can also detect celebrities (and you can block them), landmark detection. The extended face apis can detect moods in pictures, allowing you to moderate your content further.

Computer Vision API is "better" and more expensive.

With the custom vision service, you can select objects for it to identify in images, which helps you when you want to allow some content and not others (allowing Homer Simpson, but not Bart Simpsons). You can export the trained models to TensorFlow, CoreML and a Docker Image. Further, it provides samples on how to use this model on the various platforms (Xamarin, Swift ... )

It's import that you upload your pictures with lots of different backgrounds and angles!

The speech to text API supports web socket communication, so that you can stream data from your web.

The speaker recognition API can be used to authenticate users per voice.Anomaly finder - finds abnormal events in data! It's quite slow at the moment though (preview), so don't do it realtime.

Event tracking - what happened on this day? 

Answer search - ask a question (when is mother's day, what is microsoft) and get facts, entity information back

Project gestures - use hand gestures in your applications; requires special cameras (such as the xbox camera).

tendocare.ai - AI for good
github.com/hnky


Comments

Post a Comment

Popular posts from this blog

Auto Mapper and Record Types - will they blend?

Image
TL;DR: Yes, they will. Thank you for your time. 😄 Background At Redgate, engineers enjoy a great benefit in that we get are expected to spend 10% of our time to improve on our craft.  Having suffered this week with manually having to copy a bunch of properties from a domain object to its HTTP representation, I decided to spend this week's 10% time to see if I could answer the following questions: Can use AutoMapper to simplify mapping between two types?  Does it also allow me to map between a regular type and a record type? What about the other way around? Can I use this to reduce the maintenance burden in my product? Mapping between two types [automapper fundamentals] To started and get a basic mapping done, created a .NET 5 ASP.NET Web API project, added the below package references and configured automapper : < PackageReference Include ="AutoMapper" Version ="10.1.1" /> < PackageReference Include ="AutoMapper.Extensions.Microsoft.DependencyInj
Read more

Unit testing your Azure functions - part 2: Queues and Blobs

In our last installment , we discovered how to start unit testing our Azure Functions, looking at the HTTP Trigger (and evaulating the function's HTTP response). This time, we'll take a look at using the QueueTrigger, getting supporting data from table storage and outputting Blobs. Yup, I'm tossing you into the deep end! What are we trying to accomplish? This time, we will test a function that performs some arbitrary business logic on bank accounts. The function responds to a storage queue request, logs each command and ensures that each received command is executed exactly once. Almost like a real-world function, huh? ;-) In the function above, we are introduced to three types that we need to deal with in our unit tests - the IQueryable interface, IAsyncCollector and the CloudBlockBlob concrete type. IQueryable is easy enough to work with: Introducing the Testable Async Collector When I first started exploring this topic, I figured I could just use my favourit
Read more

Testing WCF services with user credentials and binary endpoints

Image
This article discusses the following error messages that you might receive from a WCF service An error occurred when verifying security for the message HTTP/1.1 415 Cannot process the message because the content type 'application/soap+xml;charset=UTF-8;action="..."' was not the expected type 'application/soap+msbin1' When doing analysis work on existing services, invoking them in a safe test environment is a handy way of getting an understanding of their operations, especially if the documentation has gone missing (or was never written). SoapUI is a tool that can be used to test WCF Services, but did you know that Visual Studio also comes with its own set of tools? Let's start with SoapUI, which is available from  http://www.soapui.org/ . Its operations are quite straight-forward; however, you might run into issues when trying to access services that are protected by user credentials, or when accessing services with binary endpoints. I
Read more