HP Interactive Wall

Home Management Automation is huge in today’s busy world. Concepts like One Touch, Checking-In On Your Home, and Virtual Home Management have become staples for our fast-paced world. So naturally, technology that can manage communication to and from devices and services seems a perfect fit for maintaining safety and smooth running of the place you go to relax and refresh! How did we develop our unique take on this exciting tech notion? Glad you asked…

At Akvelon, we are constantly working on a variety of Internet of Things (or simply IoT) projects! Recently, we demonstrated how easily you can create an app to control AllJoyn powered devices. Now, we will take our ingenuity a step further by enabling more natural interaction with AllJoyn powered devices – via the power of machine-based AI and intelligent services provided by Microsoft Cognitive Services and Cortana Intelligence Suite.

Prerequisites

Raspberry PI 2 or 3 with Windows 10 IoT Core
AllJoyn-enabled lightbulb or Luminaire – the Android app from Qualcomm acting as a virtual lamp.
Windows 10 and Visual Studio 2015 (Community, Professional or Enterprise) installed on Development machine.

Managing your Smart Home using Bots

Microsoft introduced the Bot Framework (part of the Cortana Intelligence Suite) a few months ago, so that everyone can easily build and connect intelligent bots to interact with your users naturally. This means the user could be anywhere, using any popular service – from text/SMS to Skype, Slack, Office 365 mail or virtually, anywhere. We believe this same approach is applicable to home automation scenarios as well. Just as you connect services and interact with other users, you can now interact and manage your Smart Home via intelligent bots.

Check out demo below:

The scenario above demonstrates a very simple case (treat it as proof-of-concept). You can also target complex and intelligent scenarios using another Cortana Intelligence Suite component called, Language Understanding Intelligent Service (LUIS). LUIS offers a fast and effective way of adding language understanding to applications by using pre-existing, world-class, already-built models from Bing and Cortana. (try examples). And when you need specialized models, LUIS guides you through the build process, in a fast and easy way!

LUIS is well integrated and fully supported by Microsoft Bot Framework. Watch Building a Conversational Bot: From 0 to 60 to learn more about Microsoft Bots and LUIS support.

Putting Everything Together

Below is proposed architecture to use intelligent bots to control your home.

Step 1 = Set up your Local/Home network

1. Use the following instructions to create Windows10 UWP app to control your home smart devices using AllJoyn: https://www.linkedin.com/pulse/windows-10-alljoyn-make-your-iot-devices-apps-speak-sergei-grebnov-1
2. Install created app on Windows 10 device (for example, Raspberry PI 2 or 3 with Windows 10 IoT Core)

Step 2 = Create the Bot

1. Use Bot Framework Getting Started to learn how to create new bot.
2. Learn how to integrate LUIS to your bot: http://docs.botframework.com/sdkreference/csharp/dialogs.html
3. Register the bot and add communication channels: https://dev.botframework.com/bots/new

Step 3 = Connect the Bot (cloud) and Windows 10 App (home)

Taking into account that the Bot is ASP.Net web application with REST API, we can use SignalR as communication channel between the Bot and home Windows 10 app.

1. Bot (SingalR Hub): add hub functionality to push content to the client (tutorial, sample code).
2. Windows10 UWP app (SignalR Client): add logic to connect to the hub and process incoming commands (tutorial, sample code).

That’s it!!! You are all set! Now, you can use your preferred client app…like Skype, Slack, etc. … on your favorite mobile or desktop platform to interact with Smart Technology in your home. Whether you are in a local network or outside and remote, you stay connected and keep your Home running the way you want.

Call to Actions

1. Visit AllSeen Alliance to learn more about AllJoyn or meet local community (AllJoyn Ambassadors).
2. Learn more about Windows 10 and AllJoyn and how to create your first AllJoyn application for Windows 10 device.
3. Visit Bot Framework Getting Started to create your first bot.
4. Reach us if you have any question.

Client

Amazon.com Inc. is the world’s largest ecommerce company covering the online sale of books, DVDs, consumer goods, etc., as well as various Cloud Computing services to a large number of enterprises world-wide.

Business need

With the release of a new version, AWS Identity and Access Management (IAM) began to support identity federation for delegated access to the AWS Management Console or AWS APIs. Now the external identities (federated users) are granted secure access to resources in the enterprise’s AWS account without having to create IAM users for each individual user.

With the need to establish a relation between corporate users and IAM accounts on a corporate level, Akvelon was tasked to provide more secure possession and use of IAM accounts by the enterprises to which these IAM accounts were issued (their identities and secret keys are never shared with end users). We were also asked to provide the ability to quickly adjust federated corporate user roles/permissions by simple action at the Active Directory level.

Akvelon was chosen as the sole contractor for this project simply due to the aggressive timeline Akvelon agreed on, and the fact that Akvelon proactively proposed several viable solutions at the stage of initial discussion. Akvelon assumed full responsibility for this end-to-end contract.

Solution

The Identity Federation application is an ASP.NET MVC web application hosted on corporation premises.

The application creates a proper request to Amazon Identity and Access Management services, containing an AWS Security Token Service (STS) for proper authentication and authorization on Amazon’s side.

The application was supplied with Windows Installer, allowing for rapid enterprise deployment. Amazon decided to ship the application with Open Source code, allowing the IT department of each enterprise to adjust federation process if they chose to; or just use the application as developed. The final deliverable was published by Amazon.

Benefits and Results

Akvelon created an application that fully satisfied the client needs – it allowed for immediate and easy use by enterprises, and helped Amazon to ease acceptance of AWS Identity and Access Management. It also improved the security of secret keys issued by Amazon to corporate clients, as they no longer needed to be explicitly shared with their corporate domain users.

Akvelon, Inc. ♦ 1+(206) 905-4626 ♦ info@akvelon.com ♦ Bellevue, WA

Akvelon Confidential. Not for redistribution.

19 Mar HP Interactive Wall

Just wanted to give you some feedback that Alisa has been an exceptional PM on the interactive wall project. There are lots of moving parts and stakeholders within HP who are involved and she has been managing the complexity really well.. Mikhail and team are also driving great results, so I’m excited about the delivery of the project next week and London event.

Case Study: Pet Hotel Application

Case Study: Pocket Barber

Case Study: Pet Hotel Application

Case Study: Pocket Barber

Prerequisites

Managing your Smart Home using Bots

Putting Everything Together

Call to Actions

HP Interactive Wall

19 Mar HP Interactive Wall

No Comments

Latest News

Case Study: Pet Hotel Application

Case Study: Pocket Barber

How Akvelon Can Help Prevent Phishing Attacks

Case Study: Microsoft Personnel Screening

Case Study: Identity Services for Tech Company

Latest Tweets

Akvelon

Prerequisites

Managing your Smart Home using Bots

Putting Everything Together

Call to Actions

HP Interactive Wall

19 Mar HP Interactive Wall

No Comments

Latest News

Latest Tweets

Socialize With Us