Key Trends In Machine Learning & Artificial Intelligence

You can hardly talk to a technology executive or developer today without talking about artificial intelligence, machine learning or bots. While everyone agrees on the importance of machine learning to their company and industry, few companies have adequate expertise to do what they wanted the technology to do. Here are some insights into what we can expect in the coming years around ML and AI.

Every application is going to be an intelligent application

If your company isn’t using machine learning to detect anomalies, recommend products or predict churn, you will start doing it soon. Because of the rapid generation of new data, availability of massive amounts of compute power and ease of use of new ML platforms (whether it is from large technology companies like Amazon, Google and Microsoft or from startups like Dato), we expect to see more and more applications that generate real-time predictions and continuously get better over time. Of the 100 early-stage startups we have met in the last six months, 90+ percent of them are already planning to use ML to deliver a better experience for their customers.

Intelligent apps are built on innovations in micro-intelligence and middle-ware services

Companies today fall into two categories (broadly): those that are building some form of ML/AI technology or those that are using ML/AI technologies in their applications and services. There is a tremendous amount of innovation happening in the building block services (aka, middle-ware services) that include both data preparation services and learning services or models-as-a-service providers.

Understanding the “why” behind the “what” is often another critical component of working with artificial intelligence.

With the advent of micro-services and the ability to seamlessly interface with them through REST APIs, there is an increasing trend for the learning services and ML algorithms to be used and re-used — as opposed to having to be re-written from scratch over and over again.

For example, Algorithmia runs a marketplace for algorithms that any intelligent application can use as needed. Combining these algorithms and models with a specific slice of data (use-case specific within a particular vertical) is what we call micro-intelligence, which can be seamlessly incorporated into applications.

Trust and transparency are absolutely critical in a world of ML and AI

Several high-profile experiments with ML and AI came into the spotlight in the last year. Examples include Microsoft Tay, Google DeepMind AlphaGo, Facebook M and the increasing number of chat-bots of all kinds. The rise of natural user interfaces (voice, chat and vision) provide very interesting options and opportunities for us as human beings to interact with virtual assistants (Apple Siri, Amazon Alexa, Microsoft Cortana and Viv).

There are also some more troubling examples of how we interact with artificial intelligences. For example, at the end of one online course at Georgia Tech, students were surprised to learn that one of the teaching assistants (named Jill Watson after the IBM Watson technology) with whom they were interacting throughout the semester was a chat-bot and not a human being.

As much as this shows the power of technology and innovation, it also brings to mind many questions around the rules of engagement in terms of trust and transparency in a world of bots, ML and AI.

Understanding the “why” behind the “what” is often another critical component of working with artificial intelligence. A doctor or a patient will not be happy with a diagnosis that tells them they have a 75 percent likelihood of cancer and they should use drug X to treat it. They need to understand which pieces of information came together to create that prediction or answer.

We absolutely believe that going forward we should have full transparency with regards to ML and think through the ethical implications of the technology advances that will be an integral part of our lives and our society moving forward.

We need human beings in the loop

There have been a number of conversations on whether we should be afraid of AI-based machines taking over the world. As much as advances in ML and AI are going to help with automation where it makes sense, it is also true that we will absolutely need to have human beings in the loop to create the right end-to-end customer experiences.

At one point, Redfin, a US real estae / esate agency company experimented with sending ML-generated recommendations to its users. These machine-generated recommendations had a slightly higher engagement rate than users’ own search and alert filters. However, the real improvement came when Redfin asked its agents to review recommendations before they were sent out. After agents reviewed the recommendations, Redfin was able to use the agents’ modifications as additional training data, and the click-through rate on recommended houses rose significantly.

Splunk re-emphasized this point by describing how IT professionals play a key role in deploying and using Splunk to help them do their jobs better and more efficiently. Without these humans in the loop, customers won’t get the most value out of Splunk.

Another company, Spare5, is a good example of how humans are sometimes required to train ML models by correcting and classifying the data going into the model. Another common adage in ML is garbage in, garbage out. The quality and integrity of data is critical to build high-quality models.

ML is a critical ingredient for intelligent applications… but you may not need ML on Day One

Machine learning is an integral part and critical ingredient in building intelligent applications, but the most important goals in building intelligent apps are to build applications or services that resonate with your customers, provide an easy way for your customer to use your service and continuously get better over time.

To use ML and AI effectively, you often need to have a large dataset. The advice from people who have done this successfully is to start with the application and experience that you want to deliver, and, in the process, think about how ML can enhance your application and what dataset you need to collect to build the best experience for your customers.

We have come a long way in the journey toward every app being an intelligent app, but we are still in the early stages of the journey. As Oren Etzioni, CEO of the Allen Institute for AI, said, we have made tremendous progress in AI and ML, but declaring success in ML today is like “climbing to the top of a tree and declaring we are going to the moon.”

TechCrunch

 

 

« Companies See Cyber Threats But Can’t Deal With Them
Data Protection Tips for Proposed US Cybersecurity Laws »

CyberSecurity Jobsite
Perimeter 81

Directory of Suppliers

The PC Support Group

The PC Support Group

A partnership with The PC Support Group delivers improved productivity, reduced costs and protects your business through exceptional IT, telecoms and cybersecurity services.

Practice Labs

Practice Labs

Practice Labs is an IT competency hub, where live-lab environments give access to real equipment for hands-on practice of essential cybersecurity skills.

Resecurity, Inc.

Resecurity, Inc.

Resecurity is a cybersecurity company that delivers a unified platform for endpoint protection, risk management, and cyber threat intelligence.

Cyber Security Supplier Directory

Cyber Security Supplier Directory

Our Supplier Directory lists 6,000+ specialist cyber security service providers in 128 countries worldwide. IS YOUR ORGANISATION LISTED?

ZenGRC

ZenGRC

ZenGRC - the first, easy-to-use, enterprise-grade information security solution for compliance and risk management - offers businesses efficient control tracking, testing, and enforcement.

NCX Group

NCX Group

NCX Group is committed to helping customers identify and mitigate the risks inherent in today’s interconnected environments and business processes.

iTrinegy

iTrinegy

iTrinegy is a world leader in Application Risk Management offering solutions to mitigate all networked application deployment risks

Kaspersky Lab

Kaspersky Lab

Kaspersky Lab is one of the world’s largest privately held vendors of endpoint cybersecurity solutions.

CIO Dive

CIO Dive

CIO Dive provides news and analysis for IT executives in areas including IT strategy, cloud computing, cyber security, big data, AI, software, infrastructure, dev ops and more.

CybernetIQ

CybernetIQ

CLAW by CybernetIQ is the industry's most advanced SOAR platform helping unify all cybersecurity tools under one umbrella and providing organizations faster, better and more accurate cybersecurity.

ICT Reverse

ICT Reverse

ICT Reverse is one of the UK’s leading, fully accredited providers of ICT asset disposal and secure data erasure.

IoT M2M Council (IMC)

IoT M2M Council (IMC)

The IMC is the largest and fastest-growing trade organisation in the IoT/M2M sector.

Smart Contract Security Alliance

Smart Contract Security Alliance

The Smart Contract Security Alliance supports the blockchain ecosystem by building standards for smart contract security and smart contract audits.

Wiser Market

Wiser Market

Wiser Market is a leading company in global online brand protection services, intellectual property protection, anti-Counterfeit & trademark infringements.

Enet 1 Group1

Enet 1 Group1

Enet 1 Group audits, assesses, recommends, and delivers tested solutions for the ever-increasing threats to your critical systems and digital assets

Consistec Engineering & Consulting

Consistec Engineering & Consulting

Consistec Engineering & Consulting GmbH is an information technology and services company offering solutions for monitoring the security of IT and OT infrastructure.

Association of anti Virus Asia Researchers (AVAR)

Association of anti Virus Asia Researchers (AVAR)

AVAR's mission is to prevent the spread of and damage caused by malicious software, and to develop cooperative relationships among anti-malware experts in Asia.

Orpheus Cyber

Orpheus Cyber

Orpheus Cyber provides predictive and actionable intelligence to our clients - enabling them to anticipate, prepare for and respond to the cyber threats they face.

BAE Systems

BAE Systems

BAE Systems develop, engineer, manufacture, and support products and systems to deliver military capability, protect national security, and keep critical information and infrastructure secure.

Blink Ops

Blink Ops

Blink helps security teams streamline everyday workflows and protect your organization better.

Royal United Services Institute (RUSI)

Royal United Services Institute (RUSI)

The Royal United Services Institute is an independent think tank engaged in cutting edge defence and security research. Areas of research include cyber security and resilience.