What No One Tells You About AI Supervision

Share this 

Share on facebook
Share on twitter
Share on linkedin

Some playtime with a “state of the art” linguistic tool led me to a startling realization – while everyone is busy making hay when the sun shines and selling their freshly baked AI tools and frameworks, few if any, realize that AI is anything but akin to DIY IKEA furniture! Before I go any further, let me explain what happened.

Language in its infinite beauty, is incredibly nuanced. “My car has four seats” – in this phrase, “seats” is a noun. “My car seats four” – identical in meaning to the previous phrase, but “seats is a verb.

The scholastic linguistic tool however reckoned that “seats” is a noun regardless of the phrase. The grammar police in me quickly realized the risk of canned, black box AI tools:

You have little control over how these tools are trained

While most commercial cognitive services have done wonders for accelerating AI adoption into everyday applications, they seldom (and often never) allow you to change the model’s training parameters. Those familiar with Machine Learning would quickly realize that training against a Naive Bayes’ vs a Max Entropy decision tree, can produce very different models and results.

You have little control over what these tools are trained on

Some cognitive services allow you to train their models on your data. However, some don’t! A major risk of using pre-trained models is that you have no clue on what the model(s) were trained on.

Let’s take a Halloween example. Say 1 in 100 humans is a zombie and your model should identify zombies from humans. If you train the model on 99 humans and 1 zombie, guess what – your model will, with a very high likelihood, classify a zombie as a human and woe shall befall upon us. You might as well have just blindly guessed, since the chance of being right was 99 percent!

My suspicion is the linguistic model was exposed to skewed data, i.e. a majority of samples had “seats” in a noun context, which biased the model’s output. If your data is skewed, your model itself could be rendered useless.

Cognitive Platform Components

Which brings me back to my earlier point. Operating AI isn’t plug and chug. Should you do that, you’ll be chugging someone else’s drink – and beware, it could be spiked. AI supervision is about owning your data and having the right resources to constantly train your models on the right data. Identifying what’s right takes experience and expertise and sometimes, is art and not science (I’ll qualify that in another blog).

At Wysdom.AI, we believe in a cognitive platform approach – a triad of Wysdom’s cutting edge cognitive products, surgically augmented DIY cognitive services, and the all important AI supervision. A platform approach is vital for AI to truly bring value to your business processes and in turn, have a positive impact on your customers.

Through our years in the industry, we’ve seen enterprises large and small struggle and succeed. Success is often the result of meticulous planning and adopting a platform approach to AI.

So before bolting off the gate to deploy DIY cognitive services, always remember – failure to train is training to fail.

0 replies on “What No One Tells You About AI Supervision”

Let’s supercharge your virtual agent together

With outstanding customer experience being the most important differentiator, make sure your virtual agent is the one leaving the competition in the dust.

Wysdom is a conversational AI optimization platform that enables higher performing, lower cost conversational virtual agents, continually learning and delivering high-quality customer experiences.

© Copyright Wysdom 2021. All rights reserved.

Artiom Kreimer

VP, Product & Analytics

Artiom has spent 10 years in software and mobile engineering, specializing in quality assurance and customer service. He has worked in testing and QA at both startups and in enterprises such as Clickfree, TELUS, and Freescale Semiconductor.

Michel Benitah

VP, Optimization & Delivery

Michel has 20 years of experience in leading the successful delivery of Conversational AI and Natural Language Customer Care solutions to some of the largest financial, telco, healthcare, utilities, and retail enterprises throughout North America. 


Prior to joining Wysdom, Michel spent 20 years at Nuance Communications, holding senior management and leadership positions within the enterprise division, most recently as director of the Toronto office and professional services team.

Frederic Lam

SVP, Sales

Fred brings in 25 years of international experience in sales and business development across North America, the Caribbean, Asia-Pacific, Europe, and the Middle-East.


Prior to Wysdom.AI, he held sales leadership positions at Oracle, Redknee, and Movius/Glenayre, successfully growing revenues in both large and small organizations. Fred has also been involved in the start-up community in the earlier stages of his career as an Investment Manager with SP Capital and was an alternate director on a few investee companies.

Karen Chan

Chief Engineering Officer, Co-Founder

With 20 years of experience in software and mobile, Karen has held senior technical roles at 5 startups, including Wysdom.AI, Clickfree, Mobile Diagnostix (HP), Teamatic, and Virtualthere.

Karthik Balakrishnan

Chief Technology Officer

Karthik has over a decade of hands-on, proven global expertise in emerging technologies and implementing intricate platforms and solutions for telecommunications and enterprise during his time at Amdocs, with senior positions in their India, Cyprus, America, and Canada offices.

Nitin Singhal

Chief Operating Officer

Nitin has over 20 years of success in global executions of business technology, driving operational efficiency and digital scalability for some of the world’s largest enterprise clients. 


Nitin spent 16 years at Redknee holding executive positions in Research and Development, Customer Operations, Partner Alliances, and most recently as COO.

Jeff Brunet​

President, Co-Founder

Jeff has more than 20 years of experience in the startup world, founding and growing 4 software companies: AracNet, Mobile Diagnostix (HP), ClickFree, and Wysdom.AI. 


His in-depth understanding of software development and the challenges in making new technologies successful in the startup world prove invaluable as he serves on the boards of XMG, SurfEasy (Opera), Locationary (Apple), Groupie, and as an advisor to Pushlife (Google), LogMeIn (IPO) and HP. 


Jeff holds 23 issued patents in the wireless and consumer electronics spaces and is the lead inventor on 30+ pending patents.

Ian Collins​

CEO, Co-Founder

Ian has founded and grown 6 technology companies over the past 20 years, primarily in the enterprise software space including Wyrex, Mobile Diagnostix (HP), Clickfree, and most recently Wysdom.AI. 


Ian invests, mentors, and sits on the boards of several startups in the Toronto area.