The latest technology and digital news on the web

Human-centric AI news and analysis

COVID-19 made your data set worthless. Now what?

The COVID-19 communicable has abashed data scientists and creators of apparatus acquirements tools as the sudden and major change in customer behavior has made predictions based on actual data nearly useless. There is also very little point in trying to train new anticipation models during the crisis, as one simply cannot adumbrate chaos. While these challenges could shake our acumen of what bogus intelligence really is (and is not), they might also foster the development of tools that could automatically adjust.

When it comes to admiration demand or customer behavior, there is annihilation in the actual data that resembles what we see now. Thus, a model based purely on actual data will try to carbon “what is normal” and is likely to give inaccurate predictions.

Let me give you a simple affinity of the botheration that data scientists and apparatus acquirements professionals are now experiencing. If you want to adumbrate how long it is going to take to drive from A to B in London next Thursday at 18:00, you can ask a model that looks at actual active times, and possibly at assorted scales. For instance, the model might look at the boilerplate speed on any day at around 18:00. It might also look at the boilerplate speed on a Thursday versus other days in the week, and at the month of April versus other months. The same acumen can be continued to other time scales as one year, ten years, or whatever is accordant for the abundance you are trying to predict. This will help adumbrate the accepted active time under “normal” conditions. However, if there is major disruption on that accurate day, like a football game or a big concert, your travelling time might be decidedly affected. That is how we see the accepted crisis in allegory with normal times.

Perhaps unsurprisingly, many AI and apparatus acquirements tools deployed across assorted businesses – from carriage to retail, able casework and the likes – are currently disturbing in trying to cope with massive changes in the behavior of both users and the environment. Clearly, one can try making anticipation algorithms focus on abate parts of data. However, it is also pretty accessible that one cannot expect “normal” outcomes and the same affection of predictions as before.

What to do?

There is some good news for data scientists and the likes though. Generally, data science solutions are built on actual data, but current, “extraordinary” data should come in when always assessing the achievement of those absolute solutions. If achievement starts to drop off consistently, then that can be an adumbration that the rules have changed. 

This achievement ecology is absolute of predictive systems for now – it tells us how things are doing, but will not change anything. However, I accept that we are now seeing a major push appear systems that could adjust automatically to the new rules. This is commodity we can call “adaptive goal-directed behaviour”, which is how we define AI at Satalia. If we can make a system adaptive, then it is going to adjust itself based on that accepted data when it recognizes achievement bottomward off. We have aspirations to do this, but we are not there just yet. In the short run, however, we can do the following:


  • Do not try to train a brand new model from Day 1 of the crisis, it is pointless. You cannot adumbrate chaos;
  • Gather more data points and try to understand/analyze, how the model is afflicted by the situation;
  • If you have data from a antecedent crisis with agnate characteristics, train a model on that data and test it offline to see if it works better;
  • Make sure your training data is always up to date. Every day, the new day goes into the data and the oldest day goes out. Like a sliding window. The model will then gradually adjust itself;
  • Shrink the timeline of your dataset as much as accessible after affecting your metrics. If you have a very long dataset, it will take too long for it to adjust to the new reality; and
  • Manage client expectations. Make it clear that noise is making things very hard to predict. Computing KPIs during this time is next to impossible. 

Clearly, architecture a model that is able to acknowledge to acute events may incur cogent extra costs, and conceivably it is not always worth the effort. However, should you decide to build a model that is able to acknowledge to acute events, then they should be advised during development/training. In this case, make sure to abduction the long- and concise history of your data when training the model. Assigning altered weights on long- and concise advice will enable you to adapt more evidently to acute changes.

In the long run, though, this crisis reminded us that there are events so circuitous even we humans still attempt to understand, let alone predictive systems we have built to arrange our compassionate in normal times. Even us humans need to adapt to this “new normal” by afterlight our own centralized ambit to help us better anticipation how long it will take to do the weekly shop or allotment a new optimal path when walking down the street. This ability is accustomed for us humans and it is a affection we should be consistently trying to impart on our new silicon work colleagues. Ultimately, we need to admit that an AI band-aid can never be seen as a accomplished artefact in the ever-changing and ambiguous world in which we live. How we enable AI systems to adapt as calmly as we do – in terms of the number of data points – is very much an open catechism whose answer will define how much our technology will be able to be of help during the acutely airy times that might be ahead of us.

I thank my colleagues Alex Lilburn, Ted Lappas, Alistair Ferag, Sinem Polat, Jonas De Beukelaer, Roberto Anzaldua, Yohann Pitrey and R?ta Palionien? for providing insights and allowance me to adapt this article.

Appear September 11, 2020 — 22:06 UTC

Hottest related news

No articles found on this category.