The future of ML (and OR!) lies in the hybridization of ML and OR. One of our main mottos is “where machine learning meets operations research”, and this truly is where Funartech shines and distinguishes itself from other companies. We strongly advocate for the combination of ML and OR for all industrial projects.
OR and ML might not be sufficient, but they should be considered in any analytical solution.
There are basically four ways to combine ML and OR:
- The now “classical” use of ML as a pre-process and OR as a post-process step.
- Use OR to improve ML.
- Use ML to improve OR.
- A complete hybridization of both ML and OR, where we develop new algorithms.
The middle two are purely technical and only of importance to ML and OR practitioners.
1. ML and OR as separate black boxes
This is the most common approach whenever companies propose to combine ML and OR. Often, ML is used to predict and OR is then used to optimize on those predictions.
As an example, let’s say you are a train company and you want to repair or replace your tracks. Of course you’ll want to do this for the minimum cost. How can you do this? Decouple this problem in two steps:
Use ML to detect your defects. Post cameras under the wagons of your trains, take pictures in rapid succession. With computer vision and deep learning, find the defects on the pictures and stitch your pictures together to obtain a network of defects of your tracks. You can classify the nature of the defects into several classes — to be replaced immediately, in 3 months, in 6 months, and so on; likewise for repairs.
Use OR to optimize your repair/replacement policy. Once you have your network of defects, you still need to know how to replace or repair your tracks in an optimal way. If a maintenance team is on site to repair a track, it might be less costly for it to repair another close-by track that doesn’t need immediate repair. OR will choose an optimal repair/replace policy for your tracks.
You might want to have a look at our use cases, as they all use that approach.
This combination became mainstream in 2019
- Pr. Yoshua Bengio et al. recognize the superiority of the combination in Machine Learning for Combinatorial Optimization: a Methodological Tour d’Horizon. This article mentions that the combination should only be used to solve combinatorial problems — but (almost) any problem can be cast as a combinatorial one.
- Scale AI is financing projects combining ML and OR: $290 million in support for SCALE AI, the AI-powered supply chains Supercluster.
- Gartner announced its vision a little earlier, in 2018: Combine Predictive and Prescriptive Techniques to Solve Business Problems.
2. Use OR to improve ML
OR can be used to optimize, i.e. minimize or maximize some function in ML. But wait, isn’t this what ML is about? Exactly — ML is strongly based on OR optimization when it optimizes its predictions.
3. Use ML to improve OR
It also goes the opposite way. The strong point of ML is to predict. Some research is conducted in order to predict on what variable and how to branch in search trees.
4. A complete hybridization of both ML and OR
We are developing new algorithms that are a complete and total hybridization of both ML and OR. These new algorithms don’t treat ML and/or OR as separate black boxes but are really a new combination of the strengths of both fields. We are convinced that these new algorithms are the way to go to solve any problem, and that in the future OR and ML will be merged into a new field.
We use this approach for our Open door to AGI project.