Define instance-based AI methods.

 title: 'Fig. 1: Comparison of the strengths of humans and statistical ML machines, illustrating the complementary ways they generalise in human-AI teaming scenarios. Humans excel at compositionality, common sense, abstraction from a few examples, and robustness. Statistical ML excels at large-scale data and inference efficiency, inference correctness, handling data complexity, and the universality of approximation. Overgeneralisation biases remain challenging for both humans and machines. Collaborative and explainable mechanisms are key to achieving alignment in human-AI teaming. See Table 3 for a complete overview of the properties of machine methods, including instance-based and analytical machines.'

Instance-based AI methods, referred to as lazy learning methods, are non-parametric techniques that focus on local inference rather than global modeling. These methods derive their predictions based on previously encountered similar cases, operating as needed. An example of this approach is the nearest-neighbor methods, which are flexible and can adjust their complexity according to the available data. They also have the capability for universal approximation, meaning they can handle various tasks as long as suitable data structures are available. Instance-based methods rely on memorizing single instances, which helps them identify out-of-sample instances based on similarity to experienced data, and they can effectively deal with catastrophic forgetting in continual learning scenarios by retaining relevant prior data points. This principle also enables them to respond to distributional changes effectively, although the choice of representation greatly influences their generalization ability【1】.