Regression via causally informed neural networks
Publication date
2024-03
Document type
Conference paper
Author
Youssef, Shahenda
Doehner, Frank
Beyerer, Jürgen
Organisational unit
Fraunhofer IOSB
Karlsruhe Institute of Technology
Book title
Machine learning for cyber physical systems
Part of the university bibliography
✅
Keyword
Neural network
Causal graph
Prior knowledge
Causal inference
Propensity score weighting
Regression
Abstract
Neural Networks have been successful in solving complex problems across various fields. However, they require significant data to learn effectively, and their decision-making process is often not transparent. To overcome these limitations, causal prior knowledge can be incorporated into neural network models. This knowledge improves the learning process and enhances the robustness and generalizability of the models. We propose a novel framework RCINN that involves calculating the inverse probability of treatment weights given a causal graph model alongside the training dataset. These weights are then concatenated as additional features in the neural network model. Then incorporating the estimated conditional average treatment effect as a regularization term to the model loss function, the potential influence of confounding variables can be mitigated, leading to bias minimization and improving the neural network model. Experiments conducted on synthetic and benchmark datasets using the framework show promising results.
Version
Published version
Access right on openHSU
Open access