Abstract
With the rise of new diseases, the fast discovery of drugs decreases the harm done to individuals. To this end, computational methods must be efficiently adaptable to new tasks, e.g. drug targets. HyperNetworks have been established as an effective technique to quickly adapt the parameters of neural networks. Notably, HyperNetwork-based parameter adaption has improved multi-task generalization in various domains, such as personalized federated learning and neural architecture search. In the drug discovery domain, drug-target interaction (DTI) models must be adapted to new drug targets, such as proteins, which constitute descriptions of prediction tasks. Current state-of-the-art Deep Learning architectures apply a few fully-connected layers to concatenated, learned embeddings of the description of the drug target and the molecule. However, these architectures do not have a specific mechanism to adapt the parameters to new targets. In this work, we develop a HyperNetwork approach to adapt the parameters of DTI models. On an established benchmark, our HyperNetwork approach improves the predictive performance of current architectures in several categories. Furthermore, we extend our approach to learn all parameters of a graph neural network as the molecular encoder using a particular weight initialization scheme. The proposed HyperNetwork approach renders DTI models more robust to new tasks and improves predictive performance in low data settings.
Original language | English |
---|---|
Title of host publication | International Conference on Machine Learning (ICML 2022), 3rd Women in Machine Learning Un-Workshop |
Number of pages | 1 |
Publication status | Published - 2022 |
Fields of science
- 305907 Medical statistics
- 202017 Embedded systems
- 202036 Sensor systems
- 101004 Biomathematics
- 101014 Numerical mathematics
- 101015 Operations research
- 101016 Optimisation
- 101017 Game theory
- 101018 Statistics
- 101019 Stochastics
- 101024 Probability theory
- 101026 Time series analysis
- 101027 Dynamical systems
- 101028 Mathematical modelling
- 101029 Mathematical statistics
- 101031 Approximation theory
- 102 Computer Sciences
- 102001 Artificial intelligence
- 102003 Image processing
- 102004 Bioinformatics
- 102013 Human-computer interaction
- 102018 Artificial neural networks
- 102019 Machine learning
- 102032 Computational intelligence
- 102033 Data mining
- 305901 Computer-aided diagnosis and therapy
- 305905 Medical informatics
- 202035 Robotics
- 202037 Signal processing
- 103029 Statistical physics
- 106005 Bioinformatics
- 106007 Biostatistics
JKU Focus areas
- Digital Transformation