A new method to predict anomaly in brain network based on graph deep learning
-
Jalal Mirakhorli
,
Hamidreza Amindavar
Abstract
Functional magnetic resonance imaging a neuroimaging technique which is used in brain disorders and dysfunction studies, has been improved in recent years by mapping the topology of the brain connections, named connectopic mapping. Based on the fact that healthy and unhealthy brain regions and functions differ slightly, studying the complex topology of the functional and structural networks in the human brain is too complicated considering the growth of evaluation measures. One of the applications of irregular graph deep learning is to analyze the human cognitive functions related to the gene expression and related distributed spatial patterns. Since a variety of brain solutions can be dynamically held in the neuronal networks of the brain with different activity patterns and functional connectivity, both node-centric and graph-centric tasks are involved in this application. In this study, we used an individual generative model and high order graph analysis for the region of interest recognition areas of the brain with abnormal connection during performing certain tasks and resting-state or decompose irregular observations. Accordingly, a high order framework of Variational Graph Autoencoder with a Gaussian distributer was proposed in the paper to analyze the functional data in brain imaging studies in which Generative Adversarial Network is employed for optimizing the latent space in the process of learning strong non-rigid graphs among large scale data. Furthermore, the possible modes of correlations were distinguished in abnormal brain connections. Our goal was to find the degree of correlation between the affected regions and their simultaneous occurrence over time. We can take advantage of this to diagnose brain diseases or show the ability of the nervous system to modify brain topology at all angles and brain plasticity according to input stimuli. In this study, we particularly focused on Alzheimer’s disease.
Acknowledgement
The authors gratefully acknowledge the assistance provided by the Medical Genetic Lab, Iranian Comprehensive Hemophilia Care Center (ICHCC).
Author contribution: All the authors have accepted responsibility for the entire content of this submitted manuscript and approved submission.
Research funding: None declared.
Employment or leadership: None declared.
Honorarium: None declared.
Conflict of interest statement: The authors declare no conflicts of interest regarding this article.
References
Agosta, F., Pievani, M., Geroldi, C., Copetti, M., Frisoni, G.B., and Filippi, M. (2012). Resting state fMRI in Alzheimer’s disease: beyond the default mode network. Neurobiol. Aging 33: 1564–1578, https://doi.org/10.1016/j.neurobiolaging.2011.06.007.Suche in Google Scholar PubMed
Bi, X.A., Jiang, Q., Sun, Q., Shu, Q., and Liu, Y. (2018). Analysis of Alzheimer’s disease based on the random neural network cluster in fMRI. Front. Neuroinform. 12: 60, https://doi.org/10.3389/fninf.2018.00060.Suche in Google Scholar PubMed PubMed Central
Bi, X., Shu, Q., Sun, Q., and Xu, Q. (2018). Random support vector machine cluster analysis of resting-state fMRI in Alzheimer’s disease. PLoS One 13: e0194479, https://doi.org/10.1371/journal.pone.0194479.Suche in Google Scholar PubMed PubMed Central
Boscaini, D., Masci, J., Rodolà, E., and Bronstein, M. (2016). Learning shape correspondence with anisotropic convolutional neural networks. In: Advances in neural information processing systems, pp. 3189–3197.Suche in Google Scholar
Bronstein, M.M., Bruna, J., LeCun, Y., Szlam, A., and Vandergheynst, P. (2017). Geometric deep learning: going beyond Euclidean data. IEEE Signal Process. Mag. 34: 8–42, https://doi.org/10.1109/MSP.2017.2693418.Suche in Google Scholar
Bruna, J., Zaremba, W., Szlam, A., and Lecun, Y. (2014). Spectral networks and locally connected networks on graphs. In: International conference on learning representations (ICLR2014). CBLS.Suche in Google Scholar
Calhoun, V.D., Miller, R., Pearlson, G., and Adali, T. (2014). The chronnectome: time-varying connectivity networks as the next Frontier in fMRI data discovery. Neuron 84: 262–274, https://doi.org/10.1016/j.neuron.2014.10.015.Suche in Google Scholar PubMed PubMed Central
Challis, E., Hurley, P., Serra, L., Bozzali, M., Oliver, S., and Cercignani, M. (2015). Gaussian process classification of Alzheimer’s disease and mild cognitive impairment from resting-state fMRI. NeuroImage 112: 232–243, https://doi.org/10.1016/j.neuroimage.2015.02.037.Suche in Google Scholar PubMed
Chen, S., Huang, L., Qiu, H., Nebel, M.B., Mostofsky, S.H., Pekar, J.J., Lindquist, M.A., Eloyan, A., and Caffo, B.S. (2017). Parallel group independent component analysis for massive fMRI data sets. PLoS One 12: e0173496, https://doi.org/10.1371/journal.pone.0173496.Suche in Google Scholar PubMed PubMed Central
Choi, H. and Jin, K.H. (2018). Predicting cognitive decline with deep learning of brain metabolism and amyloid imaging. Behav. Brain Res. 344: 103–109, https://doi.org/10.1016/j.bbr.2018.02.017.Suche in Google Scholar PubMed
Dai, Q., Li, Q., Tang, J., and Wang, D. (2018). Adversarial network embedding. In: AAAI, pp. 2167–2174.10.1609/aaai.v32i1.11865Suche in Google Scholar
de Vos, F., Koini, M., Schouten, T.M., Seiler, S., van der Grond, J., Lechner, A., Schmidt, R., de Rooij, M., and Rombouts, S.A. (2018). A comprehensive analysis of resting state fMRI measures to classify individual patients with Alzheimer’s disease. NeuroImage 167: 62–72, https://doi.org/10.1016/j.neuroimage.2017.11.025.Suche in Google Scholar PubMed
Defferrard, M., Bresson, X., and Vandergheynst, P. (2016).Convolutional neural networks on graphs with fast localized spectral filtering. In: NIPS, pp. 3844–3852.Suche in Google Scholar
Gao, H., Wang, Z., and Ji, S. (2018). Large-scale learnable graph convolutional networks. In: Proceedings of the ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp. 1416–1424.10.1145/3219819.3219947Suche in Google Scholar
Grover, A. and Leskovec, J. (2016). node2vec: scalable feature learning for networks. In: ACM SIGKDD international conference on knowledge discovery and data mining.10.1145/2939672.2939754Suche in Google Scholar PubMed PubMed Central
Hamilton, W., Ying, Z., and Leskovec, J. (2017). Inductive representation learning on large graphs. In: Advances in neural information processing systems. pp. 1024–1034.Suche in Google Scholar
Henaff, M., Bruna, J., and LeCun, Y. (2015). Deep convolutional networks on graph-structured data. https://arxiv.org/abs/1506.05163.Suche in Google Scholar
Hojjati, S.H., Ebrahimzadeh, A., Khazaee, A., and Babajani-Feremi, A. (2017). Predicting conversion from MCI to AD using resting-state fMRI, graph theoretical approach and SVM. J. Neurosci. Methods 282: 69–80, https://doi.org/10.1016/j.jneumeth.2017.03.006.Suche in Google Scholar PubMed
Hutchison, R.M., Womelsdorf, T., Allen, E.A., Bandettini, P.A., Calhoun, V.D., Corbetta, M., Della Penna, S., Duyn, J.H., Glover, G.H., Gonzalez-Castillo, J., et al. (2013). Dynamic functional connectivity: promise, issues, and interpretations. Neuroimage 80: 360–378, https://doi.org/10.1016/j.neuroimage.2013.05.079.Suche in Google Scholar PubMed PubMed Central
Ioffe, S. and Szegedy, C. (2015). Batch normalization: accelerating deep network training by reducing internal covariate shift. In: JMLR, 2015.Suche in Google Scholar
Johnson, D.D. (2017). Learning graphical state transitions. In: 5th International conference on learning representations. ICLR.Suche in Google Scholar
Khazaee, A., Ebrahimzadeh, A., and Babajani-Feremi, A. (2017). Alzheimer’s disease neuroimaging initiative (2017) classification of patients with MCI and AD from healthy controls using directed graph measures of resting-state fMRI. Behav. Brain Res. 322: 339–350, https://doi.org/10.1016/j.bbr.2016.06.043.Suche in Google Scholar PubMed
Kingma, D.P. and Ba, J. (2014). Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980.Suche in Google Scholar
Kingma, D.P. and Welling, M. (2014). Auto-encoding variational Bayes. In: International conference for learning representations.Suche in Google Scholar
Kipf, T.N. and Welling, M. (2016). Variational graph auto-encoders. In: NeurIPS workshop on Bayesian deep learning.Suche in Google Scholar
Kipf, N. and Welling, M. (2017). Semi-supervised classification with graph convolutional networks. In: International conference on learning representations (ICLR).Suche in Google Scholar
Klokov, R. and Lempitsky, V. (2017). Escape from cells: deep Kd-Networks for the recognition of 3D point cloud models. In: IEEE international conference on computer vision (ICCV).10.1109/ICCV.2017.99Suche in Google Scholar
Lan, S., Holbrook, A., Elias, G.A., Fortin, N., Ombao, H., and Shahbaba, B. (2019). Flexible Bayesian dynamic modeling of correlation and covariance matrices. Bayesian Anal. Advance Publication. 1–30. https://doi.org/10.1214/19-BA1173.Suche in Google Scholar
Larsen, A.B.L., Sønderby, S.K., Larochelle, H., and Winther, O. (2016). Autoencoding beyond pixels using a learned similarity metric. In: ICML.Suche in Google Scholar
Le-Huu, D.K. and Paragios, N. (2017). Alternating direction graph matching. In: CVPR.10.1109/CVPR.2017.522Suche in Google Scholar
Levie, R., Monti, F., Bresson, X., and Bronstein, M. (2019). Cayleynets: graph convolutional neural networks with complex rational spectral filters. IEEE Trans. Sig. Process. 67: 97–109, https://doi.org/10.1109/TSP.2018.2879624.Suche in Google Scholar
Li, W., Zhao, Y., Chen, X., Xiao, Y., and Qin, Y. (2019). Detecting Alzheimer’s disease on small dataset: a knowledge transfer perspective. IEEE J. Biomed. Health Inform. 1234–1242. https://doi.org/10.1109/JBHI.2018.2839771.Suche in Google Scholar PubMed
Liu, M., Cheng, D., Wang, K., and Wang, Y. (2018). Multi-modality cascaded convolutional neural networks for Alzheimer’s disease diagnosis. Neuroinformatics 16: 295–308. https://doi.org/10.1007/s12021-018-9370-4.Suche in Google Scholar PubMed
Makhzani, A., Shlens, J., Jaitly, N., Goodfellow, I., and Frey, B. (2015). Adversarial autoencoders. arXiv preprint arXiv:1511.05644.Suche in Google Scholar
Mirakhorli, J., and Amindavar, H. (2017). Semi-supervised hierarchical semantic object parsing. In: IEEE conference on signal processing and intelligent systems, https://doi.org/10.1109/ICSPIS.2017.8311588.Suche in Google Scholar
Monti, F., Boscaini, D., Masci, J., Rodola, E., Svoboda, J., and Bronstein, M. (2017). Geometric deep learning on graphs and manifolds using mixture model cnns. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 5115–5124, https://doi.org/10.1109/CVPR.2017.576.Suche in Google Scholar
Niepert, M., Ahmed, M., and Kutzkov, K. (2016). Learning convolutional neural networks for graphs. In: Proceedings of ICML, pp. 2014–2023.Suche in Google Scholar
Pan, S., Hu, R., Long, G., Jiang, J.F., Yao, L., and Zhang, C. (2018). Adversarially regularized graph autoencoder for graph embedding. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence, pp. 2609–2615, https://doi.org/10.24963/ijcai.2018/362.Suche in Google Scholar
Payan, A. and Montana, G. (2015). Predicting Alzheimer’s disease: a neuroimaging study with 3D convolutional neural networks. CoRR, https://doi.org/1502.02506.Suche in Google Scholar
Rolls, E.T., Joliot, M., and Tzourio-Mazoyer, N. (2015). Implementation of a new parcellation of the orbitofrontal cortex in the automated anatomical labeling Atlas. Neuroimage 122: 1–5, https://doi.org/10.1016/j.neuroimage.2015.07.075.Suche in Google Scholar PubMed
Sarraf, S. and Tofghi, G. (2016). Classification of Alzheimer’s disease structural MRI data by deep learning convolutional neural networks. https://arxiv.org/abs/1603.08631.Suche in Google Scholar
Seiler, C. and Holmes, S. (2017). Multivariate heteroscedasticity models for functional brain connectivity. Front Neurosci. 11: 696. https://doi.org/10.3389/fnins.2017.00696.Suche in Google Scholar PubMed PubMed Central
Seiler, S., Schmidt, H., Lechner, A., Benke, T, Sanin, G., Ransmayr, G., Lehner, R., DalBianco, P., Uranues, M., Marksteiner, J., et al. (2012). Driving cessation and dementia: results of the prospective registry on dementia in Austria (PRODEM). PLoS One 7. https://doi.org/10.1371/journal.pone.0052710. 23300746.Suche in Google Scholar PubMed PubMed Central
Simonovsky, M. and Komodakis, N. (2018). GraphVAE: towards generation of small graphs using variational autoencoders. In: International conference on artificial neural networks (ICANN), https://doi.org/10.1007/978-3-030-01418-6_41.Suche in Google Scholar
Sinha, A., Bai, J., and Ramani, K. (2016). Deep learning 3D shape surfaces using geometry images. In: European conference on computer vision, pp. 223–240, https://doi.org/10.1007/978-3-319-46466-4_14.Suche in Google Scholar
Sperling, R. (2011). The potential of functional MRI as a biomarker in early Alzheimer's disease. Neurobiol. Aging 32: 37–43. https://doi.org/10.1016/j.neurobiolaging.2011.09.009.Suche in Google Scholar PubMed PubMed Central
Such, F.P., Sah, S., Dominguez, M.A., Pillai, S., Zhang, C., Michael, A., and Cahill, N.D., Ptucha, R. (2017). Robust spatial filtering with graph convolutional neural networks. IEEE J. Sel. Top. Sig. Process 11: 884–896, https://doi.org/10.1109/JSTSP.2017.2726981.Suche in Google Scholar
Sun, J., Yan, S., Song, C., and Baosan, H. (2020). Dual-functional neural network for bilateral hippocampi segmentation and diagnosis of Alzheimer’s disease. Int. J. Comput. Assist. Radiol. Surg. 445–455. https://doi.org/10.1007/s11548-019-02106-w.31883064.Suche in Google Scholar
Tong, T., Gao, Q., Guerrero, R., Ledig, C., Chen, L., and Rueckert, D. (2017). A novel grading biomarker for the prediction of conversion from mild cognitive impairment to Alzheimer’s disease. IEEE Trans. Biomed. Eng. 64: 155–165, https://doi.org/10.1109/TBME.2016.2549363.Suche in Google Scholar PubMed
Verma, N., Boyer, E., and Verbeek, J. (2018). FeaStNet: feature-steered graph convolutions for 3D shape analysis. In: IEEE/CVF conference on computer vision and pattern recognition, Salt Lake City, UT, 2018, pp. 2598–2606, https://doi.org/10.1109/CVPR.2018.00275.Suche in Google Scholar
Wang, F., Xue, N., Zhang, Y., Bai, X., and Xia, G.S. (2018). Adaptively transforming graph matching. In: Computer Vision – ECCV.10.1007/978-3-030-01270-0_38Suche in Google Scholar
Wang, H., Wang, J., Wang, J., Zhao, M., Zhang, W., Zhang, F., Xie, X., and Guo, M. (2018). GraphGan: graph representation learning with generative adversarial nets. In: AAAI, pp. 2508–2515.10.1609/aaai.v32i1.11872Suche in Google Scholar
Wang, W., Tang, M., and Jiao, P. (2018). A unified framework for link prediction based on non-negative matrix factorization with coupling multivariate information. PLoS One 13: e0208185, https://doi.org/10.1371/journal.pone.0208185.Suche in Google Scholar PubMed PubMed Central
Wang, F., Xue, N., Zhang, Y., Xia, G., and Pelillo, M. (2019). A functional representation for graph matching. In: IEEE transactions on pattern analysis and machine intelligence. https://doi.org/10.1109/TPAMI.2019.2919308.Suche in Google Scholar PubMed
Wu, J., Zhang, C., Xue, T., Freeman, B., and Tenenbaum, J. (2016). Learning a probabilistic latent space of object shapes via 3D generative-adversarial modeling. In: Advances in neural information processing systems. NIPS, pp. 82–90.Suche in Google Scholar
Xu, J. and Durrett, G. (2018). Spherical latent spaces for stable variational autoencoders. arxiv:1808.10805.10.18653/v1/D18-1480Suche in Google Scholar
Xu, D., Zhu, Y., Choy, C.B., and Fei-Fei, L. (2017). Scene graph generation by iterative message passing. In: IEEE conference on computer vision and pattern recognition (CVPR), https://doi.org/10.1109/CVPR.2017.330.Suche in Google Scholar
Yan, J., Li, C., Li, Y., and Cao, G. (2018). Adaptive discrete hypergraph matching. IEEE Trans. Cybern. 48: 765–779, https://doi.org/10.1109/TCYB.2017.2655538.Suche in Google Scholar PubMed
Young, J., Modat, M., Cardoso, M.J., Mendelson, A., Cash, D., and Ourselin, S. (2013). Accurate multimodal probabilistic prediction of conversion to Alzheimer’s disease in patients with mild cognitive impairment. NeuroImage Clin. 2: 735–745, https://doi.org/10.1016/j.nicl.2013.05.004.Suche in Google Scholar PubMed PubMed Central
Yu, J.G., Xia, G.S., Samal, A., and Tian, J. (2016). Globally consistent correspondence of multiple feature sets using proximal gausseidel relaxation. Pattern Recogn. 51: 255–267, https://doi.org/10.1016/j.patcog.2015.09.029.Suche in Google Scholar
Yu, W., Zheng, C., Cheng, W., Aggarwal, C.C., Song, D., Zong, B., Chen, H., and Wang, W. (2018). Learning deep network representations with adversarially regularized autoencoders. In: SIGKDD. 2663–2671.10.1145/3219819.3220000Suche in Google Scholar
© 2020 Walter de Gruyter GmbH, Berlin/Boston
Artikel in diesem Heft
- Frontmatter
- GABAergic and glutamatergic effects on nigrostriatal and mesolimbic dopamine release in the rat
- Fragmentation of brain apolipoprotein E (ApoE) and its relevance in Alzheimer's disease
- Cochlear synaptopathy: new findings in animal and human research
- Neurophysiologic implications of neuronal nitric oxide synthase
- Exploring the mechanisms of action of the antidepressant effect of the ketogenic diet
- The potential anti-depressant properties of dexmedetomidine infusion: a review of mechanistic, preclinical, and clinical evidence
- Role of kinaesthetic motor imagery in mirror-induced visual illusion as intervention in post-stroke rehabilitation
- A review on the alterations in the brain of persistent postural-perceptual dizziness patients and non-pharmacological interventions for its management
- A new method to predict anomaly in brain network based on graph deep learning
Artikel in diesem Heft
- Frontmatter
- GABAergic and glutamatergic effects on nigrostriatal and mesolimbic dopamine release in the rat
- Fragmentation of brain apolipoprotein E (ApoE) and its relevance in Alzheimer's disease
- Cochlear synaptopathy: new findings in animal and human research
- Neurophysiologic implications of neuronal nitric oxide synthase
- Exploring the mechanisms of action of the antidepressant effect of the ketogenic diet
- The potential anti-depressant properties of dexmedetomidine infusion: a review of mechanistic, preclinical, and clinical evidence
- Role of kinaesthetic motor imagery in mirror-induced visual illusion as intervention in post-stroke rehabilitation
- A review on the alterations in the brain of persistent postural-perceptual dizziness patients and non-pharmacological interventions for its management
- A new method to predict anomaly in brain network based on graph deep learning
