journal article·2023-04-27Open access

An Overview of Open Source Deep Learning-Based Libraries for Neuroscience

Louis Fabrice Tshimanga, Federico Del Pup, Maurizio Corbetta, Manfredo Atzori

Applied Sciences· Volume 13· Issue 9

Abstract

In recent years, deep learning has revolutionized machine learning and its applications, producing results comparable to human experts in several domains, including neuroscience. Each year, hundreds of scientific publications present applications of deep neural networks for biomedical data analysis. Due to the fast growth of the domain, it could be a complicated and extremely time-consuming task for worldwide researchers to have a clear perspective of the most recent and advanced software libraries. This work contributes to clarifying the current situation in the domain, outlining the most useful libraries that implement and facilitate deep learning applications for neuroscience, allowing scientists to identify the most suitable options for their research or clinical projects. This paper summarizes the main developments in deep learning and their relevance to neuroscience; it then reviews neuroinformatic toolboxes and libraries collected from the literature and from specific hubs of software projects oriented to neuroscience research. The selected tools are presented in tables detailing key features grouped by the domain of application (e.g., data type, neuroscience area, task), model engineering (e.g., programming language, model customization), and technological aspect (e.g., interface, code source). The results show that, among a high number of available software tools, several libraries stand out in terms of functionalities for neuroscience applications. The aggregation and discussion of this information can help the neuroscience community to develop their research projects more efficiently and quickly, both by means of readily available tools and by knowing which modules may be improved, connected, or added.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Cell Image Analysis Techniques · Machine Learning in Materials Science · Explainable Artificial Intelligence (XAI)

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Neuroscience, University of Padova, Via Belzoni 160, 35121 Padova, Italy

Padova Neuroscience Center, University of Padova, Via Orus 2/B, 35129 Padova, Italy

Department of Information Engineering, University of Padova, Via Gradenigo 6/b, 35131 Padova, Italy

Venetian Institute of Molecular Medicine (VIMM), 35129 Padova, Italy

Information Systems Institute, University of Applied Sciences Western Switzerland (HES-SO Valais), 2800 Sierre, Switzerland

Funding

Italian Ministry of Education (MIUR)

References (100+)

Show source-provided references
1. The perceptron: A probabilistic model for information storage and organization in the brain10.1037/h0042519 ↗
2. Approximation by superpositions of a sigmoidal function10.1007/BF02551274 ↗
3. Multilayer feedforward networks are universal approximators10.1016/0893-6080(89)90020-8 ↗
4. Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position10.1007/BF00344251 ↗
5. Minsky, M., and Papert, S. (1969). Perceptrons: An Introduction to Computational Geometry, MIT Press.
6. Learning Representations by Back-propagating Errors10.1038/323533a0 ↗
7. A bird’s-eye view of deep learning in bioimage analysis10.1016/j.csbj.2020.08.003 ↗
8. Pereira, F., Burges, C.J.C., Bottou, L., and Weinberger, K.Q. (2012). Advances in Neural Information Processing Systems 25, Curran Associates, Inc.
9. Backpropagation Applied to Handwritten Zip Code Recognition10.1162/neco.1989.1.4.541 ↗
10. Gradient-Based Learning Applied to Document Recognition10.1109/5.726791 ↗
11. Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., and Bernstein, M. (2014). ImageNet Large Scale Visual Recognition Challenge. arXiv.10.1007/s11263-015-0816-y ↗
12. Deep Learning and Neurology: A Systematic Review10.1007/s40120-019-00153-8 ↗
13. Raymond, E.S. (2001). The Cathedral and the Bazaar: Musings on Linux and Open Source by an Accidental Revolutionary, O’Reilly Media. [2nd ed.].
14. Nvidia, Vingelmann, P., and Fitzek, F.H. (2022, November 22). CUDA, Release: 10.2.89. Available online: https://developer.nvidia.com/cuda-toolkit.
15. Chetlur, S., Woolley, C., Vandermersch, P., Cohen, J.M., Tran, J., Catanzaro, B., and Shelhamer, E. (2014). cuDNN: Efficient Primitives for Deep Learning. arXiv.
16. Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2022, November 22). TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. Available online: tensorflow.org.
17. Chollet, F. (2022, November 22). keras. Available online: https://github.com/fchollet/keras.
18. Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., and Antiga, L. (2019). Advances in Neural Information Processing Systems 32, Curran Associates, Inc.
19. (2022, August 18). Nature Neuroscience. Available online: https://www.nature.com/subjects/neuroscience.
20. Measurements of acute cerebral infarction: A clinical examination scale10.1161/01.STR.20.7.864 ↗
21. (2022, August 18). What Is Neuroinformatics?. Available online: https://www.incf.org/about/what-is-neuroinformatics.
22. A Standards Organization for Open and FAIR Neuroscience: The International Neuroinformatics Coordinating Facility10.1007/s12021-020-09509-0 ↗
23. The FAIR Guiding Principles for scientific data management and stewardship10.1038/sdata.2016.18 ↗
25. Advances in functional and structural MR image analysis and implementation as FSL10.1016/j.neuroimage.2004.07.051 ↗
26. Statistical Parametric Mapping10.4249/scholarpedia.6232 ↗
27. EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis10.1016/j.jneumeth.2003.10.009 ↗
28. Brainstorm: A User-Friendly Application for MEG/EEG Analysis10.1155/2011/879716 ↗
29. PaWFE: Fast Signal Feature Extraction Using Parallel Time Windows10.3389/fnbot.2019.00074 ↗
30. MEG and EEG Data Analysis with MNE-Python10.3389/fnins.2013.00267 ↗
31. ROS-Neuro: An Open-Source Platform for Neurorobotics10.3389/fnbot.2022.886050 ↗
32. Physical principles of brain–computer interfaces and their applications for rehabilitation, robotics and control of human brain states10.1016/j.physrep.2021.03.002 ↗
33. The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS)10.1109/TMI.2014.2377694 ↗
34. ISLES 2016 and 2017-benchmarking ischemic stroke lesion outcome prediction based on multispectral MRI10.3389/fneur.2018.00679 ↗
35. ISLES 2022: A multi-center magnetic resonance imaging stroke lesion segmentation dataset10.1038/s41597-022-01875-5 ↗
36. Atzori, M., Gijsberts, A., Heynen, S., Hager, A.G.M., Deriaz, O., van der Smagt, P., Castellini, C., Caputo, B., and Muller, H. (2012, January 24–27). Building the Ninapro database: A resource for the biorobotics community. Proceedings of the 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob), Rome, Italy.10.1109/BioRob.2012.6290287 ↗
37. Park, K.H., and Lee, S.W. (2016, January 22–24). Movement intention decoding based on deep learning for multiuser myoelectric interfaces. Proceedings of the 2016 4th International Winter Conference on Brain-Computer Interface (BCI), Gangwon, Republic of Korea.10.1109/IWW-BCI.2016.7457459 ↗
38. Deep Learning with Convolutional Neural Networks Applied to Electromyography Data: A Resource for the Classification of Movements for Prosthetic Hands10.3389/fnbot.2016.00009 ↗
39. Long Short-Term Memory10.1162/neco.1997.9.8.1735 ↗
40. Cho, K., van Merrienboer, B., Bahdanau, D., and Bengio, Y. (2014). On the Properties of Neural Machine Translation: Encoder-Decoder Approaches. arXiv.10.3115/v1/W14-4012 ↗
41. Using goal-driven deep learning models to understand sensory cortex10.1038/nn.4244 ↗
42. Van Rossum, G., and Drake, F.L. (2009). Python 3 Reference Manual, CreateSpace.
43. R Core Team (2022). R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing.
44. Julia: A fresh approach to numerical computing10.1137/141000671 ↗
45. Flux: Elegant Machine Learning with Julia10.21105/joss.00602 ↗
46. Heilmeyer, F.A., Schirrmeister, R.T., Fiederer, L.D.J., Völker, M., Behncke, J., and Ball, T. (2018, January 7–10). A large-scale evaluation framework for EEG deep learning architectures. Proceedings of the 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Miyazaki, Japan.10.1109/SMC.2018.00185 ↗
47. Deep-Learning-Based Multivariate Pattern Analysis (dMVPA): A Tutorial and a Toolbox10.3389/fnhum.2021.638052 ↗
48. Kostas, D., and Rudzicz, F. (2020). DN3: An open-source Python library for large-scale raw neurophysiology data assimilation for more flexible and standardized deep learning. Neuroscience.10.1101/2020.12.17.423197 ↗
49. A novel approach of decoding EEG four-class motor imagery tasks via scout ESI and CNN10.1088/1741-2552/ab4af6 ↗
50. Huang, Y.L., Hsieh, C.Y., Huang, J.X., and Wei, C.S. (2022). ExBrainable: An Open-Source GUI for CNN-based EEG Decoding and Model Interpretation. arXiv.
51. Gumpy: A Python toolbox suitable for hybrid brain–computer interfaces10.1088/1741-2552/aae186 ↗
52. SANTIA: A Matlab-based open-source toolbox for artifact detection and removal from extracellular neuronal signals10.1186/s40708-021-00135-3 ↗
53. Traja: A Python toolbox for animal trajectory analysis10.21105/joss.03202 ↗
54. Identifying behavioral structure from deep variational embeddings of animal motion10.1038/s42003-022-04080-7 ↗
55. Vector Auto-Regressive Deep Neural Network: A Data-Driven Deep Learning-Based Directed Functional Connectivity Estimation Toolbox10.3389/fnins.2021.764796 ↗
56. Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization10.1007/s11263-019-01228-7 ↗
57. Chen, J., Ding, L., Viana, M.P., Lee, H., Sluezwski, M.F., Morris, B., Hendershott, M.C., Yang, R., Mueller, I.A., and Rafelski, S.M. (2018). The Allen Cell and Structure Segmenter: A new open source toolkit for segmenting 3D intracellular structures in fluorescence microscopy images. Cell Biol.10.1101/491035 ↗
58. A deep learning-based toolbox for Automated Limb Motion Analysis (ALMA) in murine models of neurological disorders10.1038/s42003-022-03077-6 ↗
59. The ANTsX ecosystem for quantitative biological and medical imaging10.1038/s41598-021-87564-6 ↗
60. Biomedical image classification made easier thanks to transfer and semi-supervised learning10.1016/j.cmpb.2020.105782 ↗
61. AxonDeepSeg: Automatic axon and myelin segmentation from microscopy data using convolutional neural networks10.1038/s41598-018-22181-4 ↗
62. Deep, deep learning with BART10.1002/mrm.29485 ↗
63. Zhao, A., Balakrishnan, G., Durand, F., Guttag, J.V., and Dalca, A.V. (2019). Data augmentation using learned transformations for one-shot medical image segmentation. arXiv.10.1109/CVPR.2019.00874 ↗
64. A database and deep learning toolbox for noise-optimized, generalized spike inference from calcium imaging10.1038/s41593-021-00895-5 ↗
65. CDeep3M—Plug-and-Play cloud-based deep learning for image segmentation10.1038/s41592-018-0106-z ↗
66. Library of deep-learning image segmentation and outcomes model-implementations10.1016/j.ejmp.2020.04.011 ↗
67. ClinicaDL: An open-source deep learning software for reproducible neuroimaging processing10.1016/j.cmpb.2022.106818 ↗
68. Geometric deep learning enables 3D kinematic profiling across species and environments10.1038/s41592-021-01106-6 ↗
69. DeepBehavior: A Deep Learning Toolbox for Automated Analysis of Animal and Human Behavior Imaging Data10.3389/fnsys.2019.00020 ↗
70. DeepBhvTracking: A Novel Behavior Tracking Method for Laboratory Animals Based on Deep Learning10.3389/fnbeh.2021.750894 ↗
71. DeepCINAC: A Deep-Learning-Based Python Toolbox for Inferring Calcium Imaging Neuronal Activity Based on Movie Visualization10.1523/ENEURO.0038-20.2020 ↗
72. Mehrtash, A., Pesteie, M., Hetherington, J., Behringer, P.A., Kapur, T., Wells, W.M., Rohling, R., Fedorov, A., and Abolmaesumi, P. (2017). DeepInfer: Open-Source Deep Learning Deployment Toolkit for Image-Guided Therapy, SPIE.10.1117/12.2256011 ↗
73. Using DeepLabCut for 3D markerless pose estimation across species and behaviors10.1038/s41596-019-0176-0 ↗
74. DeepLabStream enables closed-loop behavioral experiments using deep learning-based markerless, real-time posture detection10.1038/s42003-021-01654-9 ↗
75. DeepNeuro: An open-source deep learning toolbox for neuroimaging10.1007/s12021-020-09477-5 ↗
76. DeepNeuron: An open deep learning toolbox for neuron tracing10.1186/s40708-018-0081-2 ↗
77. DeepPoseKit, a software toolkit for fast and robust animal pose estimation using deep learning10.7554/eLife.47994 ↗
78. DeepVOG: Open-source pupil segmentation and gaze estimation in neuroscience using deep learning10.1016/j.jneumeth.2019.05.016 ↗
79. Pawlowski, N., Ktena, S.I., Lee, M.C.H., Kainz, B., Rueckert, D., Glocker, B., and Rajchl, M. (2017). DLTK: State of the Art Reference Implementations for Deep Learning on Medical Images. arXiv.
80. DNNBrain: A Unifying Toolbox for Mapping Deep Neural Networks and Brains10.3389/fncom.2020.580632 ↗
81. FastSurfer—A fast and accurate deep learning based neuroimaging pipeline10.1016/j.neuroimage.2020.117012 ↗
82. Automated Brain Masking of Fetal Functional MRI with Open Data10.1007/s12021-021-09528-5 ↗
83. Pati, S., Thakur, S.P., Bhalerao, M., Thermos, S., Baid, U., Gotkowski, K., Gonzalez, C., Guley, O., Hamamci, I.E., and Er, S. (2021). GaNDLF: A Generally Nuanced Deep Learning Framework for Scalable End-to-End Clinical Workflows in Medical Imaging. arXiv.
84. Automated segmentation of the hypothalamus and associated subunits in brain MRI10.1016/j.neuroimage.2020.117287 ↗
85. Gros, C., Lemay, A., Vincent, O., Rouhier, L., Bucquet, A., Cohen, J.P., and Cohen-Adad, J. (2020). ivadomed: A Medical Imaging Deep Learning Toolbox. arXiv.10.21105/joss.02868 ↗
86. Fast animal pose estimation using deep neural networks10.1038/s41592-018-0234-5 ↗
87. SLEAP: A deep learning system for multi-animal pose tracking10.1038/s41592-022-01426-1 ↗
88. The Mouse Action Recognition System (MARS) software pipeline for automated analysis of social behaviors in mice10.7554/eLife.63720 ↗
89. MesoNet allows automated scaling and segmentation of mouse mesoscale cortical maps using machine learning10.1038/s41467-021-26255-2 ↗
90. MEYE: Web App for Translational and Real-Time Pupillometry10.1523/ENEURO.0122-21.2021 ↗
91. Müller, D., and Kramer, F. (2021). MIScnn: A framework for medical image segmentation with convolutional neural networks and deep learning. BMC Med. Imaging, 21.10.1186/s12880-020-00543-7 ↗
92. Dalca, A.V., Guttag, J., and Sabuncu, M.R. (2018, January 18–22). Anatomical Priors in Convolutional Networks for Unsupervised Biomedical Segmentation. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00968 ↗
93. NiftyNet: A deep-learning platform for medical imaging10.1016/j.cmpb.2018.01.025 ↗
94. Subramanian, A., Lan, H., Govindarajan, S., Viswanathan, L., Choupan, J., and Sepehrband, F. (2021). NiftyTorch: A Deep Learning framework for NeuroImaging. Neuroscience.10.1101/2021.02.26.433116 ↗
95. nnU-Net: A self-configuring method for deep learning-based biomedical image segmentation10.1038/s41592-020-01008-z ↗
96. Lin, Z., Wei, D., Lichtman, J., and Pfister, H. (2021). PyTorch Connectomics: A Scalable and Flexible Segmentation Framework for EM Connectomics. arXiv.
97. A deep learning toolbox for automatic segmentation of subcortical limbic structures from MRI images10.1016/j.neuroimage.2021.118610 ↗
98. Nilsson, S.R., Goodwin, N.L., Choong, J.J., Hwang, S., Wright, H.R., Norville, Z.C., Tong, X., Lin, D., Bentzley, B.S., and Eshel, N. (2020). Simple Behavioral Analysis (SimBA)—an open source toolkit for computer classification of complex social behaviors in experimental animals. bioRxiv.10.1101/2020.04.19.049452 ↗
99. SynthStrip: Skull-stripping for any brain image10.1016/j.neuroimage.2022.119474 ↗
100. Automated Detection and Localization of Synaptic Vesicles in Electron Microscopy Images10.1523/ENEURO.0400-20.2021 ↗