journal article·2022-09-03Open access

Application of Transfer Learning and Convolutional Neural Networks for Autonomous Oil Sheen Monitoring

Jialin Dong, Katherine Sitler, Joseph Scalia, Yunhao Ge, Paul Bireta, Natasha Sihota, Thomas P. Hoelen, Gregory V. Lowry

Applied Sciences· Volume 12· Issue 17

Abstract

Oil sheen on the water surface can indicate a source of hydrocarbon in underlying subaquatic sediments. Here, we develop and test the accuracy of an algorithm for automated real-time visual monitoring of the water surface for detecting oil sheen. This detection system is part of an automated oil sheen screening system (OS-SS) that disturbs subaquatic sediments and monitors for the formation of sheen. We first created a new near-surface oil sheen image dataset. We then used this dataset to develop an image-based Oil Sheen Prediction Neural Network (OS-Net), a classification machine learning model based on a convolutional neural network (CNN), to predict the existence of oil sheen on the water surface from images. We explored the effectiveness of different strategies of transfer learning to improve the model accuracy. The performance of OS-Net and the oil detection accuracy reached up to 99% on a test dataset. Because the OS-SS uses video to monitor for sheen, we also created a real-time video-based oil sheen prediction algorithm (VOS-Net) to deploy in the OS-SS to autonomously map the spatial distribution of sheening potential of hydrocarbon-impacted subaquatic sediments.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Hydrocarbon exploration and reservoir analysis · Spectroscopy Techniques in Biomedical and Chemical Research · Atmospheric and Environmental Gas Dynamics

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Civil and Environmental Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA

Department of Civil and Environmental Engineering, Colorado State University, Fort Collins, CO 80523, USA

Department of Computer Science, University of Southern California, Los Angeles, CA 90007, USA

Chevron Technical Center, San Ramon, CA 94583, USA

Funding

Chevron

References (43)

Show source-provided references
1. Neff, J.M. (1988). Composition and fate of petroleum and spill-treating agents in the marine environment. Synthesis of Effects of Oil on Marine Mammals, Battelle Memorial Institute.
2. Romero, I.C., Schwing, P.T., Brooks, G.R., Larson, R.A., Hastings, D.W., Ellis, G., Goddard, E.A., and Hollander, D.J. (2015). Hydrocarbons in deep-sea sediments following the 2010 deepwater horizon blowout in the Northeast Gulf of Mexico. PLoS ONE, 10.10.1371/journal.pone.0128371 ↗
3. National Research Council (2003). Oil in the Sea III: Inputs, Fates, and Effects, National Academies Press.
4. Disruption and stress in an alaskan fishing community: Initial and continuing impacts of the exxon valdez oil spill10.1177/108602669200600305 ↗
5. Adams, A. (2021, July 30). PAGe 2. Summary of Information Concerning the Ecological and Economic Impacts of the BP Deepwater Horizon Oil Spill Disaster New England Coral Canyons and Seamounts Area, Available online: https://www.nrdc.org/resources/summary-information-concerning-ecological-and-economic-impacts-bp-deepwater-horizon-oil.
6. (2021, July 30). Effects of Oil Spills: What Impact Does it Have on Wildlife and Humans?. Available online: https://www.offshore-technology.com/features/effects-oil-spills/.
7. Ambient air concentrations exceeded health-based standards for fine particulate matter and benzene during the deepwater horizon oil spill10.1080/10962247.2015.1114044 ↗
8. Oil spills detection by means of uas and low-cost airborne thermal sensors
9. Neural networks for oil spill detection using ERS-SAR data10.1109/36.868885 ↗
10. Zeng, K., and Wang, Y. (2020). A Deep convolutional neural network for oil spill detection from spaceborne SAR images. Remote Sens., 12.10.3390/rs12061015 ↗
11. Oil spill detection using marine SAR images10.1080/014311600750037589 ↗
12. SAR image quality assessment and indicators for vessel and oil spill detection10.1109/TGRS.2012.2190293 ↗
13. Oil spill detection by SAR images: Dark formation detection, feature extraction and classification algorithms10.3390/s8106642 ↗
14. Machine learning for the detection of oil spills in satellite radar images10.1023/A:1007452223027 ↗
15. Satellite oil spill detection using artificial neural networks10.1109/JSTARS.2013.2251864 ↗
16. De Kerf, T., Gladines, J., Sels, S., and Vanlanduit, S. (2020). Oil spill detection using machine learning and infrared images. Remote Sens., 12.10.3390/rs12244090 ↗
17. Al-Ruzouq, R., Gibril, M.B.A., Shanableh, A., Kais, A., Hamed, O., Al-Mansoori, S., and Khalil, M.A. (2020). Sensors, features, and machine learning for oil spill detection and monitoring: A review. Remote Sens., 12.10.3390/rs12203338 ↗
18. Bukin, O., Proschenko, D., Korovetskiy, D., Chekhlenok, A., Yurchik, V., and Bukin, I. (2021). Development of the artificial intelligence and optical sensing methods for oil pollution monitoring of the sea by drones. Appl. Sci., 11.10.3390/app11083642 ↗
19. A new approach to oil spill detection that combines deep learning with unmanned aerial vehicles10.1016/j.cie.2018.11.008 ↗
20. Alharam, A., Almansoori, E., Elmadeny, W., and Alnoiami, H. (2020, January 20–21). Real time AI-based pipeline inspection using drone for oil and gas industries in Bahrain. Proceedings of the 2020 International Conference on Innovation and Intelligence for Informatics, Computing and Technologies (3ICT), Sakheer, Bahrain.10.1109/3ICT51146.2020.9312021 ↗
21. Managing Risk at LNAPL Sites
22. Sitler, K., Scalia, J., and Sale, T. (2020). Identification and Validation of Screening Methods for Assessment of the Sheening Potential of Embedded Oil in Sediments, Colorado State University.
23. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
24. Review of deep learning: Concepts, CNN architectures, challenges, applications, future directions10.1186/s40537-021-00444-8 ↗
25. Recent Advances in Convolutional Neural Networks10.1016/j.patcog.2017.10.013 ↗
26. Zhiqiang, W., and Jun, L. (2017, January 26–28). A review of object detection based on convolutional neural network. Proceedings of the 2017 36th Chinese Control Conference (CCC), Dalian, China.10.23919/ChiCC.2017.8029130 ↗
27. Convolutional neural network based image segmentation: A review
28. Deep transfer learning for image-based structural damage recognition10.1111/mice.12363 ↗
29. A Study on CNN transfer learning for image classification10.1007/978-3-319-97982-3_16 ↗
30. Research of water body turbidity classification model for aquiculture based on transfer learning10.1088/1742-6596/1757/1/012004 ↗
31. ImageNet: A large-scale hierarchical image database
32. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
33. ImageNet Classification with Deep Convolutional Neural Networks10.1145/3065386 ↗
34. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
35. A comprehensive survey on transfer learning10.1109/JPROC.2020.3004555 ↗
36. How transferable are features in deep neural networks?
37. Exploring the efficacy of transfer learning in mining image-based software artifacts10.1186/s40537-020-00335-4 ↗
38. Diversity in machine learning10.1109/ACCESS.2019.2917620 ↗
39. Li, H., Ellis, J.G., Zhang, L., and Chang, S.-F. (2018, January 11–14). PatternNet: Visual pattern mining with deep neural network. Proceedings of the 2018 ACM on International Conference on Multimedia Retrieval, Yokohama, Japan.10.1145/3206025.3206039 ↗
40. The backpropagation algorithm10.1007/978-3-642-61068-4_7 ↗
41. Evolutionary stochastic gradient descent for optimization of deep neural networks
42. Yacouby, R., and Axman, D. (2020, January 20). Probabilistic extension of precision, recall, and F1 score for more thorough evaluation of classification models. Proceedings of the First Workshop on Evaluation and Comparison of NLP Systems, Punta Cana, Dominican Republic.10.18653/v1/2020.eval4nlp-1.9 ↗
43. Development of a low cost multi-robot autonomous marine surface platform10.1007/978-3-642-40686-7_43 ↗