journal article·2023-05-01Open access

Perspective on improving the quality of surface and material data analysis in the scientific literature with a focus on x-ray photoelectron spectroscopy (XPS)

George H. Major, Joshua W. Pinder, Daniel E. Austin, Donald R. Baer, Steven L. Castle, Jan Čechal, B. Maxwell Clark, Hagai Cohen, Jonathan Counsell, Alberto Herrera-Gomez, Pavitra Govindan, Seong H. Kim, David J. Morgan, Robert L. Opila, Cedric J. Powell, Stanislav Průša, Adam Roberts, Mario Rocca, Naoto Shirahata, Tomáš Šikola, Emily F. Smith, Regina C. So, John E. Stovall, Jennifer Strunk, Andrew Teplyakov, Jeff Terry, Stephen G. Weber, Matthew R. Linford

Abstract

Due to significant advances in instrumentation, many previously specialized techniques have become “routine” in user facilities. However, detailed knowledge held by experts has often not been relayed to general users, so they often rely on entry-level information, basic principles, and comparison with literature results for data analysis. As a result, major errors in the data analysis of multiple surface and material analysis techniques, including in x-ray photoelectron spectroscopy (XPS), have been appearing in the scientific literature. Representative examples of serious errors in XPS data analysis are shown in this work. We suggest that surface and material analysis, and perhaps even science in general, are in a state of “pre-crisis.” We use two (logistic) models from population biology to suggest that bad analyses self-correct if they remain below a critical number. However, beyond a threshold, the literature can become useless because of the perpetuation of faulty analyses and concomitant loss of its self-correcting ability. XPS is used by scientists in many communities because of the power of the technique and high-quality instrumentation that is commercially available. Those who make new surfaces and materials face unique challenges because of the large number of surface and material analytical techniques that are often needed to characterize their materials. Graduate students and post-docs are often provided with only minimal instruction on using surface and material characterization methods. High fees for instruments may affect both the quality and the quantity of the data people collect. The Prisoner's Dilemma is a model from game theory that describes situations with reward structures that encourage uncooperative behavior and lead to suboptimal outcomes. However, the outcomes of Prisoner's Dilemma are not inevitable—their consequences change if their reward structures change. The current system does not appear to incentivize detailed learning of surface and material characterization techniques and careful material characterization. Prisoner's dilemmas appear to lead to other undesirable consequences in science. The concerns raised in this work suggest that many manuscripts are incompletely reviewed at present. The different stakeholders in this problem, including authors, research advisers, subject matter experts, reviewers, scientists who notice examples of faulty data analysis, editors, journals and publishers, funding agencies, scientific societies, leaders at universities and research centers, and instrument vendors, can improve the current situation. This work provides specific recommendations for each of these stakeholders. For example, we believe that authors are primarily responsible for the correctness of their work, not reviewers or editors; we question the wisdom of listing the names of the editor and reviewers on a paper; we are grateful for the significant contributions that have been made by subject matter experts to produce standards and tutorial information; the high cost of instrument time at some institutions may limit student access and result in suboptimal analyses; staff scientists often need to be better recognized for their intellectual contributions to studies; publishers may wish to allow selective reviewing of specific sections of papers related to material characterization; the reviewing at some open access journals may be inadequate; while it had its shortcomings, the pre-open access model of publishing incentivized the production and publication of high-quality work; audits of the products (scientific papers) of funding agencies may be necessary; collaboration needs to be encouraged to a greater extent at some institutions; and instrument vendors should not suggest to potential customers that surface characterization, e.g., by XPS, is trivial or simple.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Electron and X-Ray Spectroscopy Techniques · Machine Learning in Materials Science · X-ray Spectroscopy and Fluorescence Analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Chemistry and Biochemistry, Brigham Young University 1 , C100 BNSN, Provo, Utah 84602

Pacific Northwest National Laboratory 2 , Richland, Washington 99352

CEITEC BUT, Brno University of Technology 3 , Purkyňova 123, Brno 612 00, Czech Republic

Department of Chemical Research Support Weizmann Institute of Science 4 , Rehovot 76100, Israel

Kratos Analytical Ltd., Wharfside 5 , Trafford Wharf Road, Manchester M17 1GP, United Kingdom

CINVESTAV–Unidad Querétaro 6 , Querétaro 76230, Mexico

Department of Economics, University of Utah 7 , 260 Central Campus Dr #4100, Salt Lake City, Utah 84112

Department of Chemical Engineering and Materials Research Institute, Pennsylvania State University 8 , University Park, Pennsylvania 16802

Max Planck-Cardiff Centre on the Fundamentals of Heterogeneous Catalysis FUNCAT, Cardiff Catalysis Institute, School of Chemistry, Cardiff University 9 , Main Building, Park Place, Cardiff CF10 3AT, United Kingdom

HarwellXPS—EPSRC National Facility for Photoelectron spectroscopy, RCaH 10 , Didcot, Oxon OX11 0FA, United Kingdom

Materials Science and Engineering, College of Engineering, University of Delaware 11 , Newark, Delaware 19716

Associate, Materials Measurement Science Division, National Institute of Standards and Technology 12 , Gaithersburg, Maryland 20899-8370

School of Chemistry, University of Nottingham 19 , Nottingham NG7 2RD, United Kingdom

Department of Economics, Brigham Young University 20 , Provo, Utah 84602

Leibniz-Institute for Catalysis at the University of Rostock 21 , Rostock18059, Germany

Department of Chemistry and Biochemistry, University of Delaware 22 , Newark, Delaware 19716

Department of Physics, Illinois Institute of Technology 23 , Chicago, Illinois 60616

Department of Chemistry, University of Pittsburgh 24 , Pittsburgh, Pennsylvania 15260

References (90)

Show source-provided references
1. J. Vac. Sci. Technol. A · 2020 · 38 · 06320410.1116/6.0000412 ↗
2. 2012
3. J. Vac. Sci. Technol. A · 2021 · 39 · 02160110.1116/6.0000873 ↗
4. J. Vac. Sci. Technol. A · 2020 · 3810.1116/1.5141419 ↗
5. J. Vac. Sci. Technol. A · 2013 · 3110.1116/1.4818423 ↗
6. Microsc. Microanal. · 2020 · 26 · 110.1017/S1431927619015332 ↗
7. J. Vac. Sci. Technol. A · 2020 · 38 · 06120410.1116/6.0000685 ↗
8. J. Vac. Sci. Technol. A · 2020 · 38 · 02080410.1116/1.5140603 ↗
9. Nanomaterials · 2018 · 8 · 31110.3390/nano8050311 ↗
10. Chem. Mater. · 2017 · 29 · 1048710.1021/acs.chemmater.7b04287 ↗
11. J. Chem. Eng. Data · 2013 · 58 · 269910.1021/je400569s ↗
12. Science · 2011 · 334 · 122610.1126/science.1213847 ↗
13. 2022
14. J. Electron Spectros. Relat. Phenomena · 2010 · 178 · 12810.1016/j.elspec.2009.08.005 ↗
15. J. Electron. Spectrosc. Relat. Phenom. · 1976 · 8 · 12910.1016/0368-2048(76)80015-1 ↗
16. Appl. Surf. Sci. · 2021 · 542 · 14863610.1016/j.apsusc.2020.148636 ↗
17. Surf. Sci. Spectra · 2013 · 20 · 3610.1116/11.20121101 ↗
18. J. Vac. Sci. Technol. A · 1996 · 14 · 142410.1116/1.579964 ↗
19. J. Vac. Sci. Technol. A · 2020 · 38 · 06120310.1116/6.0000377 ↗
20. Surf. Interface Anal. · 1982 · 4 · 12510.1002/sia.740040402 ↗
21. Prog. Mater. Sci. · 2020 · 107 · 10059110.1016/j.pmatsci.2019.100591 ↗
22. J. Electrochem. Soc. · 1995 · 142 · 144210.1149/1.2048594 ↗
23. Appl. Surf. Sci. · 1994 · 81 · 33110.1016/0169-4332(94)90290-9 ↗
24. Phys. Rev. B · 1973 · 8 · 358310.1103/PhysRevB.8.3583 ↗
25. Phys. Scr. · 1970 · 1 · 27710.1088/0031-8949/1/5-6/018 ↗
26. J. Colloid Interface Sci. · 1979 · 70 · 54410.1016/0021-9797(79)90062-6 ↗
27. Surf. Sci · 1990 · 234 · 32410.1016/0039-6028(90)90564-O ↗
28. Solid State Ionics · 1996 · 90 · 15110.1016/S0167-2738(96)00411-0 ↗
29. Solid State Ionics · 1992 · 53 · 117210.1016/0167-2738(92)90308-C ↗
30. J. Electron. Spectrosc. Relat. Phenom. · 1985 · 35 · 19110.1016/0368-2048(85)80056-6 ↗
31. J. Am. Chem. Soc. · 1973 · 95 · 75110.1021/ja00784a018 ↗
33. J. Phys. Chem. C · 2015 · 119 · 2586010.1021/acs.jpcc.5b06441 ↗
34. Surf. Sci. Spectra · 1992 · 1 · 27710.1116/1.1247651 ↗
35. J. Microsc. Spectrosc. Electroniques · 1979 · 4 · 483
36. J. Vac. Sci. Technol. A · 2022 · 40 · 06320110.1116/6.0001975 ↗
37. J. Vac. Sci. Technol. A · 2019 · 37 · 03140110.1116/1.5065501 ↗
38. J. Vac. Sci. Technol. A · 2020 · 38 · 03120410.1116/6.0000057 ↗
39. J. Vac. Sci. Technol. A · 2020 · 38 · 04120110.1116/1.5141395 ↗
40. J. Vac. Sci. Technol. A · 2020 · 38 · 04100110.1116/1.5143897 ↗
41. J. Vac. Sci. Technol. A · 2020 · 38 · 06320310.1116/6.0000359 ↗
42. J. Vac. Sci. Technol. A · 2021 · 39 · 01320410.1116/6.0000682 ↗
43. Surf. Interface Anal. · 1990 · 15 · 5110.1002/sia.740150109 ↗
44. Surf. Interface Anal. · 2002 · 33 · 78110.1002/sia.1454 ↗
45. E. National Academies of Sciences and Medicine · 2019
46. J. Vac. Sci. Technol. A · 2018 · 36 · 06850210.1116/1.5049141 ↗
47. Nature · 2016 · 533 · 45210.1038/533452a ↗
48. Proc. Natl. Acad. Sci. U.S.A. · 2018 · 115 · 262810.1073/pnas.1708272114 ↗
49. 2022
50. Surf. Interface Anal. · 2004 · 36 · 22510.1002/sia.1678 ↗
51. Surf. Interface Anal. · 2010 · 42 · 106110.1002/sia.3304 ↗
52. J. Electron. Spectrosc. Relat. Phenom. · 2010 · 178 · 34710.1016/j.elspec.2009.07.005 ↗
53. Nouveaux mémoires de l'Académie Royale des Sciences et Belles-Lettres de Bruxelles · 1845 · 18 · 14
54. 1972
55. Q. Rev. Biol. · 1927 · 2 · 53210.1086/394288 ↗
56. 2011
57. 2015
58. 1798
59. J. Vac. Sci. Technol. A · 2022 · 40 · 06320610.1116/6.0002082 ↗
60. J. Vac. Sci. Technol. A · 2022 · 40 · 06320510.1116/6.0001969 ↗
61. J. Electron. Spectrosc. Relat. Phenom. · 2001 · 121 · 3310.1016/S0368-2048(01)00325-5 ↗
62. Appl. Surf. Sci. · 2010 · 256 · 320410.1016/j.apsusc.2009.12.006 ↗
63. J. Electron. Spectrosc. Relat. Phenom. · 1995 · 71 · 14110.1016/0368-2048(94)02278-X ↗
64. J. Electron. Spectrosc. Relat. Phenom. · 1995 · 71 · 16510.1016/0368-2048(94)02279-8 ↗
65. J. Electron. Spectrosc. Relat. Phenom. · 1995 · 71 · 17910.1016/0368-2048(94)02280-1 ↗
66. Science · 1991 · 254 · 98110.1126/science.254.5034.981 ↗
67. J. Vac. Sci. Technol. A · 2020 · 38 · 04320610.1116/6.0000224 ↗
68. 1993
69. Eatwell · 1989 · 19910.1007/978-1-349-20181-5 ↗
70. 2013
71. Appl. Surf. Sci. · 2016 · 387 · 15510.1016/j.apsusc.2016.06.070 ↗
72. J. Electron. Spectrosc. Relat. Phenom. · 2021 · 250 · 14709410.1016/j.elspec.2021.147094 ↗
73. J. Vac. Sci. Technol. A · 2020 · 38 · 01320110.1116/1.5128901 ↗
74. J. Vac. Sci. Technol. A · 2020 · 38 · 03321110.1116/1.5143132 ↗
75. J. Vac. Sci. Technol. B · 2018 · 36 · 06290210.1116/1.5043297 ↗
76. J. Appl. Phys. · 2022 · 132 · 01110110.1063/5.0086359 ↗
77. 2003
78. Surf. Interface Anal. · 2018 · 50 · 52710.1002/sia.6417 ↗
79. Vac. Technol. Coat. · 2023
80. J. Am. Ceram. Soc. · 2022 · 105 · 235510.1111/jace.18206 ↗
81. J. Vac. Sci. Technol. A · 2020 · 38 · 04340910.1116/6.0000291 ↗
82. J. Vac. Sci. Technol. A · 2020 · 38 · 02320910.1116/1.5141079 ↗
83. J. Vac. Sci. Technol. A · 2021 · 39 · 01120110.1116/6.0000661 ↗
84. J. Vac. Sci. Technol. A · 2020 · 38 · 06320910.1116/6.0000578 ↗
86. Surf. Interface Anal.10.1002/sia.7194 ↗
87. Nature · 2016 · 533 · 14710.1038/533147a ↗
89. Nature · 2023 · 613 · 13810.1038/s41586-022-05543-x ↗
90. 2022