Ethical Conduct of Research

1. Ethical Conduct of Research Ran Libeskind-Hadas Harvey Mudd College Four handouts!

2. Why talk about ethics? • Our credibility as scientists and engineers depends on applying high ethical standards • False or unreliable results set science back • Funding sources rightfully demand that work be conducted ethically

3. Why talk about ethics? • Our credibility as scientists and engineers depends on applying high ethical standards • False or unreliable results set science back • Funding sources rightfully demand that work be conducted ethically

4. Why talk about ethics? • Our credibility as scientists and engineers depends on applying high ethical standards • False or unreliable results set science back • Funding sources rightfully demand that work be conducted ethically

5. Why talk about ethics? • Our credibility as scientists and engineers depends on applying high ethical standards • False or unreliable results set science back • Funding sources rightfully demand that work be conducted ethically And agencies such as the Federal Office of Research Integrity investigate and prosecute violations…

6. Ethical issues at all levels… • Fraud • Bad judgment • Errors

7. Fraud

8. http://www.nature.com/news/2011/110628/full/474552a.html

9. Ethical issues at all levels… • Fraud • Bad judgment • Errors O. Uplavici, PredbeznaZprava, 1887 cited for over 50 years 1939: “Dr. O. Uplavici (1887-1938)” by Clifford Dobell JaroslavHlava

10. What are the issues? • Conflicts of interest • Experimental Design and Conduct • Appropriate use of human subjects • Subjectivity and perception bias • Data Integrity and Analysis • Acquisition • Management • Appropriate use of statistical tools • Publication • Fabrication • Falsification • Selective reporting • Plagiarism • Authorship • Citation • … and more

11. What are the issues? • Conflicts of interest • Experimental Design and Conduct • Appropriate use of human subjects • Subjectivity and perception bias • Data Integrity and Analysis • Acquisition • Management • Appropriate use of statistical tools • Publication • Fabrication • Falsification • Selective reporting • Plagiarism • Authorship • Citation • … and more

12. What are the issues? • Conflicts of interest • Experimental Design and Conduct • Appropriate use of human subjects • Subjectivity and perception bias • Data Integrity and Analysis • Acquisition • Management • Appropriate use of statistical tools • Publication • Fabrication • Falsification • Selective reporting • Plagiarism • Authorship • Citation • … and more

13. What are the issues? • Conflicts of interest • Experimental Design and Conduct • Appropriate use of human subjects • Subjectivity and perception bias • Data Integrity and Analysis • Acquisition • Management • Appropriate use of statistical tools • Publication • Fabrication • Falsification • Selective reporting • Plagiarism • Authorship • Citation • … and more

14. Examples of Conflicts of Interest (COI) • You have research funding from a company and they would like your results to show X (or not show X). • You are asked to recommend which instrument to purchase and you own stock in one of the companies. • You are involved in a hiring decision and a friend of yours has applied for the position. • Your employer owns some equipment that you would like to use to do some work for your start-up. • You have been given a paper to review that in some way reduces the value of your prior work.

15. Examples of Conflicts of Interest (COI) • You have research funding from a company and they would like your results to show X (or not show X). • You are asked to recommend which instrument to purchase and you own stock in one of the companies. • You are involved in a hiring decision and a friend of yours has applied for the position. • Your employer owns some equipment that you would like to use to do some work for your start-up. • You have been given a paper to review that in some way reduces the value of your prior work.

16. Examples of Conflicts of Interest (COI) • You have research funding from a company and they would like your results to show X (or not show X). • You are asked to recommend which instrument to purchase and you own stock in one of the companies. • You are involved in a hiring decision and a friend of yours has applied for the position. • Your employer owns some equipment that you would like to use to do some work for your start-up. • You have been given a paper to review that in some way reduces the value of your prior work.

17. Examples of Conflicts of Interest (COI) • You have research funding from a company and they would like your results to show X (or not show X). • You are asked to recommend which instrument to purchase and you own stock in one of the companies. • You are involved in a hiring decision and a friend of yours has applied for the position. • Your employer owns some equipment that you would like to use to do some work for your start-up. • You have been given a paper to review that in some way reduces the value of your prior work.

18. Examples of Conflicts of Interest (COI) • You have research funding from a company and they would like your results to show X (or not show X). • You are asked to recommend which instrument to purchase and you own stock in one of the companies. • You are involved in a hiring decision and a friend of yours has applied for the position. • Your employer owns some equipment that you would like to use to do some work for your start-up. • You have been given a paper to review that in some way reduces the value of your prior work. Ran’s current situation

19. COI Safeguards • Most institutions have explicit COI policies and disclosure forms. Declaration of competing interests----------------------------------Please complete a declaration of competing interests, considering the following questions:- Have you in the past five years received reimbursements, fees, funding, or salary from an organisation that may in any way gain or lose financially from the publication of this manuscript, either now or in the future?- Do you hold any stocks or shares in an organisation that may in any way gain or lose financially from the publication of this manuscript, either now or in the future?- Do you hold or are you currently applying for any patents relating to the content of the manuscript? Have you received reimbursements, fees, funding, or salary from an organization that holds or has applied for patents relating to the content of the manuscript?- Do you have any other financial competing interests?- Do you have any non-financial competing interests in relation to this paper?If you can answer no to all of the above, write 'I declare that I have no competing interests' below. If your reply is yes to any, please give details below.

20. Experimental Design & Conduct • Your experiment involves human subjects. • Your experimental design is complicated and not fully documented. • Your experimental design has the possibility of human subjectivity and bias.

21. Safeguards • Human Subjects: Any study that involves human subjects must be reviewed by an IRB (“Institutional Review Board”) prior to commencing the study. • Experimental design is ideally peer reviewed in published findings (but even then, subtle details are difficult to document and often missed).

22. Data Integrity and Analysis • Data is not recorded reliably. • Multiple contributors to dataset using ambiguous standards. • Sensitive data is not secured or authenticated. • Which statistical tests to use is ambiguous. • Questionable protocols for throwing out “outliers”.

23. Data Integrity and Analysis • Data is not recorded reliably. • Multiple contributors to dataset using ambiguous standards. • Sensitive data is not secured or authenticated. • Which statistical tests to use is ambiguous. • Questionable protocols for throwing out “outliers”.

24. Data Integrity and Analysis • Data is not recorded reliably. • Multiple contributors to dataset using ambiguous standards. • Sensitive data is not secured or authenticated. • Which statistical tests to use is ambiguous. • Questionable protocols for throwing out “outliers”.

25. Data Integrity and Analysis • Data is not recorded reliably. • Multiple contributors to dataset using ambiguous standards. • Sensitive data is not secured or authenticated. • Which statistical tests to use is ambiguous. • Questionable protocols for throwing out “outliers”.

26. Data Integrity and Analysis • Data is not recorded reliably. • Multiple contributors to dataset using ambiguous standards. • Sensitive data is not secured or authenticated. • Which statistical tests to use is ambiguous. • Questionable protocols for throwing out “outliers”. True Story

27. Safeguards • Some large institutions have auditors who perform routine or reactive audits.

28. Publication • Some closely-related work was done earlier by others and is not properly cited. • Some of this work was already published elsewhere. • Selective reporting: Some of the data or studies that don’t support the conclusions are omitted. • Some co-authors did not contribute to the work. • Citations are copied from earlier papers and not verified.

29. Publication • Some closely-related work was done earlier by others and is not properly cited. • Some of this work was already published elsewhere. • Selective reporting: Some of the data or studies that don’t support the conclusions are omitted. • Some co-authors did not contribute to the work. • Citations are copied from earlier papers and not verified.

30. Publication • Some closely-related work was done earlier by others and is not properly cited. • Some of this work was already published elsewhere. • Selective reporting: Some of the data or studies that don’t support the conclusions are omitted. • Some co-authors did not contribute to the work. • Citations are copied from earlier papers and not verified.

31. Publication • Some closely-related work was done earlier by others and is not properly cited. • Some of this work was already published elsewhere. • Selective reporting: Some of the data or studies that don’t support the conclusions are omitted. • Some co-authors did not contribute to the work. • Citations are copied from earlier papers and not verified.

32. Publication • Some closely-related work was done earlier by others and is not properly cited. • Some of this work was already published elsewhere. • Selective reporting: Some of the data or studies that don’t support the conclusions are omitted. • Some co-authors did not contribute to the work. • Citations are copied from earlier papers and not verified.

33. Safeguards • Journals and conf. proceedings generally have clear policies about what may be submitted. • Peer review will catch some errors. • Some journals require a statement on how each author contributed. • Errors found by others can be published.

34. Some Tests… • Harm test: Do the benefits outweigh the harms, short term and long term? • Reversibility test: Would I still think this choice is good if I traded places? • Common practice test: What if everyone behaved in this way? • Legality test: Would this choice violate a law or a policy of my employer? • Colleague test: What would professional colleagues say? • Wise relative test: What would my wise old aunt or uncle do? • Mirror test: Would I feel proud of myself when I look into the mirror? • Publicity test: How would this choice look on the front page of a newspaper? When in doubt, talk to (several) people that you trust

35. Some Tests… • Harm test: Do the benefits outweigh the harms, short term and long term? • Reversibility test: Would I still think this choice is good if I traded places? • Common practice test: What if everyone behaved in this way? • Legality test: Would this choice violate a law or a policy of my employer? • Colleague test: What would professional colleagues say? • Wise relative test: What would my wise old aunt or uncle do? • Mirror test: Would I feel proud of myself when I look into the mirror? • Publicity test: How would this choice look on the front page of a newspaper? When in doubt, talk to (several) people that you trust

36. Some Tests… • Harm test: Do the benefits outweigh the harms, short term and long term? • Reversibility test: Would I still think this choice is good if I traded places? • Common practice test: What if everyone behaved in this way? • Legality test: Would this choice violate a law or a policy of my employer? • Colleague test: What would professional colleagues say? • Wise relative test: What would my wise old aunt or uncle do? • Mirror test: Would I feel proud of myself when I look into the mirror? • Publicity test: How would this choice look on the front page of a newspaper? When in doubt, talk to (several) people that you trust

37. Some Tests… • Harm test: Do the benefits outweigh the harms, short term and long term? • Reversibility test: Would I still think this choice is good if I traded places? • Common practice test: What if everyone behaved in this way? • Legality test: Would this choice violate a law or a policy of my employer? • Colleague test: What would professional colleagues say? • Wise relative test: What would my wise old aunt or uncle do? • Mirror test: Would I feel proud of myself when I look into the mirror? • Publicity test: How would this choice look on the front page of a newspaper? When in doubt, talk to (several) people that you trust

38. Some Tests… • Harm test: Do the benefits outweigh the harms, short term and long term? • Reversibility test: Would I still think this choice is good if I traded places? • Common practice test: What if everyone behaved in this way? • Legality test: Would this choice violate a law or a policy of my employer? • Colleague test: What would professional colleagues say? • Wise relative test: What would my wise old aunt or uncle do? • Mirror test: Would I feel proud of myself when I look into the mirror? • Publicity test: How would this choice look on the front page of a newspaper? When in doubt, talk to (several) people that you trust

39. Some Tests… • Harm test: Do the benefits outweigh the harms, short term and long term? • Reversibility test: Would I still think this choice is good if I traded places? • Common practice test: What if everyone behaved in this way? • Legality test: Would this choice violate a law or a policy of my employer? • Colleague test: What would professional colleagues say? • Wise relative test: What would my wise old aunt or uncle do? • Mirror test: Would I feel proud of myself when I look into the mirror? • Publicity test: How would this choice look on the front page of a newspaper? When in doubt, talk to (several) people that you trust

40. Some Tests… • Harm test: Do the benefits outweigh the harms, short term and long term? • Reversibility test: Would I still think this choice is good if I traded places? • Common practice test: What if everyone behaved in this way? • Legality test: Would this choice violate a law or a policy of my employer? • Colleague test: What would professional colleagues say? • Wise relative test: What would my wise old aunt or uncle do? • Mirror test: Would I feel proud of myself when I look into the mirror? • Publicity test: How would this choice look on the front page of a newspaper? When in doubt, talk to (several) people that you trust

41. Some Tests… • Harm test: Do the benefits outweigh the harms, short term and long term? • Reversibility test: Would I still think this choice is good if I traded places? • Common practice test: What if everyone behaved in this way? • Legality test: Would this choice violate a law or a policy of my employer? • Colleague test: What would professional colleagues say? • Wise relative test: What would my wise old aunt or uncle do? • Mirror test: Would I feel proud of myself when I look into the mirror? • Publicity test: How would this choice look on the front page of a newspaper? When in doubt, talk to (several) people that you trust

42. What are the issues? • Conflicts of interest • Experimental Design and Conduct • Use of human subjects • Subjectivity and perception bias • Data Integrity • Acquisition • Management • Publication • Fabrication • Falsification • Selective reporting • Appropriate use of statistical tools • Plagiarism • Authorship • Citation • … and more Case Study 1: Reviewing a Manuscript Case Study 2: Grant Review Case Study 3: Kinky Data “The Truth Wears Off”

43. Research misconduct • Handling of data http://ori.hhs.gov/TheLab/

44. Case Study 1: Reviewing a Manuscript • Researchers are frequently asked to review manuscripts for journals as a professional courtesy • Manuscripts under review are considered confidential

45. Questions • Is Prof. Dvizer’s behavior here ethical? Why or why not? • Are there some things that Prof. Dvizer could have done differently in order to mitigate your concerns? • Should Sue have declined to review the manuscript? Why or why not?

46. Here’s what happened next… • Sue read Litik’s paper and gave a thoughtful and constructive review • Litik’s paper was rejected by the editor, based on strong criticism from other reviewers on a part of the paper not relevant to Sue’s work and not in Sue’s area of expertise or interest • Sue now plans to submit a manuscript based on some of the ideas from Litik’s paper and her own work but had no way to cite Litik’s work • What should Sue do?

47. Case Study 2: Reviewing a Grant Proposal • Established researchers are asked to review grant proposals (NSF, NIH, HHMI, etc.) • A grant can make a large impact on a research program, and a particularly large impact on a junior faculty member’s career

48. Questions • What’s your advice to Polly? • Is there any additional information that you feel that you’d like to have before being absolutely certain about the right way to proceed? • Are there any slight changes in the circumstances under which your advice would be different?

49. Case Study 3: Kinky Data(adapted from a real case by Dr. Adam Johnson) • Integrity and presentation of data

50. Questions • What’s your advice to Prof. Lemma? • Can you imagine any slight differences in the scenario which would result in very different advice?