{ "cells": [ { "cell_type": "markdown", "metadata": { "provenance": [ { "last_modified": "2020-05-28T12:19:52.567Z", "source": "# A Survey on Understanding Experiments and Research Practices for Reproducibility" } ] }, "source": [ "# A Survey on Understanding Experiments and Research Practices for Reproducibility" ] }, { "cell_type": "markdown", "metadata": { "provenance": [ { "last_modified": "2020-05-28T12:19:52.567Z", "source": "This Jupyter Notebook presents the results from the survey \"Survey on Understanding Experiments and Research Practices for Reproducibility\" conducted in the context of DFG CRC/TRR ReceptorLight. The notebook analyses the dataset which provides insight into the reproducibility crisis and how to tackle this problem according to scientists. The purpose of the online survey was to gain a better understanding of what is needed to achieve reproducibility of experiments in science. This dataset consists of 26 questions grouped in 6 sections. We analyse each question in the following cells." } ] }, "source": [ "This Jupyter Notebook presents the results from the survey \"Survey on Understanding Experiments and Research Practices for Reproducibility\" conducted in the context of DFG CRC/TRR ReceptorLight. The notebook analyses the dataset which provides insight into the reproducibility crisis and how to tackle this problem according to scientists. The purpose of the online survey was to gain a better understanding of what is needed to achieve reproducibility of experiments in science. This dataset consists of 26 questions grouped in 6 sections. We analyse each question in the following cells." ] }, { "cell_type": "markdown", "metadata": { "provenance": [ { "last_modified": "2020-05-28T12:19:52.567Z", "source": "
\n | Response ID | \nDate started | \nDate last action | \n[Yes, I have read the privacy policy and agree./ Ja, ich habe die Datenschutzerklärung gelesen und stimme zu.] | \nWhat is your current position? | \nWhat is your current position? [Other] | \nWhat is your primary area of study? | \nWhat is your primary area of study? [Other] | \nDo you think there is a reproducibility crisis in your field of research? | \nDo you think there is a reproducibility crisis in your field of research? [Other] | \n... | \nWhere do you save your experimental metadata like descriptions of experiment, methods, samples used? [Data Management Platforms] | \nWhere do you save your experimental metadata like descriptions of experiment, methods, samples used? [Other] | \nDo you write scripts or program to perform data analysis at any stage in your experimental workflow? | \nHave you heard about the FAIR (Findable, Accessible, Interoperable, Reusable) principles? | \nDoes your research follow the FAIR (Findable, Accessible, Interoperable, Reusable) principles? [Findable] | \nDoes your research follow the FAIR (Findable, Accessible, Interoperable, Reusable) principles? [Accessible] | \nDoes your research follow the FAIR (Findable, Accessible, Interoperable, Reusable) principles? [Interoperable] | \nDoes your research follow the FAIR (Findable, Accessible, Interoperable, Reusable) principles? [Reusable] | \nPlease feel free to provide comments regarding what you think is important to enable understandability and reproducibility of scientific experiments in your field of research. | \nTotal time | \n
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
0 | \n2 | \n2019-01-24 08:37:24 | \n2019-01-24 08:40:56 | \nYes | \nPhD Student | \nNaN | \nComputer Science | \nNaN | \nYes | \nNaN | \n... | \nPrimary Source | \nPrimary Source | \nYes | \nYes | \nOften | \nOften | \nSometimes | \nOften | \nNaN | \n215.17 | \n
1 | \n3 | \n2019-01-24 10:10:30 | \n2019-01-24 10:16:33 | \nYes | \nPhD Student | \nNaN | \nComputer Science | \nNaN | \nYes | \nNaN | \n... | \nSecondary Source | \nNaN | \nYes | \nYes | \nOften | \nOften | \nSometimes | \nSometimes | \nNaN | \n365.51 | \n
2 | \n4 | \n2019-01-24 10:20:13 | \n2019-01-24 10:33:42 | \nYes | \nPostDoc | \nNaN | \nBiology(other) | \nNaN | \nNo | \nNaN | \n... | \nNaN | \nNaN | \nNo | \nYes | \nOften | \nRarely | \nSometimes | \nSometimes | \nNaN | \n811.73 | \n
3 | \n6 | \n2019-01-24 18:34:03 | \n2019-01-24 18:40:46 | \nYes | \nProfessor | \nNaN | \nComputer Science | \nNaN | \nOther | \npartly | \n... | \nOther | \nOther | \nYes | \nNo | \nNaN | \nNaN | \nNaN | \nNaN | \nNaN | \n405.30 | \n
4 | \n7 | \n2019-01-24 18:43:32 | \n2019-01-24 18:56:51 | \nYes | \nProfessor | \nNaN | \nComputer Science | \nNaN | \nYes | \nNaN | \n... | \nNaN | \nNaN | \nYes | \nYes | \nRarely | \nSometimes | \nRarely | \nRarely | \nNaN | \n802.05 | \n
5 rows × 94 columns
\n\n", " | Response ID | \n", "Date started | \n", "Date last action | \n", "[Yes, I have read the privacy policy and agree./ Ja, ich habe die Datenschutzerklärung gelesen und stimme zu.] | \n", "What is your current position? | \n", "What is your current position? [Other] | \n", "What is your primary area of study? | \n", "What is your primary area of study? [Other] | \n", "Do you think there is a reproducibility crisis in your field of research? | \n", "Do you think there is a reproducibility crisis in your field of research? [Other] | \n", "... | \n", "Where do you save your experimental metadata like descriptions of experiment, methods, samples used? [Data Management Platforms] | \n", "Where do you save your experimental metadata like descriptions of experiment, methods, samples used? [Other] | \n", "Do you write scripts or program to perform data analysis at any stage in your experimental workflow? | \n", "Have you heard about the FAIR (Findable, Accessible, Interoperable, Reusable) principles? | \n", "Does your research follow the FAIR (Findable, Accessible, Interoperable, Reusable) principles? [Findable] | \n", "Does your research follow the FAIR (Findable, Accessible, Interoperable, Reusable) principles? [Accessible] | \n", "Does your research follow the FAIR (Findable, Accessible, Interoperable, Reusable) principles? [Interoperable] | \n", "Does your research follow the FAIR (Findable, Accessible, Interoperable, Reusable) principles? [Reusable] | \n", "Please feel free to provide comments regarding what you think is important to enable understandability and reproducibility of scientific experiments in your field of research. | \n", "Total time | \n", "
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
0 | \n", "2 | \n", "2019-01-24 08:37:24 | \n", "2019-01-24 08:40:56 | \n", "Yes | \n", "PhD Student | \n", "NaN | \n", "Computer Science | \n", "NaN | \n", "Yes | \n", "NaN | \n", "... | \n", "Primary Source | \n", "Primary Source | \n", "Yes | \n", "Yes | \n", "Often | \n", "Often | \n", "Sometimes | \n", "Often | \n", "NaN | \n", "215.17 | \n", "
1 | \n", "3 | \n", "2019-01-24 10:10:30 | \n", "2019-01-24 10:16:33 | \n", "Yes | \n", "PhD Student | \n", "NaN | \n", "Computer Science | \n", "NaN | \n", "Yes | \n", "NaN | \n", "... | \n", "Secondary Source | \n", "NaN | \n", "Yes | \n", "Yes | \n", "Often | \n", "Often | \n", "Sometimes | \n", "Sometimes | \n", "NaN | \n", "365.51 | \n", "
2 | \n", "4 | \n", "2019-01-24 10:20:13 | \n", "2019-01-24 10:33:42 | \n", "Yes | \n", "PostDoc | \n", "NaN | \n", "Biology(other) | \n", "NaN | \n", "No | \n", "NaN | \n", "... | \n", "NaN | \n", "NaN | \n", "No | \n", "Yes | \n", "Often | \n", "Rarely | \n", "Sometimes | \n", "Sometimes | \n", "NaN | \n", "811.73 | \n", "
3 | \n", "6 | \n", "2019-01-24 18:34:03 | \n", "2019-01-24 18:40:46 | \n", "Yes | \n", "Professor | \n", "NaN | \n", "Computer Science | \n", "NaN | \n", "Other | \n", "partly | \n", "... | \n", "Other | \n", "Other | \n", "Yes | \n", "No | \n", "NaN | \n", "NaN | \n", "NaN | \n", "NaN | \n", "NaN | \n", "405.30 | \n", "
4 | \n", "7 | \n", "2019-01-24 18:43:32 | \n", "2019-01-24 18:56:51 | \n", "Yes | \n", "Professor | \n", "NaN | \n", "Computer Science | \n", "NaN | \n", "Yes | \n", "NaN | \n", "... | \n", "NaN | \n", "NaN | \n", "Yes | \n", "Yes | \n", "Rarely | \n", "Sometimes | \n", "Rarely | \n", "Rarely | \n", "NaN | \n", "802.05 | \n", "
5 rows × 94 columns
\n", "