punkish: Ethics and Integrity of Data Collection and Sharing

name: intro
class: center, middle

# Ethics and Integrity of Data Collection and Sharing
##

Rencontres Mondiales du Logiciel Libre 2015, Beauvais, France • May 2015

Puneet Kishor (Plazi)

Released under a [CC0 Public Domain Dedication](https://creativecommons.org/publicdomain/zero/1.0/).

<div class="slidefooter">
    <a href="/Ethics-and-Integrity-of-Data-Collection-and-Sharing"><img src="/_lib/img/PunkishEidesisOrg-small.gif"></a> 
    <a rel="license" href="https://creativecommons.org/publicdomain/zero/1.0/"><img src="/_lib/img/zero.png" alt="CC0" width="30" height="30"></a>
    <div class="navlinks">
        <a href="javascript:slideshow.gotoPreviousSlide()">prev</a> 
        <a href="javascript:slideshow.gotoNextSlide()">next</a>
    </div>
</div>
---

layout: true

## Help

* Notes are hidden, but may be seen by pressing **P** on your keyboard.
* Press **C** to clone a show.
* Press **H** for other keyboard shortcuts.

???

notes here

---

## Approving conventional science projects

Traditionally done by Institutional Review Boards (IRBs)

> (In the United States) IRBs must approve proposed non-exempt research before involvement of human subjects may begin.

—US Dept. of Health and Human Services

---

## But what about…

# Citizen Science?

---

## Citizen Science

> Citizen science… is changing the relationship between science and society, helping meet environmental challenges by fostering more collaborative, interdisciplinary research.

—<a href="http://e360.yale.edu/feature/interview_caren_cooper_how_rise_of_citizen_science_is_democratizing_research/2733/" target="_blank">How Rise of Citizen Science 
Is Democratizing Research</a>

---

## But…

## How do we evaluate, approve and monitor (some) citizen science projects?

---

## Three kinds of open projects

.left-column[
  ### Contributory
]
.right-column[
Projects that are generally designed by scientists and for which members of the public primarily contribute data
]

<br clear="both">
<span class='footnote'>Bonney, R., Ballard, H., Jordan, R., McCallie, E., Phillips, T., Shirk, J. and Wilderman, C. C. <a href="http://informalscience.org/images/research/PublicParticipationinScientificResearch.pdf" target="_blank">Public Participation in Scientific Research: Defining the Field and Assessing Its Potential for Informal Science Education - a CAISE Inquiry Group Report</a>, Center for Advancement of Informal Science Education, Washington, DC, 2009.</span>

---

## Three kinds of open projects

.left-column[
  ### Contributory
  ### Collaborative
]
.right-column[
Projects designed by scientists and for which members of the public contribute data but also may help to refine project design, analyze data, or disseminate findings
]

---

## Three kinds of open projects

.left-column[
  ### Contributory
  ### Collaborative
  ### Co-created
]
.right-column[
Projects where scientists and members of the public are working together and for which at least some of the public participants are actively involved in most or all steps of the scientific process.
]

---

## <strike>Three</strike> Four kinds of open projects

.left-column[
  ### Contributory
  ### Collaborative
  ### Co-created
  ### Self-Organized
]
.right-column[
Projects where members of the public are working on their own, either individually or in self-organized groups, <span class="hilite">outside conventional academies</span>.
]

---

## How do we approve non-conventional projects

- citizen science
- sensors
- self-measurement (quantified self)
- participant led research (PLR)

---

## Substitute for IRBs

# ?

---

## What about ongoing monitoring?

### Collecting data on others
### (Mis-)Reporting Data
### Damaging Irreplaceable Evidence
### Invading Privacy of Others
### Balancing Privacy and Honesty
### Giving Credit

---

## Legal tools are…

### Inadequate
### Inappropriate
### Expensive
### Complicated
### Fear-driven

---

# Do no evil

## That hasn't gone down very well

---

# Respect and social contract

## Can good behavior and a sense of community work?

---

## Good behavior by another name

### Code of conduct
### Social contract
### Hippocratic oath
### Honor code
### Respect

---

## Importance of data integrity

### open is good but not a substitute for good science
### what if the design is open but the data are bad?

---

## Evaluating data integrity

.left-column[
  ### validation dimensions
]
.right-column[
.two-left-column[

- Accessibility
- Amount of information
- Believability
- Completeness
- Concise representation
- Consistent representation
- Ease of manipulation
- Free-of-error

]
.two-right-column[

- Interpretability
- Objectivity
- Relevancy
- Reputation
- Security
- Timeliness
- Understandability
- Value-added
- other?

]
]

<br clear="both">
<span class='footnote'>Hunter, J., Alabri, A. and van Ingen, C. 2013. <a href="http://onlinelibrary.wiley.com/doi/10.1002/cpe.2923/full" target="_blank">Assessing the quality and trustworthiness of citizen science data</a>. Concurrency Computat.: Pract. Exper., 25: 454–466. doi: 10.1002/cpe.2923</span>

---

## Evaluating data integrity

.left-column[
  ### Validation dimensions
  ### Reputation
]
.right-column[
 ### trust across social networks
 ### co-calibration
]