Open Source based Intelligence Analysis
Verbal protocol analysis, opensource information, Expertise, Intelligence Analysis, Cognitive processes
Project details
This is an exploratory case study, that examines the interactions between a high-level domain expert engaged in political analysis and the output of a semi-automated commercial open-source analytic system. The study used an in-context think-aloud methodology to extract rich information on the analytical strategies used by the expert as he addressed a typical socio-political analytical task. The focus of the research was to find the cognitive processes of the analyst, including analytic strategies and information gathering behaviors.
Study setup
Double coding the transcript
Three main cognitive process patterns and 2 patterns of information behavior were observed . We double coded transcript of the think-aloud process with moderate agreement.
Few things I learned from doing this project were:
- The opportunity to work so closely with 2 professors on a research project consisted of valuable discussions.
- Looking at cognitive and knowledge work with protocol analysis and from a grounded theory approach.
- Working on Intelligence Analysis, a completely new domain gave me confidence in quickly familiarizing with new domains.
- The various data representations used to handle the analyzed qualitative data were an exercise I thoroughly enjoyed.
- Finally, I learned to produce work at professional quality: focusing on the details while thinking on the higher level research questions.
People
- Prof. Mark Haselkorn
- Dr. Timmothy Thomas
- RA: Pallavi Damera
Artifacts
- This is work in progress. We are working on submitting it in form of a journal paper.
- Here is a poster I presented of preliminary findings during the departmental open house at UW.
- Coded Trascript
- Consent form
- Author's Version of Paper
- Video of the study: part 1
- Video of the study: part 2
