Archive | data collection RSS for this section

Ethical issues in Social Research Projects

This short paper discusses ethical issues as embedded in a TV reality show format that provides the [ill-designed] imagined setting for a social psychology-informed research project looking at group dynamics and performance under stress. The core principles of informed consent, briefing and debriefing, backup, coercion and incentives are applied to the experiment.
You find the PDF below and for download on Slideshare where you can also get a presentation transcript. Creative Commons Licence applies, attribute please. And if you like it: quote, embed – and question it 🙂

Add to FacebookAdd to NewsvineAdd to DiggAdd to Del.icio.usAdd to StumbleuponAdd to RedditAdd to BlinklistAdd to Ma.gnoliaAdd to TechnoratiAdd to Furl

exam revision: deductive versus inductive research strategies

This belongs to the revision of social research strategies, I am going to summarise the key differences between inductive and deductive research approaches – but first what they’ve got in common. Both strategies are rooted in a positivist assumption in terms of epistemology and ontology. The underlying empiricism, i.e. the notion that only knowledge gained through experiences and senses is acceptable, is implemented by rigorous testing. Enlarging the number of instances observed (samples) increases plausibility and the number of regularities being identified. The accumulated ‘facts’ provide basis for general laws of cause and effects. Those are depicted in models as dependent (predictor) and independent (outcome) variables.

Inductive theory is being derived from the observations made. This approach cannot test hypotheses but generates them. In contrast, deduction is theory-driven, it’s based on preconceptions and aims to overcome the limitations of induction. It puts theories to the test, that means hypotheses can be falsified and disproved. The aim is to move closer to the truth, hence the gradual elimination of false theories implies that theories tested and not disproved can only be considered provisional.

Ideally, a deductive approach starts with a theoretical framework (for instance based on Erving Goffman’s ‘stigma’ or Pierre Bourdieu’s ‘social capital’) and the formulation of hypotheses. Usually, this includes an alternative hypothesis (also called experimental H., which states the effect assumed) and the null hypothesis (which states the effect is absent). What follows is the data collection which delivers findings that either result in confirmation or rejection of the null hypothesis and a subsequent revision of the theory.

In practice, though, deduction often entails an element of induction and vice versa. This is rooted in theoretical reflection once the data has been collected or the desire to establish conditions which allow the theory to hold (or not). This continuous weaving back and forth between data and theory and is called an iterative strategy, particularly evident in qualitative research which takes a grounded theory approach and a way to add to the validity of research. In quantitative research, it is advisable to carefully distinguish between the more complex development of theory and the generalisation of empirical findings.

Add to FacebookAdd to NewsvineAdd to DiggAdd to Del.icio.usAdd to StumbleuponAdd to RedditAdd to BlinklistAdd to Ma.gnoliaAdd to TechnoratiAdd to Furl

MIT webart: data-mining visualised

MIT (Media Lab; Museum et al.) is asking: How does the web see you? Personas was created by Aaron Zinman et al. and produces different pieces of digital art, depending on whether you look for your real name, your avatar or someone else’s online identity. It’s a rapid creation, a speedy data-mining process that crawls whatever traces you may have left in the past and spits it out in bars and cubes. Who am I – sliced into shades of colour, chunks of categories….who am I? Is that me? That’s not even remotely me, my first reaction – but then it must be me, right? It’s based on MIT’s machine power…
britbohlinger

Research Methods – the useful material

Following on from my previous two posts, here is a list of very useful material I recommend for studying Social Research Methods including

  • research strategies and design,
  • literature review,
  • ethics and politics of research
  • sampling,
  • qualitative and quantitative methods,
  • as well as data analysis,
  • writing up social research and presentation of findings.

References:
BRYMAN, A. (3rd ed.) (2008) Social Research Methods. Oxford: Oxford University Press.
Resource centre including Flashcards, Multiple Choice Questions etc. as well as some hands-on Excel data analysis/tutorials. More useful links in relation to each chapter to external sites: weblinks by chapter. The book is also listed on Amazon, where you can search inside: Bryman’s Social Research Methods on Amazon.

DE VAUS, D. (5th ed.) (2002) Surveys in Social Research. Abingdon: Routledge.
de Vaus’s Surveys in Social Research on Amazon. This edition comes with a massive number of weblinks which de Vaus has listed on his site. Further de Vaus links, site set up by an OU student: who publishes under Ariadne and also some handy notes related to the OU’s DT840 study guide .

LEE, Carl et al. , Central Michigan University.
Tutorials and Movie Clips (based on SPSS 9.0 and 10.0) with transcripts

LEVESQUE, Raynald in Montreal, Canada SPSS tools

OPEN UNIVERSITY (OU)
OpenLearn SPSS is a step-by-step online tutorial which covers adding variables, obtaining descriptive statistics, correlation, independent t-tests, and paired samples t-tests.

ROWNTREE, D (1981) Statistics without Tears: An Introduction for Non-Mathematicians. London: Penguin Books.
a classic on Amazon, search inside.

SEALE, C. (ed.) (2004) Social Research Methods – A Reader. London: Routledge.

SOPER, Daniel offers a free calculator for multiple regression as well as a great overview of numerous concepts on his Free Statistics Calculators site which is an excellent online support source for last minute revision, pop-up windows will save you time.

TROCHIM, William M.K. Social Research Methods is another incredibly helpful site. Well structured and illustrated.

UNIVERSITY OF CALIFORNIA, Los Angeles (UCLA)
SPSS Version 15.0 Learning Module includes T-tests, Chi-square tests, correlation, ANOVA (Analysis of Variance) as well as a detailed, well-structured discussion and explanation of Regression among their SPSS Webbooks.

Add to FacebookAdd to NewsvineAdd to DiggAdd to Del.icio.usAdd to StumbleuponAdd to RedditAdd to BlinklistAdd to Ma.gnoliaAdd to TechnoratiAdd to Furl

Research Methods – DT840 and beyond, review of course books

As announced in my earlier post on Research Methods and Skills
I am providing here a brief review of the books which present the set books in my current post-graduate course on research skills and statistics, i.e. the Open University post-graduate course DT840 (DTZY840). The assessment (5 assignments and an exam) is based on the following materials:

LE VOI, M., Sapsford, R., Potter, S., Green, A., Redman, P. and Yates S. (2008) DT840 Course and Study Guide. Milton Keynes: The Open University

POTTER, S (2nd ed.) (2006) Doing Postgraduate Research. London: Sage.
This set book by Stephen Potter – OU Professor, specialist in transport strategies, and course team members – is available on Amazon. There is also a companion which contains related links and chapter excerpts: Potter companion on Sage which, unfortunately, appears to be neglected: 3 listed links out of 4, supposed to connect to ethical frameworks, turn out to be broken. Some of the course assessment is based on the online sources which you will need to find elsewhere. I have listed ethical guidelines in a separate box on the right hand within this blog.

SAPSFORD, R. (2nd ed.) (2007) Survey Research. London: Sage.
Also this one is available on Amazon, interested readers can: search inside. The reviews on Amazon are throughout very negative and the reviewers have gone into great detail with their substantiated critique. It’s helpful to read them and keep in mind the following problems with the material:

  • Lack of a glossary
  • Minimalist link list and Index
  • Key concepts such as triangulation not mentioned
  • Discusses online research settings only very briefly, insufficient
  • References to chapters/figures/boxes/tables rather than to pages
  • 1st edition had attracted equally negative reviews
  • 16 pages contain substantial errors: in formulae, explanations of concepts, tables are wrongly labelled etc. Luckily the OU provides a list of corrections, but it’s not comprehensive and you will need to constantly check and correct.
  • Carelessly compiled bibliography: referencing appears to follow random systems and lacks consistency (the OU prefers Harvard referencing style also in this course).
  • Unclear structure with a wordy approach

[N.B. To make matters worse: NO previous exams available – as common for the majority of courses on OUSA site, yet 1 exam specimen paper is delivered by OU.]
Here is a site which lists Sapsford’s content without providing any evaluation: Sapsford content, overview by OU student.

Add to FacebookAdd to NewsvineAdd to DiggAdd to Del.icio.usAdd to StumbleuponAdd to RedditAdd to BlinklistAdd to Ma.gnoliaAdd to TechnoratiAdd to Furl

VKS: Ethics in (e)research Workshop in Amsterdam, Part 2

It’s a fortnight ago I attended the Workshop and the analyses of ethical dilemmas in a range of different fields explored with colleagues gained another dimension during a conversation I had last week with a friend located in continental Europe – who’s neither related to research nor sociology or internet studies in the wider sense.

I notice that a universal notion of ethics, online collaboration, self/community, individual authorship and Creative Commons equals an assumption we all see the same sky, every day. We don’t. And this is not only due to geographical location, national politics and regulation, but also related to varying degrees and facets of collective unconsciousness. The kind of public debates I do have access to here in the UK by help of traditional media including print media differ considerably from German debates (so do US debates I access online). Different types of angst feed into such discourses on macro and micro levels. Only by seeking actively to push my personal boundaries and engaging in a challenge of my own ideas as well as questioning what is taken for granted by others, something of a more personalised value system, based on eclecticism has emerged. This is a mix of nationally framed legal regulations, enhanced by ethical guidelines compiled by academic and professional bodies, plus a range of personal, in part moral, beliefs.

The questions I have in mind are:

  1. Are others similarly aware of their values and beliefs and their origin?
  2. Are they subscribing to a notion of values in flux or rather static, life-long held beliefs when it comes to moral values and ethics, in particular in the globalised virtual sphere?
  3. Where does awareness and reflexivity come from if not formally acquired, and what role do social media play in this? Is it undermining, challenging or enhancing ‘everyday ethics’?

Clashes and opportunities are produced in social networks which offer discussions in forums and groups. Large and heterogeneous groups of individuals engage in debates and become exposed to ideas, behaviours and practices they are less likely to encounter in real life in such a speedy, diverse, and dynamic manner. I recalled my own experiences and reviewed my impressions, wondering whether research can be improved in its ethical quality if more consideration would be given to the following aspects:

  • Communication skills and awareness levels are culturally embedded, they are often taken for granted and subject to assumptions rather than being explicitly discussed and reflected upon – if researchers take a reflexive approach why not offering research participants the chance to engage in a collective exercise of reflexivity too?
  • The digital divide 2.0: social media super-users vs social media sceptics – are social media super-users ethically more aware as they are more likely to be exposed to a wider range of positive as well as ethically problematic behaviours?
  • How do adult research participants learn about ethical issues? Informal learning processes (which can be an incentive for research participants as well as researchers), crowdsourcing practices and non-target driven engagement in social network sites may result in a stronger sense of authorship and a willingness to challenge practices of production of authoritative knowledge in the researchers’ world. Yet, this may be rather an exception than the norm. Would researchers and societies benefit from a more pro-active approach on the part of researchers, for instance by including such debates into research projects and making them part of the data collection?
  • Not just Twitter but also Facebook is one such major site that potentially may help to increase attribution awareness. However, as attributing practices, for instance on Twitter, evolve rapidly but haven’t stabilised yet, we cannot assume users will adjust and adopt naturally the most ethically beneficial syntax at some point. Flickr for instance offers currently 4 explicit options under the Creative Commons Licence – plus the option to not licence images and videos but make them freely available for all purposes. The advise is provided in clear language and many users may develop an awareness for authorship and copyrights, however, others may not even bother about finding out the differences between options.

What is supposed to be right or how things should be done online differs widely, conventions are emerging and are being challenged on an ongoing basis. The amount of trust gained over time by help of familiarisation with Social Network Sites and Social Bookmarking Sites as well as expertise in online commenting, eloquence and online ‘street wisdom’ separates social media savvy users from those who rather stick to e-mail and the consultation of conventional websites. This distinction applies also to researchers and academics. Awareness-building and reflexivity as well as ethical considerations should accompany the entire research process, from drafting to publishing and beyond, when participants critique the findings and interpretations. The learning could and should be mutual, without fearing the researcher’s expertise and specialist position is under threat, although it might well be under scrutiny due to the increased level of transparency. That may well be a very optimistic stance, yet, a paradigm shift towards collaboration in a partner-like manner could be beneficial and much more sustainable on the long-term and it could help to educate where institutionalised learning fails to reach out.

The key discussion points and questions raised at the workshop have been posted by Anne Beaulieu at the Virtual Knowledge Studio as FAQs which underlines the fact that ethics in (e)research is not only ongoing and iterative but also a process rather than a stage at some point of a research which means, frequently asked questions may require new answers, each time we encounter the dilemma.

Add to FacebookAdd to NewsvineAdd to DiggAdd to Del.icio.usAdd to StumbleuponAdd to RedditAdd to BlinklistAdd to TwitterAdd to TechnoratiAdd to Furl

VKS: Ethics of (e)research Workshop in Amsterdam, Part 1

The Virtual Knowledge Studio in Amsterdam offered an Ethics of (e)research Workshop on
Monday 15 June, which brought together post-graduate/doctoral students and researchers from various fields and a range of cultural backgrounds.

Below are the ethical dilemmas I anticipate to encounter in due course of my future research project which will investigate Digital Technologies [as research tool and objects] in the context of informal cognitive processes embedded in online social interaction which have repercussions on real world settings and experiences.

Methodology: based on a triangulatory approach, it will include a self-completed online survey, auto-ethnographic work as well as semi-structured focus-group interviews and content analysis. Inevitably, in particular the auto-ethnographic work conducted in the blogosphere and online social networks entails a range of possible ethical conflicts which I fear an Ethics Committee may subject to a one-size-fits-all policy that won’t take into account the following particularities:

  1. Participant Consent –fully informed and voluntary (FIV) – in retrospective?
    Conversations and comments on blogs, tweets and retweets on Twitter and comments on Facebook status updates or semi-public debates via Facebook’s wall-to-wall feature: they cut across the public/private boundaries. Given that participants provide FIV consent, Ethics Committees should accept this as ethical research. However, danah boyd et al. have experienced considerable difficulties with retrospective consent in recent projects. Hence, a more ‘dynamic’ and contextualised/non-static model of ethical guidelines is still something we cannot take for granted when submitting our forms to the Ethics Committees.
  2. Public versus private, blurred boundaries and imagined risky/secure spaces
    Are Facebook status updates private, semi-public or public? If forwarded by applications that support Twitter boundaries become blurred and even participants may differ in their perceptions, resulting in different participants demanding different levels of privacy (at different stages in the research) – or, maybe also requesting to categorise rather private messages as public for they may want to be heard and gain higher ‘online status’ (for instance on QDOS which calculate your virtual footprint). Imposing privacy might indeed cause harm when participants do rather desire publicity.
  3. Confidentiality and Anonymity
    Are aspects closely related to point 2 above. Can we safely assume all participants desire anonymisation of their real name or pseudonym? How can I deal with texts/images and other media that evolve over time and contain various levels of confidentiality, for instance participant comments in 1:1 conversation (think Twitter DM [direct messaging], forwarded automatically to email, responded to by public tweet) and also in focus group follow-up interviews. I.e. naturalistic research in the first case vs. participatory research in the latter.
    Moreover: cultural differences, expectations and needs may vary across age groups, perhaps even gender, and depend on social class background/educational level. Ideally, we are giving a voice to the interviewee/participant and promoting a level of equality, i.e. avoiding misrepresentation, paternalistic attitude and harm by all means – yet, we need to understand that positions are highly contextual and depend on subjective needs of participants rather than universal model of research ethics. Have ethics committes already arrived at that point?
  4. Power and Equality
    Conducting research, collecting data and distributing findings may be greatly facilitated by online channels. The level of transparency can be high, and research participants may want to claim part-authorship for instance by using excerpts of the research report to be posted on their blog or website (or used in other media). A continued dialogue with participants, post-debriefing, may require further ethical decision-making beyond the levels common in other contexts. Again, not a one-size-fits-all ethical guideline but rather a case-by-case-based ethical decision making might be required. Will participants become involved in future amendments of ethical guidelines?

Finally, the participants’ levels of reflexivity and general awareness of research processes do seem to increase continuously while access to paths of personal and professional development of the researchers become ever more transparent and accessible. Will we need to learn to remind participants that they also need to behave ethically towards researchers? Are we progressing towards a more equal research-driven community and wider – globalised – society? Moreover, the researcher as the researched: my blog, my SNSs, my microblog, all the many profiles, traces left – can I expect research participants to act in an ethical manner in case they won’t agree with my findings (interpretations of findings, to be precise)?

Add to FacebookAdd to NewsvineAdd to DiggAdd to Del.icio.usAdd to StumbleuponAdd to RedditAdd to BlinklistAdd to TwitterAdd to TechnoratiAdd to Furl

Researching Trust: Jordan McCarthy’s questionnaire

Over the past 12 months or so I have been keeping an eye on online surveys, questionnaire styles and data collection methods in more general. I found requests to complete online surveys in social networking sites such as Xing and Facebook as well as on daily lists issued by associations I am a member of and followed all of them, curious to learn and gain a sense of what constitutes good practice from the participant’s perspective.

80% of the surveys I attempted to fill in I abonded within a few minutes – more often than not I found the questions asked were designed to an annoying degree to provide the researching individual with neatly packaged data rather than aiming at an understanding of my meaning-making processes and practices or patterns of consumption. A number of online surveys were so heavily shaped by cultural centrism (the US-centric, the German-centric view etc) that I wondered why these researchers even bothered posting on sites where audiences/potential participants were obviously drawn from a wider cross-cultural background.

I found it amazing how restrictively surveys can be structured and how little information in some cases is provided as to the wider picture, the distribution, the funding (and implied interest parties) and the aims and objective of the project.

  • Where is the data I provide going to end up?
  • Where and when will I be able to obtain a copy of the results?
  • What happens with the data once I decide to drop out in the midst of the session?

Some researchers did not seem to have ever heard of the use of vignettes (i.e. a brief illustrating description or a mini-narrative) nor did they convey a sense of understanding the power/inequality issues involved in research.

Those surveys developed with the particpant’s well-being in mind – ethical issues should constitute a considerable part of postgraduate studies but don’t seem to inform survey designs as much as one might anticipate – manage to convey a sense of trust and respect that is vital, I think. In this regard, I found Jordan McCarthy’s survey a pleasant surprise and rather exceptional. The questionnaire is well-crafted, the style of asking helps to develop a sense of trust, mainly because Jordan has chosen a very thoughtful way and a fair amount of open-ended questions that gave me a sense of being listened to.

Many researchers use such comments provided in textfields as quotable material, which means they actually give a voice to the participants if they use such quotes in a responsible and meaningfull manner (a few years ago a German researcher ripped many of my quotes out of context and imposed her -wrong- interpretations on them – the experience left me with a strong sense of powerlessness – and what damage poorly conducted research can do to participants/interlocutors)Jordan McCarthy is a student at Standford University who is doing

“a bit of research on how our conceptions and practices of trust may be changing as we adapt to various online environments”

The full announcement with contact details is available on the AoIR server
And on a final, more practical note, I can confirm that the announced 10-20 minutes duration of participation were perfectly sufficient.  The self-completion online survey can be found here: on Surveymonkey

You can subscribe to my site’s updates using this link to my RSS feed

Add to FacebookAdd to NewsvineAdd to DiggAdd to Del.icio.usAdd to StumbleuponAdd to RedditAdd to BlinklistAdd to TwitterAdd to TechnoratiAdd to Furl

%d bloggers like this: