tisdag 11 oktober 2016

Theme 5 Post 2

I feel like I now have a clearer grasp on what empirical data is. It’s data which has been acquired directly through someone’s observations and experiences. It’s not just any data which has been previously collected. However, this got me thinking about what the opposite of empirical data is. Unfortunately I didn’t get to discuss this during the seminar but I spent some time thinking about it. Opposites to empirical data would then be speculations, hypotheses and basically anything which is unobserved and just analytically thought out. Since empirical data has once been observed it’s also possible to verify the data.

Design work is in itself knowledge contributing. One main thing that should be stressed is that this is almost the purpose of doing research through design. Design work is explorative. It can start out from common design principles but they can change along the way since the purpose is mainly to gain insight into the field where the research is taking place. The iterative nature of design work facilitates this since changes can be made according to observations made in the study. It’s quite a flexible approach as it can be tweaked during the study and not everything has to be thought out before beginning. Instead of having a lot of research questions in the onset of the study, the questions may emerge as it proceeds. Future research topics could actually be revealed as the result of design work. I think that the most important take away from this is that the intentions of design work is different from other research. In design work the intention is to gain insight while doing, and in other research the insight comes as the final results. I do also think that in design it’s not necessary to explain all observations or design choices. It provides a lot of freedom to try stuff out and see if they work. Basically it’s a bit like learning by doing.

I wasn’t exactly sure what was meant about whether design work was ever replicable. In some sense it is. You could use the exact same technology, given that it’s still available. And then from a technical point of view wouldn’t this mean that the study is constructed in the same way? Probably, but a thing that has changed is the setting and the context in which the study is conducted. This could lead to unwanted results even though the study was very much the same. So it’s not only a matter of what technology is used but it’s also about the context of use. One could also think of replication as the methodology of a study being used again. The study could still be a replicate even though the technology has been renewed but the core methodology and structure remains the same (like the sequel to the tangible programming paper). Another thing which I would argue is even more important to discuss than the replicability is if it’s really meaningful to do so. Surely this depends on a lot of factors but I would argue that in many cases, especially in the softer sciences it’s not worth replicating older studies, mainly because the social context has been significantly changed. In general, harder sciences are more meaningful to replicate because they are less dependent on the social environment in which they’re performed. Social life contexts incorporates many complex variables which will influence the scientific results.

10 kommentarer:

  1. I don't think you can say there is an opposite to empirical data. Maybe a simple way of thinking about it is as the core of research. In design research, as you highlight very neatly, the process is much less structured than in other types of research which means sometimes you insert the empirical data in the results section and sometimes in other parts of the paper (as Ylva mentioned, in their paper it was different).

    When you mention social vs hard sciences, I question whether or not you mean this specifically within design research? Because it you'd compare for example math in a quantitative research study with the study Ylva did with the children, then I get your point. But if you would take math into a design research perspective, I don't see why this would be more or less replicable as a rule.

    SvaraRadera
  2. I must disagree with you about the empirical data. As far as I understood, it also includes the data from the pre-study, in case with the "Driving rage" paper it also contained the comments and opinions from the Internet.

    Replicability is used not only to repeat the study using the same conditions to get the different output. It is also the question of verification of the researches: once it can be reproduced, its reliability may be confirmed. Have a look at the video in the article, it explains a lot about the importance of replicability: http://www.nature.com/news/1-500-scientists-lift-the-lid-on-reproducibility-1.19970?WT.mc_id=SFB_NNEWS_1508_RHBox

    SvaraRadera
  3. Hi! Well written reflection I really enjoyed reading it!
    To elaborate on the necessity of explaining the observation, I think that in the case of design research it’s actually significant to explain this, as it is part of the process and the process is a very important part in design research. But this isn’t always done in detail as the process is long and messy.
    About the replication, I do think that it is important that a study can be replicated, because this places more faith in the validity of the findings. This is important for both the study as for the researcher.

    SvaraRadera
  4. Hi,
    Interesting reflection. You mention in the beginning that empirical data is (among other things) based on observation, and that 's what makes it verifiable, I wouldn't necessarily agree on that. An observation is always is very reliant on the researchers perception, and therefore, it can be taken for granted that data from observations are fully true. I'd say they need back-up from another source to be verifiable.

    SvaraRadera
  5. Yop,
    You are making a valid point as starter. What would be the opposite of empirical data, since those are based on observation and verifiable, what would be logic as you mentioned is that they are speculation whose cannot be verified, hello god.

    later on you mention that not everything need to be thought of, I disagree a bit on that since this is the principal source of problem of a researcher is to know that he has thought about everything. Even if along the ways he learns new things, he cannot just ignore some facts just because he is most likely gonna learn more while researching it. Therefore, being able to explain all those steps he took makes it even more important for him to think about everything.

    But very nice reflection it sounds like you wider your knowledge on that subject ! Thanks

    SvaraRadera
  6. Really good reflection. Your starter with the question what the opposite of empirical data is, is really interesting. Maybe it’s a little bit hard to define, since empirical data can have so many forms, so maybe the question could be: What is not empirical data or what is empirical data not? I’m not sure if I’d agree with all the examples that you made, since hypotheses are not just thought out, but mostly base on empirical data (at least in qualitative research). But it’s really interesting to think about!
    Further I like your description of the replication of a research as a sequel to the previous and replicated investigation. This gives it the value it deserves as an addition to previously gained knowledge.
    Thank you for your nice thoughts.

    SvaraRadera
  7. Den här kommentaren har tagits bort av skribenten.

    SvaraRadera
    Svar
    1. Hi, thanks for the interesting reflection! To elaborate on your thoughts on the opposite of the empirical data, I personally believe empirical evidence is a provable fact that shows unquestionable results. It is also the observable proof that knowledge was gained by data, rather than hypothesis, or conjecture.

      On the other hand, the opposite of empirical are indeed more like hypothetical, impractical, speculative, theoretical, unobserved data to collect. Anecdotal evidence is evidence that is usually a generalization or is not able to be proven.

      Radera
  8. Hello! Thanks for sharing you thoughts.

    I disagree with you; data can also be previous findings that you investigate. I agree with you that the produced knowledge throughout the explorative processes is the main objective with a design research. Replications is about replicating other studies findings, which I think is important in design research even if its not the cornerstone and does not have the same value as in more traditional disciplines. In your post 1 for theme 5, you wrote that research project have different purpose than commercial products, I total agree with that. Research is about knowledge production, and creating reusable knowledge commercial product is much more driven by money. Well done with your post.

    SvaraRadera
  9. Hi! Thanks for a great reflection! Before seminar I was quite sure that design work cannot be in itself knowledge contributing. However, after the lecture and seminar I realized as you say "One main thing that should be stressed is that this is almost the purpose of doing research through design" - which means that design in itself draws and shapes the form of the research which in that sense makes a great contribution to knowledge. Moreover, I agree to your thoughts that research is replicable. However, replicable not in the sense that someone does the same research, but using same methods, same tools, etc.

    SvaraRadera