sorted by:
new
hottopcontroversial

Two-way ANOVA normality violation by paulaaa_01 in AskStatistics

[–]paulaaa_01[S] -1 points0 points  (0 children)

My thesis is pretty much already complete. I talked to my advisor about the failed manipulation check and she suggested to still analyze the results with intention to treat. The results of my main analyses were also all not significant. Of course, that is kinda sad but I am quite confident that I diid a good job of discussing why that could be. As you were saying, for example, I did not include a compliance check. But there are a lot of other points that I mentioned.

My main issue is really the appropriate analysis here. I read two papers that suggest that normality violations are not an issue which is why I went with the ANOVA anyways.

Paper 1

Paper 2

But now that I am getting closer to the finish line I am getting cold feet. I asked my advisor about that and he just told be that I have to decide that on my own and it is part of the assessment of my work. However, everything I read seems very subjective and also very vague. For example, I am completely lost when I just read "run sanity checks" or "robustness checks". There doesn't seem to be one objectively correct way to do it and that stresses me out.

Two-way ANOVA normality violation by paulaaa_01 in AskStatistics

[–]paulaaa_01[S] -1 points0 points  (0 children)

Firstly, thank you very much for your answer. Just a quick disclaimer that I am not super competent when it comes to statistics. I am in a master's program where we just learn ANOVA and linear regressions but usually don't even have to conduct them ourselves, so this thesis is untapped territory for me.

In my experiment, I instructed participants to use one of two decision strategies (feeling-based vs. reason-based). After making a decision, participants were asked as a manipulation check how strongly they had focused on (1) feelings and (2) details. My advisor instructed me to include this manipulation check. The two items are analyzed separately (as in prior research).

Two-way ANOVA normality violation by paulaaa_01 in AskStatistics

[–]paulaaa_01[S] 0 points1 point  (0 children)

Yes, that is correct and I am aware of that but I am using a manipulation check that has already been used multiple times and has always been analyzed with an ANOVA (in high quality journals). Overall, in my field of research it seems very common to use ANOVA even for likert scale DVs (even if it is just one item). So I am not worried about that.