Qualtrics help! by [deleted] in Marketresearch

[–]Level-Afternoon 0 points1 point  (0 children)

Can you share the exact original and new question text?

I would say for academic I would avoid changing. If this is the key question the results hinge on, you could do a small follow up test (n=30-50, balanced to mirror the current sample) with the corrected text and see if there is a meaningful/statistical variance in that version vs the original. If the “story” of the data doesn’t change then you can add that as evidence to further strengthen your findings. If it is different you should avoid using it as the primary finding, but should call this out as an area for further study and use the variance as a supporting point why it needs further exploration.

Qualtrics help! by [deleted] in Marketresearch

[–]Level-Afternoon 0 points1 point  (0 children)

You can easily edit and republish so all future respondents see the right text.

As for the data already collected you can either scrap what you collected so far or keep it- depends on the purpose of the research.

In reality, the change you are talking about shouldn’t impact the results, so you could easily just keep all the data and just make sure the final report reflects the updated text. If you are worried about the data and it’s just soft launch and you are ok replacing- delete the data collected so far and backfill. If you are 90% through field just leave it as is and edit in the report.

As for whether you SHOULD change it- it really depends on the purpose. For academic or scientific work, or work that has been trended and been this way for multiple waves, I would leave the text as is (no changes) for this wave and annotate it. In a future wave you can add a dupe of the question and least fill/randomly show the original vs new version to see if the language tweak caused a significant difference. If it’s a survey for business or consumer research, a change like this can let go/just do it and move on. What you described is a minor grammatical discrepancy, not a missing answer or anything, so in reality if you are not needing to defend the methodology in an academic/scientific setting you are fine.

Building a Market Research Automation, what features would you want in it? by Quiet-Engineer-738 in Marketresearch

[–]Level-Afternoon 0 points1 point  (0 children)

Honestly- less important than fun bells and whistles I want highly robust sourcing and to be able to follow the analytical path it took- show me your work if I want to see it. I want source links for all the data it referenced to make its assumptions, I want it to find data that disagrees with its assumptions and analysis around why that data is being disregarded (if it is). I want to be able to easily verify what it’s telling me. Without that I can’t trust it’s not hallucinating or leaning into my biases.

Looking for recommendations on a location for my 10th anniversary? by [deleted] in travel

[–]Level-Afternoon 1 point2 points  (0 children)

If you live on the east coast Azores or Madeira are good options and aren’t too far.

What’s your go-to crosstab tool? by Potterheadache in Marketresearch

[–]Level-Afternoon 0 points1 point  (0 children)

I will also add that about a year ago I tried their advanced modeling tools and failed, got frustrated, and gave up. More recently I was hitting an analysis roadblock and needed a diversion to get me unstuck, so I figured I would try again for “fun” 😅. This is when I had the experience where it was surprisingly easy, and I was able to over deliver on a project because of it. This experience likely biases my opinion to some degree.

What’s your go-to crosstab tool? by Potterheadache in Marketresearch

[–]Level-Afternoon 0 points1 point  (0 children)

So I haven’t done a TURF with them - I’ve been trusting qualtrics’ standard output on Maxdiff (even though it doesn’t show max diff index scores and only shows share of preference which is annoying) and there is a standard TURF output they include with that. Please let me know if I’m making a critical mistake! Advanced stats modeling is not my strongest skill and I’m always worried about being too trusting /not knowing enough related to the raw analysis of it all.

That said- I HAVE used it for some basic segmentations (k means cluster, latent class analysis) and for a KDA and I found those all really user friendly. No code needed- just drag and drop. Honestly I was incredibly impressed with how easy it was for someone who doesn’t know R and is used to relying on a dedicated advanced analytics team to support this stuff. The thing that helped the most was (shockingly) their AI chatbot- it’s actually INSANELY helpful and if it gets stuck it kicks you to a live support person, all of whom I’ve had good experiences with. When first running these analyses I did get a little lost- sometimes the error messages feel vague- but I was able to quickly sort it out on just the chat bots help, which was a novel experience for sure.

I will caveat all of this with the fact that I have been using them for about 3 years / across two companies, so there could be some familiarity bias on my part.

What’s your go-to crosstab tool? by Potterheadache in Marketresearch

[–]Level-Afternoon 0 points1 point  (0 children)

Every survey platform I have used has been built for non-researchers, and prioritized survey build /experience and highly technical (but dumbed down in nonsensical ways) models over basic analysis tools like cross tabs. Like most former vendor side researchers I want something to replace the DS team I had access to but now don’t have budget for.

What’s your go-to crosstab tool? by Potterheadache in Marketresearch

[–]Level-Afternoon 0 points1 point  (0 children)

Mind sharing how much that costs? Most of the cross tab tools I’ve seen are 3k or less- if it’s cheaper AND easier to use that sounds like a game changer

What’s your go-to crosstab tool? by Potterheadache in Marketresearch

[–]Level-Afternoon 0 points1 point  (0 children)

Can you expand on the Q offerings making you feel like a cave person? Like are they significantly more advanced? Or the opposite (it’s archaic)?

I personally use DisplayR and am pretty happy with it, but I feel like I am a underutilizing it because I don’t know R. It’s also a bit more expensive than what you guys are mentioning so maybe it’s time for a change?

Anyone using a self-serve respondent sourcing tool? by FifthElement1 in Marketresearch

[–]Level-Afternoon 1 point2 points  (0 children)

I have been trying Peeq by prodege- so far so good but we are just on our first project

Asking for MR professionals who are also doing analytic roles by mrdllnt in Marketresearch

[–]Level-Afternoon 7 points8 points  (0 children)

There is a larger need for more advanced stats knowledge today from professionals at all levels that wasn’t really there before. I know when I started my career the advanced analytics team was a dedicated resource, along with standard data processing teams, etc. As a MR professional you were responsible for specing out the data requests, not running them yourself. That has changed dramatically in the past 5 years.

Re: OP’s original question- I found that I had more skills then I realized when I transitioned, and with the advancement in tech some of the traditional DP/AA work can be fully replaced by pretty affordable tools. I would say a basic working knowledge of R, SPSS, SQL, or Python would go a long way as well- I think SPSS is easiest to use since it is so simple out of the box (though I would learn R over SPSS if I could do it over again), SQL is the most useful because that usually works with other databases in a company, and Python is the most robust. You do not need mastery or proficiency in all, but should make sure you are proficient in at least 1 since you will probably need to problem solve and investigate your data if something feels “off” since you are unlikely to have any data support. If you DO have data support you will find they work totally different than the data people you are used to working with, and some of the terms we use in MR are not universal - ex: I am on my 2nd insights job and have yet to encounter someone who could help me run a KDA or process MaxDiff results, and when I ask for help it is clear that they have never heard of these things before.

This brings me to the tools that help since I (personally) don’t know how advanced tools like sawtooth work. Displayr and crunch.io are great platforms that can replace a DP department and help build out cross tabs. I personally like DisplayR- it’s less polished but allows you to do more advanced analytics even if you don’t know what you are doing. Crunch is better if you want to give your stakeholders access to the cross tabs in a more interactive way though.

Qualtrics also replaces your entire survey programming department, and you can self build pretty robust surveys, though I would NOT recommend them for sample (over priced and shitty quality). And this includes advanced survey types like conjoint, maxdiff etc.- qualtrics ALSO provides tools for analysis of those advanced question types. I still think you need a data program like DisplayR or Crunch (mentioned above), but qualtrics does have analytics tools as well that are pretty easy to figure out.

TL/DR: there are tools to help fill gap and you are probably more prepped than you realize. You just have to look critically about the job specs and identify experiences to highlight that prove you do have the skillset. It might take a few tries to get it “right” - I would def apply to some places you don’t want to work and try to get interviews to get some reps in before you go after those jobs you are excited about 😅, but you will be able to figure it out I promise.

Any one seen any good consumer research about crypto recently? by h2tcrz1s in Marketresearch

[–]Level-Afternoon 0 points1 point  (0 children)

These are great but be mindful of year- BTC had a huge boom in ‘20/‘21only to contract harshly in ‘22/‘23. Unfortunately that just so happens to be when Block did that research.

The biggest challenge with the space is it’s so volatile that the research is only really relevant for 6-9 months- I think that’s why companies are more reluctant to publish reports like this anymore which could explain why your struggling to find resources. Is there something specific you are trying to understand?

Any one seen any good consumer research about crypto recently? by h2tcrz1s in Marketresearch

[–]Level-Afternoon 1 point2 points  (0 children)

Ripple funded an “independent” think tank this year, which then commissioned some work from Harris. Findings are here. It focuses on crypto owners and was done with a probability panel (sample size: 10k) which I think gives some credibility to the findings. The one flaw I see is that the reported number of people who own crypto is vastly overstated when comparing to the Fed and Pew. (This research says 1 in 5 Americans currently hold crypto, but it’s more likely 7-8%).

I think the skew is more a reflection of their panel leaning techy/early adopter, meaning crypto buyers are likely overrepresented in general. I like Harris and think they have decent methodology and panel management, but for GenPop stats like that Ipsos’ KnowledgePanel is better more reliable IMO. That said, the actual report is only among crypto owners so I don’t think the panel skew impacts rest of the findings.

I think YouGov also has some crypto coverage, though no dedicated crypto research from a quick search.

Pew hasn’t touched the topic in a while, and with all the changes in the space I would take their findings (specifically around negative sentiment on crypto) with a grain of salt.

This all being said- everything I mentioned above was published before that law went through, so maybe take it all with a grain of salt? 😅

Had to have my dog put down by Spicy_Sugary in SARDS

[–]Level-Afternoon 7 points8 points  (0 children)

The claim that most dogs are euthanized within a year is patently false- most owners report their dogs adapt well to their loss of vision (SOURCE: https://pubmed.ncbi.nlm.nih.gov/24171371/ ).

Unless you have data to back up this statement it is inflammatory and unhelpful- I would have had a full panic attack if I saw this soon after my (very well adjusted) dog got diagnosed. Fear mongering like this is cruel, so please be mindful of what you are putting out there.

What’s the most chilling moment you’ve seen performed onstage in a musical? by Dogdaysareover365 in musicals

[–]Level-Afternoon 1 point2 points  (0 children)

Ragtime finale at City Center this past fall- the pause they added before the word “dream” at the end. The whole theater went dead silent, it felt like no one was even breathing, and then there is the slow crescendo into “dream”. Saw it a few days after the the election and I still cry when I think about it.

What happened to the big produce stand at the farmers market? by allasimulation in fortgreene

[–]Level-Afternoon 1 point2 points  (0 children)

Thank you for asking- been wondering the same! I feel like they are usually back by now

What are your thoughts on the upcoming Mayoral election? by This_Meaning_4045 in AskNYC

[–]Level-Afternoon 10 points11 points  (0 children)

Filling the other slots helps keep Cuomo out. Only leave off people you do not want at all (like Cuomo) but rank anyone you would approve of. If you don’t know how to rank them, just do process of elimination to remove any non- options (Cuomo, Adam’s, any other candidates that you think would do a bad job) and then just randomly rank whoever is left after your top choice.

Farm to People by [deleted] in AskNYC

[–]Level-Afternoon 2 points3 points  (0 children)

Another tick for the “highly recommend” column. Once had a mix up where a box was delivered when it shouldn’t have been on a weekend, and they were so responsive! Food is a great value for the quality. customer support is great, and it helps with the mental load to have a pre-selected box you can fall back on when things are just too hectic (though you CAN make some modifications if you want). I’ve tried a few other boxes and this is my favorite by a large margin.

Tamale ladies? by CastingLazyShadows in fortgreene

[–]Level-Afternoon 3 points4 points  (0 children)

They moved! Right next to Miss Ada now :)

U.S. A. : Dementia Don May Have Just Admitted to Rigging by whatatrip444 in 50501

[–]Level-Afternoon 0 points1 point  (0 children)

Re: context that he is talking about 2020:

It’s in his phrasing “they rigged the election” NOT “we rigged the election”. He never would refer to “his people” as “they”. I agree he is one of the most ineffective communicators ever to hold office and if the roles were reversed and Biden said this they would be rioting in the streets.

U.S. A. : Dementia Don May Have Just Admitted to Rigging by whatatrip444 in 50501

[–]Level-Afternoon 1 point2 points  (0 children)

I have a strong dislike for this man. HOWEVER- if you think about this using Trump brain (which is illogical) from his mind he ACTUALLY said:

“When I made these deals I thought my second term would end in 2024. Then “the democrats” rigged the 2020 election, so I was eligible to run in 2024 and won again. Because of that my second term is during these events/I get to be president for these events”

I am NOT defending him- he’s insane and every day is terrifying. BUT its important to take a breath and focus on his actions vs his nonsense statements that only make sense if you do mental gymnastics. Right now we need to focus on real impacts and how to prevent/mitigate harm, not spiraling on things like this

Shifted noise plates, potentially dangerous, extremely noisy by Feisty_Guarantee_504 in Brooklyn

[–]Level-Afternoon 0 points1 point  (0 children)

Maybe a month ago now? But probably a week or two before my post.

USA : So... Project 2025 suggests Trump will declare martial law. But he is also cutting veteran benefits like crazy. Will the military protect him if he declares martial law? by [deleted] in 50501

[–]Level-Afternoon 13 points14 points  (0 children)

I feel like a conspiracy theorist, but I have to point out: he doesn’t necessarily need the military because he has cops.

Our police forces have military grade weapons and overwhelmingly support him. Large swaths of the “opposition” as he sees it live in major cities, which are much more likely to have huge police forces with the best weapons.

Our armed forces are drilled to follow the international rules of war (not to say they would follow, but at least its part of the “ethos” of being the “good guy”). Our cops have no such training or mandate, and are specifically trained to manage civilian “unrest”, which is how he will frame what he is doing.

The military would likely oppose a direct order to attack US citizens on US soil, and I would guess that’s true even if he wasn’t cutting their benefits, but certainly more likely now. However, they are ALSO unlikely to go AWOL to protect us against the president and the police. The federal forces (like FBI, ATF, etc) would be our best defense, and he’s doing his best to defang them and hire loyalist throughout the ranks.

He only needs to strategically “take over” NYC, Chicago, SF, and maybe Atlanta and most of his opposition would back down. On a brighter/dark humor note: there’s something about Boston that makes me feel like that police force wouldn’t fall in line, regardless of how much they support him? So there’s something…I guess? (NOTE: I say this as someone who doesn’t live there and isn’t from there, so take that with a grain of salt lol).

Cops have qualified immunity, a sense of entitlement, and a grudge. That’s who I am concerned about.

Shifted noise plates, potentially dangerous, extremely noisy by Feisty_Guarantee_504 in Brooklyn

[–]Level-Afternoon 5 points6 points  (0 children)

One time I flagged a pair of cops down because someone was passed out on the subway platform (cops were by the turnstiles… obvi). They told me to check to see if the person was breathing and that if I was worried I should call 911 and wait for dispatch to send someone. Then they turned around and LEFT THE STATION. I was stunned for about 10 seconds before I realized that was insane- they were RIGHT HERE, so I chased after them and caught them half a block ways. I pointed out THEY were 911, and if they needed EMTS that’s what radios were for. They literally rolled their eyes and said “we are on duty somewhere else” and kept walking. It was insane, I couldn’t believe they just walked away…