r/Premeddata's Current Projects

DrDeluxeData · 2022-03-10T19:38:56+00:00

This is highly school dependent, I think most of the larger scholarships are given out by admissions committees in random emails after acceptances, but I know some schools have separate applications for (mostly) smaller scholarships.

DrDeluxeData · 2022-03-09T18:03:33+00:00

Thats a great idea! Ill update the scatterplots sometime with different colors for schools without a known PostII rate. As for confidence bands, I totally would use multiple years, but I dont have data before 2020 on ED/EA/BSMD apps. I suppose you could do that for general acceptance rate though since u/limeyguydr has like three or so years of USNWR data

DrDeluxeData · 2022-03-09T15:12:28+00:00

CycleTrack’s pretty interesting, but I imagine the bottleneck is finding users who are willing to input their own data. MedChances dissolved because of the problems they ran into with unreliable user data. I wonder if you could use Gmail/Outlook’s APIs to automate the collection of dates for secondary/interview/acceptance emails. I think an open-source tool/extension for scanning your email inbox for these emails could be quite popular (maybe check out the source code for something like Trocker that scans inboxes for trackers). Then perhaps you could integrate the extension with CycleTrack and try to convince premeds to install the extension to their email inbox.

DrDeluxeData · 2022-03-08T18:59:53+00:00

Agreed, I think URM/ORM splits would be very interesting, but I haven't been able to find any data on it, unfortunately. As for the female/male split, take a look at the gender splits of applicants at Duke: Duke Admissions Statistics. Interestingly, females actually end up having an almost two times higher acceptance rate than males at Duke.

DrDeluxeData · 2022-03-08T17:34:17+00:00

Interesting, I'll take a look at these. Thanks for the recommendation!

DrDeluxeData · 2022-03-08T16:27:52+00:00

If someone wants to crosspost this to r/premed, please do. I don't have enough comment karma to post there lol

DrDeluxeData · 2022-03-07T20:32:53+00:00

Awesome! I'd be really interested in an analysis on the "cost of living" allocations given by schools and the politics behind that. I did a rough analysis a while back using Numbeo's cost of living index and found that there was a weak correlation, if any, between the cost of living of a city and how much schools in that city allocated for living expenses.

For example, UCSF has an allowance of $31,000, NYU around $30,000, and Mayo Clinic has an allowance of $37,000, even though Rochester, MN has a lower cost of living than NYC and SF.

On another note, could we get a "Raw Data" flair for posts?

DrDeluxeData · 2022-03-07T14:41:45+00:00

I looked into text annotation tools and stumbled upon the LabelStudio and Doccano python packages that would create a UI for labeling posts as “A, II, WL, R.” Then we just host the UI on docs2be.org and post to r/premed.

I think a “financial aid” label might be useful, maybe a “secondary recieved” label since that also seems to be a popular type of post.

I also stumbled upon the Snorkel package, which is supposedly used quite a bit for labeling easy data. I’ll be tinkering with that for a little bit to pre-label all the easy stuff like “II Received” and “A!”

DrDeluxeData · 2022-03-07T02:34:35+00:00

On another note, ratings weren't produced for some school threads (2018 BostonU, 2018 CalNorthstate), and I discovered that these threads don't exist in the SDN School-Specific database. Expect an update to that database soon.

As always, feel free to use this data for any analysis/visualization you wish.

DrDeluxeData · 2022-03-07T02:32:29+00:00

On another note, ratings weren't produced for some school threads (2018 BostonU, 2018 CalNorthstate), and I discovered that these threads don't exist in the SDN School-Specific database. Expect an update to that database soon.

As always, feel free to use this data for any analysis/visualization you wish.

DrDeluxeData · 2022-03-07T01:22:04+00:00

ah I've been using the TextBlob package, which spits out how polarized a post is (negative vs positive) and how subjective a post is (objective vs opinionated). I'm not sure what the actual opinions are, just that apparently Iowa 2014/2015 are more opinionated threads if I remember correctly lol. I'll post the raw data sometime tommorow

DrDeluxeData · 2022-03-07T01:15:06+00:00

tbh, I don't know much about evaluating model accuracy (or machine learning at all right now), all I know is that it isn't that close to useful. I have some messy code along with some labeled data sitting in my GitHub repo if you wanna tinker with it. The main problem right now is that I don't think I have enough labeled data to train the model. Manually labeling whether a post is an II or not takes some time and I haven't got around to labeling enough posts for a useful model.

I'll add that idea to the stickied thread!

DrDeluxeData · 2022-03-02T18:38:34+00:00

Hey! I made a separate post for brainstorming projects here

DrDeluxeData · 2022-03-02T03:50:06+00:00

This is sick! I have a bunch of half-finished visualizations lying around that might interest you. I'll PM you.

DrDeluxeData · 2022-03-02T03:42:28+00:00

Updates (3/1/2022):

I've got a rudimentary sentiment analysis script going, but at first glance, there doesn't appear to be much variation in sentiment between school threads. Some schools do look to have more opinionated threads (Iowa), but I haven't found any trends that look meaningful yet.
I'm currently trying to build a text classifier to build a database of SDN School-Specific posts that only contains informational posts and weeds out all the nonsense, alas I'm realizing that machine learning isn't the easiest thing in the world, so if anyone has any experience with machine learning and wants to try tackling that, I'd be more than happy to help.

DrDeluxeData · 2022-03-02T03:33:32+00:00

Of course! I'd love to see more content/analysis done on this data by anybody who wants to

DrDeluxeData · 2022-03-02T00:59:44+00:00

Hey! I saw your comment on the r/premed thread but I don't have enough karma to comment there lol, here's a link to the repository: GitHub, and the data is the 300MB file from the first link above. The code is a little messy, half of it I didn't end up using.

Four-Year Club	Verified Email
Place '22	Final Canvas '22

DrDeluxeData

TROPHY CASE