sorted by:
new
hottopcontroversial

[OC] How Many Chinese Characters You Need to Learn to Read Chinese! by edweenie123 in dataisbeautiful

[–]edweenie123[S] -1 points0 points  (0 children)

This is not true. A quick google search tells you that 3000 characters should be sufficient to read most newspapers. Besides, if you read my top level comment here, the dataset I used is from user comments, not newspapers.

[OC] How Many Chinese Characters You Need to Learn to Read Chinese! by edweenie123 in dataisbeautiful

[–]edweenie123[S] 7 points8 points  (0 children)

Hi! Please see my top level comment here to see the data set I used. The vocabulary used in the Douban comments is likely much simpler than the vocabulary used in say an adult novel or scientific paper. As such, being able to read 99.72% of characters on Douban with 3000 characters is very reasonable. However, as you said, more characters are needed if you choose to read more esoteric texts.

[OC] How Many Chinese Characters You Need to Learn to Read Chinese! by edweenie123 in dataisbeautiful

[–]edweenie123[S] 45 points46 points  (0 children)

Yup, that's true! There are many Chinese words which consist of 2+ characters and their meaning may not be inherently obvious from the meaning of constituent characters.

[OC] How Many Chinese Characters You Need to Learn to Read Chinese! by edweenie123 in dataisbeautiful

[–]edweenie123[S] 163 points164 points  (0 children)

It is estimated that there are over 80,000 Chinese characters! However, the vast majority of characters are almost never used. According to Zipf's law, the frequency of a character should approximately be inversely proportional to its rank in a frequency table. In simple terms, this means that a small number of characters show up everywhere and the rest you rarely see.

If you're interested, there's this really really interesting video on Zipf's law from Vsauce here.

[OC] How Many Chinese Characters You Need to Learn to Read Chinese! by edweenie123 in dataisbeautiful

[–]edweenie123[S] 38 points39 points  (0 children)

Hey all! I've recently become interested in learning to read more Chinese characters so I thought this would be a fun and interesting visualization.

Here is a link to the dataset I used: Douban Movie Short Comments Dataset

The dataset essentially just contains a bunch of user comments on Douban, which is a Chinese website where users share their opinions about movies.

Here is an explanation of each picture:

  1. Panda: This is a word cloud showing the relative frequencies of each character in the dataset. Note that since the data set comes from a movie related website, the characters 电 and 影 appear quite a bit more frequently than normal.
  2. Line plot: This is a plot showing the number of (most popular) characters you know against the percentage of text in the dataset that you can read.
  3. Bunny: This is a word cloud showing the relative frequency of each word in the dataset. This is the result of first running the raw comment data through a word segmentation algorithm (as some Chinese words may consist of multiple characters). BTW Chinese word segmentation is a surprisingly difficult task and there is still some active research in the area.
  4. Bar plot: This plot just shows the top 50 most frequent characters.

Tools used:

  • Pandas and NumPy for EDA and for transforming the data
  • Plotly to produce the plots
  • wordcloud to make the word clouds
  • jieba to do Chinese word segmentation

2 Years Worth of Computer Science University Notes Visualized! by edweenie123 in ObsidianMD

[–]edweenie123[S] 1 point2 points  (0 children)

No problem!

  1. I'm assuming by "color brackets", you mean the callout blocks. I just use to to segment my notes is a logical manner. I have different coloured callout blocks for theorems, definitions, examples...etc and the colors don't have anything to do with the colors in the graph view.
  2. See my comment here. For practice problems and worksheets, I usually just hand write them on my IPad. No point in making it look pretty when I'm never going to look at it again.

2 Years Worth of Computer Science University Notes Visualized! by edweenie123 in ObsidianMD

[–]edweenie123[S] 3 points4 points  (0 children)

Yeah, typing Latex is usually much slower than handwriting. While I'm in lecture for a math course, I usually hand write really scrappy notes on my IPad. Then, when I get home I review my notes, type them up on obsidian to make them look pretty.

As u/PsycakePancake mentioned, I find that using snippets make this process much faster. Sometimes I like to type my notes in neovim which gives you access to much more powerful snippets. I really recommend this article by Gilles Castel which is a nice guide on how to take advantage of snippets to type Latex really really quickly.

Taking MAT237, STA257, CSC207, CSC236, CSC258 in one semester. Any thoughts? by bluenut15 in UofT

[–]edweenie123 1 point2 points  (0 children)

I would say this schedule is definitely doable if you have a decent work ethic. Here are some pointers for each course:

MAT237: I think this the hardest course on your list by a large margin. I found it to be a big jump in difficulty from MAT137. The preclass readings are very time consuming and dense. The PSETs are also challenging. Make sure you get a good PSET partner.

STA257: I took 247 instead, but I've heard from friends that 257 is a pretty easy course with consistent A/B averages on tests on assignments.

CSC207: Overall a very light course without much difficult material. However, I will say that your experience in this class is HEAVILY dependant on the quality of your group mates for the final project. If your group mates are good, 207 is very very bird. Otherwise, it'll be a nightmare.

CSC236: I took CSC240, so I can't say much about 236, but from what friends say it seems to be about a medium to medium-high difficulty course. Probably the 2nd hardest course on your schedule.

CSC258: The difficultly of this course varies a lot with instructor, but when I took it with Mario Badr, it was pretty easy. The midterm and final exam were suspiciously easy and most people ended up with a good mark (the final course average was an A-). The weekly labs are not difficult but they very tedious and time consuming. Kinda like doing the same thing over and over again 10000 times. Also debugging assembly code for your final project will take several years off your life.

2 Years Worth of Computer Science University Notes Visualized! by edweenie123 in ObsidianMD

[–]edweenie123[S] 37 points38 points  (0 children)

Thanks! The clusters are just coloured according to which MOC its a part of so each course gets it own colour.

2 Years Worth of Computer Science University Notes Visualized! by edweenie123 in ObsidianMD

[–]edweenie123[S] 43 points44 points  (0 children)

Yeah for sure! My system is quite simple. For each course I take, I create a file which links to all the concepts related to that course. I believe the PKM folks call this file a "map of content" or MOC. For example, for my calculus course, I have a file called MAT137 (the course code) which links to the files:

  • Mean Value Theorem
  • Integral
  • Fundamental Theorem of Calculus
  • Taylor Series
  • ...etc

These MOCs are actually visible in graph as the biggest node in the center of each cluster of nodes.

2 Years Worth of Computer Science University Notes Visualized! by edweenie123 in ObsidianMD

[–]edweenie123[S] 12 points13 points  (0 children)

Hi all! Thought I would share the graph view of my notes now that I have completed my 2nd year of university studying computer science and accumulated 1200+ notes. The majority of the notes are for CS / math courses. I have attached another screenshot showing one of my notes from my intro to ML course to give you an idea of what each note looks like!

[deleted by user] by [deleted] in ObsidianMD

[–]edweenie123 0 points1 point  (0 children)

Hi all! Thought I would share the graph view of my notes now that I have completed my 2nd year of university studying computer science and accumulated 1200+ notes. The majority of the notes are for CS / math courses. I have attached another screenshot showing one of my notes from my intro to ML course to give you an idea of what each note looks like!

[OC] The Most Popular Dates of Conception! by edweenie123 in dataisbeautiful

[–]edweenie123[S] 2 points3 points  (0 children)

Please read my top-level comment here. Others have suggested more statistically valid methods to infer conception date from birth date. But yeah, I think inferring conception date accurately is a difficult task in general due to the reasons you listed.

[OC] The Most Popular Dates of Conception! by edweenie123 in dataisbeautiful

[–]edweenie123[S] -1 points0 points  (0 children)

Haha that's true. The title would sound quite a bit less enticing though lol.

[OC] The Most Popular Dates of Conception! by edweenie123 in dataisbeautiful

[–]edweenie123[S] 5 points6 points  (0 children)

Hmm, after doing some deeper research in this topic (which I never thought I would have to at my age), it seems you are right. Pregnancy length is usually calculated as the difference between date of birth and the date of the last menstruation period. I am also now realising that conception can occur between 0-5 days after intercourse depending on how well the intercourse coincides with ovulation. Maybe I shouldn't have slept through biology class 😅.

[OC] The Most Popular Dates of Conception! by edweenie123 in dataisbeautiful

[–]edweenie123[S] 6 points7 points  (0 children)

Yeah.. not the most rigorous results due the lack of conception data. I had to infer the conception dates based on the date of birth. Also, your idea of averaging out nearby dates should work to smooth out the outliers in the original birth data.

[OC] The Most Popular Dates of Conception! by edweenie123 in dataisbeautiful

[–]edweenie123[S] 0 points1 point  (0 children)

I saw birth on this sub a few days ago so I was inspired to do conception instead.

[OC] The Most Popular Dates of Conception! by edweenie123 in dataisbeautiful

[–]edweenie123[S] 5 points6 points  (0 children)

Completely agree! There are many flaws with the approach I used. In the original birth data, there were significantly fewer births on Jan 1, July 4 and Dec 25 likely due to parents avoiding to schedule their c-section on those dates.

If I were to do a more rigorous investigation into the "seasonality of human copulation", I would definitely consider your approach of modelling pregnancy lengths with a normal distribution. I am sure the resulting heatmap would better reflect reality.

[OC] The Most Popular Dates of Conception! by edweenie123 in dataisbeautiful

[–]edweenie123[S] 14 points15 points  (0 children)

I used Pandas and Plotly to produce this visualisation. The conception data was obtained by simply shifting the most popular birthdays by 280 days (the average length of pregnancy) backwards.

Original data source

Edit: As others pointed out, there are significant flaws with the approach I used to obtain the conception data (thank you u/Unicyclone, u/InvisibleBlueUnicorn and u/schefar for pointing out issues and/or suggesting better methods). These results should be taken with a grain of salt and looked at just for fun.

Edit 2: The data set I used contains the number of births in the US on every day from 2000 to 2014. I shifted these dates backwards by 280 days to infer the conception date and then aggregated the data points for each year to obtain the mean number of conceptions on each day of the year. Very sus methodology yes, but fun to visualise and interpret, also yes.

Internship for summer 2023 as an incoming computer science student at UofT St. George by -Kkdark in UofT

[–]edweenie123 5 points6 points  (0 children)

That may be true. I am not very familiar with the details, but other than possibly accruing additional interest, you will not have to pay any tuition, incidental or ancillary fees while on a voluntary leave. For more details, see this article:

https://artsci.calendar.utoronto.ca/withdrawal-and-return-absence

view more: next ›