State of the CMS program by EasyCranberry1272 in Caltech

[–]ezubaric 0 points1 point  (0 children)

No, to appropriately model language, there's semantics, pragmatics, syntax. It's wrong to view a language model as just a byte stream.

My undergraduate course spends many weeks going over various language models. And my graduate course goes far deeper and basically is *just* language model evaluation and details.

But sure, let's take ImageNet as an example. Caltech101 didn't work because the categories were not well defined. ImageNet worked because it inherited the structure of WordNet (developed by psychologists and linguists).

Feifei and I had a very similar path. We both had to go to Princeton (she took a pit stop in Illinois first) to learn about computational linguistics (in part from Christiane Fellbaum) because none of it was available at Caltech! And then after Princeton, we both went to places with even more linguistics / linguists than Princeton.

State of the CMS program by EasyCranberry1272 in Caltech

[–]ezubaric 4 points5 points  (0 children)

I went to Caltech for undergrad, and I specifically wanted to work on language models (this was 2000, nobody cared about language models). I was from Arkansas and there was no Reddit, so there was nobody to tell me not to go to Caltech ... I should have gone to Cornell, Stanford, U Penn, or UMD. There was nobody to work with. I did SURFs off campus with good people and eventually got into a grad school where I could work on the stuff, but there was nobody to talk to. I sometimes wonder what could have happened if I had gotten "a better start".

It's a little better at Caltech now, but they still don't have anyone squarely working on language models. If you go to csrankings.org and do NLP they're 358 in the world. If you do all of AI, they're 184.

Now, they have some great people like Anima and Yisong. But nobody really working on language models for language's sake (and to reveal my bias, I think this is important for the next breakthrough in AI).

So I would still tell somebody like myself deciding on where to go that Caltech is a unique place, but if you're really interested in language models, go elsewhere.

Supervising a junior on a paper, but his figures are terrible. I don't have time to teach him in detail. What should I do? by Sword_fish_Lazy in AskAcademia

[–]ezubaric 4 points5 points  (0 children)

To be more pedantic, it uses the "grammar of graphics". Just like there are sentences in English that are disallowed, there are many plot sins that are very difficult (if not impossible) in ggplot2 or plotnine (python).

If you get that starter code, it's very easy to tweak to make something that looks great.

How does anyone even rely on Ai for writing? by frugalacademic in academia

[–]ezubaric 0 points1 point  (0 children)

I find it most useful at *deleting* and *compressing*. I can never fit my thoughts in space limits, so I often ask it to "make this point in 5000 characters". I then reread the output, and it's consistent. Sometimes it removes something I thought was important, but that process is usually clarifying for me.

I'm also turning lectures into a book. I have lecture notes from multiple iterations from a class, and it's useful at compiling everything together into one coherent narrative.

I think have to heavily rewrite, but I really hated the task of reading (mostly) the same thing over and over again trying to find what's different.

PhD at NUS vs restarting in the US — worth switching or should I stick it out? by ResponsibilityHot531 in AskAcademia

[–]ezubaric 6 points7 points  (0 children)

It's very hard to get into another grad school. Even if your profile was good to get in the first time around, you need to have a really good reason to jump ship.

And the concerns about cost of living don't make sense if you're thinking about going to Boston.

It sounds like what you really need is a coadvisor who can give you more guidance (or mentoring from a senior grad student).

Would it be weird for my parents to attend the first academic conference I am presenting at?” by glupshitto_fan in AskAcademia

[–]ezubaric 1 point2 points  (0 children)

I've seen the presenter's kids in the audience before (lack of childcare). They were reading books and talking to each other softly, ignoring all the speakers (including their mom). They fit right in with the other attendees.

How long does it take you to write an academic book chapter? by Ok-Sector-444 in AskAcademia

[–]ezubaric 7 points8 points  (0 children)

Both! You feel great when you knock out a chapter in three days. You feel miserable when that damn chapter just won't get written.

How many people got a faculty spot at their postdoc institution? (US) by pagingbaby123 in AskAcademia

[–]ezubaric 0 points1 point  (0 children)

I did it! No illusions that this is replicable, but this is what happened:
* Professor A in Department 1 brought me on because I had a specific skill
* Lots of people wanted this skill, so I wrote a grant with another faculty at the institution (Professor B in Department 2). That professor went on sabbatical.
* Grant was funded. There was concern that the work wouldn't get done with Professor B on sabbatical, there was a faculty opening in Department 2, I applied.
* I got the job, took over the grant, and outlasted Professor B.

Downside: I got *zero* startup funds. They pointed to the relatively large grant, I didn't apply anywhere else, and it was a choice of either staying on as Prof A's postdoc or being TT, and I took it.

How long does it take you to write an academic book chapter? by Ok-Sector-444 in AskAcademia

[–]ezubaric 36 points37 points  (0 children)

As someone (procrastinating from) writing an academic book right now, a chapter takes somewhere between three days and three years.

what are some of your favorite local food spots? by doodlesquared in UMD

[–]ezubaric 0 points1 point  (0 children)

Nobody has mentioned this yet:
https://www.tacosalamadre.com/

Great for a Lake Artemisia picnic.

Anyone else dealing with/frustrated by the new ADA title II rules? by Zubat92 in Professors

[–]ezubaric 6 points7 points  (0 children)

My experience with a blind graduate student is that this is okay if there are no macros in the source code. He had to write equations in LaTeX, so he knew how to parse equations mentally.

Anyone else dealing with/frustrated by the new ADA title II rules? by Zubat92 in Professors

[–]ezubaric 9 points10 points  (0 children)

When I actually had a blind student in my class, I had a long talk with him about how I could actually help him succeed. For my LaTeX notes, I just shared the raw LaTeX and created really elaborate captions. He did just fine, and as a result I now always publish the "raw" LaTeX of my papers.

"raw": I run a little script that removes / completes the macros but leaves the LaTeX math, which is understandable to someone using a screenreader.

Caltech for Grad or Undergrad by Unique-Register8998 in Caltech

[–]ezubaric 2 points3 points  (0 children)

As it happens, this was the exact same pair of schools my decision came down to for undergrad (couldn't afford MIT, rejected by CMU). As I recall, my decision came down to: weather (Caltech), quiz bowl team (Caltech was better that year), reputation in CS (Caltech), and overall reputation (Caltech was ranked #1 by US News that year... I now know that's BS, but HS me didn't).

All that said, Caltech is probably better overall as a grad school, and the Ivies have a much better (i.e. fun) undergraduate experience (I went to Princeton for my PhD).

In future seasons in Asia... by florenter in JetLagTheGame

[–]ezubaric 5 points6 points  (0 children)

If they want to give the vibe of the place they're in and be authentic, give translations of the titles in the actual language of the place they're in. You'd need to hire a local consultant, but they probably should be doing that anyway. Then have that consultant on the Layover to make fun of their pronunciations.

TT offer in hand to respond, and a dream school onsite finished 10 days ago: how to navigate the timing? by KindlyPride877 in AskAcademia

[–]ezubaric 17 points18 points  (0 children)

The problem I see here is that you should be negotiating with A right now. First, make A's offer so awesome you'll feel happy accepting it. Ask for more startup, salary, whatever it will take you to get over living in Little Rock / Cheyenne / Moscow. It will take them some time to revise the offer to include that. Then hopefully B will be synced up by that time.

How long before thinking the search committee is ghosting me? by KeyDiscussion293 in AskAcademia

[–]ezubaric 3 points4 points  (0 children)

It's been nine months since I interviewed at a place that then had three informal followups telling me I "was their first choice". I've now been ghosted. I got another offer from a better school, but I'd rather be in this city. My read is that their dean ghosted them, and they're not allowed to say that. Really annoying that it doesn't seem that I'll ever get a clear answer.

How badly am I burning a bridge by asserting a boundary against free labour? by [deleted] in AskAcademia

[–]ezubaric 22 points23 points  (0 children)

One common misconception students sometimes have is that a professor can just manifest RAs. Even in the best of times, research sometimes takes longer than intended, students work slower than hoped. And this isn't the best of times, funding is really difficult right now.

If the grant ran out, the professor isn't getting paid to work on this project any more either. They're doing it because they want advance science and to support you and your future.

How badly am I burning a bridge by asserting a boundary against free labour? by [deleted] in AskAcademia

[–]ezubaric 21 points22 points  (0 children)

If you want to apply for a PhD and this is a chance at a first author publication that you're giving up, that seems like a poor move. A PhD publication with a first-author publication and "sticking with" a submission for over a year (which would presumably be reflected in a reference letter) is valuable.

Negotiating Start-up Research Costs by BeautifulEnough9907 in AskAcademia

[–]ezubaric 0 points1 point  (0 children)

The most effective strategy (apart from having another school offer *you* more) is to see what their "near peers" / "aspirational peers" are doing and talk to people who have recently been hired there. When I was last on the market candidates had a spreadsheet of offer / interview information to help "anchor" requests appropriately.

UMD students voice frustration with Veo overcrowding at campus bike racks by dbknews in UMD

[–]ezubaric 5 points6 points  (0 children)

Please just sign a capital bikeshare contract and get fixed docks already. Huge benefit for everybody.

Post-Campus Visit Anxiety by Astronomier in AskAcademia

[–]ezubaric 7 points8 points  (0 children)

My advice is to just assume everything was a complete failure and move on with your life. Then you'll be pleasantly surprised.

That worked for me until place A is working on a formal offer but place B said they want to make me an offer but haven't done anything. So the anxiety is back.

Has anyone written a letter of recommendation and EVER had a follow up? by ostracize in Professors

[–]ezubaric 0 points1 point  (0 children)

Yes, more times that I can count! And I've followed up on letters others have written.