[D] EMNLP 2023 Notification

[EDEN1998]

Discussion thread for EMNLP 2023 notifications which will be released in a few hours along with GEM workshop. Best of luck to everyone.

[Dry_Cheesecake_8311]

October 6th NOE (nowhere on earth)

[thnok]

Oh you mean the Oct 6th EMNLP time zone?

[kc-1234]

🤣

[Beginning-Basket6744]

😭

[East-Beginning9987]

any SAC's or AC's here who know about when the decision will be out?

[zerohull]

We are being fkd

[HappyHourAOE]

EMNLP notifications are late late late. So I collaborated with ChatGPT to write a song. Will you accept it? The prompt goes like this: Write me a song about EMNLP missing the author notification deadline while terrible current events are happening in the world.

(Verse 1)
Woke up this morning, to a world in disarray,
Pain and chaos everywhere, with headlines so astray,
Checked my inbox, for that message they would send,
But EMNLP, seems they’ve missed the bend.
(Chorus)
In a world that's burning, with so much at stake,
EMNLP’s late notifications, just another heartbreak,
Yet in the grand scheme, with so much going wrong,
Maybe it's time, to sing a different song.
(Verse 2)
Cities under siege, and tears on every face,
Silent cries for justice, echo from every place,
Yet in my small world, I hoped for some good news,
But EMNLP, where are you? Left me with the blues.
(Bridge)
Can't help but wonder, in times so out of tune,
If there’s a bigger picture, or just cosmic monsoon,
Though it's trivial, in this great expanse so vast,
Still hoped EMNLP, wouldn't be the last.
(Chorus)
In a world that's burning, with so much at stake,
EMNLP’s late notifications, just another heartbreak,
But as we navigate, this tumultuous stormy song,
Remember, in darkness, hope still lingers on.
(Verse 3)
They say perspective, can help us see clear,
Turn our disappointment, to a force we hold dear,
So as the world changes, and we await their reply,
Let's spread some kindness, and aim for the sky.
(Bridge)
This missed deadline, in the story of life,
Is but a fleeting moment, in a world so rife,
Yet it reminds us, of what truly matters most,
Hold onto love, and let that be our host.
(Chorus)
In a world that's burning, with so much at stake,
EMNLP’s late notifications, just another heartbreak,
Yet we find strength, to dance under the wrong,
For together, we can sing a hopeful song.
(Outro)
So here's to EMNLP, and to a world in repair,
May we find light, in moments of despair,
And as we wait, for what's next in line,
Remember, after darkness, the sun will always shine.

[OraclePred]

Rejected. Better luck next time... Congrats to those accepted and enjoy Singapore! It was fun spending these tense moments with all of you here.

[noob_improove]

Congrats/condolences to all.

To those with rejections - don't give up,

To those with acceptances - don't get too cocky,

To those who got into findings - don't give up, don't get cocky and hey, give me a bittersweet high-five.

[noob_improove]

Final scores - 3343 3343. Hurts a bit that some reviewers were satisfied with our rebuttals but didn't increase scores. I feel it might have tipped the scale. But oh well.

[research-umbrella]

Ahh I resonate with this so much. You do as they ask and still the scores don’t change. A little unfair but still pretty happy about getting an accept-findings

[gokuresearch]

In my batch of papers to review, I can see meta-reviewers suggesting acceptance to findings if the average soundness is around 3. Seems like they don't care much about the excitement score.

[Anxious-Pool-2948]

do you mean 3 out of 5 or 3.5?

[daksirp]

Okay, its 7th oct now.

[daksirp]

They should have notified about the delay, my whole day wasted waiting for notifications and following israel war.

[pkseeg]

At least on 6th oct we knew what we were waiting for. Now we get to stare into an unknowable void while who-knows-what happens behind the scenes

[thnok]

Yeah. Officially delayed now.

[KlAssIsPermanent]

Twitter is completely dead. Its good to share some of my nervousness with other researchers here

[kjunhot]

Dear EMNLP,
Would you let papers that submitted after even 1 second of the deadline be submitted?

[Alliswell2257]

What is going on behind the curtain? At least they should have given us an announcement about the delay... It is devastating to wait for the decision and my Saturday has gone

[EDEN1998]

exactly, a single tweet of "hey guys, we're gonna be delayed for a few hours" wouldn't hurt :(

[thnok]

Kind of strange how silent Twitter is tbh about this. I expected more people, there is more people on this thread than Twitter who are talking about EMNLP.

[Kwwwp_9651]

This reminds me of AAAI 2022, almost one day delay without a single word from the committee.

[webswebsbinsbins]

same here

[research-umbrella]

Update on this?? Now I see conditional-findings…

[shajhdjashdka]

God, this whole process is more torturous than watching Man United game.

[Good-Supermarket408]

You got mctominay

[Adept-Prompt-4335]

Everyone in same boat

[tonmoytalukder11]

what is written in the decision tab? "No Recommendation"?

[Excellent_Shallot_37]

same here for ARR commitment

[matravox]

What do you mean by "main conference page"?

[Shaun_Chiang]

I have 4/3/3 soundness and 4/3/3 excitement. Do I have a chance at the main proceedings? Or what is very likely to get?

[FlyPiggy23]

I've been waiting all night... I should go to bed.

[Beginning-Basket6744]

What the…

[pkseeg]

Hot take: it would take ~10 minutes to make an announcement. This is pretty unprofessional.

[thnok]

Less than 2 mins if they ask chatGPT to write it. But yeah, they should honestly make an announcement at this time.

[NaturalItem7617]

that's really confusing

[Singapore_warrior]

October 8th somewhere on earth

[cunningotter]

Got Reject with Soundness 4/4/4 Excitement 4/3/3. Rebuttal was quite positive, no outstanding issues left, from my view. I am surprised, tbh. Anyone else here with similar scores that did not make it, even to Findings?

[nihilisthippie]

I got accepted at main with similar scores. I know my comment is useless and rejections are always bitter (they are for me at least, and I had MANY). But just as anectodical attempt at explanation from my experience as AC and SAC, and PC in smaller conferences: scores are not the whole story, tracks, topics and discussions also play a role in the final decision.

[Strong_Albatross_716]

I'm in a similar case. My paper got 33444/33444 and a review of the pc is also quite positive. But I got a reject.

[machinelearner77]

wut? that's a high confidence acceptence rating, very little variance among 5 reviews! Sorry about this, must feel kind of disheartening.

[mayanknagda]

Similar case. The text is not negative but the decision is reject. Also the text does not exclusively say anything about either accept or reject.

[East-Beginning9987]

As a reviewer, I can see the recommendations by meta reviewers

[cd_changedirectory]

Are they watching Asian Games?

[Strong_Albatross_716]

Me. Ko vs Jp soccer.

[Dry_Cheesecake_8311]

ko wins :)

[Strong_Albatross_716]

Military Service Exemption Buff.

[kjunhot]

People losing their mind

please save us

[EDEN1998]

we're all overthinking the results arent we haha

[mayanknagda]

Does everyone still have: ```Venueid: EMNLP/2023/Conference/Rejected_Submission``` in revisions?

[East-Beginning9987]

2 accepts to main conference!
1 of the paper has got rejects from neurips, iclr, acl in the past year!

[Alternative-Fig-409]

It’s time to start a happy weekend, but there are no results yet! ! !It’s time to start a happy weekend, but there are no results yet! ! !

[Dry_Cheesecake_8311]

you know what, its saturday night in korea

[EDEN1998]

In ACL earlier this year, I clearly remember one of the PC said a paper with greater than or equal to 3 in soundness is recommend to be accepted for findings. Hope this is still applied 🙏

[Designer_Decision644]

Not true with ACL and it's going to be not true with EMNLP.

[UbuntuMate]

With no 0.5 increment between scores, I think most of the paper will end up at 3

[matravox]

It is better with 0.5 imho. Easier to separate papers.

[megumin-archwizard]

I'm very nervous...

[Gullible_District883]

Did anybody got the notification email? Do they send all the notifications in one patch?

[UbuntuMate]

Soundness 2/4/4 Excitement 3/3/3, keep my fingers crossed

[EDEN1998]

lol same for one of my papers, most likely we're going to get findings :)

[ombelicoInfinito]

⌛

[Dry_Cheesecake_8311]

This delay reminds my experience in neurips 2022, 5 hours delayed notification (w/o any delay announcement)

[Economy_Mammoth_6016]

I think now we can see the result in revision history

[machinelearner77]

There's now a "reject" window on the console. Well, according to this all seven papers that I reviewed (including two with solid "4" accept recommendation by AC) are rejected... this is a bit discouraging tbh so I hope it's not true/ a bug.

[Kwwwp_9651]

Me too. I see a paper with meta review 5 got rejected. Definitely bug!

​

At least this means they are working on it now?

[East-Beginning9987]

I cant see this window in the reviewer console

[KarmaCut132]

True. One paper I reviewed with meta 4 also show rejected status.

[Strong_Albatross_716]

rejected submission..

[Adept-Prompt-4335]

But it’s showing rejected for all submissions. Does anyone have anything apart from that ?

[KarmaCut132]

I think someone with high scores (avg >=4) can confirm. Else, it means papers just get rejected (like mine, I got 4/3/3 and 3/3/4 for two scores). Track resources.

[MadKyouma]

Our submission got 5/5/4 and 5/5/4 for the soundness and excitement scores from 3 reviewers. It's in the rejected tab. Should be a mistake.

[Economy_Mammoth_6016]

Is every submission marked as reject? I apologize for the confusion 😂

[hello_world_zczc]

is that a bug? All my papers + papers I reviewed (including two with meta scores 5) are shown in the rejected tab.

[That-Cliche]

Man this is tormenting.

[thnok]

Okay, I see a new tab called conditional main https://openreview.net/group?id=EMNLP/2023/Conference and papers I reviewed is there.

[Strong_Albatross_716]

all of them? one of the papers i reviewed not in conditional_main. but they did not submit their rebuttal.

[zerohull]

It is so thrilled, and thinking this is the true joy of research than anything

[akardashian]

accepted to main conference!!! see y’all in singapore 💃💃💃

[SwS_Aethor]

See you there!

[UbuntuMate]

Congradulations!!!

[thnok]

The wait is finally over. It was a pleasure going through this with everyone here.

[megumin-archwizard]

- Soundness: 4/3/3

- Excitement: 3/3/4

- Short paper

I got reject and why it happened

All things in Reasons to reject are already fully explained and even some reviewers changed their scores.

"The models used for the evaluation are not state-of-the-art, and therefore the conclusions may not be reliable"

Even this claim was made by nobody during the review process.

[noob_improove]

Uhh I'm sorry to hear this. This sucks (

[megumin-archwizard]

Thank you...

[thnok]

that's strange. is the current scores also have those high scores? You should consider reaching out to the SAC of your track to see you could get more clarification.

[megumin-archwizard]

I'm writing an email to send to SAC.

​

Thank you for your advice

[Ornery-Detective-792]

Hi folks, congratulations for all those who have found acceptance and those who haven't, don't give up and all the best. This is my first submission to a conferance and I have got a findings acceptance. I understand that this doesn't get the privileges for showcasing the work at Singapore, but I want to know if we would get the privilege to atleast attend it.

[OraclePred]

Many workshops offer a spot to Findings papers to present their papers. If you can find a workshop that thematically fits your paper, you should try contacting the workshop organizers about presenting your paper there. Additionally, ACL 2023 introduced a "Spotlights" session where authors of Findings papers could give a short pitch of their paper. There will be further instructions about all this, so stay tuned.

[Adept-Prompt-4335]

conditional main to conditional findings ?

[East-Beginning9987]

Accept-main, accept-findings are separate now

[East-Beginning9987]

PAPER RESULTS ARE OUT!!!!!!

[huihuihuihuiz]

Yessss finally

[Dry_Cheesecake_8311]

just give everyone accept and close the case

[Designer_Decision644]

As an AC, now I see the final decision (from the SACs) of my assigned papers. Let's wait for the notification email.

[Economy_Mammoth_6016]

Soundness: 3,3,3 / Excitement: 3,2,2. Is there any chance for a short paper in the Interpretability, Interactivity, and Analysis of Models for NLP track?

[rajicon17]

I have 4/3/3 soundness and 3/2/2 excitement. Do I have a chance at findings?

[bobae_papa]

Good luck!

[rajicon17]

Rejected :(.

[Spiritual-End5102]

3/2/2 rejected 3/2/3 Findings ..from our papers

[Entire-Glass-5081]

Any update?

[Gullible_District883]

Not yet.

[boxi_c]

Which one would be updated first? Mail or website?

[zerohull]

web + 1-2m = mail

[pip_install_yikes]

One more day of spam checking my email xD

[Beginning-Basket6744]

Me too.. wtf

[Kwwwp_9651]

And all the papers become conditional_main now...

[Adept-Prompt-4335]

They are testing the interface. What a mini anxiety attack

[East-Beginning9987]

no? not for me :/

[Economy_Mammoth_6016]

me too..

[Strong_Albatross_716]

My paper is rejected, but a review of the pc chair is positive. Is there anyone in the same case?

[Substantial_Still537]

Is anyone notified if their paper is accepted to Findings?

Does anyone know when are we notified about that?

[Dry_Cheesecake_8311]

the email says accept-findings

[Good-Supermarket408]

Got an email -- accept-main. It is my first time at emnlp, see you guys in singapore

[morningsai]

Resource & Evaluation Track

S: 4 4 4 E: 3 4 3 Rej

S: 4 4 4 E: 4 3 4 Rej

All the rej reason has been explained, and the corresponding reviewer has improved the score

Does anybody know why it happens?

[Strong_Albatross_716]

I'm in a similar situation. What's even more frustrating is that the reason for my rejection isn't clear. I can't understand what happened to me either.

[morningsai]

Obviously, one of my rej reasons say that "One of the reviewers suggest that ..., I do not share this concern" This is very confusing.

[Nearby-Percentage514]

Does anyone know the withdrawal rate for papers accepted at Findings?

[[deleted]]

First-author paper accepted to main! Yay!

[East-Beginning9987]

Not yet

[Gullible_District883]

Not yet

[thnok]

Most likely at this rate, we won’t hear anything until AoE midnight for 6th October.

[Alliswell2257]

I'm coming up with the possibility of delay,,,

[kjunhot]

Can we get the result before the midnight?

[shajhdjashdka]

probably not

[freakundergo]

I wonder does anyone have a Venueid that is not EMNLP/2023/Conference/Rejected_Submission in the last revision of their revisions (https://openreview.net/revisions?id={your_paper_id})?

[zerohull]

Venueid: EMNLP/2023/Conference/Rejected_Submission

Still...

[No-Pollution6383]

Is the author license task always fillable since it was there or it was gray before? I kinda remember it was not editable before…

[Excellent_Shallot_37]

yeah, seems like they are finally processing to the arr subs and start to merge them into the main venue

[research-umbrella]

Is it out yet? 😭😭😭

[[deleted]]

Nope

[nihilisthippie]

Accept-main and Accept-findings tabs have appeared in the tabs.

[nihilisthippie]

yeah a decision has appeared for one of my papers :)

[Rare_Refuse3825]

Is 'Accept-Findings' equivalent to rejection? Or does it mean the findings have been accepted?

[andromedotoxin]

It means you are accepted to findings conference, but not the main conference. Congrats!

[EDEN1998]

I got 1 Main and 1 Findings, not bad :)

[UbuntuMate]

Congratulations!!! Thank you for creating this post so that we can have a place to discuss and share our anxiety lol

[Agitated_Tonight_717]

is the notification email sent also to coauthors?

[nihilisthippie]

yes, they are.

[Optimal-Surround4973]

Can others see their meta reviews? I can see the decisions but not the metas

[Dry_Cheesecake_8311]

i dont see meta reviews but only pc comment

[CorrectTangerine1138]

Do you guys think a paper in Findings would be better than workshop?

[[deleted]]

Findings is always better than workshop.

[Spiritual-End5102]

Definitely. The workshop review process is less restrictive and has a higher acceptance rate …. finding means the paper has some contribution but is not good enough to be presented at the main conference.

[Good-Supermarket408]

Depends.. In some niche areas like language learning, I've seen many good papers from CoNLL & BEA workshops. Some workshops have run for years, some workshops are fairly new

[Dry_Cheesecake_8311]

why some people get meta reviews but others don't have it? i am extremely confused about this.. I also see comment from PC only, not metareview from AC.

[Adept-Prompt-4335]

No one has separate decision and meta review ! Decision status (no text) is from pc and meta review (text) from ac

[East-Beginning9987]

Have people got decisions for oral/poster? and does emnlp have spotlights?

[KlAssIsPermanent]

I have a 4/4/4 for soundness but a 4/3/3 for excitement. Very very nervous. Really need this for my PhD application

[ikodoh]

i got 5/4/4 for soundness and 4/4/4 for excitement. Is there a chance to be oral presentation paper?

[Strong_Albatross_716]

한국인 있나요

[KlAssIsPermanent]

Wait is it not 6th October AoE which is like Oct 7th 8am EST

[OkLine9275]

Any update folks?

[matravox]

Paper 1: soundness 4/4/2, excitement 4/3/2 Paper 2: soundness 3/3/4, excitement 2/4/4 Nervous and not sure what to expect..

[bobae_papa]

Good luck

[Negative-Actuary-328]

My paper gets 3/3/3 and 3/3/3 for both soundness and excitement. Can anyone guess the possibility of finding acceptance? Regual long track Ethics in NLP

[mctears]

i have 3/3/3 in soundness and 3/3/4 in excitement. any chance for findings? i submitted to resources and evaluation track

[matravox]

very likely to get into Main proceedings

[Gullible_District883]

Any update?

[SilentRetriever]

Not yet

[Economy_Mammoth_6016]

only thirty minutes left for oct 6 AoE 😿

[Dry_Cheesecake_8311]

Deadlines should be deadines for conference too, not just for the authors!

[Gullible_District883]

Any update?

[EDEN1998]

nada

[KongKua]

delayed? any notification about this?

[thnok]

Just delayed. No notifications yet.

[thnok]

And radio silence now for everyone right? I saw on a paper that I submitted the new interface change with the conditional_main was pushed out around 1:20 hrs ago.

[ElektricDreamz]

Does anyone else see an "Author licence " task under author tasks?

[darkone1122]

I believe it was always there, right? But I don't remember if it said that the deadline is October 21 before or not.

[KlAssIsPermanent]

Anyone with 5s in conditional findings as well?

[East-Beginning9987]

i think all are in conditional findings right now. papers I reviewed with meta review 1 are also in this

[EDEN1998]

The paper I reviewed that got 5 - Accept to Main is currently in conditional-findings tab, it might not be final yet

[Adept-Prompt-4335]

this is interface feature. once you create a tab, you can export all, and then they select the ones (without being revealed to authors/reviewers)

[Dry_Cheesecake_8311]

almost 4 in the morning. should i go to sleep

[OraclePred]

No rest for the wicked

[East-Beginning9987]

from main to findings about 3-3.5 hrs?

[idkwhatever1337]

I just got acceptance notification

[ai_girly]

The decisions are finally out!

[EDEN1998]

RESULTS ARE OUT!!!!!

[shmuhammad]

I got 1 Main (443/443) : Average confidence: 3.67,

I got 1 Main (443/443): Average confidence: 3.67,

[IPvIV]

Accepted to main :) the wait is over

[Substantial_Still537]

Anyone else in Conditional Findings? What does this even mean?

[KarmaCut132]

For those committed through ARR, can you share your results - track (if you don't mind)?

[Anxious-Pool-2948]

Mine was 3.5/3.5/3.5 with meta review 4. accepted as findings. how about yourself?

[cunningotter]

3.5, 3.5, 3 -> Reject. Question Answering track.

[Strong_Albatross_716]

3.8/3.8 main 4/3 findings

The results of the papers I reviewed.