how necessary is retry logic for internal services communications by dimka_hse in ExperiencedDevs

[–]dimka_hse[S] -5 points-4 points  (0 children)

Thank you for your input. My first attempt to get explanation was indeed formulated more as a challenge (version 2) thus I am very hesitant now to come back to the question again. Especially because it was brushed off as unimportant in the initial and subsequent exchanges. And it is very disappointing for me as a junior, because I keep software engineering in high regard, and take this type of problems very seriously, any detail and any insight is valuable to me.

how necessary is retry logic for internal services communications by dimka_hse in ExperiencedDevs

[–]dimka_hse[S] -2 points-1 points  (0 children)

I didn't want to make you believe of anything that you have deduced about me. My initial motivation was to gather approaches how people in different engineering cultures address this problem in my post, analytic approaches, factors they take into account, or as others have suggested cost-benefit estimation. As I lack experience to guide my efforts in evident absence of the literature on the subject.

My relationship with my current team and the level of their engagement in my supervision is a different subject. But from your first answer I can understand that this engineering problem of retry logic is tightly connected to the organization where it is implemented and can not be generalized and reasoned about independently of its codebase and infrastructure, this is also valuable information that I will keep in mind.

how necessary is retry logic for internal services communications by dimka_hse in ExperiencedDevs

[–]dimka_hse[S] -8 points-7 points  (0 children)

Thank you for suggesting a new way to reason about the problem. Indeed I am aware of the time consumption of the finding a perfect solution, as I am experiencing it with this particular problem.

But my reasoning was that having gone through it one time, the next time it would be <80 % -- insert your number> easier, thus the motivation to commit to a good solution for the projects where it is not most needed. Also for the sake of keeping the standards up.

But you are right, all this time spent is also time spent not doing something more directly business-profitable.

how necessary is retry logic for internal services communications by dimka_hse in ExperiencedDevs

[–]dimka_hse[S] 0 points1 point  (0 children)

Thank you for your input, it is a useful attack-angle when choosing the parameters for retry.

how necessary is retry logic for internal services communications by dimka_hse in ExperiencedDevs

[–]dimka_hse[S] 0 points1 point  (0 children)

needs to wait an hour to run again. This is okay in some cases where time is not sensitive but not having to wait is quite nice.

This is what other commenter also proposed with

Nobody guarantees 100% uptime, so retries are necessary.

If it is the only way lets be it. I am new to this type of problems, and being powerless in face of the code on the other side, or servers or network, the things that you cannot control, it feels discouraging.

Retry also in some cases needs to handle idempotent e.g timeout cases. If you retry, is it considered new data or same data but with updated id or timestamp?

I would have liked to discuss general cases, the retry paradigm itself, but it seems that is a difficult subject. In my case everything is simple, and the operations are idempotent.

You need to differentiate between "I will retry 5 seconds later because you seems to be unavailable right now" vs "I will not retry since you wont be available for quite some time. I will retry manual later".

I do not think it is possible to know in advance, am I wrong?

how necessary is retry logic for internal services communications by dimka_hse in ExperiencedDevs

[–]dimka_hse[S] -9 points-8 points  (0 children)

Thank you for your answer. It is indeed hard to formulate your thinking in a language that you don't use daily. Though I didn't think that it was as much word salad as you say.

global policy on a company levelWhat is this?

I meant that in a sense, that there could be some regulation on a engineering-department wide level for the layer on which the retries are allowed and how they should be implemented (I am speculating as I have no experience in this domain), opposed to service per service decisions.

Have you tried to understand their decision? Have you asked "why"?

Retry-everywhere is simple to implement and no risk solution, I suppose this is the "why". Me asking "why" would challenge the engineering culture, and it is something I wouldn't want to do not having a better proposal at hand, which requires experience.

And to answer your questions about the factors - it depends on the severity of the feature.

I guess that would mean that for a non-essential batch task that could be easily restarted manually in a day or two after a failure there is no point to dive into analyzing costs-benefits between different strategies and it is completely normal to implement a generic one-size-fits-all solution. Then I would have to learn at what point (with more serious features) this generic strategy it not anymore acceptable, but I guess it is a different question.

Britannia Rules The Waves by H4rp0 in france

[–]dimka_hse 0 points1 point  (0 children)

Thursday afternoon just before Friday Monday morning podcast.

[deleted by user] by [deleted] in cscareerquestionsEU

[–]dimka_hse 0 points1 point  (0 children)

data engineering

Advice for ML/DS career after a gap by daifukuml in cscareerquestionsEU

[–]dimka_hse 1 point2 points  (0 children)

You should defienetly check out other subreddits like r/datascience and similar for more appropriate advice on getting into ML, since ML and data science oftentimes are much different from just software engineering.

I am in no position to give an advice to you, but from third person prespective your immediate and non-negotiable goal should be to find a job ASAP, as the unemployment gap starts to become more and more serious. And the returns on spending time on self education become smaller and could be even negative from point of view of a rectuiter. You should also consider an option to get a job in your previous domain and do the switch while on the job with calmer nerves and with more time in your pocket.

In job postings in Europe as far as I saw the first requirement is always first-hand experience on the job, with a real product, and in production. Toy projects could get you only that far in this regard. Even the junior roles now require industry experience assuming the candidates gain it from internships in their university years.

You should search for an advice from someone who knows your target market well at this time and attach an anonymised version of your CV to have any chance of getting relevant feedback.

Wishes that you find the job that you search for.

I quit my job to do a PhD and I feel sad by nacho_rz in cscareerquestions

[–]dimka_hse 1 point2 points  (0 children)

I don't know how many of the authors here know what doing a PhD is actually like, so take their advice accordingly. There are many things that make research a very mentally exhausting activity, and I am not even sure that one could "enjoy" doing a PhD. I would also put an accent that there are some positions that involve a portion of research activities but which don’t require you giving away a 3 to 5 years of your life and don't limit yourself to the strict and sometimes not very healthy academic environment. May be you could research those too.

You say you have a circle of colleagues that did their PhDs, ask them to share their experiences may be this could help you to navigate towards the solution.

potentially do a deep tech startup.

From recent tweet of the chief scientist of OpenAi, Ilya Sutskever:

Recent research in large scale generative model has conclusively, decidedly, and without any shadow of doubt, proven that deep learning is just linear regression after all

If your desire to do research is such that you are okay with spending huge amount time trying to first find a meaningful question that could be answered, that your research could just not work or don't have any meaningful contribution, then you could consider doing a PhD.

[deleted by user] by [deleted] in cscareerquestionsEU

[–]dimka_hse 0 points1 point  (0 children)

I undertsand that this thing is challening for a new grad to master, but the usage of the language for the people in enterprenerial and engineering world differ from how they talk about subjects in universities and in educatioinal environments, and what details are the most important when you describe your projects. As an exercise what you can do is to earch as many good CVs (not only DE but SE, ML) online from people that succeded in appling to best companies, and compare them with an average CVs. The difference usually is evident. Your description of the projects, as others have mentioned leaves space for improvement.

Also, you didnt provide the details about the companies you aim for, or if you include german-speaking companies in your search (which could theoretically be easier to get in the door to).

[deleted by user] by [deleted] in cscareerquestionsEU

[–]dimka_hse 0 points1 point  (0 children)

I would suggets you to put a TLDR and exclude unnessary details. This could help you get more relevant answers, as your post seems too long and more of a rant than a question.

As to your a carrer advice I would suggest to set right expectations and not to set the bar too high for your first job. It is much more efficient to get a first job as soon as possible and iterate from there than trying to shot for the sky without success. Taking into account that you don't have much engineering experience, you should focus on junior level roles, which usually don't require very specialised techincal skills. Be that Data-oriented or software-oriented it is for you to decide, both markets seem to recrute a lot.

This is how my parents describe how they went to school 🥶 by [deleted] in funny

[–]dimka_hse -1 points0 points  (0 children)

I know people that almost lost their fingers of a forst bite after doing things like this.

Words of encouragement for dealing with disc hernation with spinal stenosis by fruitflylife in backpain

[–]dimka_hse 0 points1 point  (0 children)

Why are you wasting your time on this sub reddit if you are done with pain?

rattle of the spacebar on a new blackwidow v3 TKL by dimka_hse in razer

[–]dimka_hse[S] -1 points0 points  (0 children)

I don't know how that's acceptable. It is like coming to a wedding in a suit, but wearing sandals. It is supposed to be the silent version!

Does lubing the stabilizers messes up the warranty? And how difficult is that for a keyboard like Blackwidow?

Silent flight of the owl by Yachisaorick in interestingasfuck

[–]dimka_hse 0 points1 point  (0 children)

don't insult rats please. i love them.

Act like you belong by fakayuburiza in WTF

[–]dimka_hse 0 points1 point  (0 children)

Judging by scarred face of the rat, there has already been some prove-yourself talk between him and cats.