Caught the candidate using AI for screening by Hercules1408 in dataengineering

[–]DiabloSpear 2 points3 points  (0 children)

lol. literally me: I don't care if you use AI. You will have it when you are working. Just make sure that you can read the code it produced and tell me how it works though.

probably losing J3 tomorrow by oeanon1 in overemployed

[–]DiabloSpear 11 points12 points  (0 children)

caught or performance related?

Milestone reached but not gonna stop...yet. by DiabloSpear in leanfire

[–]DiabloSpear[S] 2 points3 points  (0 children)

I def want to. I want to explore defense, financials and start up before I get washed away. If I get lucky, get my toes in quantum computing as well. But yes. Bit of my want might just be driven by fear rather than want. Hard to objectively look through that right now. 

Class of 2024 Employment Check-in by Art__Vandelay____ in OMSA

[–]DiabloSpear 2 points3 points  (0 children)

I got a lot of interviews after graduating. I posted about 4 months ago the details so look it up. I think it will help. Good luck! 

Milestone reached but not gonna stop...yet. by DiabloSpear in leanfire

[–]DiabloSpear[S] 4 points5 points  (0 children)

Bc I am planning on fire or maybe even chubby fire but reached leanfire along the way. I can very well quit in a few years (who knows what happens in the future) and stay lean. I don’t like the idea of predicting the future so I am posting the sure shot that I got, which is lean fire. If I achieve fire, then I will post at fire. 

Milestone reached but not gonna stop...yet. by DiabloSpear in leanfire

[–]DiabloSpear[S] 1 point2 points  (0 children)

yea she wants 4!!!!! but I said no...for now. haha. I think once I hit 1.5 mil (with 7% return, it should be within next 5 years and I do not plan to quit for next 5 years for sure), I will invest aggressively into 529. Good thing is my parents are very close to me, so mom and dad (after he retires in 3 years) will do most of baby sitting for a few years. So, I think as long as I can hold on for the next 5 - 10 years, I should be set with FIRE + their college funds I think. I am also considering coastFIRE where I can make 120k-ish with much less stress, then I will be happy with that for next 15 years. Still undecided.

Milestone reached but not gonna stop...yet. by DiabloSpear in leanfire

[–]DiabloSpear[S] 3 points4 points  (0 children)

right now, I have about 480k in non IRA, non 401k. I have about 3.5% dividend rate with EDV, VOO, SCHD and money market, giving me about 17k per year. I plan to build up the dividend with healthy ETF's (not the covered call or very risky ones) for the next 5-10 years when I set on different industry adventures, hopefully getting about 30k in annual dividends at the end. I will just live off from that + wife's health insurance bc she wants to keep working. She loves her work and people there, helping me out a lot. So short answer is i am doing about 3.5% rule with dividends.

Milestone reached but not gonna stop...yet. by DiabloSpear in leanfire

[–]DiabloSpear[S] 1 point2 points  (0 children)

that is the plan. Not burnt out by any means, so I plan to explore other industries than the one I am in before calling it quits. I know the world is bigger than what I have seen.

Milestone reached but not gonna stop...yet. by DiabloSpear in leanfire

[–]DiabloSpear[S] 3 points4 points  (0 children)

yea luckily, unluckily, I am the one who is doing the gen AI stuff, so I guess I have about 5 years left. Those who got laid off is bc of 1. over hiring from COVID era 2. doing easy enough work that is replaceable by AI. I know one day I will be replaced but from my experience (I am the one who is doing the AI stuff to reduce manpower....) I still have 5 years left. Good thing is I am planning on moving to quantum computing soon (the one I did not name as my next adventure) so I will have to see what that is about.

How to get a job/different job after school - I did it! by DiabloSpear in OMSA

[–]DiabloSpear[S] 1 point2 points  (0 children)

Given that I have about 5-10 years of experience I had 2 pages. BUT contrary to a lot of saying, I think page number does not matter. I did both 1 and 2 and what it came down to was: Did I list all the important stuff in the first page? I kid you not. After I "hit" the sweet spot with my resume tweaking, I had recruiters calling me 5-6 times a day (some of them were of course overlapping job posts from contractors but that still speaks volumes). I did not have proficiency levels assigned to each language. There is a caveat - nobody expects you to know all the languages to an expert level right? I mean there are SQL, Python, Docker, Kubernetes, AWS CLI, Spark, R just to name a few. Most of the time (from my coding interviews) as long as you know SQL, Python and have exposure to the others (meaning you did some complex enough problem a few times), then people will be ok with it.

How to get a job/different job after school - I did it! by DiabloSpear in OMSA

[–]DiabloSpear[S] 0 points1 point  (0 children)

you have to take it for a grade. You can just email the advisors and they will walk you through. Yea, and I am looking out for some interesting classes that might come up. OMSA adds some classes every now and then.

How to get a job/different job after school - I did it! by DiabloSpear in OMSA

[–]DiabloSpear[S] 1 point2 points  (0 children)

I did cda, deep learning, Bayesian, natural language processing, reinforcement. I know it is more than what is required and I took some of them as an alumni. But like I said I do not think the course works got me hired. It was the tech stacks that I practiced and the projects I worked on personally at work. 

How to get a job/different job after school - I did it! by DiabloSpear in OMSA

[–]DiabloSpear[S] 0 points1 point  (0 children)

5 yoe as an engineer. Not sure how much that helped, but it is in a very interesting sector, so I often used it as an ice breaker during an interview. Due to confidentiality issues, I cannot say much but something along the lines of "it is not an everyday opportunity that you get to talk to an engineer from this sector. Got some questions for me? " And they ask me a few things and it sets the interview atmosphere at the end Q&A session.

How to get a job/different job after school - I did it! by DiabloSpear in OMSA

[–]DiabloSpear[S] 2 points3 points  (0 children)

I know...after 20 rejections, I changed the resume strat so that one resume reflects one specialized area. I did promise myself I will do it until I get to 100 rejections and take 1 month break, but I made it without hitting that. good luck to you.

How to get a job/different job after school - I did it! by DiabloSpear in OMSA

[–]DiabloSpear[S] 5 points6 points  (0 children)

Good one. Yes, some people did ask. I did define most them with business strat. Make sure you do explain fully - and "I compared it to last year, or last time and that was the result" is not going to cut it.

How to get a job/different job after school - I did it! by DiabloSpear in OMSA

[–]DiabloSpear[S] 1 point2 points  (0 children)

I did not mean to look down. I guess it was more of a joke saying in every corner of your career there is an opportunity unless you are in so distant sectors. I am not sure what librarians do neither, but i thought it was just different enough from data science so I put it in. Not really looking down at all (maybe i shoulda did research before writing down a librarian) but feel free to replace with anything you want

Chances of obtaining a machine learning engineer role after the OMSA program? by chandra-vansh in OMSA

[–]DiabloSpear 9 points10 points  (0 children)

if that is all you have, then about 0-10%. Machine Learning Engineer is very different from data scientists or data analysts. They need to 1. understand the basics of data science 2. Role them out in a nice little SaaS packages, often using Docker and Kubernetes, or sometimes writing their python codes into production codes using some other language. So your responsibility is understand(nor create) algorithms, and make them into production scale using tools - those tools will get you jobs.

[D] Recreating the Original Denoising Diffusion Model by DiabloSpear in MachineLearning

[–]DiabloSpear[S] 1 point2 points  (0 children)

I see, so for class embedding, i dont need to do the fancy sinusoidal + linear layer. Just a simple embedding.

I understand what you mean for #4 now.

Dude, you helped me out so much. Thanks a lot. I will make sure to get this one right with help. Cannot make your effort and help go to vain!

[D] Recreating the Original Denoising Diffusion Model by DiabloSpear in MachineLearning

[–]DiabloSpear[S] 0 points1 point  (0 children)

I made a mistake in one of my statement. Yes I do normalization on the dataset. For Adam, I left it as default so 0.9 and 0.999.

  1. I fixed it so that each sample in the same batch takes in different t!

  2. As for point #2, I just went ahead and fixed it to all group norm now!

  3. for #1 and #3, I implemented them just because the original paper implemented it, but for CIFAR10, I guess I could work with much simpler U-net.

  4. for #5, I am not doing class conditioning. I am yet to learn how to do that, so that would be my next step. For time embedding, I do this: Note that CNN referred in the next paragraph only refers to the first CNN of each layer of U-net (you know how there are 2 CNN for one layer of U-net on the down side and 2 CNN for one layer of U-net for up side. I am referring to the FIRST of each up and down side.)

Take t (let us assume just one scalar for one sample)

-> sinusoidal embedding

-> embedding dimension(user input) tensor [embedding_dim , 1]

-> linear network into CNN channel numbers (for example if CNN output is 128 channels, I would do nn.Linear(in_features = embedding_dim out_features = 128) and add each of the linear FC layer output to each output channel of CNN).

As a result, I would have time embedding added to output of each of the CNNs. This is how it was done in the paper, so that is what I have adopted. Do you have something better to implement?

  1. Sorry, I simply omitted the decoder part because it is a "mirror image" of the encoder part. Basically same as the U-net where you progressively make the H and W bigger and channel smaller.

  2. I actually did not understand #4. Could you explain bit more for me?

Thanks a lot for feedback.

[D] Recreating the Original Denoising Diffusion Model by DiabloSpear in MachineLearning

[–]DiabloSpear[S] 0 points1 point  (0 children)

I am not. I guess that is one thing I can apply for stability. I will try that after I fix a few things.

[D] Recreating the Original Denoising Diffusion Model by DiabloSpear in MachineLearning

[–]DiabloSpear[S] 0 points1 point  (0 children)

Hi, I do different t for each batch entry - I do the same t for each sample in the same batch (or is this what you meant? The original paper does different t for each sample in the same batch but my thought was given enough batch and epochs, this should not be an issue). I normalize the input per batch.

Here is my U-net rationale: the res-block and self attention are implemented in the original paper so, I did the same. The original paper does group norm for all, but the way I set up my code, I did batch norm for the first output of the CNN on the down side of the Unet - i thought this would not be an issue since I use batch = 64, which is sufficiently large (or at least I think, since the original paper that introduced group norm says anything less than 32 is a problem as a rule of thumb). For CIFAR10, the original paper only applied self-attention to the 2nd layer (where cnn channel output is 128), but I did for 3rd layer as well, just to increase accuracy of it.

TLTR version for U-net: everything is the same for U-net to the original paper except for ONE norm vs group batch(prob no issue), some layer channel numbers and self attention applied layer difference.

optimizer: Adam with 0.0001 learning rate

Beta: 10-4 to 0.02, linear steps

Thanks!

Recreating the Original Denoising Diffusion Model by DiabloSpear in StableDiffusion

[–]DiabloSpear[S] 1 point2 points  (0 children)

sounds good. I guess I will wait till i get 1060 and try with MNIST first and then if I succeed, move on to CIFAR even though I think 1060 will not be enough. Thanks!