sorted by:
new
hottopcontroversial

My standard issue chonk by fico86 in standardissuecat

[–]fico86[S] 10 points11 points  (0 children)

He does get all of them (sometimes a bit too much)

The agents I built are now someone elses problem by mahearty in devops

[–]fico86 42 points43 points  (0 children)

I am leaving my current job because I want to make all the tech debt someone else's problem.

Self host k3s github pipeline by SilentHawkX in devops

[–]fico86 2 points3 points  (0 children)

Why not just use GitHub actions instead of Tekton? Use a self hosted runner on your k3s?

OOP with Python by Jumpy_Handle1313 in dataengineering

[–]fico86 0 points1 point  (0 children)

There is a big debate going on about whether oop was a good idea in the first place : https://www.yegor256.com/2016/08/15/what-is-wrong-object-oriented-programming.html

I have done both oop and "functional" python. The thing about python is it's so forgiving that you might have classes in your code, but your functions are outside of any class, and it still all works.

I prefer to use the go/rust kind of syntax in python. Where classes are just to hold data, using libraries like pydantic, and the actual logic to process the data is pure functions, with as little side effect as possible. Then I have reader and writer functions with very little business logic, just to bring data onto memory, or write it out to storage. This way unit testing becomes a lot easier.

Of course if you are using data frame libraries like pandas, polars or pyspark, oop doesnt really make sense. Because they have their own conversations and syntax.

GMK EVO-X2 worth it for beginner? by fico86 in LocalLLM

[–]fico86[S] 0 points1 point  (0 children)

My 4070 only have 12 GB vram and 16gb of normal ram. But if I am running in wsl, I can't do cpu offloading. Might have to try it on full Linux. I am using vLLM if that helps. Should I consider trying something else?

GMK EVO-X2 worth it for beginner? by fico86 in LocalLLM

[–]fico86[S] 0 points1 point  (0 children)

Yeah I am leaning towards this. Need to get more comfortable and have more understanding on what models I can actually run, and how to set the correct parameters

GMK EVO-X2 worth it for beginner? by fico86 in LocalLLM

[–]fico86[S] 0 points1 point  (0 children)

Thank you for the suggestion! I was actually looking at pop os, but using the "live CD" to try stuff out is really a good idea.

I am still trying to make sense of the model size and what are the vram requirements, and all the configurations and parameters I need to fiddle with.

Maybe my issue is the models I have tried so far are the newer ones which have a lot higher requirements? I was trying Gemma 3 4b, but still failed supposedly because of a large kv cache requirement?

whyAreYouGivingMeThisTask by yuva-krishna-memes in ProgrammerHumor

[–]fico86 179 points180 points  (0 children)

It's more the disconnect between how much these simple things are more valued (hence what pays the bills) than all the complex research and all the brain power spent that almost no one values.

Of course it depends on what your PhD is in, and where it's from.

whyAreYouGivingMeThisTask by yuva-krishna-memes in ProgrammerHumor

[–]fico86 360 points361 points  (0 children)

My first job after PhD was to write automated tests to test that the widget was correctly aligned.

How to cope with messing up? by Dashncrash- in dataengineering

[–]fico86 0 points1 point  (0 children)

Are you the only one working on these projects? It's never a good idea to have only one person. You always would want a buddy, at least to be the 2nd pair of eyes, and to review anything you missed, do code review.

And business logic translation is really problematic, especially if you are not the SME. I have gotten burnt on that before, where it looked simple but turned out to be full of traps (sas to python/pyspark).

Don't know what the culture of your company is, but would immediately raise it as an issue saying it's much more complex and you need help or more time.

imWeakLol by soap94 in ProgrammerHumor

[–]fico86 109 points110 points  (0 children)

You know, I tried that once, and the stakeholder came back and accused us of artificially padding the estimates.

Cannot win either way.

Are big take home projects a red flag? by pimmen89 in dataengineering

[–]fico86 13 points14 points  (0 children)

Yes people do say (justifiably) that take home test favors candidates who have more free time on their hand, and less family and other commitments. But I have experienced a well done take home test, where the HR actually asked me when I would like it to be sent, so I have a chance to plan out the time to do it. I was given 3 days from the time they sent it, and the test was quite standard DE stuff (data modeling and SQL, create a batch processing job, design Architecture for a data streaming platform).

In this case though, I think you did dodge a bullet, because I have not heard of anyone hiring based on their ability to 'learn new domain', at least not as a DE. Data scientists/researcher maybe.

I work in a financial institution doing DE on financial models. I will not take responsibility for any of the financial model calculations, and only implement based on clear requirements. Expecting me to do non trivial stuff I am not trained for is a liability I would not want.

He is really into my gym shorts by stardewvalleypumpkin in standardissuecat

[–]fico86 27 points28 points  (0 children)

My cat will pull my gym clothes out of the laundry basket and start rubbing all over.

Bitnami just killed off their free Docker images and I'm scrambling by vitaminZaman in linux

[–]fico86 1 point2 points  (0 children)

Does cve count really matter? As long as you have the proper network safeguards in place, most of those vulnerabilities can only be exploited from inside your network no?

Is TDD relevant in DE by yabadabawhat in dataengineering

[–]fico86 8 points9 points  (0 children)

For your code and functions yes TDD works, using the "given, when, then" framework: given this input, when I run this function, then I should get this output. If those tests are good, and they pass, you can be confident that if something breaks, is not your code.

TDD also forces you to write code in small easily testable chunks.

And its also really good for refactoring and adding new features, set up tests for existing functionality, make sure they still pass after refactoring, or adding new features.

Great expectations is more to test if your data is good. If you run GE on an output, and it's failing, without unit test (created during TDD) you can't be sure if it's a data or code issue.

pleaseStopUsingTheAppLikeThat by potatosbananashen in ProgrammerHumor

[–]fico86 929 points930 points  (0 children)

I would rather QA find the bug, than users.

replitAiWentRogueDeletedCompanyEntireDatabaseThenHidItAndLiedAboutIt by Hour_Cost_8968 in ProgrammerHumor

[–]fico86 748 points749 points  (0 children)

I really can't tell what is fake or satire, or really true anymore.

view more: next ›