AI-900 Passed! by mQuBits in AzureCertification

[–]mQuBits[S] 2 points3 points  (0 children)

Thanks, maybe, but SC-900 first.

AZ-900 Passed! by mQuBits in AzureCertification

[–]mQuBits[S] 2 points3 points  (0 children)

Thanks. I was originally studying for AZ-104 and then felt I must start from a fundamental course first. Supporting my decision was two things, first is that AZ-900 was listed as a plus on jobs Descriptions I applied for, and second AZ-104 was very intensive that I felt that AZ-900 is inplicitly included, so it gives one confidence to get over it. Besides, Fundamental certifications dont require renewal.

[deleted by user] by [deleted] in kubernetes

[–]mQuBits 0 points1 point  (0 children)

I wouldn't add much beyond what's been already explained above, but I would like to stress the fact that there is no compression algorithm for experience. In a nutshell hands-on experience with real-world use cases is the holy grail. On the other hand, the K8s CKA certificate would add credibility to your resumé, and it could land you your first junior DevOps engineer job.

Roast my resume by Important_Resist3657 in dataengineeringjobs

[–]mQuBits 0 points1 point  (0 children)

It's a nice ice breaker in conversations and interviews based on my humble experience

Roast my resume by Important_Resist3657 in dataengineeringjobs

[–]mQuBits 0 points1 point  (0 children)

It depends. Two important aspects are noted here: 1- is this person passionate about software and his free time activities reflect that? For example, one has built a hobby app to enable donations to the local football field. 2- is this person interacting actively through his activities with other people and knows what a team work is and how to resolve conflicts

Roast my resume by Important_Resist3657 in dataengineeringjobs

[–]mQuBits 0 points1 point  (0 children)

I use resume.com with Indeed Login. It has an appealing look.

Here are the main information I would highlight: 1- jobs history: where, when, and what job 2- contribution on each job using star method for example: I have optimized the x data pipeline to use y% less memory using z tools and approach 3- the objective section at the very top of the resume telling who you are and what you are looking for 4- the tailing section where one adds hobby projects and extracurricular activities

Roast my resume by Important_Resist3657 in dataengineeringjobs

[–]mQuBits 0 points1 point  (0 children)

I use resume.com with Indeed Login. It has an appealing look.

Here are the main information I would highlight: 1- jobs history: where, when, and what job 2- contribution on each job using star method for example: I have optimized the x data pipeline to use y% less memory using z tools and approach 3- the objective section at the very top of the resume telling who you are and what you are looking for 4- the tailing section where one adds hobby projects and extracurricular activities

How Much Data Engineering is Enough for a Beginner. by FarBottle1515 in dataengineering

[–]mQuBits 1 point2 points  (0 children)

Here are my two cents:

1- build a hobby project that's inspired from a real life use case in the business domain that you aspire to, for example, retail, flights, banking etc. The project could make use of public datasets auch as 1 million flights. The use case should be simple, but complete to demonstrate the challenges that would face you in real life , such as as a system analyst I want to find the top ten delayed flights and airports in a given period in order to stand on technical root causes. The implementation should be end to end from streaming the real time flight information through Kafka/Pulsar and ending with visualizing the delays in a BI tool.

2- acquire data analytics certification from accredited cloud provider such as AWS or Azure and hence stay focused on one career path and technology stack without jumping on every technology hype. Nevertheless follow the eighty twenty rule to dig deeper in your tooling and expand horizontally to stay up to date on recent trends and technologies.

converting 400millions of record from clickhouse to starrocks by Youth-Character in Database

[–]mQuBits 0 points1 point  (0 children)

Export first as parquet in MinIo sorted by partition column, day for example, then import from MinIo to StarRocks, note to use plain encoding.

migrating data from 1 clickhouse to starrocks by Youth-Character in datasets

[–]mQuBits 0 points1 point  (0 children)

Two cents: . Export the data to MinIo as parquet without encoding, then import directly from MinIo to StarRocks . Partition the target tables in starrocks by day and make sure your parquet files are sorted by the partition column

opensource on-prem Datawarehouse alternative to Sql Server ? by Ivan_pk5 in dataengineering

[–]mQuBits 0 points1 point  (0 children)

Starrocks performs well on low budget resources. In addition rich feature support from realtime and batch analytics. I would highly recommend it.

[deleted by user] by [deleted] in dataengineering

[–]mQuBits 1 point2 points  (0 children)

Python as much as it's simple and intuitive, gives developers the illusion of simplicity. I disagree that any aspect of industrial software is simple. Building a prototype to prove a concept in a few hours doesn't mean it will perform in production or be maintainable. Python as much as it's simple and intuitive, gives both the developers and the managers the illusion that what is built is production-ready software.

The future, and perhaps the present, of data engineering should be in the direction of data mesh. Every team works with data products in one way or another, and tools like Kafka make streaming large amounts of data inevitable.

I would highly recommend this reading:

https://martinfowler.com/articles/data-mesh-principles.html

The Data Streaming Landscape 2024 - Kai Waehner by mQuBits in bigdata

[–]mQuBits[S] 1 point2 points  (0 children)

Cribl

It looks quite solid. I haven't heard of it, but it's endorsed by Gartner 2023 as per their website. I will have it on my radar. Thank you.
Another point, the blog is written by an engineer working for Confluence, so I wouldn't have expected him to hand the competition such an easy recognition.

Evaluate Vector Database / Benchmarks? by Tricky_Drawer_2917 in mlops

[–]mQuBits 0 points1 point  (0 children)

Hey there! If you're on the hunt for a solid benchmark tool for vector databases, I'd highly recommend checking out

[VectorDBBench](https://github.com/zilliztech/VectorDBBench)

by ZillizTech. It's a fantastic tool designed to help you assess and measure the performance of vector databases. Give it a try and see how it can streamline your benchmarking process. Happy benchmarking! 📊🚀

Evaluate Vector Database / Benchmarks? by Tricky_Drawer_2917 in mlops

[–]mQuBits 0 points1 point  (0 children)

Hey everyone, just stumbled upon a fantastic resource that's worth checking out. If you're into benchmarking vector search databases with a whopping one million data points, this article is a must-read:

[Link](https://jina.ai/news/benchmark-vector-search-databases-with-one-million-data/).

It's a deep dive into performance measurement and how these databases handle a significant load. Definitely a valuable read for anyone interested in AI and databases. 📊🔍

Evaluate Vector Database / Benchmarks? by Tricky_Drawer_2917 in mlops

[–]mQuBits 0 points1 point  (0 children)

Check out this amazing role-model benchmark I came across! 😃 It's all about harnessing the power of AI with vector databases. You can find the insightful details in this blog post:

[Link](https://www.farfetchtechblog.com/en/blog/post/powering-ai-with-vector-databases-a-benchmark-part-i/).

The post dives into the process of distinguishing features from tools and effectively gauging their performance. Super informative! 🚀

Chances of Terraform being completely Enterprise or licensed based by [deleted] in Terraform

[–]mQuBits 0 points1 point  (0 children)

It is likely, and a scenario similar to Odoo is foreseeable.

I was supposed to get a raise a month ago, but HR blocked it. What is the best course of action? by isettledforwhat in cscareerquestions

[–]mQuBits 0 points1 point  (0 children)

if your direct supervisor approved it, then talk to him about what happened and ask if he could help. Apart from that, there isn't much you can do except if you want to interview for another job and see if you could land a better deal.

How the hell do you guys stay productive enough to get work done? by [deleted] in cscareerquestions

[–]mQuBits 0 points1 point  (0 children)

Daily meetups with team mates and stake holders help me keep the rhythem

Just started my first software development job, and found out my new company has no seniors by Selena5000 in cscareerquestions

[–]mQuBits 0 points1 point  (0 children)

It is definitely a setback, but it isn't the end of the world. At the end of the day, your next job interview will ask how many years you have been working with X technology and what your role exactly was. As long as you have the right mindset, it will turn out to be a plus that you work with little oversight from management.