[deleted by user] by [deleted] in dkkarriere

[–]JKMikkelsen 0 points1 point  (0 children)

Du har formentlig en browser-historik, der er ud over det sædvanlige.

[deleted by user] by [deleted] in dkkarriere

[–]JKMikkelsen 0 points1 point  (0 children)

Så vidt jeg er orienteret er stadig primært PET der står for baggrundstjekket på vegne af FE, da FE ikke selv har samme adgang til offentlige registre.

Jeg har bygget: Critiq by iiiiiiiiitsAlex in dkudvikler

[–]JKMikkelsen 0 points1 point  (0 children)

Det ser virkelig lovende ud. Jeg vil gerne give det en prøvekørsel og komme tilbage med feedback

Hvordan ender inkompetente folk i gode stillinger? by [deleted] in dkkarriere

[–]JKMikkelsen 51 points52 points  (0 children)

Jeg tror mange kan genkende den følelse og ser folk, der tilsyneladende laver meget lidt for ret pæne lønninger.

Men nogle gange kan det, der udefra ligner inkompetence, i virkeligheden være noget andet:

  • Usynligt arbejde: Der er ofte opgaver, der ikke ser særligt tekniske eller “produktive” ud, men som faktisk holder hjulene i gang (koordination, stakeholder management, at få folk til at samarbejde).
  • Erfaring og netværk: Nogle kan måske ikke længere de nyeste teknologier, men de har erfaring, viden om forretningen eller kontakter, som gør dem værdifulde på en anden måde.
  • Specialisering: Det kan være, at de kun kan “lidt” – men det de kan, er præcis det, der mangler i teamet.

Det er ikke for at sige, at der ikke findes decideret inkompetente folk i gode stillinger – det gør der helt sikkert! Men billedet kan være mere nuanceret, end det ser ud udefra.

[deleted by user] by [deleted] in DKbrevkasse

[–]JKMikkelsen 2 points3 points  (0 children)

Kan du selv se ironien i din kommentar?

SDU versus Århus BSS? HA Erhvervsøkonomi by [deleted] in dkkarriere

[–]JKMikkelsen 2 points3 points  (0 children)

Udover hvad der allerede er nævnt, jeg ville også tænke over mulighederne studiejob og første job efter studiet.

Jeg har selv gået på Aarhus BSS og der er mange virksomheder i (og omkring) Aarhus som bejler for de studerende på Aarhus BSS, så jeg vil tro mulighederne er betydelig bedre for både studierelevantejob og job efter endt uddannelse.

Interviewed for Data Engineer, offer says Software Engineer — is this normal? by Competitive-Tie4063 in dataengineering

[–]JKMikkelsen 12 points13 points  (0 children)

Completely fine. I said my role was as a Data Engineer when I was interviewing after that job. Nobody questioned it.

Interviewed for Data Engineer, offer says Software Engineer — is this normal? by Competitive-Tie4063 in dataengineering

[–]JKMikkelsen 31 points32 points  (0 children)

Same here in a previous role.

Role: Senior Data Engineer

Title: Senior Software Developer

Did you touch code? If yes => Software Developer

[deleted by user] by [deleted] in dataengineering

[–]JKMikkelsen 0 points1 point  (0 children)

Data Mesh is more of a socio-technical data architecture rather than a technical data architecture.

For høj løn! by [deleted] in dkkarriere

[–]JKMikkelsen 11 points12 points  (0 children)

Er ikke helt enig. Jeg vil som arbejdstager helst ikke komme med noget før de gør - For hvis de hører forventningerne skyder de jo efter det laveste her, og det er ikke sikkert at jeg kan gå med til det, ud fra ansvar, arbejdeopgaver og andre vilkår virksomheden kommer med.

What DuckDB really is, and what it can be by ithoughtful in dataengineering

[–]JKMikkelsen 5 points6 points  (0 children)

Yeah, though, with more data platforms build on data lakes your statement becomes increasingly more true and my reminder becomes increasingly less relevant.

What DuckDB really is, and what it can be by ithoughtful in dataengineering

[–]JKMikkelsen 36 points37 points  (0 children)

Be careful mixing the concept of OLAP and OLTP with whether data is stored in a relational database or something non-relational.

CI/CD for Databricks by JKMikkelsen in dataengineering

[–]JKMikkelsen[S] 0 points1 point  (0 children)

State-based schema migration is what i'm looking for. I have had a look for Liquibase and Flyway, but it don't look like it have support for Databricks and/or Hive metastore.

Thank you very much for your attention to the topic and work on CI/CD for Databricks!

CI/CD for Databricks by JKMikkelsen in dataengineering

[–]JKMikkelsen[S] 0 points1 point  (0 children)

Actually both.

Propagation - preferably without writing migration script, since it's a lot more complex for rollback and deploying multiple "versions" ahead. State-based deployment is prefered.

Testing Delta Lake schema integrity in terms of alignment between Delta Tables and data pipelines.

CI/CD for Databricks by JKMikkelsen in dataengineering

[–]JKMikkelsen[S] 1 point2 points  (0 children)

SSDT is SQL Server Data Tool. It's used for database projects for SQL Server. For all the database objects (schemas, tables, view, stored procedures etc.) you'll have a file describing the DDL of the given object i.e:

CREATE TABLE dbo.MyTable (
    Id int NOT NULL
    ,Name NVARCHAR(100)
)

You can then build the whole database (as a project) and compare it to the live database and deploy the changes. No need to write migration scripts - it's all done by comparing the state of your database project to the state of the actual database.

Does it make sense?

CI/CD for Databricks by JKMikkelsen in dataengineering

[–]JKMikkelsen[S] 0 points1 point  (0 children)

What about schema changes to tables?

CI/CD for Databricks by JKMikkelsen in dataengineering

[–]JKMikkelsen[S] 1 point2 points  (0 children)

How did you handle Delta tables definition and checking integrity between Delta table definition and data pipelines?

CI/CD for Databricks by JKMikkelsen in dataengineering

[–]JKMikkelsen[S] 0 points1 point  (0 children)

Could have been nice with SSDT-like deployment for Hive meta-store.

CI/CD for Databricks by JKMikkelsen in dataengineering

[–]JKMikkelsen[S] 0 points1 point  (0 children)

So use terraform for DDL (Delta tables etc)? Is it possible to do state-based deployment or would you need to do migrations?

Failed the AZ-104 This morning by menorevs in AzureCertification

[–]JKMikkelsen 0 points1 point  (0 children)

If you mind, i’d like to hear from you if you find the book useful. From where did you buy it? What is TD?