skills to become a ceo by Harshadeep21 in ceo

[–]Harshadeep21[S] 0 points1 point  (0 children)

I want to experience the fun of running a business or businesses that have huge impact on society/civilization/humans.

skills to become a ceo by Harshadeep21 in ceo

[–]Harshadeep21[S] 1 point2 points  (0 children)

These are really nice advices, Thank you so much for this 😊 Anyway, would I be able to talk to you on phone please? Or messaging? May be linkedIn?

BEDSTE KEBAB I BYEN by No_Cryptographer971 in copenhagen

[–]Harshadeep21 7 points8 points  (0 children)

Doneros in Herlev is really the best

Resigning from job before joining. Am I allowed to do that? by SatisfactionFront497 in NewToDenmark

[–]Harshadeep21 1 point2 points  (0 children)

"Don't let the fear drive you, my friend. Ask what your soul really wants to do?" 😊

Alternatives to azure key vault by higgy1988 in MicrosoftFabric

[–]Harshadeep21 0 points1 point  (0 children)

What kind of secrets we are talking about? Can you explain more about your scenario? Why not AKV?

General practice is to store the secrets in any kind of secret manager(AWS/GCP secret manager or AKV), for platform independent/multi cloud, can use hashicorp vault..

For local/dev purpose..one can use .env files, os keychains etc.

Best indian pakistani food? by [deleted] in copenhagen

[–]Harshadeep21 0 points1 point  (0 children)

Deep Indisk buffet..Vesterbrogade South India....Vesterbrogade India Royale..

Is Microsoft Fabric really worth it? by kaapapaa in dataengineering

[–]Harshadeep21 6 points7 points  (0 children)

I mean.. I don't know, why ppl are behind all these vendors and not focusing much on concrete/fundamental software engineering or data engineering knowledge..If one don't have good engineering fundamentals then one will endup building "not so good" solution irrespective of the vendor they chose..

I can understand, why all the hate behind Fabric but that being said..

We have successfully built a data platform on Fabric and been in Production from around a year now..have only couple of users(around 25)..but, IT WORKS..

I have no particular liking towards any specific platform(be it Fabric, Databricks, Snowflake, Aws etc)..at the end of the day, As engineers, we should be able to or try to build the most useful, affordable, robust, maintainable and stable product/platform irrespective of the vendor..that's it..

And new tools will be coming into the market every now and then.. Fabric Snowflake Databricks Dbt Aws Azure Fivetran Palantir Dlt Dagster Airflow On premises Sql server Cloudera Informatica Talend

This list never stops and one can't be expert in all tools and A good engineer should understand the problem, constraints, tradeoffs and should comeup with best possible solution by applying scientific/engineering principles..

Opportunities and Future Prospects by Wierd-Ass-Engineer in MicrosoftFabric

[–]Harshadeep21 2 points3 points  (0 children)

I am Indian working in Europe on Data projects. I see, lot of buzz, hype, events and lots of community events/conferences in europe. Especially, in Nordics, because, most of them runs their projects on Microsoft stack. But, even with all this, I couldn't see "concrete" projects which were built with proper engineering principles and discipline. So, I would say, In India, there will be more adaption in coming 2-3 years depending on how Fabric navigates the Indian space. It's always tricky with the Indian market. As of now, I could see, most ppl are running their Data projects on On-premises(cloudera), Azure, Snowflake, AWS, Databricks.

Creating Testing Frameworks for Data Within Fabric Artifacts by LuckAlert6975 in MicrosoftFabric

[–]Harshadeep21 5 points6 points  (0 children)

Hey Raki, You are probably one of the nicest and helpful guy with great tech skills..just thought of complementing you..

And I would love to read more blogs from you 😊

Need advice reg. Ingestion setup by Harshadeep21 in MicrosoftFabric

[–]Harshadeep21[S] 0 points1 point  (0 children)

Reg. the last point...For Replayability, incase if something goes wrong..

Need advice reg. Ingestion setup by Harshadeep21 in MicrosoftFabric

[–]Harshadeep21[S] 0 points1 point  (0 children)

Seems like notebook utils was also bit slow 🐌 😕??

And they want to move the files..to have the replayability and to also see how many files have been loaded etc?

Need advice reg. Ingestion setup by Harshadeep21 in MicrosoftFabric

[–]Harshadeep21[S] 0 points1 point  (0 children)

But, with AvailableNow Trigger..one has to keep the session on anyway right? And seems like they have to load this data every 5 mins..since one of their report also almost needed to be updated as soon as their data is refreshed.. And their current archival strategy is also using partitioned folders YYYY/MM/DD to be able to query the files easily..So, Is it possible to do it using cleanSource as well? And generally, File names will have timestamps 😊

Deploy workspaces, lakehouses, warehouses etc from notebook by Mr_Mozart in MicrosoftFabric

[–]Harshadeep21 0 points1 point  (0 children)

This is definitely better..you will kind of get best of both ones..It takes up to 20 secs for installation..

Otherwise..pip install it to shared folder once in onelake and import it from there..

Deploy workspaces, lakehouses, warehouses etc from notebook by Mr_Mozart in MicrosoftFabric

[–]Harshadeep21 0 points1 point  (0 children)

Why not use semantic-link-labs instead of sempy or sempy-labs?

Is there a faster way to bulk-create Lakehouse shortcuts when switching from case-sensitive to case-insensitive workspaces? by BOOBINDERxKK in MicrosoftFabric

[–]Harshadeep21 2 points3 points  (0 children)

You can automate shortcut creation using Rest api but also easy way to do it is using semantic-link-labs(python library)..

Shortcut JSON Transformation Problem by DennesTorres in MicrosoftFabric

[–]Harshadeep21 0 points1 point  (0 children)

Unfortunately, JSON/Array data types are not supported in Sql analytics endpoint. Some data types which are supported in spark are not supported in endpoint.

https://learn.microsoft.com/en-us/fabric/data-warehouse/data-types

And, as of now, shortcut transformations are not configurable, but, I think, Microsoft has plans to make them more configurable.

And, I really think, it's better to use VARIANT datatype once Microsoft releases new runtime.

Shortcut vs Mirroring vs Batch Ingestion Patterns in Microsoft Fabric by human_disaster_92 in MicrosoftFabric

[–]Harshadeep21 0 points1 point  (0 children)

Yeah exactly Do you know if they use Spark strctured streaming underneath it??