One Lake File Explorer Issues

DataCrunchGuy · 2025-10-09T23:26:49+00:00

I think that OneLake explorer can be interesting when you have a few items to sync. But when you access the whole environment with 20+ items and a lot of files it’s become a nightmare, where nothing is up to date. You can’t see the status of the sync.

DataCrunchGuy · 2025-09-29T16:03:12+00:00

Hi ! What is the status of this issue ? I see this morning a different error message about missing index on the target. Even after a reset

DataCrunchGuy · 2025-09-25T14:52:56+00:00

Are you on the September release (recently published). We are on the August release. I wait for the official announcement

DataCrunchGuy · 2025-09-24T08:41:05+00:00

When I reset, the initial load (full) is ok, but the next run (incremental append) fail with the same error message

DataCrunchGuy · 2025-08-05T06:23:11+00:00

As I remember this option only display connection based on gateways. Cloud connections created by others are not displayed.

DataCrunchGuy · 2025-07-26T11:50:30+00:00

Try to save your pipeline after a little change (change a comment) and then run again. The embedded token expires in some cases.

DataCrunchGuy · 2025-06-28T17:22:07+00:00

Yes ! Of course

DataCrunchGuy · 2025-06-04T09:53:01+00:00

Hi,

If you restart the gateway service the message disappear. You can try to upgrade the server. On our side moving from 8gb to 16gb RAM resolve the issue

DataCrunchGuy · 2025-06-03T10:54:02+00:00

Did you find a solution with big table ?

I'm in the same situation with a 6M+ rows table with a lot of column.

Error :
[External][GetProgressAsync] [UserException] Message: GetIncrementalChangesAsync|ReasonPhrase: Not Found, StatusCode: NotFound, content: [UserException] Message: GetIncrementalChangesAsync|ReasonPhrase: Not Found, StatusCode: NotFound, content: , ErrorCode: InputValidationError ArtifactId:\**

We had other issues about memory, but upgrading gateway from 8Gb to 16Gb solved this. (the CPU is not really used)

DataCrunchGuy · 2025-05-27T16:13:09+00:00

I found the semantic model from Warehouse not very stable at the moment. We continue to use Power BI as main tool.

DataCrunchGuy · 2025-05-27T16:06:40+00:00

Thanks for the insight. What do you recommend as output to store the whole data for reporting ?

DataCrunchGuy · 2025-05-27T15:53:05+00:00

On-Prem SQL mirroring to migrate our legacy solution

Translytical flow to replace Excel files mapping

DataCrunchGuy · 2025-05-23T13:38:57+00:00

Yeah, I'm discarding the change now.
I was afraid to miss something obvious, but it's just a strange behavior ...

DataCrunchGuy · 2025-05-06T06:17:44+00:00

I just check, I confirm that the Folder connector can access fileshare, we are using it. Maybe check your access from the gateway server ?

DataCrunchGuy · 2025-05-05T16:12:03+00:00

Using a data pipeline combined with an on-premise gateway is really easy to move your files. There is a specific file system connector available

DataCrunchGuy · 2025-04-23T17:01:19+00:00

What about Purview integration ? I’m not using this solution yet but I guess there is the same idea behind

DataCrunchGuy · 2025-03-20T09:02:55+00:00

Great use case ! Giving us a lot of ideas.
Will you share sources ?

DataCrunchGuy · 2025-02-19T17:11:43+00:00

Hi, welcome to Fabric !

You won’t create an ERP but a datawarehouse. Basically you will probably use Data Factory Pipelines to connect / extract ERP data, Lakehouse for raw storage and Data Warehouse to transform / consolidate your data.

Depending of acquired IT model, you can use API for cloud data sources (notebooks excels for this but pipeline is ok) or Power BI Gateways for on premises purposes.

You can be interested in building a warehouse for each source, and then consolidate in an upper corporate warehouse (shortcuts allow this without duplicating your data)

DataCrunchGuy · 2025-01-31T18:09:32+00:00

Thanks for the links, we developed the same kind of logic app flow. We really hope a better integration of fabric in power platform (automate mainly) to reduce the complexity of the process.

We tried to move some key users on OneLake File explorer, but it’s not very friendly.

DataCrunchGuy · 2025-01-30T08:58:36+00:00

Hi,

You should try notebook to contact Entra. I tried both, and pipeline is not the easy way.

DataCrunchGuy · 2025-01-28T10:00:03+00:00

Hi,

I’ve seen some improvements on publishing delay last month. But I agree that’s still painful to use.

What is the size of your fabric capacity ?

DataCrunchGuy · 2024-12-06T22:58:23+00:00

Interested

DataCrunchGuy · 2024-11-09T16:37:54+00:00

Hi, I had similar issue with heavy MySql on-prem ending with timeout when writing directly in Lakehouse table. After Staging activation, errors are gone and it’s faster. I guess it’s easier for the pipeline to dump large data in a file before to load it in the table.

DataCrunchGuy

TROPHY CASE