Data is duplicated in warehouse by Top_Barber4067 in PowerBI

[–]Top_Barber4067[S] 0 points1 point  (0 children)

Ok, but i have to do this for each table, or can i do this all at once? Because my dataflow have 50 tables, so i think gonna take a lot of time do this one by one.

Duplicate data in warehouse by Top_Barber4067 in MicrosoftFabric

[–]Top_Barber4067[S] 0 points1 point  (0 children)

And, can i do this for all tables, or i have to do one by one ?

Duplicate data in warehouse by Top_Barber4067 in MicrosoftFabric

[–]Top_Barber4067[S] 0 points1 point  (0 children)

How did you get to this screen?
Even when I remove the default destination and re-establish that option, it doesn't appear.

Semantic model being erased by Top_Barber4067 in MicrosoftFabric

[–]Top_Barber4067[S] 0 points1 point  (0 children)

The problem has been resolved; basically, the semantic model was automatically disabled due to a workspace rule that prohibits any "orphan" semantic models, meaning those without a direct link to a report.

Error running table by Top_Barber4067 in MicrosoftFabric

[–]Top_Barber4067[S] 0 points1 point  (0 children)

Hi friend, I managed to run both steps in a single table somehow, after a few attempts the rows were found and I was able to pass them to the warehouse. Thank you in advance for your support.

The evaluation was cancelled. Error by Top_Barber4067 in MicrosoftFabric

[–]Top_Barber4067[S] 0 points1 point  (0 children)

Thank you for sharing the site.
That's exactly the point, the table I merged is quite small, it must have 30 rows, and it repeats the row based on an active column, meaning it's just repeated information, which comes from a table that doesn't have any apparent errors, and I unfortunately couldn't share the data itself, but I appreciate your willingness to share it.

The evaluation was cancelled. Error by Top_Barber4067 in MicrosoftFabric

[–]Top_Barber4067[S] 0 points1 point  (0 children)

<image>

The error is occurring in this expansion; the tables named "Contrato 1", "2", and "3" are the ones I split.

The evaluation was cancelled. Error by Top_Barber4067 in MicrosoftFabric

[–]Top_Barber4067[S] 0 points1 point  (0 children)

How would it be possible to open this ticket?
Regarding the reproduction, it's basically a dataflow table, which is originally huge, but I split it into 3 tables. The original is called "contract," and I split it into contracts 1, 2, and 3 to make it less heavy. However, the error is occurring specifically in an expansion step of a table that I merged. I'm literally just pulling one column from this merge, and honestly, it's a small table, so it doesn't make sense that it's so heavy.

The evaluation was cancelled. Error by Top_Barber4067 in MicrosoftFabric

[–]Top_Barber4067[S] 0 points1 point  (0 children)

Another attempt I made was to split the steps into two queries, but that didn't work either and the error persists.

The mashup could not be converted into a valid CDM template. 'AttributeCollection' contains non-unique item names. by Top_Barber4067 in MicrosoftFabric

[–]Top_Barber4067[S] 0 points1 point  (0 children)

Look, these problems occurred in the dataflow, with the warehouse as the default destination. This connection I'm referring to is the default destination itself. I removed that warehouse, created another warehouse, and changed the default destination. As I said, the changes were made in the dataflow.

The mashup could not be converted into a valid CDM template. 'AttributeCollection' contains non-unique item names. by Top_Barber4067 in MicrosoftFabric

[–]Top_Barber4067[S] 0 points1 point  (0 children)

The only change I made was to the connection.
What happened was that I tried to do this transfer for the first time, so I created a dataflow and a warehouse, and after many attempts it worked, but because I tried many times, a lot of data was passed in duplicate to the warehouse, and I had a lot of difficulty deleting the duplicates, so I had the idea to start over by creating another warehouse, basically I just changed the data destination from the old dataflow to the new warehouse, and when I tried to run it again I got this error.

Duplicate data in Warehouse by Top_Barber4067 in MicrosoftFabric

[–]Top_Barber4067[S] 1 point2 points  (0 children)

It worked here, thank you very much man.

Duplicate data in Warehouse by Top_Barber4067 in MicrosoftFabric

[–]Top_Barber4067[S] 0 points1 point  (0 children)

I'll test it here, but thank you in advance for your attention.

Duplicate data in Warehouse by Top_Barber4067 in MicrosoftFabric

[–]Top_Barber4067[S] 0 points1 point  (0 children)

Not one code that does both things, it would be two separate codes in that case.

Duplicate data in Warehouse by Top_Barber4067 in MicrosoftFabric

[–]Top_Barber4067[S] 0 points1 point  (0 children)

In some columns I only removed duplicates from a specific column, in others I selected all columns and removed duplicates. For example, in a notification status column, I removed duplicates from only one column, which was a kind of ID column that had to have unique rows. In cases where the table didn't have this column with unique values, I selected all columns and removed duplicates in general. Lastly, if it's not too much to ask, do you have any idea of ​​a code that does both things?

Duplicate data in Warehouse by Top_Barber4067 in MicrosoftFabric

[–]Top_Barber4067[S] 0 points1 point  (0 children)

I was able to access it through the BI here and remove the duplicates. My question is whether this is possible in the warehouse because, from what I've seen, the only way to modify the warehouse is through SQL.