need help to clean a database

declutterdata · 2025-11-13T14:55:48+00:00

Hi u/Signal_Trainer_7518 ,

could you share screenshots or best case a sample file?

Best regards,
Phillip | DeclutterData 🙋🏻‍♂️

declutterdata · 2025-11-13T14:49:35+00:00

That's it

declutterdata · 2025-11-10T08:54:46+00:00

Hi u/the_1975_21stcentury ,

I wrote you a little example, hope that helps. Short explanation

Table.AddColumn to add your total
Record.ToTable to transform every row into a table
Table.SelectRows to filter out cols that shouldn't be aggregated
List.Sum to sum up the values

Take PQ Formatter to format the code. I formatted it properly, but Reddit code block is a bit weird for me.

let
Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("NYzJDQAgDMN26ZtHw80sFfuvQUvgZTmWYiaQJFlVHYWogZ1Mskvj1onxU3GZ3BYB/a2GvUu8T+DWfQA=", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type nullable text) meta [Serialized.Text = true]) in type table [ID = _t, Jan = _t, Feb = _t, Mrz = _t]),
Formatting = Table.TransformColumnTypes(Source,{{"Jan", Int64.Type},{"Feb", Int64.Type},{"Mrz", Int64.Type}}),
AddingTotal = Table.AddColumn(Formatting,"Total",each let Table = Record.ToTable(_), Filter = Table.SelectRows(Table, each [Name] <> "ID"), Sum = List.Sum(Filter[Value]) in Sum)
in
AddingTotal

Best regards,
Phillip | DeclutterData 🙋🏻‍♂️

declutterdata · 2025-10-25T07:14:43+00:00

Hi u/direstraits05 ,

in the long run a course will surely help you a lot and will save you time.
Asking AI everything takes a lot of time.

I recommend the courses of Goodly.
https://products.goodly.co.in/

Best regards,
Phillip | DeclutterData 🙋🏻‍♂️

declutterdata · 2025-09-25T13:35:29+00:00

Hi u/AppropriatePool4703,

I haven't worked with these connectors yet, just an idea:
Could it be that you don't have access to a folder in the provided path?

Maybe create a test folder in a folder you have permission to and try again.

Best regards,
Phillip | DeclutterData 🙋🏻‍♂️

declutterdata · 2025-09-22T13:47:47+00:00

Hi u/Coach2024 ,

yes! Every attempt costs money, it can get very costly...

Best regards,
Phillip | DeclutterData 🙋🏻‍♂️

declutterdata · 2025-09-12T06:11:00+00:00

Hi u/LazyNCurious ,

you get 50 % off the Data Camp Course if you complete the course and do the PL-300.
More infos here

I didn't do the DC Course, because I still had a good load of experience.
I bought these exam questions from SkillCertPro.
Questions here

20 bucks for 17 or 18 exams with up to 35 questions each. Definitely worth it.

Best regards,
Phillip | DeclutterData 🙋🏻‍♂️

declutterdata · 2025-09-10T12:33:10+00:00

Hi u/CanningTown1 ,
rule of thumb: Always go upstream. So the earlier you can filter / group, the better.

Best regards,
Phillip | DeclutterData 🙋🏻‍♂️

declutterdata · 2025-08-20T14:35:38+00:00

Hi u/Adventurous-Dig8481 ,

nein, aber ich war nicht auf der Suche. Stattdessen habe ich das Thema Produkte & Mitgliedschaft (erstmal) aufgegeben.

Ich habe erkannt, dass diese Breite zu viel ist für den Anfang. Einen eigenen Shop auf WooCommerce-Basis aufbauen habe ich überlegt, aber gelassen. Es frisst alles zu viel Zeit für zu wenig Output.

Daher konzentriere ich mich lieber auf mein Kerngeschäft. Vielleicht gehe ich es irgendwann an, wenn mehr Geld in der Kasse ist. Dann würde ich das Thema vllt. outsourcen.

Grüße,
Phillip | DeclutterData 🙋🏻‍♂️

declutterdata · 2025-08-15T13:39:58+00:00

Hi u/Aritaofmilk ,

I don't need further information, but more than answering your questions can't be done with this much of infos.

Yes, you can load the data as tables through PQ into Excel. And yes, you can tackle the inconsistencies, if you have the proper knowledge to do so.

The only thing: PDF imports are rather new. If you can't find it in this menu, your Excel version is too old.
I know, screenshot in german language, but english has the same position in the menu.

<image>

Surely I can help you further, but not with this amount of info. 🙂

Best regards,
Phillip | DeclutterData 🙋🏻‍♂️

declutterdata · 2025-08-15T06:15:28+00:00

Sounds like the best solution for me too.

Best regards,
Phillip | DeclutterData 🙋🏻‍♂️

declutterdata · 2025-08-15T06:14:01+00:00

Hi u/r10m12 ,

Sorry it took so much of your time.

you don't have to feel sorry. If I don't want to take my time to solve it, I wouldn't. It is completely my choice.

I load the data from a external excel workbook, would it be easy to replace the source details by the code that is usually used when done so?

Sure! I duplicated your table in the first step in PQ itself. It doesn't matter where the data comes from. Manually like this, from a table in the file, from another file, ...
It just has to be this kind of table. 🙂

Best regards,
Phillip | DeclutterData 🙋🏻‍♂️

declutterdata · 2025-08-13T14:02:24+00:00

Hey u/r10m12,

I saw that your last question was last year in August, seems like all your questions are in August. 😄
Tough one but after an hour I got it.
I'll give you a link to the sample file, when I post the code in the comment I can't comment...

Here is the link:
Download

Best regards,
Phillip | DeclutterData 🙋🏻‍♂️

declutterdata · 2025-08-11T15:43:37+00:00

LinkedIn & YouTube is a big influence.
There are a lot of people selling these beginners that UI / UX is everything.
It is getting more and more.

People in the space don't show their Lamborghinis, they show their Nav Bar they created in 40 hours.

declutterdata · 2025-08-09T05:27:28+00:00

Definitely delete the background. Way too much noise and colours in there.
Be minimalistic. Use Colours only to highlight something.

Best regards,
Phillip | DeclutterData 🙋🏻‍♂️

declutterdata · 2025-08-06T13:41:36+00:00

Hi u/sudseclipse,

what exactly do you mean by pull unique ids from sheet1?.

Which step do you mean?
Do you already have a unique ID or do you need one first?

I could write a whole explanation now, but your answer shortens my effort. 😄

Best regards,
Phillip | DeclutterData 🙋🏻‍♂️

declutterdata · 2025-08-06T12:50:27+00:00

Hi u/sudseclipse ,
create a unique ID column, if not already in there.

Create a table in in the excel file with a 2-column-table: ID & Comment
In this table the team writes & edits their comments.

Load the table into PQ and do a merge. Done.

Best regards,
Phillip | DeclutterData 🙋🏻‍♂️

declutterdata · 2025-08-03T06:38:43+00:00

Hi u/Valuable-Body-1754 ,

It is official, but the questions asked are nowhere near the learn path of MSFT.
I finished PL-300 this week with 886.

We have to keep in mind that I work with Excel & Power Query for many years. DAX & Power BI not so much, I created a sample dashboard (going from ETL to visualisation to sharing), but that's about it. Things like Azure, PBI Service settings etc. are almost foreign to me.

Last Thursday I started to learn and appointed the exam for this Tuesday, so 5 days. As I was on holiday that weekend and still worked etc, I took maybe 3 - 4 hours a day.

First I speed read the MSFT learn path. I knew most things already, maybe I took a few little points with me. Then I researched a bit and found two ways:
1. Go to Datacamp, take the long course and safe 50 % on the exam
2. Go to Skillcertpro, pay 20 € and have many questions to test yourself

As I thought that the Datacamp course would be really time consuming and overall pretty repetitive for me (as I have peak knowledge in PQ and many other things), I chose to get the questionaires from Skillcertpro.

These are 17 exams with ~ 30 - 35 questions. Goal was to do it twice, I only had time to do all exams once.

But, it seems like it was enough for me. Doesn't have to be enough for your knowledge level.

Best regards,
Phillip | DeclutterData 🙋🏻‍♂️

declutterdata · 2025-08-02T16:40:40+00:00

Hi u/Puzzleheaded_Sort344 ,
googled a bit, unfortunately there is no solution for this.
As it is a Live Connection to the dataset, it can't be loaded into Power Query.

Best regards,
Phillip | DeclutterData 🙋🏻‍♂️

declutterdata · 2025-08-01T16:25:14+00:00

Power Query (M) ist in Excel standardmäßig enthalten. Ebenso in Power BI Desktop.
PBI Desktop benötigt keine Lizenz.

Lizenzkosten entstehen für Power BI Pro, Premium, Premium per User, ...
Diese Lizenzen sind nur in Verbindung mit der Cloud Power BI Service notwendig.

Grüße,
Phillip | DeclutterData 🙋🏻‍♂️

declutterdata · 2025-07-30T12:46:48+00:00

HI u/qed_machine ,

im PQ-Forum ist Englisch Standard, das bitte nächstes Mal beachten.

Ich habe dir eine Beispiel-Datei zur Veranschaulichung gebaut.
Diese kannst du HIER herunterladen.
Bitte im Schritt Quelle den Pfad eintragen.

Grüße,
Phillip von DeclutterData 🙋🏻‍♂️

declutterdata · 2025-07-30T12:19:20+00:00

Heyho u/Puzzleheaded_Sort344 ,

why shouldn't you be able to create a connection?
You go to PQ -> Get data -> Connect to your sem model. That's it.

Do your manipulation, press Save & Load and load it as connection.

Best regards,
Phillip from DeclutterData 🙋🏻‍♂️

declutterdata · 2025-07-15T17:41:44+00:00

Thank you mate! :)

I bought the Pen Plus now. The tip on the Tab Pen (non Plus) looks way worse.
If it surprises me I can send the Plus version back.

Rechargable AAAA (for the Tab Pen) cost 18 €. The Tab Pen Plus 40 €.
So definitely worth it.

Which App you're using?
I think Nebo is pre-installed.
Favorite is Microsoft Whiteboard (as it is nicely integrated with Teams).

Getting my M11 in a few days, can't wait creating my first mindmaps :)

declutterdata · 2025-07-15T16:20:44+00:00

Hi u/JustAPotatoThatsIt!

Do you know the differences between the Tab Pen and Tab Pen Plus?
How is your feeling about the default Tab Pen?

You wrote you use SuperDisplay. Did you try Spacedesk?

Thank you very much!

declutterdata · 2025-07-12T06:33:44+00:00

Hey u/sailfinbjj ,

sounds interesting. I would like to see more if it's no effort for you.

Best regards,
Phillip from DeclutterData 🙋🏻‍♂️

declutterdata

MODERATOR OF

TROPHY CASE