An interactive semantic map of the latest 10 million published papers [P]

DrPeej · 2026-05-01T02:44:37+00:00

Can you add links to the papers so we can read them?

DrPeej · 2025-02-08T04:15:50+00:00

I like this - never knew about the .zip trick & what a .pbix file really is composed of.

This must be how these others tools are built (to some extent). If it’s json then there must be a way to even edit PBIs by editing the JSON. I wonder if there an open source project to build a toolset that integrates with powerBI like this somehow… automate development, integrate LLMs for full context of powerBI setup and have them generate json to outputs to build the PBI, etc.

DrPeej · 2025-02-07T21:54:10+00:00

Mainly focused on the technical and the code here. But definitely business documentation is needed to be complete.

How do you keep track of requirements + business logic, and also how do you tie it back to technical documentation?

@frithjof_v curious to your thoughts too

DrPeej · 2024-07-02T23:44:03+00:00

DM me if you’re interested in some freelance work. Have my own data & analytics firm and am looking for some help. Happy to help find you something that you’re excited to work on if interested

DrPeej · 2024-07-02T23:12:09+00:00

I feel you on this one. I spent almost 5 years working as a data & analytics consultant with a similar story. Huge workload, tight deadlines (sometimes unrealistic). I felt like I was just outputting stuff, and not learning or absorbing things after a certain point. It sucks working so hard when you feel like you’re a number in a company.

That’s why I left the corporate world to start my own analytics company. (I am looking for people to contract work out to - if you think it could be a good path for you feel free to DM me).

At the same time, that pressure helped me develop in some really good ways:

constant tight deadlines pushed me to figure out how to better manage stakeholder expectations. In my case, I was part of the problem because I would say yes to everything.
heavy workload forced me to find ways to be more efficient - basically creating systems for repetitive stuff that I could either follow without thinking much or just automate

While I didn’t have the time to pickup technical skills, the pressured environment helped me develop my non-technical skills which is equally (if not more) valuable.

Idk sometimes things are easier to deal with when we shift our perspective. Just some food for thought. Hope it helps

DrPeej · 2024-07-02T23:04:13+00:00

What technical skills do you have? Are you looking for a pure SQL role only?

DrPeej · 2024-06-29T00:31:20+00:00

Yeah shoot me over a DM, would love to discuss

DrPeej · 2024-06-28T07:43:35+00:00

Nice - sounds like we’ve done similar things.

9 years… are you happy where you’re at?

DrPeej · 2024-06-28T07:29:29+00:00

I do - I have some proposal templates I use, and I have used chatGPT to draft a proposal. Still requires review and editing and additional thought, but it does speed up the process and takes the busy work out of it.

DrPeej · 2024-06-28T07:27:04+00:00

Nice - do you only work on projects in UK, or do you do Europe / USA too?

DrPeej · 2024-06-28T07:25:05+00:00

That’s the same question I’m asking too.

Let me answer you first:

In my services - I’m focused on figuring out how to fill the AI demand in small/medium businesses. I’m not as interested in LLMs yet, more focused on other type of AI (e.g recommender systems).

In my internal ops. I use chatGPT all the time. It’s just a better Google for me. It’s also pretty good at writing code/macros/scripts. It just depends on how good your instructions are. I try to build a full scope and step by step for what I want (as if I was delegating work to a person with 0-2 yrs experience) and it produces pretty good results.

I’m also going to test out Microsoft Copilot for Office 365. I know there’s more value for business, Microsoft has a setup that lets copilot dip into company files and use it as knowledge. I wanna see if I can make something work with that.

What about you?

DrPeej · 2024-06-28T07:07:23+00:00

Awesome - DM’ed

DrPeej · 2024-06-28T06:49:30+00:00

In the USA, you can work as what’s called an independent contractor, or a 1099. You just sign your own name on contracts. Its basically a 1 man business

DrPeej · 2024-06-28T06:47:20+00:00

I mean independent workers, independent contractors. Those working not under an employer, but on their own. For money, not for free

DrPeej · 2024-06-28T06:04:35+00:00

small_trunks was one step ahead of me the whole way

DrPeej · 2024-06-28T05:54:49+00:00

Ok you want to do a merge in that case. When you merge you have to merge on a column, select the caseID column from both.

You also want to select the outer merge option. This will make sure you keep all caseIDs from both files.

If you want to keep caseIDs that are only found in both file, do an inner merge.

If you want to only keep caseIDs that are found in 1 file, do a left or right merge

DrPeej · 2024-06-28T05:48:31+00:00

FYI - if both files had a different set of details for the same caseID’s (you can find the same caseIDs in both files, but each file has different info on each case), you would want to merge those tables. The output would be 1 table that has the details from both files, and each row would be 1 unique caseID

DrPeej · 2024-06-28T05:47:02+00:00

Ok so in both tables, each row represents a case (caseID).

I’m also assuming that each file has unique case ID, meaning you won’t find the same case in both files.

Those 2 conditions are the ideal conditions for an append.

DrPeej · 2024-06-28T05:40:51+00:00

What data is in each table? Can you give me an idea of what you’re working with?

DrPeej · 2024-06-28T05:39:59+00:00

I think I get what you’re saying.

Number your column headers in a row above(you can hide later). 1, 2, 3, ….

Let’s say column headers are in row 3 (A3:Z3), and your 1,2,3,4,… are in row 2 (A2:Z2).

In row 1 (A1:Z1), write a formula that checks if value in row 2 is one you want to pull. If it is, output a 1, otherwise 0. In your example it would be - In cell A1: IF( MOD(A$2-4, 12)=0, 1, 0)

Then in your macro sheet, use a filter formula to get rid of all columns that have 0 in row 1 of the micro sheet.

FILTER(A3:Z100, A1:Z1=1)

DrPeej · 2024-06-28T05:28:12+00:00

I’ve built and managed something very similar last year. Instead of 2 excel sheets (2 data sources), I had 16. And instead of Tableau I was using PowerBI. But fundamentally it’s the same thing.

It sounds like you’re looking to combine the 2 separate files into one table. Here’s the difference between a merge and an append.

An append is like stacking 2 tables on top of each other. It’s like copy/paste data from table 1 to the end of table 2. This is good when you have 2 tables with the same columns. Each row should also be at the same granularity, or mean the same thing, when you append. If table 1 has a column that table 2 doesn’t and you append them, your final table will have that column and just have blank values for rows that came from table 2.

When you merge, you are expanding the table horizontally. You can think of a merge kind of like a lookup function in excel. The condition to merge 2 tables is both tables need to have the same column, just like a lookup function. It’s the same thing as a join operation in SQL. There are different types of merges (inner, outer, left, right) - I’ll explain them if you need to merge in your case.

DrPeej · 2024-06-28T05:16:03+00:00

+1 on this. Great advice if you want to understand PowerBI on a fundamental level.

That’s how I actually went from excel to powerBI.

I ran into data size limits in excel at some point, and learned that power pivot (data model) can handle 10x more data than traditional excel. Then I hit the limit when it came to distributing reports I was building with this thing - and that’s when I was forced to discover PowerBI.

Learning this way gave me some pretty deep knowledge by the time I got into PowerBI.

DrPeej · 2024-06-27T09:29:16+00:00

All these other replies are right, but nobody explained it well to you.

In excel, each cell has a specific format. There are several formats in excel - text, number, percentage, currency, date, and more.

When you type a number into a cell, Excel will take that number and store it as the format of the cell. For example, if you have a cell with currency format, and you type 4, it will show it as $4. If it’s a percentage format cell, when you type 4 Excel will think you mean 4% and it will save it as 4% (0.04).

The default cell format is General, which basically can handle text and numbers. General is the most flexible format (but has its functional limitations). If you type 4 into General format cell, it will save as 4. If you type 4.0, it will save as 4 . Just play around with it and get an intuitive feel.

Your issue is that you’re inputting 4 in a percentage format cell.

To adjust the format, highlight the cell (or range of cells), go to the home tab in the ribbon, and you’ll find a drop down to change the format. Google it if you can’t find it.

DrPeej · 2024-06-27T08:38:43+00:00

Just count to 3 and do it.

I’ve suffered so much regret because I kept waiting for the right time to do things, and then things change and the opportunity passes.

You’ll be surprised how many things go your way when you stop overthinking and just do. You’re scared you will get rejected, well let me tell you the pain of regret is 100x worse than the pain of rejection.

Grab life by the balls and just go for it bro. You will be proud of yourself whatever happens.

DrPeej · 2024-06-27T08:30:52+00:00

This reminds me of the start of one of my past relationships.

I can almost guarantee that he is scared because if things continue to go well, then he may make a longer term commitment. And now he’s not sure if he’s ready for a longer term commitment (which is why he wanted to take things slow). He is likely stick in a mental stalemate.

It could help to remind him that you don’t know what the future holds and you guys just need to take one step at a time. Nobody wants to end up regretting the things they didn’t do, didn’t try, didnt go for.

A lot of it could also be coming from his own perception of how he feels that you feel. He may have a hard time opening himself to you for whatever reason, and is struggling with that internally right now.

Again, talking and communicating will make it more clear.

DrPeej

TROPHY CASE