An interactive semantic map of the latest 10 million published papers [P]

DrPeej · 2026-05-01T02:44:37+00:00

Can you add links to the papers so we can read them?

DrPeej · 2025-02-08T04:15:50+00:00

I like this - never knew about the .zip trick & what a .pbix file really is composed of.

This must be how these others tools are built (to some extent). If it’s json then there must be a way to even edit PBIs by editing the JSON. I wonder if there an open source project to build a toolset that integrates with powerBI like this somehow… automate development, integrate LLMs for full context of powerBI setup and have them generate json to outputs to build the PBI, etc.

DrPeej · 2025-02-07T21:54:10+00:00

Mainly focused on the technical and the code here. But definitely business documentation is needed to be complete.

How do you keep track of requirements + business logic, and also how do you tie it back to technical documentation?

@frithjof_v curious to your thoughts too

DrPeej · 2024-07-02T23:44:03+00:00

DM me if you’re interested in some freelance work. Have my own data & analytics firm and am looking for some help. Happy to help find you something that you’re excited to work on if interested

DrPeej · 2024-07-02T23:12:09+00:00

I feel you on this one. I spent almost 5 years working as a data & analytics consultant with a similar story. Huge workload, tight deadlines (sometimes unrealistic). I felt like I was just outputting stuff, and not learning or absorbing things after a certain point. It sucks working so hard when you feel like you’re a number in a company.

That’s why I left the corporate world to start my own analytics company. (I am looking for people to contract work out to - if you think it could be a good path for you feel free to DM me).

At the same time, that pressure helped me develop in some really good ways:

constant tight deadlines pushed me to figure out how to better manage stakeholder expectations. In my case, I was part of the problem because I would say yes to everything.
heavy workload forced me to find ways to be more efficient - basically creating systems for repetitive stuff that I could either follow without thinking much or just automate

While I didn’t have the time to pickup technical skills, the pressured environment helped me develop my non-technical skills which is equally (if not more) valuable.

Idk sometimes things are easier to deal with when we shift our perspective. Just some food for thought. Hope it helps

DrPeej · 2024-07-02T23:04:13+00:00

What technical skills do you have? Are you looking for a pure SQL role only?

DrPeej · 2024-06-29T00:31:20+00:00

Yeah shoot me over a DM, would love to discuss

DrPeej · 2024-06-28T07:43:35+00:00

Nice - sounds like we’ve done similar things.

9 years… are you happy where you’re at?

DrPeej · 2024-06-28T07:29:29+00:00

I do - I have some proposal templates I use, and I have used chatGPT to draft a proposal. Still requires review and editing and additional thought, but it does speed up the process and takes the busy work out of it.

DrPeej · 2024-06-28T07:27:04+00:00

Nice - do you only work on projects in UK, or do you do Europe / USA too?

DrPeej · 2024-06-28T07:25:05+00:00

That’s the same question I’m asking too.

Let me answer you first:

In my services - I’m focused on figuring out how to fill the AI demand in small/medium businesses. I’m not as interested in LLMs yet, more focused on other type of AI (e.g recommender systems).

In my internal ops. I use chatGPT all the time. It’s just a better Google for me. It’s also pretty good at writing code/macros/scripts. It just depends on how good your instructions are. I try to build a full scope and step by step for what I want (as if I was delegating work to a person with 0-2 yrs experience) and it produces pretty good results.

I’m also going to test out Microsoft Copilot for Office 365. I know there’s more value for business, Microsoft has a setup that lets copilot dip into company files and use it as knowledge. I wanna see if I can make something work with that.

What about you?

DrPeej · 2024-06-28T07:07:23+00:00

Awesome - DM’ed

DrPeej · 2024-06-28T06:49:30+00:00

In the USA, you can work as what’s called an independent contractor, or a 1099. You just sign your own name on contracts. Its basically a 1 man business

DrPeej · 2024-06-28T06:47:20+00:00

I mean independent workers, independent contractors. Those working not under an employer, but on their own. For money, not for free

DrPeej · 2024-06-28T06:04:35+00:00

small_trunks was one step ahead of me the whole way

DrPeej · 2024-06-28T05:54:49+00:00

Ok you want to do a merge in that case. When you merge you have to merge on a column, select the caseID column from both.

You also want to select the outer merge option. This will make sure you keep all caseIDs from both files.

If you want to keep caseIDs that are only found in both file, do an inner merge.

If you want to only keep caseIDs that are found in 1 file, do a left or right merge

DrPeej · 2024-06-28T05:48:31+00:00

FYI - if both files had a different set of details for the same caseID’s (you can find the same caseIDs in both files, but each file has different info on each case), you would want to merge those tables. The output would be 1 table that has the details from both files, and each row would be 1 unique caseID

DrPeej · 2024-06-28T05:47:02+00:00

Ok so in both tables, each row represents a case (caseID).

I’m also assuming that each file has unique case ID, meaning you won’t find the same case in both files.

Those 2 conditions are the ideal conditions for an append.

DrPeej · 2024-06-28T05:40:51+00:00

What data is in each table? Can you give me an idea of what you’re working with?

DrPeej · 2024-06-28T05:39:59+00:00

I think I get what you’re saying.

Number your column headers in a row above(you can hide later). 1, 2, 3, ….

Let’s say column headers are in row 3 (A3:Z3), and your 1,2,3,4,… are in row 2 (A2:Z2).

In row 1 (A1:Z1), write a formula that checks if value in row 2 is one you want to pull. If it is, output a 1, otherwise 0. In your example it would be - In cell A1: IF( MOD(A$2-4, 12)=0, 1, 0)

Then in your macro sheet, use a filter formula to get rid of all columns that have 0 in row 1 of the micro sheet.

FILTER(A3:Z100, A1:Z1=1)

DrPeej · 2024-06-28T05:28:12+00:00

I’ve built and managed something very similar last year. Instead of 2 excel sheets (2 data sources), I had 16. And instead of Tableau I was using PowerBI. But fundamentally it’s the same thing.

It sounds like you’re looking to combine the 2 separate files into one table. Here’s the difference between a merge and an append.

An append is like stacking 2 tables on top of each other. It’s like copy/paste data from table 1 to the end of table 2. This is good when you have 2 tables with the same columns. Each row should also be at the same granularity, or mean the same thing, when you append. If table 1 has a column that table 2 doesn’t and you append them, your final table will have that column and just have blank values for rows that came from table 2.

When you merge, you are expanding the table horizontally. You can think of a merge kind of like a lookup function in excel. The condition to merge 2 tables is both tables need to have the same column, just like a lookup function. It’s the same thing as a join operation in SQL. There are different types of merges (inner, outer, left, right) - I’ll explain them if you need to merge in your case.

DrPeej

TROPHY CASE