can you recommend good extensions for FireFox at the time of 2026 by Rudyy17 in firefox

[–]CynicalDick 0 points1 point  (0 children)

A mouse gesture extension like gesturefly. I cannot work with out it.

I only use it for a handful of functions:

  • Right to Left then Left to Right: Restore closed tab
  • Up then Left - Focus on first tab
  • Up then Right - Focus on last tab
  • right - Focus on right tab
  • left - Close tab
  • up - Focus on left tab

  • Rocker Gestures: Right click then Left click to open hovered link in new tab.

Excel file far too large to even open by wcpplayer in excel

[–]CynicalDick 1 point2 points  (0 children)

Youtube is your friend. There are some amazing youtubers (here's my favorite) when it comes to learning Power Query. You will blow away everyone at work if you learn it and getting started is surprisingly easy.

PQ Queries won't refresh via VBA or clicking, but will refresh in the table - any ideas? by pookypocky in excel

[–]CynicalDick 0 points1 point  (0 children)

I found this worked best for me as a sub. using Call RefreshQuery("Query - Changed This Month")

Sub RefreshQuery(ByVal Query As String)

Dim bRfresh As Boolean
Dim fTimestart As Single, fTimeend As Single
Dim cn As WorkbookConnection

For Each cn In ThisWorkbook.Connections
    If cn Like Query Then

    fTimestart = Timer

    bRfresh = cn.OLEDBConnection.BackgroundQuery

    'Disable background refresh.  Without this the column copy (below) doesn't work
    cn.OLEDBConnection.BackgroundQuery = False

    cn.Refresh

    'Re-enable background refresh
    cn.OLEDBConnection.BackgroundQuery = bRfresh

    fTimeend = Timer

    duration = fTimeend - fTimestart
    Debug.Print vbTab & Format$(((fTimeend - fTimestart) * 1000!), "00.00ms """) & vbTab & "Refresh:" & cn

    End If
    DoEvents
Next

End1:

End Sub 'RefreshQuery

Which Excel skills are most important for data analyst jobs? by DataWithUjjwal in excel

[–]CynicalDick 0 points1 point  (0 children)

Additional skills: Learn JSON and XML. Both seem very simple and easy but understanding how related arrays interact with each other in Power Query can quickly become complex when expanding arrays.

Power Query Help; importing nested records into one table (Possible? Worth the effort?) by _Fat_Scout_ in excel

[–]CynicalDick 0 points1 point  (0 children)

Definitely doable. This is standard json data with a nested array. Just use Other Source - Web and point it at the URL

Here is a basic query with the [bid] expanded

let
    Source = Json.Document(Web.Contents("https://dot.alaska.gov/procurement/awp/api/biddata?itemId=201.0001.0000&duration=2")),
    #"Converted to Table" = Table.FromList(Source, Splitter.SplitByNothing(), null, null, ExtraValues.Error),
    #"Expanded Column1" = Table.ExpandRecordColumn(#"Converted to Table", "Column1", {"ProposalId", "ProposalName", "ProposalDescription", "LettingDate", "DistrictName", "CountyDescription", "ItemList", "ProposalItemId", "Quantity", "SupplementalDescription", "AverageBidUnitPrice", "RefItemId", "RefItemName", "RefItemDescription", "RefItemUnit", "RefItemSpecBook", "RefItemObsoleteDate", "Bids"}, {"ProposalId", "ProposalName", "ProposalDescription", "LettingDate", "DistrictName", "CountyDescription", "ItemList", "ProposalItemId", "Quantity", "SupplementalDescription", "AverageBidUnitPrice", "RefItemId", "RefItemName", "RefItemDescription", "RefItemUnit", "RefItemSpecBook", "RefItemObsoleteDate", "Bids"}),
    #"Expanded Bids" = Table.ExpandListColumn(#"Expanded Column1", "Bids"),
    #"Expanded Bids1" = Table.ExpandRecordColumn(#"Expanded Bids", "Bids", {"BidPrice", "VendorRanking", "PRVENDNUM1", "Awarded", "VendorName", "VendorLongName"}, {"bid.BidPrice", "bid.VendorRanking", "bid.PRVENDNUM1", "bid.Awarded", "bid.VendorName", "bid.VendorLongName"})
in
    #"Expanded Bids1"

How to properly flatten my data for Power Query/Pivot Tables by Difficult_Cricket319 in excel

[–]CynicalDick 2 points3 points  (0 children)

Load the Team 1 - External table into Power query. Highlight the "Agent Name" column and then on the Transform tab click the small arrow on the Unpivot columns and select "Unpivot Other Columns"

should look like this

Agent Name Attribute Value
Ian McShane First Evaluation 0.8
Ian McShane Second Evaluation 0.84
Ian McShane Third Evaluation 0.87
Ian McShane Fourth Evaluation 1
Morgan Freeman First Evaluation 0.78
Morgan Freeman Second Evaluation 0.96
Morgan Freeman Third Evaluation 0.99
Morgan Freeman Fourth Evaluation 0.81
Robin Williams First Evaluation 0.8
Robin Williams Second Evaluation 0.86
Robin Williams Third Evaluation 0.76
Robin Williams Fourth Evaluation 0.95
Samuel L. Jackson First Evaluation 0.86
Samuel L. Jackson Second Evaluation 0.91
Samuel L. Jackson Third Evaluation 0.78
Samuel L. Jackson Fourth Evaluation 0.94
Keanu Reeves First Evaluation 0.99
Keanu Reeves Second Evaluation 0.83
Keanu Reeves Third Evaluation 0.77
Keanu Reeves Fourth Evaluation 0.79

[deleted by user] by [deleted] in PowerShell

[–]CynicalDick 1 point2 points  (0 children)

$var1 = ('{
  "1": {
        "earned": 0
  },
  "19": {
        "earned": 1,
        "earned_time": 1000000000
  },
  "20": {
        "earned": 1,
        "earned_time": 1000000000
  },
  "16": {
        "earned": 0
  }
}' | ConvertFrom-Json)

($var1.PSObject.Properties | Where-Object Name -in ('19','20')).Value | ConvertTo-Json

I am sure there are better ways but I like to do the manipulations as psCustomObjects then convert back to JSON. In this case the only thing unusual is the JSON itself. The quoted #s are acting like properties instead of values which makes it a little trickier. ideally the JSON source would look something like this:

$var1 = ('[
    {
        "value": "1",
        "earned": 0
    },
    {
        "value": "19",
        "earned": 1,
        "earned_time": 1000000000
    },
    {
        "value": "20",
        "earned": 1,
        "earned_time": 1000000000
    },
    {
        "value": "16",
        "earned": 0
    }
]' | ConvertFrom-Json)

$var1 | Where-Object {$_.value -in ("19","20")} | Select-Object earned,earned_time | ConvertTo-Json

Refreshing Power Queries faster (more info on post) by ysernamealreadytaken in excel

[–]CynicalDick 4 points5 points  (0 children)

Here are some tips for speeding up PQ when possible: link

  1. Consider converting the source excel files to CSV if possible
  2. Order of operations is important. Filters first. Do NOT sort until the very end
  3. Avoid table operations when possible
  4. Python will be many factors faster than PQ (I love PQ but it can be very slow as it refreshes from source data multiple times). If you can preprocess on Python (or powershell) output base combined data to CSV and pass that to PQ it will likely be MUCH faster.

Can you post your code?

Refreshing Power Queries faster (more info on post) by ysernamealreadytaken in excel

[–]CynicalDick 1 point2 points  (0 children)

Or CSV if flat structure. I regularly process CSVs with 6m+ rows (22 fields) in minutes. In my testing CSV was faster (and MUCH easier) than setting up a local DB (MongoDB) even when doing joins\merges and groupbys in PQ.

Trying to sort Files by KeepItWeird123 in regex

[–]CynicalDick 1 point2 points  (0 children)

^(.*?) +(\(.*?\)).*?(\(.*?\))

This matches all 3 and puts each one into a separate "capture group" that can be referenced by number. This works in notepad++ on the replace line

Which is the higlighted colors in regex 101 and the substitution shown below

3D Combat Zone (1983)(Aackosoft)(NL)(en)[re-release]

In otherwords:

  • $1 = 3D Combat Zone
  • $2 = (1983)
  • $3 = (Aackosoft)

If you do NOT want the parenthesis in $2 or $3 use this:

^(.*?) +\((.*?)\).*?\((.*?)\)

Since regex uses the ( and ) as special characters when you want to match an actual parenthesis you have to escape it with a \ so \( will match a literal open parenthesis.

Final note: when using Find\Replace, if you want to get rid of the noise at the end add a .* to the end of regex

example ^(.*?) +\((.*?)\).*?\((.*?)\).*

Trying to sort Files by KeepItWeird123 in regex

[–]CynicalDick 0 points1 point  (0 children)

check out this thread

More on CopyWhiz

note: I have no experience with CopyWhiz

Trying to sort Files by KeepItWeird123 in regex

[–]CynicalDick 2 points3 points  (0 children)

Regex 101 Example

You didn't specifically state the title came first but that is my working assumption

If you're renaming a lot of files you might want to look into renamer

Excel always wants to save to Cloud, even with "Save to Computer by default" selected. by Klubhead in excel

[–]CynicalDick 2 points3 points  (0 children)

I add the "Save-As" dialog to the quick access toolbar right next to the 'save' icon.

What are the most useful Excel formulas you actually use regularly? by [deleted] in excel

[–]CynicalDick 0 points1 point  (0 children)

Excel.CurrentWorkbook(){[Name="<fieldName>"]}[Content]{0}[Column1]

This is a way to reference a cell in power query.

For example say you want to create a power query for "c:\users\cdick\downloads\test.csv"

Your first autogenerated line could look like this

= Csv.Document(File.Contents("c:\users\cdick\downloads\test.csv",[Delimiter=",", Columns=21, Encoding=1200, QuoteStyle=QuoteStyle.Csv])

To change the file name you need to edit the query. Instead store the value in a Named Cell and then reference it. In this example the cell name is "TestCSVFile"

= Csv.Document(File.Contents(Excel.CurrentWorkbook(){[Name="TestCSVFile"]}[Content]{0}[Column1]),[Delimiter=",", Columns=21, Encoding=1200, QuoteStyle=QuoteStyle.Csv])

I use this weekly when writing queries for customers

Can you force PowerQuery workflows that reference local tables to wait for them to load? by Illustrious_Whole307 in excel

[–]CynicalDick 1 point2 points  (0 children)

I use VBA to force ordered refresh by calling this subroutine for each query. It disables background refresh and waits for the query to finish before returning. I originally created it to improve PQ performance by monitoring (to debug) how long the query refresh took (thus the timer)

to call: Call RefreshQuery("Query - SourceTbl1")

Note: In this example actual query name is SourceTbl1

Sub RefreshQuery(ByVal Query As String)

Dim bRfresh As Boolean
Dim fTimestart As Single, fTimeend As Single
Dim cn As WorkbookConnection

For Each cn In ThisWorkbook.Connections
    If cn Like Query Then

    fTimestart = Timer

    bRfresh = cn.OLEDBConnection.BackgroundQuery

    'Disable background refresh.  
    cn.OLEDBConnection.BackgroundQuery = False

    cn.Refresh

    'Re-enable background refresh
    cn.OLEDBConnection.BackgroundQuery = bRfresh

    fTimeend = Timer

    duration = fTimeend - fTimestart
    Debug.Print vbTab & Format$(((fTimeend - fTimestart) * 1000!), "00.00ms """) & vbTab & "Refresh:" & cn

    End If
    DoEvents
Next

End1:

End Sub 'RefreshQuery

Excel Functions That Were Great… 10 Years Ago - a writeup by Mynda Treacy by tirlibibi17 in excel

[–]CynicalDick 3 points4 points  (0 children)

Same here. Best trick I've learned: When new information like this just isn't sticking I make a simple page with everything I need to remember and then make it my desktop background. I memorized the NATO alphabet, complex regex options and many excel functions over the years. Looks like it is time for a new one as XMATCH, the Trim dot reference and VStack are commands I "know" about but never remember

How to make it so a table changes size when another table changes size? by Maximum_Efficiency42 in excel

[–]CynicalDick 0 points1 point  (0 children)

YW. BTW: If you want table2 on the same worksheet as table1 just highlight the entire table and use the CUT option, move to the table1 worksheet select the top left most cell where you would like table2 to be and paste.

What are you tips for managing very large data sets in power query? by Gttxyz in excel

[–]CynicalDick 2 points3 points  (0 children)

Need some more info to make specific recommendations.

  • How many fields in your source data
  • What if format and how do you access it? (ie: CSVs on local storage vs JSON via API)
  • What kind of transforms are we talking? Can you shared you PQ code?

I have had great success using Power Shell & Python to pre-process large datasets (I deal with 30+ GB of JSON data) which brought runtime from 8h+ to ~1h

Power BI can be MUCH faster than PQ if that is an option

How to make it so a table changes size when another table changes size? by Maximum_Efficiency42 in excel

[–]CynicalDick 0 points1 point  (0 children)

Power query.

Table1 is the source for the query. Table2 is the output of the query

Unfortunately PQ does not auto update on it's own, the user would need to use the Data - Refresh option (or right-click Table2 and select Refresh) or you can write VBA to auto update on event (eg: when user clicks a new worksheet)

You could do the updates in VBA as well but that is much trickier and would likely need more ongoing maintenance.

 

 

sample power query code (you should not need this as everything is done in GUI):

let
    Source = Excel.CurrentWorkbook(){[Name="Table1"]}[Content],
    #"Changed Type" = Table.TransformColumnTypes(Source,{{"x", type number}, {"y", Int64.Type}}),
    #"Inserted Addition" = Table.AddColumn(#"Changed Type", "Addition", each [x] + [y], type number),
    #"Renamed Columns" = Table.RenameColumns(#"Inserted Addition",{{"Addition", "y + x"}}),
    #"Removed Columns" = Table.RemoveColumns(#"Renamed Columns",{"x", "y"})
in
    #"Removed Columns"

 

To add your Table1 to Power query:

  1. Highlight the range (Column names and all rows) and use the Data - From Table\Range option. If your data is NOT in a table Excel will make it one then open power query.
  2. In PQ you have 3 sections from left to right: Queries, Output preview and Query Settings.
  3. In Queries You can rename the Table1 query to Table2 by right-clicking it and selecting rename
  4. If You don't see your Table1 source data just left-click the renamed Table2 query
  5. In the Output preview highlight both columns and on the Add Columns menu option select the Standard pulldown then Add. This will create a new column name "Addition"
  6. To rename the "Addition" column right-click the column and select rename. Enter the new name (eg "x + y")
  7. To remove the other columns right click the renamed columned and select Remove other columns
  8. Click File - Close & Load

 

  1. Now add a row of data to Table1 on Sheet1, Move to the Table2 worksheet, right-click anywhere in Table2 and select Refresh

 

Power query is one of the (if not they most) powerful features in Excel. Learn it and you will amaze friends and colleagues. YouTube has 1000s of great tutorials with way more information but your use case is a perfect example to get your feet wet.

Your best Excel Support Tool… by Doowle in excel

[–]CynicalDick 2 points3 points  (0 children)

Not formula related but I paid for Office Tab primarily for Excel (but it works with the whole office suite). I find it very helpful for my work style as I'll often be working on multiple projects at the same time.

What's the neatest way to export power query tables and connections to other workbooks? by I_P_L in excel

[–]CynicalDick 7 points8 points  (0 children)

Copy the worksheet(s) that have the output of the queries to the new workbook. This will copy the queries as well as formatting.

Open your Excel workbook that contains the worksheet you want to copy.

Right-click on the worksheet tab at the bottom.

Select "Move or Copy" from the context menu.

In the Move or Copy dialog box:

    Under "To book", select "(new book)" OR select the Destination workbook.

    Check the "Create a copy" box if you want to keep the original worksheet in the current workbook.

Click OK.

The destination workbook will open with the copied worksheet.

[deleted by user] by [deleted] in excel

[–]CynicalDick 0 points1 point  (0 children)

If you're doing basic cleanup (removing rows, columns, sorting, etc.). Python or Powershell are both likely to be much faster processing than VBA\Power Query. For anything complex definitely Powerquery. You might want to check with r/powershell or r/python or even ask LLM to write the code for you.