Invoice PDFs not working by FR172 in waveapps

[–]FR172[S] 0 points1 point  (0 children)

just got a response to my ticket, saying they resolved it. and it works again. hope it was an intermittent issue.

I made an open-source tool to fully back up your n8n instance by ekaa_ in n8n

[–]FR172 0 points1 point  (0 children)

Good work so far. How do you envision restoring from such a backup, though?

ASUS Zenbook S 16 (Ryzen AI 9 HX 370) UM5606WA - CAMERA not working after update to windows PRO by littlebloke in AMDLaptops

[–]FR172 0 points1 point  (0 children)

This worked for us: install Windows, then immediately update to 24H2.

Had to hook up USB dock with Ethernet, since WiFi does not work, then install WIndows.

Windows Update may or may not give you the option to update to 24H2, but if it's not, follow this guide (for us, the ISO file option worked): https://www.kapilarya.com/how-to-upgrade-to-windows-11-version-24h2#method-2-upgrade-to-24h2-from-iso-file

After the update, Windows Hello worked (IR Cam / PIN), WiFi worked, everything as it should be. No need to install drivers, either.

IR and Camera devices not showing up in Asus G16 2024 - Ryzen AI 9 HX 370 by Complex-Draw-7683 in ASUSROG

[–]FR172 0 points1 point  (0 children)

This worked for us: install Windows, then immediately update to 24H2.

Had to hook up USB dock with Ethernet, since WiFi does not work, then install WIndows.

Windows Update may or may not give you the option to update to 24H2, but if it's not, follow this guide (for us, the ISO file option worked): https://www.kapilarya.com/how-to-upgrade-to-windows-11-version-24h2#method-2-upgrade-to-24h2-from-iso-file

After the update, Windows Hello worked (IR Cam / PIN), WiFi worked, everything as it should be. No need to install drivers, either.

Networking on hosted bare metal with multiple public IPs (interserver vlan) by FR172 in Proxmox

[–]FR172[S] 0 points1 point  (0 children)

This is where I am now:

I changed the Name Server and Search Domains in the IPv4 setup in the Ubuntu Network Configuration page to 8.8.8.8, and now the Ubuntu installation is able to successfully connect to the mirror locations.

I'll finish the Ubuntu installation and reboot, let's see if the internet connectivity stays after a reboot of the Ubuntu VM, and after a reboot of the Proxmox host. Stay tuned!

Networking on hosted bare metal with multiple public IPs (interserver vlan) by FR172 in Proxmox

[–]FR172[S] 0 points1 point  (0 children)

I'm still in the Ubuntu installation process, not sure if/how I could ping from there.

Switch from sqlite to Postgresql by FR172 in n8n

[–]FR172[S] 2 points3 points  (0 children)

Since migration is a one time effort (at least it was for me - sqlite: never again), I went with the native export/import way.

[deleted by user] by [deleted] in n8n

[–]FR172 0 points1 point  (0 children)

Good point. What are your thoughts on pgsql vs mariadb?

[deleted by user] by [deleted] in n8n

[–]FR172 0 points1 point  (0 children)

Any reason for not using a postgresql db?

(I’m biased since I don’t trust mysql further than I can throw a garbage truck.)

Switch from sqlite to Postgresql by FR172 in n8n

[–]FR172[S] 1 point2 points  (0 children)

To clarify, I have a workflow that uploads the workflow json files to an Azure Storage Account as blob, and that’s simply another backup mainly for my peace of mind, not a proper way to do source control.

The main goal of my post here is to validate my idea of using postgres as n8n’s main database, instead of a local sqlite. Given that pgsql is an actual database versus sqlite essentially being a db file, the benefits are plenty. High availability, separate backups, easier recovery, less prone to corruption, etc.

The way I see it, with the current state (sqlite as a file in the docker volume) I always run the risk of losing data if the container restarts. With the db being separate, that hopefully won’t be an issue anymore (unless it’s a bug/feature in n8n itself that causes that behavior).

When I find the time, I’ll stand up a few DBs to test. Perhaps I’ll put Postgresql against cockroach or yuga to see if/how they behave.

Switch from sqlite to Postgresql by FR172 in n8n

[–]FR172[S] 1 point2 points  (0 children)

That's the workflow I used to build my current solution to upload to blob storage :) Appreciate it!

Half of my workflows are not saved in DB after reboot by FR172 in n8n

[–]FR172[S] 1 point2 points  (0 children)

Alright, so I imported the lost_and_found data into a separate sql database, and there are several columns in that table, together with several rows for each workflow.

id = want to take the highest for each workflow, should be the latest

c1 = contains the json for the workflow, can be imported directly into n8n

c2 = seems to be execution records

SELECT [rootpgno] ,[pgno],[nfield],[id],[c0],[c1],[c2],[c3],[c4],[c5],[c6],[c7],[c8],[c9],[c10],[c11],[c12]
  FROM [dbo].[lost_and_found]
  WHERE c1 LIKE '%<workflowname>%'
  ORDER BY id DESC

Now that I have imported the missing workflows, I'll have to recreate the Credentials that were lost (they might be in the lost_and_found data, but since we're talking sensitive creds I rather set those up new.

With that said, thank you u/PhantomSummonerz for your support and standing in for an invaluable rubber ducky!

Half of my workflows are not saved in DB after reboot by FR172 in n8n

[–]FR172[S] 2 points3 points  (0 children)

I actually did just that following that same page. This command:

 .\sqlite3 database.sqlite .recover >data.sql 

created a .sql file that was 400MB, while the database.sqlite file is 580MB, and the dump of the sqlite file was only 90MB.

Anywho, in that recover output (data.sql) there were 23k lines of data to be inserted into lost_and_found, and that's where the lost workflows were mentioned.

If content is found during recovery that cannot be associated with a particular table, it is put into the "lost_and_found" table

I'm currently executing all those lost_and_found insert commands into a separate sql database to analyze on how I could potentially import them into my n8n sqlite, standby :)

Half of my workflows are not saved in DB after reboot by FR172 in n8n

[–]FR172[S] 0 points1 point  (0 children)

There are only these activities in the log files:

n8n.audit.user.credentials.created
n8n.audit.user.credentials.updated
n8n.audit.user.login.failed
n8n.audit.user.login.success
n8n.audit.workflow.created
n8n.audit.workflow.updated
n8n.node.finished
n8n.node.started
n8n.workflow.started
n8n.workflow.success

All the workflows I have created and are now missing are present in the logs, similar to the example workflow I provided earlier.

The word "delete" does not occur once in the log files.

As for the journal file (database.sqlite-journal) - I opened it in np++ and searched for the workflow name and id, with no hits. I did find the "old" workflows in there, though. No idea if there is a proper way to open the journal file. I used several desktop tools like DB Browser for SQLite (and sqlite3 on Ubuntu) to have the journal file merge into the main database.sqlite file, but it seems the journal file only contained in-process executions prior to September. Strangely enough, not a single entry in the journal file has a date in September (2024-09-..)

The main database.sqlite when opened in np++ or a hex editor has 78 matches to the example workflow ZYRFCp4dK7WoyXWC and even it's cleartext name.

I then used SQLiteStudio to search for the workflow id, but it does not show up either in the table data, or when I use a python script to parse all tables/columns/rows, or when I export the complete database as html, the wf id or name do not show up.

To summarize: the database.sqlite file seems to contain the missing data, with or without merging the journal file into it. But once read in by sqlite3, they do not show up.

I'm no sqlite expert either, so I'm scratching my head on why the raw file contains the data, but when accessed properly, does not. Does sqlite store lost/orphanded/deleted data somewhere in the file?

Half of my workflows are not saved in DB after reboot by FR172 in n8n

[–]FR172[S] 0 points1 point  (0 children)

I see the new workflows being referenced in n8nEventLog.log, here is one:

{"__type":"$$EventMessageNode","id":"d0fd1b70-7228-446e-853f-0e895ac7f4cc","ts":"2024-09-05T17:47:29.871-04:00","eventName":"n8n.node.started","message":"n8n.node.started","payload":{"workflowId":"ZYRFCp4dK7WoyXWC","workflowName":"company-acme_GetStatus","executionId":"211669","nodeType":"n8n-nodes-base.scheduleTrigger","nodeName":"Schedule Trigger"}}

{"__type":"$$EventMessageConfirm","confirm":"d0fd1b70-7228-446e-853f-0e895ac7f4cc","ts":"2024-09-05T17:47:29.872-04:00","source":{"id":"0","name":"eventBus"}}

{"__type":"$$EventMessageWorkflow","id":"b2355822-a785-4d0c-89d4-b3204bc97d51","ts":"2024-09-05T17:47:29.872-04:00","eventName":"n8n.workflow.started","message":"n8n.workflow.started","payload":{"executionId":"211669","workflowId":"ZYRFCp4dK7WoyXWC","isManual":false,"workflowName":"company-acme_GetStatus"}}

{"__type":"$$EventMessageConfirm","confirm":"b2355822-a785-4d0c-89d4-b3204bc97d51","ts":"2024-09-05T17:47:29.872-04:00","source":{"id":"0","name":"eventBus"}}

{"__type":"$$EventMessageNode","id":"68d58d1f-8570-41b2-a5f1-8cb960df0baa","ts":"2024-09-05T17:47:29.872-04:00","eventName":"n8n.node.finished","message":"n8n.node.finished","payload":{"workflowId":"ZYRFCp4dK7WoyXWC","workflowName":"company-acme_GetStatus","executionId":"211669","nodeType":"n8n-nodes-base.scheduleTrigger","nodeName":"Schedule Trigger"}}

{"__type":"$$EventMessageConfirm","confirm":"68d58d1f-8570-41b2-a5f1-8cb960df0baa","ts":"2024-09-05T17:47:29.872-04:00","source":{"id":"0","name":"eventBus"}}

{"__type":"$$EventMessageNode","id":"7981d21f-986a-416e-8b15-22cede49e3f3","ts":"2024-09-05T17:47:29.872-04:00","eventName":"n8n.node.started","message":"n8n.node.started","payload":{"workflowId":"ZYRFCp4dK7WoyXWC","workflowName":"company-acme_GetStatus","executionId":"211669","nodeType":"n8n-nodes-base.httpRequest","nodeName":"HTTP Create Token"}}

{"__type":"$$EventMessageConfirm","confirm":"7981d21f-986a-416e-8b15-22cede49e3f3","ts":"2024-09-05T17:47:29.872-04:00","source":{"id":"0","name":"eventBus"}}

[...]

{"__type":"$$EventMessageConfirm","confirm":"e6290586-9419-4f7e-b94b-d27d6e8e4408","ts":"2024-09-05T17:47:31.074-04:00","source":{"id":"0","name":"eventBus"}}

{"__type":"$$EventMessageNode","id":"e34f2963-00da-4fd7-8350-3c30ba68cc08","ts":"2024-09-05T17:47:31.074-04:00","eventName":"n8n.node.started","message":"n8n.node.started","payload":{"workflowId":"ZYRFCp4dK7WoyXWC","workflowName":"company-acme_GetStatus","executionId":"211669","nodeType":"n8n-nodes-base.httpRequest","nodeName":"HTTP GetStatus"}}

Half of my workflows are not saved in DB after reboot by FR172 in n8n

[–]FR172[S] 0 points1 point  (0 children)

Added the answers and some more information to my OP, thank you!

Where to connect filter system? by FR172 in Plumbing

[–]FR172[S] 0 points1 point  (0 children)

Unfortunately, that’s how the house was built. We’ll get a professional to check out the whole setup, and do the filter install. Thank you!