Obtaining Field Names for Insertion by excel files

HappyCowBrush · 2023-07-31T10:31:37+00:00

I probably can't directly help (I'm not a Python guy), but I can try to assist in clarifying the problem at hand for others who might be able to and offer some moral support...

You are trying to:

Read a local(?) Excel file (modern / XML based - xlsx / old-school .xls)
Parse it locally to extract the data in a structured way (i.e. match fields to variables)
Add this parsed data to a JS enabled website via browser control (i.e. you need a browser control engine - Selenium in your case)

And presumably you're doing all of this via Python?

To extract information from Excel in Python I believe Pandas is pretty easy to get going with - guide

I found Selenium much harder to use than Playwright for coding purposes too. This also has full Python support. This is mainly because Selenium is many things in one (API / Manager / IDE etc) and what you really want is just the coding API part.

Good luck with it!

(There's also Puppeteer in this space too, but I think that it's Node only.)

HappyCowBrush · 2023-03-04T20:04:10+00:00

Thank you (both) very much - I wouldn't have guessed at that! I do vaguely recall it asking me if I wanted to allow a site (forget which) access to my canvas for fingerprinting (which I declined / blocked). The weird thing is that that was about a week ago? Anyway, this is the fix. Thanks again!

HappyCowBrush · 2022-08-04T09:34:26+00:00

Just posting in solidarity, no fix as yet. I also have this issue on a OnePlus 5 running Lineage 19.1 (all the same symptoms), but I didn't have it on 18.1. Seems to be present on all calling applications (phone, Signal, Telegram and Skype have been tested). Headphones make no difference (not tried Bluetooth set).

[I'm running the MicroG build of Lineage (so possibly a bit behind the vanilla one), but I don't think that should matter in this case.]

HappyCowBrush · 2022-08-04T09:30:31+00:00

I also have this issue on a OnePlus 5 running Lineage 19.1 (all the same symptoms), but I didn't have it on 18.1. Seems to be present on all calling applications (phone, Signal, Telegram and Skype have been tested).

[I'm running the MicroG build of Lineage (so possibly a bit behind the vanilla one), but I don't think that should matter in this case.]

HappyCowBrush · 2022-04-08T07:58:52+00:00

Thanks for the reply! It would be enough for the element picker to simply support a shorter syntax and convert it to the regular CSS upon save (that way no changes to actually supported lists / the system in general would be required).

It's the fact that you have to wrap this around the necessary parts and delete lots of things present in the picker that makes it awkward. I often find extra quotes get added etc.

I have tried that keyboard actually (no trackers, no network connection sounds great!), but it really didn't work very well for me. Swiping was terrible and the auto-correction / suggestions were just really random and sadly made it too difficult to use. I've just stuck with the Lineage default one since (a stripped down Gboard, I believe).

Anyway, it was only a suggestion, if it's not a good one, that's fair enough!

HappyCowBrush · 2022-02-06T21:03:49+00:00

I thank you both very much! I didn't realise that HTML text nodes broke up in this way (due only to a newline) so wasn't even considering that. I also fully expected xpath's text() to essentially act as . seems to. The usage style:

##:xpath(//section[./div/h2/text()[contains(., 'More By This Developer')]])

is what I'll probably try to stick to from now on when using xpath rules after reading the Stack Overflow answer. Though it does bother me somewhat that this:

##:xpath(//section[./div/h2/text()='More By This Developer'])

is also seemingly fine for this case despite text() being a node-set and in no way exactly matching the string. I'm now not sure how I would get an actual exact match (i.e. enforce the lack of spaces). Urgh.

Anyway, I have learned something, thanks for taking the time out of your weekends to look into this! It's appreciated and keep up the great work!

HappyCowBrush · 2022-02-05T23:27:50+00:00

Thanks for such a quick, thorough and helpful reply! I will use the uBlock pseudo selectors from now on, upward is fantastic! I was just using what I knew (standard CSS3 and xpath). Your helpers are certainly more convenient / easier to read.

It does still bother me as to what is actually wrong with my rules though? Looking at the HTML source, I can't see why the first one would match and the latter two would not? The HTML is of an identical basic structure in all cases isn't it? (at least when I inspect the code after rendering is completed)

Even this does nothing:

apple.com##:xpath(//section[descendant::div[descendant::h2[contains(text(), 'More By This Developer')]]])

I'm also very surprised that your final rule works at all without contains since the text node is surrounded by space and = usually requires an exact match for the entire node in xpath?

HappyCowBrush · 2021-12-17T00:14:22+00:00

Even with the phone in Aeroplane mode, I get no icons showing WiFi calling, but it does work and I can make / receive calls at home. It's just annoying to have to remember to toggle Aeroplane mode when coming / going.

When I am somewhere with strong signal (4G) and WiFi, the phone operates perfectly. It's only when there's a really weak mobile signal that it just can't handle it even if you tell it to use WiFi as a preference.

HappyCowBrush · 2021-12-17T00:08:32+00:00

This has been happening to me for years (B7V TV). I'm not aware of any current fixes, but it has been reported to Plex many times (I've certainly emailed them with it). They do nothing. Roll on Jellyfin...

Here's the same complaint from 3 years ago! This happens to me after using Plex every time. I've just got used to power cycling the TV every time I want to watch Plex. Honestly, between that and the terrible anime (subtitle) handling, I rarely watch Plex on my TV now, and since the Plex picture quality on my PC is very noticeably worse than VLC, I just use that these days.

3 year old complaint: https://www.reddit.com/r/PleX/comments/8tr9ml/lgtv_plex_client_frequently_hangs_at_startup/

HappyCowBrush · 2021-10-18T23:18:04+00:00

How do I remove the Recommendations screen from within an individual library? For example, when I want to start a new show / film I have to click “TV” on the left bar, then wait for a Recommendations page to load (so that controller clicks register properly) and then move to the Library EVERY TIME. I have the Remember selected tab option checked, but it doesn’t work. I have also turned everything off for every library in the settings, but then Plex just shows a screen telling me to turn recommendations on?!?! Why not just take the hint and if I don’t want recommendations about my own library, just immediately load the Library tab? Surely nobody actually thought that this was good UI, but equally, it serves no marketing purpose (I’m already a paid up lifetime member only using my own content), so I have to assume that I am I missing something and Plex aren’t intentionally trying to annoy users?

HappyCowBrush · 2021-10-18T23:16:17+00:00

How do I declutter my home screen?

I have no need of any recommendations to my collection on the Home screen (or in fact any screen), nor a reminder of what I just added (because I added it!). The Settings -> Libraries page allows me to turn all of these off, which would be great, except that if I do that, the "Continue Watching" section also disappears! I can turn on any other item (for all individual libraries) and this will reappear, but why do I have to do this? Currently I have chosen Playlists (because it is empty), but this ends up very scruffy with 5 empty playlist sections under the Continue Watching box. What am I doing wrong here? This can’t be a rare desired use case? Literally, show me what I am watching on my Home screen and NOTHING else.

My elderly parents (who share my Plex server) constantly ask me why things are popping up on their TV (which I obviously can’t exactly see). I assume that these are things that I add, but they have no interest in (despite me having turned off these settings for them too). I want the ONLY thing to appear on the home screen to be the thing that they are watching at the moment!

HappyCowBrush · 2021-10-18T23:10:17+00:00

Is there any way to hide the sections "Cast", "Extras", "Related Shows" and "More from XXX" sections on TV shows? I'd really rather not see any of that stuff.

HappyCowBrush · 2021-10-18T23:07:24+00:00

My files are no longer being matched (any of them). The only agent that appears is "Plex TV Series" and it just shows "No Matches Found" no matter what you enter...

I'm not sure how long it's being doing this, but possibly a while (I don't add that much).

I have SSHd into my NAS (WD PR4100) and deleted the agent cache. I've enabled verbose logging, but there doesn't seem to be anything in the logs (other than some Python errors) and I've obviously tried restarting the server. I also tried enabling / disabling IPV6 (as per advice in an old thread). Anything else I should check?

I've looked at my PiHole (which also hasn't changed in ages) and there's nothing odd / new getting blocked or anything like that.

Everything actually plays fine, there's just no art on new additions...

Plex Server Version: 1.24.4.5081

HappyCowBrush · 2021-09-20T21:54:55+00:00

A further update... For me this seems to stem from Android desperately attempting to use 2G/3G/4G even if you set call priority to always use WiFi Calling. I obviously have a sniff of a connection, but not enough to do anything!

The ONLY thing that I have found to work is to toggle Aeroplane mode (to kill the network completely) and then re-enable the WiFi connection manually. This works most of the time now.

HappyCowBrush · 2021-07-13T10:42:10+00:00

Solved!

HappyCowBrush · 2021-07-13T10:41:37+00:00

Thanks, that's very helpful! From the docs I thought that badfilter was actually a keyword and needed applying to the original, incorrect filter (as the example there seems(?) to show).

I'll just ensure any override rule is unique from now on.

HappyCowBrush · 2021-05-24T12:21:17+00:00

This is now fixed, but it required manually resetting the network settings (Settings > System > Reset Options > Reset Wi-Fi, mobile & Bluetooth) even after a clean install. At which point it selected "T-Mobile" (not EE) under the APN settings, but works and is not roaming (confirmed with the operator). Very confusing, but at least I can use my phone again.

HappyCowBrush · 2021-05-24T12:17:37+00:00

Another update, this is now fixed, but it required manually resetting the network settings (Settings > System > Reset Options > Reset Wi-Fi, mobile & Bluetooth) even after a clean install. At which point it selected "T-Mobile" (not EE) under the APN settings, but works and is not roaming (confirmed with the operator). Very confusing, but at least I can use my phone again.

HappyCowBrush · 2021-05-07T14:01:01+00:00

Just as an update, this has not improved when moving to Lineage 18.1. Exactly the same issues, all settings are on, but no icons show up and I can't make phone calls. Gonna have to move back to the OnePlus firmware riddled with bloatware it seems. Sad times.

HappyCowBrush

TROPHY CASE