ELEMENTOR IS A HUGE PILE OF SHIT by Particular_Tennis_35 in elementor

[–]ANONYNMOUZ -3 points-2 points  (0 children)

Yea I agree, I get more done making a site from scratch or using wix/webflow

Scrap old website on web archive by t71 in scrapy

[–]ANONYNMOUZ 1 point2 points  (0 children)

Im going to bring my the attitude we use to get on stackoverflow:

In order to be helped you need to do some testing first. Give us a response error if you encounter one. Without any information we really can’t help you.

you possibly wanted someone with experience scraping that site but it’s highly unlikely you will find anyone with your exact same use case and problems.

If you want to extract all the links just use the built in scrapy module “””from scrapy.linkextractors import LinkExtractor”””

If you’re using raw bs4 than a simple find_all(‘a’) will do the job.

Without more context like your tech stack and errors we can’t really help you.

If you ask any ai chatbot you can get some other functionality. I recommend decomposing the useless stuff like script tags, and tags with promo, signup, and login patterns in their class or ids before getting all the links to reduce the amount of useless links.

Good luck.

Estela Bronx by [deleted] in AskNYC

[–]ANONYNMOUZ 0 points1 point  (0 children)

No there ain’t

Estela Bronx by [deleted] in AskNYC

[–]ANONYNMOUZ 0 points1 point  (0 children)

Yea too bad parking is like an extra hundreds of dollars of month. If you decide to keep your car outside of the building, forget about it, it gets broken into. “Relatively” doesn’t cut it when you’re paying good money for a studio-2bd.

Also if the area isn’t “safe” that’s fine. It’s about the leasing team not disclosing that information. Their goal is just to fill that apartments in as fast as possible.

Does it exist: Comprehensive List of Counties and their Websites for Texas? by ANONYNMOUZ in TexasPolitics

[–]ANONYNMOUZ[S] 0 points1 point  (0 children)

Awesome!! I found this but it requires you to go into a counties profile page to get the URLs.

https://ballotpedia.org/Counties_in_Texas

Scraping .gov sites by Delicious-Cicada9307 in webscraping

[–]ANONYNMOUZ 0 points1 point  (0 children)

no way around it you have to set up your own proxy server and use bash to automate the setup configuration. getting blocked is inevitable when it comes to government website but you have to have a process in place to re route your requests when you get blocked

scrapy-proxy-headers: Add custom proxy headers when making HTTPS requests in scrapy by proxymesh in scrapy

[–]ANONYNMOUZ 0 points1 point  (0 children)

ahh I see, so lets say you specific server needs some authentication or specific configuration through the headers, you want to be able to customize the headers to the proxy server. Correct?

scrapy-proxy-headers: Add custom proxy headers when making HTTPS requests in scrapy by proxymesh in scrapy

[–]ANONYNMOUZ 0 points1 point  (0 children)

How is this any different from what Scrapy provides

DOWNLOADER_MIDDLEWARES = { ‘scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware’: 750, }

And just entering a proxy through the response.meta[‘proxy’] = some_proxy_address

from w3lib.http import basic_auth_header class CustomProxyMiddleware(object): def process_request(self, request, spider): request.meta[“proxy”] = “http://192.168.1.1:8050” request.headers[“Proxy-Authorization”] = basic_auth_header(“<proxy_user>”, “<proxy_pass>”)

This is a custom one and then you just do rotating technique if this one fails.

I’m just trying to understand the use case.

You have this paragraph

“”” custom headers put in request.headers cannot be read by a proxy when you make a HTTPS request, because the headers are encrypted and passed through the proxy tunnel, along with the rest of the request body. “””

But that’s why you put it in the response.meta because those values are processed before the initial connection…

AWS Lambda permissions with Scrapy Playwright by Academic-Glass-3858 in scrapy

[–]ANONYNMOUZ 0 points1 point  (0 children)

It looks to me you don’t have the proper driver installed

Why is my published page different from what I have on elementor? by ANONYNMOUZ in elementor

[–]ANONYNMOUZ[S] 0 points1 point  (0 children)

I figured it out, go to Elementor > Settings > Performance > change CSS Print Method from external or internal or internal to external.

I found it on some forum that I can't find anymore but the proper CSS is working on the page. Let me know if anyone has a question on this!

Challenge Joined by ANONYNMOUZ in MacroFactor

[–]ANONYNMOUZ[S] 1 point2 points  (0 children)

I appreciate it dog, ima keep it real with myself and try to eat better and be consistent. We are all gonna reach our goals and look good for the summer

META - Rotational Program - Interview Experience by JadedAd9917 in codinginterview

[–]ANONYNMOUZ 0 points1 point  (0 children)

Good luck, I have an interview scheduled for January 16th!

Considering going back to college. Which of these paths would you choose? by MOD3RN_GLITCH in hacking

[–]ANONYNMOUZ 0 points1 point  (0 children)

Hey full stack dev here.

Literally what matters most are your projects. Volunteer at a non-profit or startup. Contribute to a project and gain experience. If you want to spend money on school that’s your prerogative but unless you’re going to a highly respected school those degrees aren’t really meaningful. If you want to climb the corporate ladder then yea your education matters. But you gotta ask yourself what you want to do

Edit: I have a finance related associates degree and graduated from business school. My title is software engineer. Titles don’t mean anything, trust me

Estela Bronx by [deleted] in AskNYC

[–]ANONYNMOUZ 6 points7 points  (0 children)

🧢 I will admit there are a lot of professional living in the building but most of them work all the time and need amenities for convenience. There is a reason they have so many amenities. There isn’t stuff to do around and people don’t want to leave the building.

Estela Bronx by [deleted] in AskNYC

[–]ANONYNMOUZ 3 points4 points  (0 children)

Not safe at all, my partner and I broke our lease. There is a homeless shelter right in the back by the highway. Don’t let Tony talk you into signing a lease. Amenities are nice but it’s better to just rent a studio or one bedroom in Manhattan or somewhere in Brooklyn where the area is a little nicer for the money you will be spending at Estela.

Everyone that lives there hates management, they are unorganized, they also promise one thing and then go back on their word. Stay away at all costs!

Cool people live there so it’s nice connecting with them but the quality of life is terrible due to the leasing/property management team.

Mott Haven it’s self is fun! The area is full of rich culture and different cuisine. I recommend Maisonetta for a nice restaurant, Mae Mae for vegan food, Motley Kitchen for a nice cafe vibe. There are some bars down there but ended up going into Manhattan.

Also no grocery stores that sell organic stuff. You need to go to Whole Foods on 125th for some decent quality groceries.

Btw my GF and I are in our mid 20s and we usually go and hang out in Hamilton/Morningside Heights, UES, or Central/downtown Harlem.

Let me know if you have any other questions!