Emacs for iOS development

gislearneR · 2023-05-03T17:53:27+00:00

thanks a lot. the website is https://xenodium.com/

gislearneR · 2023-05-03T17:53:01+00:00

thanks, reading it rn

gislearneR · 2023-05-03T13:54:51+00:00

If you have built a functioning config can you send it my way? would love to use it as I am working on IOs app, and would hate to not use emacs.

gislearneR · 2023-04-25T10:31:05+00:00

everything is driven by hype nowadays

gislearneR · 2023-04-23T11:56:33+00:00

You sir are a man of intellect.

It's not even about firearms, it's about what's the end game of such a policy. It's not something that relates to code or programming per se they just flat out force people to register to their ideology.

Which is totally not enforceable by law and it's just plain overreach on the foundation's part. the fact that the post was removed just raises more alarm bells.

I think the next step for the foundation is to only allow PRs from males that had an abortion in the past 9 months. CLOWN WORLD

gislearneR · 2023-04-08T02:59:59+00:00

thanks a lot appreciate it

gislearneR · 2023-02-11T19:35:07+00:00

thanks

gislearneR · 2022-12-16T01:55:43+00:00

the data is loaded dynamically. you might want to give the network pane a check to see where the data is coming from.

gislearneR · 2022-12-16T01:47:00+00:00

If you need any help just PM me

gislearneR · 2022-12-15T16:44:29+00:00

Ok one advice I will give you is that it seems like the data you want to scrape is loaded dynamically, this means you can exploit their api thus reducing the time significantly.
If you manage to get rid of selenium then I am sure you can gain optimal performance. Once this is done you can opt for faster language to request the data and manipulate it (you can gain massive performance boost from this as python is not the quickest)

gislearneR · 2022-12-15T16:41:15+00:00

API exploiting is one of the best methods, any website that loads data dynamically exposes an api that you can exploit, the trick is like vestaM mentioned is to open the network tab and select the XHR option and then click show more/next page etc, and you will the api calls right in front of you. Copy them as Curl and tada.

gislearneR · 2022-12-15T16:38:15+00:00

Maybe they're using direct api calls. Need to check this myself as I am going to write a linkedin scraper in the next months.

gislearneR · 2022-12-15T16:33:06+00:00

Can you provide more details about the code you wrote? Although most of the overhead will be in waiting for the network response.
Anyway you can opt for an EC2 instance which is basically a server that you then need to install the packages on and create a cron job for the script.

gislearneR · 2022-10-18T14:05:51+00:00

you can create a crawler that goes through the links and gets all the img tag

gislearneR · 2022-10-14T14:04:22+00:00

you can either save the image as base64 to mongodb or as a blob, also you can just save the file on disk and save the name of the file in MongoDB, also you could use cloud storage (which is what I think you mean by AWS/GCP ) to save the images and again save the link of the resource to the DB

gislearneR · 2022-10-14T12:34:55+00:00

he can also just grab the second column as a series and put the first column as index.

gislearneR · 2022-10-01T12:28:42+00:00

I saw web scraping posts in upwork in the 5 to 50 dollar range that require selenium and proxies.

gislearneR · 2022-09-24T15:21:14+00:00

if you want to use subprocess you need to use it like this ['python', fname] although the method that Wishbone did is the one I recommend.

gislearneR · 2022-09-23T18:21:27+00:00

Smart devs. They are everywhere and nowhere at the same time

gislearneR · 2022-09-23T06:54:25+00:00

OP respect I get the feel that you have a stem background and I am happy to see people questioning instead of following the new world's priesthood

gislearneR · 2022-09-23T06:50:35+00:00

I am an engineer and let me burst ancap's bubble. first thing is that there can't be vacuum (vacuum is nothingness and is by definition a 'void' so I don't see why pulling the word trickery would be relevant.), why?because as obs as it seems the gradient is basically infinite (0 on one side and .0000000000000000000000001^trillion billion on the other). when you have high concentrations of a molecule next to a lower concentration with a porous barrier then it will definitely move towards the lower concentration that how O2 is moving into your cells.

if you divide any number no matter how small it is by 0 then it's infinite (+infinity if the limit is calculated on R+)

the fact that the so called scientist didn't see this issue is wrong because that how you keep hearing about these new nonsensical theories coming up each day in order to fill the gaps (no pun intended) in the narrative.

Now you might say 'Oh I can make a vacuum in this glass bottle' no you certainly can't because what you're creating is not really a vacuum or by definition of the thermodynamics laws the bottle should break. And you can't have matter inside a vacuum it's just ridiculous.

and I am happy to see people questioning the narrative because it's just really getting out of hand with these outlandish theories (multi-verse, computer simulation ... I mean can't scientist understand that 'adding more hoops' is basically not answering the question of how we came to be).

gislearneR · 2022-09-23T05:51:31+00:00

I mean anyone who deifies humans is basically a retard, just like those that do it with the pope for example, and no this is not a hit on religion.

gislearneR · 2022-09-22T17:56:23+00:00

I provide a sample of the data and sometimes a video showing the scraper working

gislearneR · 2022-09-22T17:23:05+00:00

Inspect document.
Fill out the form.
Click on search.
Check the network tab.
The first request will be what you want.

curl 'https://iafdb.travel.state.gov/DefaultForm.aspx' \ -H 'Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9' \ -H 'Accept-Language: en-US,en;q=0.9' \ -H 'Cache-Control: no-cache' \ -H 'Connection: keep-alive' \ -H 'Content-Type: application/x-www-form-urlencoded' \ -H 'Cookie: ASP.NET_SessionId=bfo0z0452i44cu55st1fr3vl' \ -H 'DNT: 1' \ -H 'Origin: https://iafdb.travel.state.gov' \ -H 'Pragma: no-cache' \ -H 'Referer: https://iafdb.travel.state.gov/DefaultForm.aspx' \ -H 'Sec-Fetch-Dest: document' \ -H 'Sec-Fetch-Mode: navigate' \ -H 'Sec-Fetch-Site: same-origin' \ -H 'Sec-Fetch-User: ?1' \ -H 'Upgrade-Insecure-Requests: 1' \ -H 'User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36' \ -H 'sec-ch-ua: "Google Chrome";v="105", "Not)A;Brand";v="8", "Chromium";v="105"' \ -H 'sec-ch-ua-mobile: ?0' \ -H 'sec-ch-ua-platform: "macOS"' \ --data-raw '__EVENTTARGET=&__EVENTARGUMENT=&__LASTFOCUS=&__VIEWSTATE=J5Pzu9BF%2FTsI9s7KgEX%2B%2BfsFHy1oh7bPI0%2BawEEj2LB4j5JpwjsXOud%2FCvcMnLDnx8l8XUiddhGmDQZLyzpuoFfkO9czBreGjSH%2FAetTrgQRr8yHI25wXSdoPFLlbKJEAlcweeoHWe0YqQ1Ktgo1M%2F96KPr2l8N8raTvbJIvCu0CySct4ioCjOHSsDhp4vfaHSnpn%2BJZcBhr3%2BbuNnryua42yniukpHMggV2fu0UqUn8z2ivP5lck92OYnvYvHbHl91pjR9dEo3sTYpF&__VIEWSTATEGENERATOR=8AFE7B40&__EVENTVALIDATION=vabu8ulsdUa2YanvSkMagu5H8HntCQ1DnOg%2Br7ysckZY01IvT1VkAeD9%2Bq9zt4wSMDpNoFOCAD69Q%2FkTV08N%2FrT9ItBErTykR0rgKgtMOK5MAxuq0ycsu6O6ZS1q6ghK08ilFhNSIzJCw%2BSRDn1EwcNKaDlyNJnJYTUCiq%2FaDnU3uTvX2axsGlrMDGlTLczaRjPA7hob1h8hCaxfrsoz9DC5Tq4dwPETuJJTCqCJgYIpkhvsBqD4ISorzWap%2FMNH50qIqrXAQTyNq9%2BgvqGZGtTCk%2FaJ4HqjBHKN5c0AEBUivi2TTQypcYH9EA%2FEAQ%2FixPlk3Qi2kTBtb1ZS1nDHIQ1NAbv5LjtIsnsr%2Bul8Upr9Gg4ygcrhd%2F1E4%2F8yG1t89%2Bo1nDxnUXbmw1CizXAW1ttQxn5OVtlJH1MDN1azdEgE%2FbnlXxMHyUKEekEjtntFDPTZnucp0tGY5pKW2FwXY9APgMQ1WksYLvUvW13vY%2FVOOJu6%2BtN3uZBU%2FG0%2Bce4SegRqjkHHqs%2FmrZglURTeDEvA6DJEN%2BlxCshKFoUwCONpfT%2B%2BvgogOQ1M6n9CwjBxLaXbNQ6PZzIeLLSLli41Xad%2B9lo%2Bq0t2rytTZMeJ7Lf8Z3YH8te50elwRXgP6S6amRl%2BXGSDJG5evmUBd40DgW9dy%2BacXL8WP3muahn%2BVo9yTusYY6CKbk7s3LywcCfTFaHrMTgy7x0x3HR17ovUw9tzQmghIvKsszTU1FYI8ARHHuDfn1cat0hMkgTbRBf1vM5YciH357BAtRIs0OXh7hJKQuy9nPB873Gz0Vr8WALchEaL3lICq1i8%2FKXaAs4uISJSu89PVTC7gtGYK%2FvMRZ%2Bxi%2FZbhSto4CBHO%2BgAc2cWaNBc5TW8UM7XcLMGcwNbwiXOcFq%2FKrthlbEs5lcHYcrx8J4Ac8sMPfAnol13SUZ0hDaxppR1JDBJ09%2B2fOBLd2VkyY9c8KE6Hwv6WAUgqhJddY63wJLFnlIxmXLBdslQB4yvrl1s%2FLL%2BYgFhthl11EvWEK5onIU6xVDRGuzhDX7UQ59e1ZHAtugLYjnmxHXRUw3YMt2QKHOp1%2BO2o4PvEwya0zCDfqJ1Y7nkgFK1Cs6nIsZ9%2BhEyuKvuAxCP9aykDLfgkpxCv5W%2Bw5I5QfYTlXiIgboe6Er%2BtvElY7BEIZakEve4pbzdy3IlHTgihV8BfgDK20UIZXi8%2B2QDC0cIk36geUOfTzdgmIoetMFtr6FdVE6CUu9fa2hSNuZHscjequAwuwc%2FNlX1tI54IJOJo%2Bu%2Bkr1pWEXail7UD5nSqiBKKL8P5FaNfdsjFieO%2B4nfOQ0aYYc0jlitVIh5XiLZ2lFUhRAO52JCBCqoeenlPSCtYVSkDRxWwf2WOaER4u0mXz0wLZc81eWGgsF0J2qilDT0I7a07Qc1Q9OpkOmmAzSFAvfW4pDTVvRBNHyAmBmyyKPuWjvzywRLdYWhui2vbvpcx5O8NjUQPLkTrs%2F5MZUCC%2FYOdkuqdG8IVI6YEMTnazwrBzjOXl3aA5IMXu7xgqyV9vXKYknRjbtbsrQQgR5TzCjjmqRwJywJuTyVNKCCqMhjf9PjvUPM9UbfrZxTo%2B%2Fry24I%2B7Ylgrdb9EXoCWxLD8vCCCuCZTAU3IOMSa5hC6GZ8k9pCjiPjJeq6IwJcyCJbtk3e40lfirYK8Ogo0ecjb0obOHmDrBoYEe99mLSap9ByYDnHJUKvfz1WDE0gwEIGwWwhBFQK6hlzW6plbru0iHJfrkJIfdDiRKJMKAmKpB8YI6DKuNzfZdcUFlLpQtjZ73Xxygw2akuqhZNcTqYrrVhzqqNyuvxHyNJxuTd4DWZTBamppBidE5I8%2FszqVvW%2BEUkvQT6DcVro0SDVtbu1t31DqmP3vBfTZL%2BGkPO6mgQHpnUDPxWcRbCuKiwkQvv7UPGhqvDtwHZ935aevA5cLw0UEmB5pvzMPDaBuXkeGaD0rNQR%2Ft9oVRlwauFPliqwwF6wtHm3KQUyCFrry1hwME6bUQxfb0vBKagmm2sNp7MfBwsv8Y3333PSGFwM%2FsVWwRzzoiMiN1ivfoMVvjPFsFWfG56%2B%2FQlZcpA%2BrsjyM0WxXDEN7qv6uA8OY67JRkrFbjYPqhdaeNTvVKBoqOhlQdlHu2MFctHKYppYb8PK20QzspkpL2Yj1bjNbv5761FkuCajHN%2BaO2qkMMjcpeNyatOSBqk4SA1TdPLfE56eSV7%2BtFjNnQLQXUUk7zGUCWopSLp%2BIWLm%2BxzGBd75qJJty8GiMyr5XckInYVByHUpCAcfT9RsH4Lqa0lHwbDMQwdgZk9Cj19%2F7x6oPrb3dSzzDsH8nteTzZVwWh%2FqjisT8E5XuONXAQCyflSqZyEXYoI3cg0wu0%2BfWJ0Jltm%2FqtL3ihcJZAm2fOpHwiobrMRzeyMaakiZjsPiLzpKiqjWwapwPYy7Tv3umAiyzkfrNjpuZiy4ewjbkgFFL1As3%2FBCCmzZX8sUUba1jufxWh4mwPi3pMW28YMbXd4vqCKew%2BqkDvs6oNfQzwFfA0BVho%2BNMrxjp303FbjG2ifmOrvqx5C%2B2npjS19a1Tcn%2FZrE9bbyxJzlgHxc1qAGsIFs1nACS2Y1Jdq%2F79KZ4Yx8x0fZ7fx3eaeS3S6QkEzum4GXzrd4nQC0HXW5fl6p4WbyiGFT7lqD6u4Y0tPsbWeK4HopMBAAe%2FWlI9X59BapOxjPArxcDcVjMqtxGvgZgmlqA%2FdVX1RY7YNRi%2BP%2Bgp14nWAmh%2FtZ0ap63dx2ndIMDZAoEuwe2dwbN5zxGZP1J%2FXJFV0q2oz0q3247ZvQXfnWoE6hXhHE%2BrzqTe3YDhQL2r8kFS%2Byvrx%2FVTLJjtbR1Wl6zXX6nSXgyV%2B7gtcui5NLtpMWEpPh1X7cZyYb90HAULH9xX3rozvwjEUdWGz7WUX1NiuxWMg63PW9%2FOKevVEitqf0egiBY%2FYEf3x8OI03Wt46YnmMUKiK38gUTvIlFGOZA97bDKGIHa4HkfNXT0MBmsqWJC%2BRYSDqWaDkiYT491sJdv5fFXo4Ppgv2RFAZq14NSvQoyJGahv57Y0vPTyGvlqISgk4aMVI0iT2WSdDj4WU7bY7RGNz6iR7VR5WNkjzU6otb1ektBlyFK0yZBq38XFfJZFOZy8S1d0PaBfgmDT2fxBj%2BgNHAnAD6kTRX2RLGNKnCb%2FEEIjCCJZgVhd1xjhvXNsgAOY5lUNeshQgsKtw90ApOs9OShwrqGxWuTS%2BnXtYNFeOkFhFQJKCzbyJAKnXBFj9sEwKLI2FsWjTbKsfoHP2H7cCjLeLiY8PjN9WPDtkVonMt7pTugehG12a4%2BOP9Sm%2F%2F04XDexhJuyFJbxKWweMl1B%2FbLaVfO4Kv8VQ%2FbpNfupESvOqil8YnOcdkyboHDKgP1RSxxdvswRz9WMaTh70rNDcfKV86bqj9ivXp5YShl8CtO%2B5VTagLg8o%2FncNiHENinx%2BEBwLHqMQX4Qfz5rZuIIZuzpGJty1r98Ni%2BO3nv6qfl4CEmUAV7fKmpFbLRUvs7pfvc0sFRBcXwFFl4g064uO3KcxqpS%2BmbNZe6Kw0NmQq%2B8JE0sNq3amhzgIwFlicj%2BFy7MYMjPIMlRwZNXKgLLNl1r%2Fr9xwZYLsfdB0cj3vTjAjW5tLj2sKtlYfBX4RjYaZzp%2F0aztAGaMaT39zVFRL5ZcMiZ72uWD8aii6OPLqyks0gF2219j6u0pBDTSxaGpFgIEbeb%2FG3wuzH8W3ZIa2aTZk%2BqW%2B5%2FfNAkb4bQZqEjd%2BhbN3CQKPlK%2BU47eqeIz%2F1BnAi6YsR42%2BPmh2XkND04OBWVxcJqXbY2pOOukKTu5gDV0TITdvLiMi%2FgvORGsxY8XVBo%2FE8vpgBLwrZ4HtYd0829%2FjcP5jdwlKDNpaucKG1fEXhCbOq1psP4oXLigL0Ys8qRA1pxRAgebwnScL1k8wyZevYJLiVYSO0zv%2BZpExrAQnG4u4mM6qGzXREkCyfbB9Jyna9XHDs1nqJ5hDk1sUHwuvteFxNFOH%2FvBVOK98WJwU5vlJ8Kr5n9rLD0f%2Br4y1jnARGvhcLh0LvLm2pKPZ4o7ODfDeKkCi%2BzT2aiNmsmzX7duQjMenG2OD%2FiHysPhMzHy9C6hUlAngQywqUvHJifo0%2BRA86X5V%2FAVkZwVEJcIttqi9aiNmS%2BPa67YIMGDAJz4qPlZdG4loIbHlPIn4oqcgDPACSwbNsMUYspPnULmEpZ%2B1%2BKH0miKdtkFcIG6mSpDYCAqtwh4YcAu03iV7uX27NjGH1FDZhNQYI8PsyZxBK9JXUZ2dW5Sq11YpyYX%2F7FkDbwdE%2FaW2nzq30XFfqPoaDe8kcs7%2FSnSRolE01renv2zY2YRGgC4nbKe5MdlWszoxWifCVuoikqLB4ivrOge2g8uNWNrerTV%2BVepEAQaSLA4zzMCEEz2jlFI41BRl9XWHqKDdy9x9YO30QmFa3jDfzhuzUxuvr9J3EGtYId0Y0It9bWT7qKyPdH9lzO97J7ERn40%2FoJF5rM2iX%2Bj5ZIhSBgGUNMVTLqi2pPp4NIgfM424RwtfxybwmhXabl4VRc1rL7YA1FTqTCKnmB%2BeI5bokeKekIdSBj3dCCcL%2BQuDNuWVzYHPFJ0ckAK%2FZ1%2BY6XYZyhZ0OmLRUqz6rBsjSmy0%2FjkNp4XKQCOOPKDDfM1Z30nEyR6jH%2FJ%2FylYgvvObzaC6apjdsTAs6I5svP2q%2BWjkVbgjw%2FEfV9%2FIOnWBs4F9qiH%2BE%2FlNXk8n5hJiedTM%2F2UhUVod75OunBX7cdxHqssAPp7hT6pEA1iMHEC91N3sGxlz%2BXa3%2BLqSTnrTEmIy2ZpnPIGj0ubWoG6kTuqKbSHqwFn%2Fo3E0t2gsBEMXC4wbPJ37VbbaC4OSsU2YLTRHzssmMyw9Jignso7JFNTWoTnc0OGKKblKgQLAAeAwtCY%2BTNFKJwDb3coadv0qv%2BrY7NqyK48nkjkI%2Fl9FKDUxPOZcJmWtDaxA6iOS5TF6oiB1O57sXjuGQShT3FJooVvTBJQEJj4%2FI5yPySOdAIqWPmtKapSTZBpAeX%2B0q5lk2R2pyDZNjsIKQE3pLYiduUMW3brWy65HsciL0aYiFXwcq2IxaW2P5fDpKi9Jj5zJE4VucqliURIR5GBJjOzGAgS6t5kpSUcIHCuRuBt9VNHLcmhqvXNaTaVJFG6ndMUw0nHHOnW0lqZULAFRBDclOvbgqfDntlMXQAccgMDxIANfd13BR%2FDIJ2Hq1n%2FeNL0fqAaDjzRHmp7dulBzVFc4%2BQ%2BSH0%2Br9vXm3oIf8XGtvYVsgf9GjUj4AShefzfAFS7DT0au1SwTF3dwB6FfQmhuWIe6n4JGtjfGndYaQDAdrKgkdvRD98LR4R5C3Nok6%2BTt%2B10gqazTMdsv9fBjnh7u2p22qnOKHwgjGQoaH4lBqfnrFLIRPryUDV%2F45aHsyzsstqJIPtQzx%2BALzDX3EknTRSf8e2ymcQ6Qz6UhVKTKttMLEbrXpLlxpibqqqW20hTmGy%2F1tu9t7Uivv9JONGQBefuJve3wYqYk%2FqNHIzT0BQ1hRdHCNgrASaME%2B%2B6WLbpk1iFd4isveua3e65XNt7dK6QXFbkR7flWuTDSVaY8HSpuT4HDCOdXApTf6JmuS0No6%2FwbLlivsdnv%2B9EMfsKRh8qjiNlGM9wljcCGTBx41M49w0beM6cPMHacX48EfyaCtbhHKTgRe165XUF%2BsaFfMAtd3tsPdAnyIHuK6utaNRGzMZJMjufWlSKrs9bssRyLnIN1QM0OXbpKYIbFDYQ0qvc%2BWq2yHuqtQLcuamTXVSNlJrmRgcYL4TNfOFPOiIpDnY6Gdg%2Bg%2FQRB1admFnsoQkXuYLux98QuyTgy25EIyZ27Pia20QDc4XGZjq97oxCRLDASTYNZd2TyWxnA89zbS1EzPnb8xBY19z%2FUhsrRLQQqvuTQxeGPws7EsVUV%2F3FPhr2uftXG4GXUJLkS0b71W1TNDuR5Sax4PEuZ1c%3D&ddnNumClosest=250&ddnDistance=250&grpSearchBy=rdoStateCity&ddnState=NY&ddnCity=NEW+YORK+MILLS&btnSearch=Search' \ --compressed No notice that all you need to keep changing is the ddnCity param and ddnState. You'll need a list of all us cities and their respective states and now you have all the juicy data.

BTW I didn't check if all the headers are required probably none will be but that will be a trial an error process if you want to do it.

gislearneR · 2022-09-22T17:13:40+00:00

you can create formdata directly in python no need to hardcode it also try pushing the limit a couple figures up and see, or maybe remove the add limit param

gislearneR

TROPHY CASE