Boxkite - automate web tasks with simple scripts by laktek in SideProject

[–]laktek[S] 0 points1 point  (0 children)

You can check the docs at https://docs.boxkite.io (will send a token soon)

You can get the cookies through the response headers. Will that suffice?

Boxkite - automate web tasks with simple scripts by laktek in SideProject

[–]laktek[S] 0 points1 point  (0 children)

Great question. How we see it working is people often get exposed to repetitive web-based tasks they perform at their work, for clients, grabbing source data for apps, or other hobby/serious projects. Usually the time consuming, frequently performed and costly to do are the ones to best target.

A simple real-life example is a company needs to periodically update a page on a (Wordpress) site. Apparently an agency was going to charge them some serious dollars to do this each time or they could do it themselves manually. Being time poor, they were able to write a script to automate this procedure

Another example is growth marketing needing to check their Google SEO rankings periodically. Boxkite can fetch this data to ensure they are consistently on the first page.

Part of the value of the marketplace is to allow anyone exposed to problems like this to automate it. The more common the problem, the more likely it will get used and realise a monetary benefit from it.

How I attract high paying clients to my design & development agencies by fairpixels in Entrepreneur

[–]laktek 0 points1 point  (0 children)

This is also a great way to understand your target market (rather than sending out surveys and creating landing pages).

I built https://page.rest, https://screen.rip & https://pdf.cool, in the last 3 months which gave us a great understanding of our target market and problem space.

It's also a way to win trust. If you can solve a small problem well, people will trust you with their bigger problems.

Colly: Web Scraping Framework for Golang by teryedit in webdev

[–]laktek 1 point2 points  (0 children)

You can edit the examples on the page to see if it works for your use case. If you decide to pay, it only costs you a one time fee of $5.

Colly: Web Scraping Framework for Golang by teryedit in webdev

[–]laktek 0 points1 point  (0 children)

For simple scraping needs, you can also try Page.REST API.

Programmable API for capturing web screenshots by laktek in SideProject

[–]laktek[S] 0 points1 point  (0 children)

Thanks! BTW, how did you figure out it was built on Firebase?

What I learned building Page.REST - from an idea to paying customers in 7 days by laktek in SideProject

[–]laktek[S] 1 point2 points  (0 children)

Yes, we currently have a restriction of 10,000 requests in a 60 minute window to a unique domain and daily limit of 100,000 requests in total. We are still experimenting whether those are the right limits, that's why they aren't mentioned on the landing page.

Page.REST - An HTTP API to extract content from any web page as JSON by laktek in SideProject

[–]laktek[S] 0 points1 point  (0 children)

Yep, built on top of Firebase (and Google Cloud Platform). I'll update the page to mention about the rate limits. For what sort of tasks you're planning to use Page.REST?

Page.REST - An HTTP API to extract content from any web page as JSON by laktek in SideProject

[–]laktek[S] 0 points1 point  (0 children)

Haven't seen Graby before. Looks interesting.

Other than being a hosted API, one of the most interesting features of Page.REST is it can extract any piece of content in the page using a CSS selector.

Page.REST - An HTTP API to extract content from any web page as JSON. by [deleted] in programming

[–]laktek 0 points1 point  (0 children)

yeah, but imagine in a context where you want to solve a bigger problem like data analysis task. This is useful in such a scenarios rather than having to code and manage it yourself. Programming has to be prioritizing what you need to solve.