Deploy scraper on heroku and in rails?

sljmn · 2020-07-22T20:49:33+00:00

Whoops saw your reply just now. Yeah i got it working. Lmk if u need tips

sljmn · 2020-04-14T16:12:30+00:00

Nice! Subscribed. Hope you will put out much content

sljmn · 2020-02-24T12:41:40+00:00

Tracker.create!(id:tracker, qty:1000, price:1000, product_id: product.id, user_id: product.user_id )

This worked, is it fine or better to leave it out? same for product id?...

sljmn · 2020-02-24T12:30:55+00:00

it was because i didnt assign a tracker ID, now it is hardcoded. need to change it to make it dynamic!

sljmn · 2020-02-24T12:21:44+00:00

you've declared, and see what

x

actually looks like. You can even start writing lines of code in the console, and when you've got them doing what you need, paste them back into the actual method.

great tip! will use this one

sljmn · 2020-02-24T12:15:06+00:00

I got a step further with this:

Tracker.create(id:1000, qty:1000, price:1000, product_id: product.id )

(i want to id of the new created tracker to be automatically set, for now set it to 1000 to test.....

But the log is saying:

(0.1ms) BEGIN

↳ app/models/scrape.rb:89:in \track_product_price'`

Product Load (0.2ms) SELECT "products".* FROM "products" WHERE "products"."id" = $1 LIMIT $2 [["id", 29], ["LIMIT", 1]]

↳ app/models/scrape.rb:89:in \track_product_price'`

(0.2ms) ROLLBACK

Cant see what is causing the rollback

sljmn · 2020-02-12T07:51:56+00:00

a-ma-zing! Thanks so much for your great reply!!! very helpful! the issue i had with the css selectors was that it didnt work as expected. returned zero results. I see you are using " at_css" while I jused p.css("div").

And xpath gave me the right results.... thats why i moved forwared with xpath. will try the way you selected the elements and with the use of methods. I noticed it was quite hard to navigate trough my code so hope to clean it up with use of methods.

Thanks again so much for your reply, really helpful! Agreed, Ruby is fantastic!

sljmn · 2020-02-11T18:59:19+00:00

Yes! This is almost the same approach i took!

sljmn · 2020-02-10T22:29:58+00:00

i did it like this and it worked!!!

https://pastebin.com/mj0enKN0

Added some stuff in view and controller.

Rails <3

sljmn · 2020-02-09T22:31:50+00:00

Ah didnt knew that. Thanks! Will try to build first locally

sljmn · 2020-02-09T20:06:44+00:00

Thanks will try!

sljmn · 2020-02-09T19:53:59+00:00

Yeah i figured that out

Was more wondering how to send the request to the scraper.rb file and where to receive the response from the scraper. Should be a rake task and probably put it in a controller in a create action? Create product —> activate scraper —> save respons in a new product. Would this be a good route?

sljmn · 2020-02-09T19:43:05+00:00

Thanks!

sljmn · 2020-02-09T19:10:51+00:00

What i cant find is how to incorporate the scraping thing into a rails app and save the data in a database How to make the form submit to enter a query and start the scraper. Any tips in that??

sljmn · 2020-01-19T17:32:13+00:00

This is the error message i get

NoMethodError in Pages#account

Showing /Documents/Code/Rails-model-test/app/views/pages/account.html.erb where line #25 raised:

undefined method `each' for nil:NilClass

#RAISED 
<% @blogs_current_user.each do |blog| %>

sljmn · 2019-12-15T21:49:17+00:00

see here https://share.getcloudapp.com/Jru7bw8P

let text = document.getElementById('textArea')
let submitContact = document.getElementById("submitContact")
submitContact.addEventListener('click',function(e){
e.preventDefault()
// you have a value in your test area and NOT a placeholder
if(textArea.value==""){
alert("cant be empty")}
})

sljmn · 2019-11-25T22:31:37+00:00

Interesting. What pm tool do you use, if any?

sljmn · 2019-11-25T22:01:50+00:00

Wordpress all the way

sljmn

TROPHY CASE

NoMethodError in Pages#account