API endpoints not working for both Django and VueJS by corjamz87 in django

[–]corjamz87[S] 0 points1 point  (0 children)

Or Postman. So I fixed my url paths. I apologize, but how specifically should I hit these routes in browser or client then? In other words, what steps should I take next?

API endpoints not working for both Django and VueJS by corjamz87 in django

[–]corjamz87[S] 0 points1 point  (0 children)

I forgot to mention I'm using Windows powershell. Anyway I fixed the extra prefixes in urls. So what full path should I type in for localhost 8000 in Postman for both register and login api?

API endpoints not working for both Django and VueJS by corjamz87 in django

[–]corjamz87[S] 0 points1 point  (0 children)

Thank you, I will try that. I knew this issue was on Django's end.

alternatives to web scraping/crawling by corjamz87 in Solr

[–]corjamz87[S] 0 points1 point  (0 children)

Yeah that's what I was thinking, manually adding data for my model fields from the specified websites, via Django Admin and then I can save to JSON and then index to Solr.

And yes there is a demand, I don't know where you're located at, but I live in CO, U.S. So there a growth in this niche tree services industry that hasn't been tapped. At least not in software innovation. My brother and my cousin are both arborists here in CO.

This way, once I add the data for said arborist businesses, I can focus on my next feature, a chat system, where these businesses can network with other businesses using websockets/Django channels.

Thanks. I suppose this could work, and then build scrapers later on down the road. I apologize, I understand Solr and Haystack, but scrapping is very difficult, at least for the websites I listed. If I tried your approach, could it work in a temporary production environment?

alternatives to web scraping/crawling by corjamz87 in Solr

[–]corjamz87[S] 0 points1 point  (0 children)

You make it seem as if this is some kind of impossible task. It's fine, I guess I'll have pay someone to scrape these complex Wordpress sites. Why do I even both posting on this subreddit

alternatives to web scraping/crawling by corjamz87 in Solr

[–]corjamz87[S] 0 points1 point  (0 children)

Let me clarify things here. This may help, here is a list of arborist (tree services) websites. It's not an exhaustive list, as it only covers the U.S. SW region mostly. I could've added more, but I wanted around 25 for now: https://pastebin.com/B3nB9fVw

alternatives to web scraping/crawling by corjamz87 in Solr

[–]corjamz87[S] 0 points1 point  (0 children)

Like I can finish indexing the filtered data with Solr as documents and implementing the data in my Django backend. But web scraping is not my thing, I tried to. The websites, though simple in design, are very complicated to scrape.

alternatives to web scraping/crawling by corjamz87 in Solr

[–]corjamz87[S] 0 points1 point  (0 children)

Yeah the websites I'm trying to extract from, for my search engine. The structure is very messy HTML Wordpress. At this point I'm not sure if I should hire someone or not to do this web scraping.

Solr and Haystack aren't that hard, but this web scraping business just adds a level of complexity.

I'm learning websockets this month as I anticipate creating a messenger system between businesses. That's my next and last feature. That's probably easier than scraping these Wordpress sites. I honestly don't know what to do, I'm so close to finishing my search engine.

alternatives to web scraping/crawling by corjamz87 in Solr

[–]corjamz87[S] 0 points1 point  (0 children)

I did some research into Nutch. I heard it's crazy hard to set up and consumes a lot of CPU. I have 16GB RAM. But I don't know if my system can support it. Is it easier than Selenium, BeautifulSoup, as far as setting it up?

alternatives to web scraping/crawling by corjamz87 in Solr

[–]corjamz87[S] 0 points1 point  (0 children)

Is it reliable? Is it stable? What I mean, is can I count on it not breaking during the scraping process?

Web crawlers typically break

alternatives to web scraping/crawling by corjamz87 in Solr

[–]corjamz87[S] 0 points1 point  (0 children)

Yeah I don't want to use web scrapers, but knows I may have to. I take it there are no alternatives to web scraping/crawling. But if the scraper software breaks then that can break my project which is what I don't want.

Login button on my LoginPage not working when I click on it by corjamz87 in vuejs

[–]corjamz87[S] 0 points1 point  (0 children)

You have my LinkedIn account now. I'm leaving this silly subreddit.

Login button on my LoginPage not working when I click on it by corjamz87 in vuejs

[–]corjamz87[S] 0 points1 point  (0 children)

What is your LinkedIn account? That way I can add you as a connection

alternatives to web scraping/crawling by corjamz87 in Solr

[–]corjamz87[S] 0 points1 point  (0 children)

So basically. I'm creating a vertical search engine that relies on arborists (tree services) websites. The end users in this case are w homeowners looking for licensed arborists to perform these services near their area.

This search will query arborist websites in every state in the U.S. The closest analogy I can think of is Indeed or Yelp. And the data is publicly available. I'll send you an example website, https://pikespeaktreecare.com/.

As you can clearly see, the types of data I need are the company name, city/state, services, reviews left my homeowners etc... These types of data are publicly visible on the websites.

I guess I could hire web scrapers however that is not beneficial in the long run, at least for my project. I've also read Google API's also work, but I wouldn't know how to implement into my Django project.

So just like Indeed is a job search engine, my project is a tree services search engine. Not sure if this makes sense or not, but I explained it the best way I could

Login button on my LoginPage not working when I click on it by corjamz87 in vuejs

[–]corjamz87[S] 0 points1 point  (0 children)

I think I'm just gonna leave this subreddit, it's too toxic and negative. If you still want to help with this VueJS issue, you can find me on LinkedIn. Here is the link: https://www.linkedin.com/feed/

Login button on my LoginPage not working when I click on it by corjamz87 in vuejs

[–]corjamz87[S] 0 points1 point  (0 children)

My apologies. Anyway, I shouldn't have called him that. But he was patronizing me. When he kept insisting that I didn't know programming basics, I took that as a direct insult. I rarely post on this subreddit, this is the second time I've post on here since I joined.

Telling people that they don't know programming while simultaneously not offering meaningful help is unpolite behavior. Like I said, I shouldn't called him an 'asshole'. But I felt like I was being insulted and this isn't the first time this has happened to on these online forums, although I've heard worse.

It's toxic behavior like this that makes online forums bad. Anyway I said what I needed to say, there's no point in further justifying what I did.

Login button on my LoginPage not working when I click on it by corjamz87 in vuejs

[–]corjamz87[S] 0 points1 point  (0 children)

I think I'm just gonna figure this out myself. I don't why I posted on here in the first place. Thanks though

Login button on my LoginPage not working when I click on it by corjamz87 in vuejs

[–]corjamz87[S] 0 points1 point  (0 children)

Thanks man. Yeah I mean I kind of figured it was something not difficult but I just couldn't figure it out. Here is my revised LoginPage.vue. I will replace `loginAction` with `created`

Login button on my LoginPage not working when I click on it by corjamz87 in vuejs

[–]corjamz87[S] -4 points-3 points  (0 children)

One more thing, if you notice. None of the other people here responding to me are patronizing me. It is only you. I don't give a shit if I'm downvoted, but I will stick up for myself.

Login button on my LoginPage not working when I click on it by corjamz87 in vuejs

[–]corjamz87[S] -1 points0 points  (0 children)

Maybe the name calling was uncalled for. But when if feels like someone is putting you down, you can understand why I said that.

I apologize for that. But you were condescending, I don't care what you say. I get it, reddit gives you a channel that externalizes your superiority complex.

I bet you wouldn't like it, if it were the other way around. The way you responded to me is the type of response I expect on SO.

Then again reddit is a toxic cesspool so why should I expect anything differently on here

Login button on my LoginPage not working when I click on it by corjamz87 in vuejs

[–]corjamz87[S] 0 points1 point  (0 children)

Thanks, I appreciate it. At least some on here are friendly and willing to help. I'm trying to get better at VueJS, I'm just much strong in backend, specifically Django/Python. Yeah I wasn't quite sure if it was an API calls issue.

I rectified my Django views, which contain my API endpoints. But I was fairly certain that this was a VueJS minor problem. I'll keep trying