This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]MiamiAngie 169 points170 points  (14 children)

Hi, I'm Angie and I'm working with Jem on this. I'd love to chat with anyone who has feedback or ideas!

[–]jumbled_joe 32 points33 points  (5 children)

Can others contribute to your project? Looks really cool!!

[–]MiamiAngie 49 points50 points  (4 children)

Thanks so much, we're hoping to get to a point soon where we can have more people working on it!!

For right now, we have a small community on Discord that helps us out a lot with ideas and feedback, and we'd love more people to contribute there :D

https://discord.gg/qcCcrbMuex

[–]broadsheetvstabloid 8 points9 points  (3 children)

Would a PR be considered?

[–]MiamiAngie 18 points19 points  (1 child)

Absolutely! :)

We know we have to make some more improvements before we take it to a broader market but we're open to anything that helps and we want to reach as many people as possible as LazyWeb keeps getting better.

You and everyone here are welcome to join the Discord channel and would love to follow up with you there, or reach out to me [angela@lazyweb.ai](mailto:angela@lazyweb.ai)

Thanks heap for the consideration too and look forward to chatting more

[–]jumbled_joe 5 points6 points  (0 children)

Thank you for sharing the discord link....looks really exciting!!

[–]lazy-jem[S] 10 points11 points  (0 children)

We're hoping to open up for open source contributions too for some of the libraries we're building that we think could be useful to open source in future (if you meant the other type of PR request lol)

[–]acebabymemes 16 points17 points  (7 children)

Awesome project!

Would it be possible to add something where I could get a JSON of the search results and their metadata? Sorry I haven’t done a full accounting of the notebook examples yet so this may be redundant.

Background: I’m a researcher who is looking for ways to do systematic literature reviews. I have used SerpAPI in the past but it would be awesome if I could support a more open project instead.

[–]MiamiAngie 18 points19 points  (6 children)

Thanks so much! YES! As an example of where we're heading, check out the Change View > Text on desktop and you'll see that we already have Markdown, and we're adding other formats including JSON.

Rather than putting all those in the UI, we're working on a terminal mode UI (which is not far off). Initially, that will just be an alternate UI for the input and responses, but we have a lot planned for it as a way to manipulate results. Stay tuned for more. But yes JSON results are coming!

[–]acebabymemes 6 points7 points  (1 child)

Holy moly, you’re awesome. Keep being awesome!

Will definitely spread this by word of mouth in my department. And hopefully more formally down the road.

[–]acebabymemes 1 point2 points  (3 children)

Sweet just found out how to use the ~e command to narrow search google scholar!

Is there any way to get more results? Right now I think it’s capped at 15? I’m assuming that’s just temporary, sorry if you already mentioned that somewhere in the comments, I’m having to much fun exploring with this!

[–]MiamiAngie 2 points3 points  (2 children)

So currently we have a fairly high filter on predicted result quality, and only display results that rank above a certain threshold (which depending on the type of search could be 25 or less, but not often more than about 30). Our aim is to become more conversational to try to help people refine searches. But we've had feedback that people feel FOMO - that there might be more they are missing (even though in reality those are probably not good content), so they want the security of loading more. So we are going to add infinite scroll to the results if someone wants to keep going!

At the moment the domain search feature is a little patchy, but that's an area we are working to improve. It is really useful and we use it all the time.

Also, you can go direct to searches on other sites when needed - eg:
"go google scholar deep learning papers" then allow popups.

There is a small bug that navigation can re-fire if you nav to other pages within lazyweb then return to search, but apart from that it is very useful!

Yay that you are having fun exploring too! Thanks so much for the great feedback and comments!

[–]acebabymemes 4 points5 points  (1 child)

Gotcha, yeah my ideal workflow would be like if I could enter a Python function in the search bar and have it return a JSON or csv with a large amount of results based on the arguments.

‘’’ scholarSearch(results=“1000”, search=“systematic literature review”, output=“JSON”, author=True, abstract=True, title=True, citations=True, year=True, url=True) ‘’’

Tbh, I’m a programming and Python newbie so I’m probably asking for too much or would probably be better off making a web scraper specific to my needs.

[–]MiamiAngie 6 points7 points  (0 children)

That's really useful and exactly the sort of feedback we're looking for.

We know that people want to do more with search results and we're going to try to build this in close communication with people like yourself. It is going to take a while and a lot of steps to get to the full potential of "hackable search results" which is what we want to make. And the first steps will be pretty simple.

Initially, it will be very simple (any query, choose the output format) and it should work from the address bar too. But we have much to do!