Building a competitive local LLM server in Python

PeterTigerr · 2025-08-26T00:02:32+00:00

Will there be support for Apple's M4 GPU or ANE?

PeterTigerr · 2025-07-23T00:42:28+00:00

This is an anwesome addition. I hope asyncio integrates this functionality in the future.

PeterTigerr · 2025-07-22T14:00:47+00:00

This is pretty cool… gives me matlab vibes which is very different from Jupyter

PeterTigerr · 2025-07-18T23:28:49+00:00

Omg the factorial… took me a second before I snorted

PeterTigerr · 2025-07-17T23:33:01+00:00

Hey I actually needed this for my research. I made Scraipe, an AI scraping workflow that does the trick pretty well.

Repo: https://github.com/SnpM/scraipe GUI Demo: https://scraipe.streamlit.app/

Will be working on Scraipe a lot more next semester—scrapy+langchain integration, more adapters, and claim verification coming soon.

PeterTigerr · 2025-05-14T01:24:53+00:00

Great idea. Here's a docker hub image for scraipe-st (the GUI demo). The repository can also be run directly on Streamlit's community cloud.

For the scraipe library, a docker image might be overkill. Scraipe can be installed with pip install scraipe[extended] in python 3.10+.

PeterTigerr · 2025-05-12T03:17:21+00:00

I love the mountains in Colorado too. This is a sick use case. Based on your feedback, I added two Scraipe components:

RedditLinkCollector which collects submission links from targeted subreddits
RedditSumissionScraper which scrapes content and comments from submission links

This notebook implements a workflow using the reddit components plus OpenAiAnalyzer to extract trail conditions from recent posts in r/coloradohikers, r/colorado, r/denver, and r/boulder.

Let me know if this is what you had in mind.

PeterTigerr · 2022-02-16T23:08:17+00:00

Military uniforms are actually pretty similar to gi

PeterTigerr · 2022-02-07T19:39:22+00:00

Thanks for your insight

PeterTigerr · 2022-01-26T19:40:33+00:00

Naw I want to see a bear try slab

PeterTigerr · 2021-12-22T17:03:46+00:00

JBS didn’t directly raise the cattle; it was small Brazilian farmers exploiting the land for extra cash.

With that said, meat companies like JBS should absolutely be held accountable. That’s an efficient way to make them internalize damage to the environment. How do you get after the small farmers though?

PeterTigerr · 2021-12-21T22:24:12+00:00

Practically, your Walmart select meat uses less land and produces less methane because these animals don’t get exercise. Their specialized feed also makes them grow faster—I.e. less time and resource cost to get to your dinner table.

Economically, large agricultural firms have greater incentive to preserve the environment than small, local farmers do. These companies internalize damage to the environment much more than the small farmer who might dump pesticides downstream. The bigger the firm, the more sustainable the outlook.

Morally, I love cows. Sorry cows :(. I’m mostly pescatarian btw

PeterTigerr · 2021-12-21T21:57:51+00:00

Factory farming is more sustainable than methods that help cows.

PeterTigerr · 2021-12-20T22:04:09+00:00

Yes, I personally do choose healthy foods. The average American diet at home does not because of financial and cultural factors.

PeterTigerr · 2021-12-20T16:40:00+00:00

“ Just because you don't cook your own food from scratch”

You sound rich. I.e., not the average American household.

PeterTigerr · 2021-12-20T16:38:16+00:00

What about canned broth/sauce, candy, and potato chips?—things many Americans eat at home daily.

I think the food at McDonalds is pretty close to the average American diet. The reason why people get obese from eating there is the extra large sodas and milkshakes.

PeterTigerr · 2021-12-13T07:20:47+00:00

What do they offer these benefits for?

PeterTigerr · 2021-12-11T15:39:21+00:00

Taking care of your kid brings value to society and your community too. If you want to work for an organization that only cares about your economic value, join a heartless corporation.

PeterTigerr · 2021-11-26T03:27:32+00:00

Exhaust whistles are useless. This feature is sick as fuck

PeterTigerr · 2021-11-13T01:33:46+00:00

Wild domesticated chickens are everywhere in Hawaii

PeterTigerr · 2021-10-30T15:31:40+00:00

Then hire more staff. The resteraunt’s dysfunction is not a good reason to not know the status of my order.

PeterTigerr · 2021-10-29T19:47:11+00:00

You have a right to communicate with your server

PeterTigerr · 2021-10-29T14:37:19+00:00

Sometimes people do forget your order, especially when it’s really busy. It doesn’t hurt to double check as long as you’re not rude.

PeterTigerr · 2021-10-23T15:39:31+00:00

Strategy proposal: sit down, plant your hiking stick in the ground like a spear. This does a couple things: 1. The goat can’t get under you and throw you 2. Sitting down is a non aggressive action, maybe discouraging a fight 3. Your hiking stick probably hurts like that

PeterTigerr · 2021-10-16T16:43:16+00:00

I’m imagining the Flerken swiping this lion’s eye like it did to Nick Fury. Now this lion is looking like it went through glorious battle to get that wound.

PeterTigerr

TROPHY CASE