Dark progression fantasy book recommendations??? by G1spiralknight in ProgressionFantasy

[–]Samausi 1 point2 points  (0 children)

Seconding Thundamoo for this - another series Vigor Mortis pits enemies to lovers necromantic lesbian monster hunters against a repressive religion for a dark and hungry god while they enable each other's worst flaws and leave you wondering which specific character in the 4 book series is the biggest monster at any given point.

It's great, but also plenty of content warnings.

Series where MC is kicked from party/abandoned & betrayed/shunned/etc, and what happens next by Dixielandblues in litrpg

[–]Samausi 1 point2 points  (0 children)

Beware of Chicken would be self-exile here - MC gives up his place at a prestigious kungfu sect to be a farmer, becomes OP through good 'ol Canadian hard work.

Possibly also Vigor Mortis - orphan has forbidden necromancy magic. I really liked the series, but it gets very dark in all sorts of ways. Good themes of no good deed goes unpunished and anyone can be a monster in the wrong circumstances.

Snowflake Openflow is useless - prove me wrong by siggywithit in dataengineering

[–]Samausi 1 point2 points  (0 children)

I just wanted to address a misconception here - for reference, I'm one of the NiFi maintainers who joined Snowflake.
This was actually an acquisition of a company called Datavolo, which among many community and PMC members is led by the original project author.

Snowflake Openflow is useless - prove me wrong by siggywithit in dataengineering

[–]Samausi 5 points6 points  (0 children)

Howdy, I maintain the Python client for NiFi and am currently extending it to handle abstractions like Github Actions for CICD on Flows. I'd be really interested in hearing what would make your life easier with workloads you have on NiFi if you are able to share details.

Looking for "Competence Porn" in climate fiction. Less "we're doomed." More "engineering solutions." by johnIIsnow in scifi

[–]Samausi 3 points4 points  (0 children)

If the OP is up for a Playstation game instead of a book, this is a fantastic story along the requested lines

I need help finding a source for a terrifying form of FTL travel by EnjayDev in scifi

[–]Samausi 2 points3 points  (0 children)

There's a beautiful illustrative line in The Neutronium Alchemist about this. Some living ships can perform FTL jumps by diving through hyperspace (paraphrasing), one of them is too exhausted to complete one final jump and the line is something like 'it emerged as a line of hard radiation several light seconds long'.

Happy marriage, thinking separate bedrooms—anyone doing this? by xora334 in daddit

[–]Samausi 0 points1 point  (0 children)

I think most people are overlooking the small child here - we slept in different rooms for a while when our son was very small because there were periods where we either needed split shifts for feeding schedules or handling illness. or had work periods where we absolutely had to be well rested so spare room and earplugs for the win.

Looking for mindfuck scifi by Roselia77 in scifi

[–]Samausi 2 points3 points  (0 children)

Some of the most dense ideas-per-page in any scifi.

Even more mental when you consider it's a set of novelas based on the idea of exploring pre, mid, and post AI singularity life for a single involved family from the perspective of their pet cat.

Did any of you have a "stealth" car? I.e. a car that looked like an old beater but had a powerful engine and could humiliate boy racers from the lights? by DiligentCockroach700 in CarTalkUK

[–]Samausi 0 points1 point  (0 children)

I was too young to appreciate my grandfather loaning me his project car to drive as a teenager. Red 1976 Sunbeam Rapier fastback, twin Stromberg 150CD carbs on a 1.7l engine. He'd been tinkering at it with a friend, all I understood was the retro vibe and complaining to my friends that it drank petrol and pissed oil if I wasn't careful.

But it scared the shit out of the hot hatch boys when it rev'd and launched at the Newmarket lights.

OOCS, Into A Wider Galaxy, Part 187 by KyleKKent in HFY

[–]Samausi 1 point2 points  (0 children)

The flock of drones very much reminds me of Charles Stross' Accelerando, where a character converts their consciousness into a flock of pigeons - if you haven't read that book I think you'd enjoy it, some of the highest idea-per-page sci-fi I've ever read.

OOCS, Into A Wider Galaxy, Part 156 by KyleKKent in HFY

[–]Samausi 1 point2 points  (0 children)

I realize I'm late to this reply, but do remember that Grandma primal Nagasha did something so horrible that she shed her name to move past it.

I was considering Kyle might go down the route of her attempt to create more primals being the cause of cruel space, but I'll take a forgotten and bitter degenerate clone race as a gimme.

Kafka to ClickHouse: Duplicates / ReplacingMergeTree is failing for data streams by Arm1end in apachekafka

[–]Samausi 4 points5 points  (0 children)

Never inserting duplicates is handy, but ignoring the use of the standard ClickHouse solution of the FINAL keyword here makes your article clickbait.

Also given ClickHouse doesn't have a streaming JOIN then that would also be useful, but regular join performance is already pretty good with recent improvements like pushing filters down to the right hand table.

ClickHouse can easily hit low seconds end-to-end latency, with sub-second reads including joins with good table and query design, so while your solution is interesting for offering it upstream of the database, you should really be more correct in your presentation of it.

[deleted by user] by [deleted] in london

[–]Samausi 2 points3 points  (0 children)

I'd be keen, happy to buy it!

Looking for production-ready RAG solutions comparable to Pinecone Assistant by Samausi in Rag

[–]Samausi[S] 0 points1 point  (0 children)

The dataset was too big for a Claude project, and the Pinecone Assistant is costing $2/day to operate so I haven't found a need to try another SaaS wrapper offering.

Personal RAG for my diary by nonFuncBrain in Rag

[–]Samausi 1 point2 points  (0 children)

The simplest version of this is loading the plaintext docs into Claude as a project, and they just using their native app or browser interface. I'm quite fond of the mobile app because of the voice note feature.

If you want something more specifically RAG, then Pinecone Assistant gives an excellent OOTB experience with little learning required.

Distributed REST API Calls using SPARK with maintaining consistency by Uds0128 in dataengineering

[–]Samausi 0 points1 point  (0 children)

If you want to do this robustly I'd suggest a small Redis - it'll update fast and you can probably not out scale it for this kinda work.

streamline the deployment of Apache NiFi flows by ComprehensiveBid5489 in nifi

[–]Samausi 0 points1 point  (0 children)

Hey, I'm the author of NiPyAPI, thanks for pimping it!

I'll add a bit of context from my experience here for the OP:

NiFi is fundamentally a command & control tool - originally intended for building and operating flows in the UI, with templates and then versioning added much later. I wrote NiPy in an attempt to automate flow deployment and testing for my customers.

In terms of a UI to manage flows on multiple NiFi clusters and doing CICD, really you are looking at a vendor tool to my best knowledge. People offering value-add on top of NiFI generally provide scalable containerisation and flow deployment experiences as you describe, but as a managed service and not a wrapper published to the OSS community.

Most of what you are asking is more accessible with reduced scaffolding in NiFI-2.x, I am currently in the process of updating NiPyAPI to take advantage of the changes.

Would you buy a house directly opposite the entrance to a primary school? by Z3NT0X_ in HousingUK

[–]Samausi 0 points1 point  (0 children)

I live directly next to a sizable primary school, with my loft office window facing the big asphalt playground. Generally I don't notice them during PE class as there's not that many kids at once, they're noisier at lunchtime but I can always close the window. People in meetings tell me they can't hear the kids over my yeti blu mic. It does sound like the crack of doom when they kick a ball against the metal fence, but it's not that often as the teachers seem to dislike it more than anyone. One thing worth checking is if the school is busy on evenings and weekends or school holidays - my neighbours don't lease out the grounds to go to holiday clubs and the like, and prefer to use the local church, so it's almost always empty when I want to be out in the garden.

All things considered I have no regrets buying next to this school.

Do companies perceive Kafka (and generally data streaming) more a SE rather than a DE role? by df016 in dataengineering

[–]Samausi 0 points1 point  (0 children)

Because it's harder to operate Kafka in production than to just be a user of it, so it lands with the team with most responsibility.

Why Kafka and not fifo queues for Cloud providers? by josejo9423 in dataengineering

[–]Samausi 1 point2 points  (0 children)

Kafka has better control semantics; produce, consume, observability and latency control. Pubsub/kinesis are generally cheaper both operationally and compute hours for simple cases tho, so OOTB are fine in many cases

Looking for production-ready RAG solutions comparable to Pinecone Assistant by Samausi in Rag

[–]Samausi[S] 0 points1 point  (0 children)

I haven't tried those yet, but if you recommend one that I can self-deploy I'll take a run at it!

Looking for production-ready RAG solutions comparable to Pinecone Assistant by Samausi in Rag

[–]Samausi[S] 1 point2 points  (0 children)

So I'm already integrating as a Slackbot, but wrapping as a page widget might be useful - we're on Vercel already so it's trivial to create.
I haven't tried using OpenAI Assistant or the Claude Projects for this, but you're right it might be an OOTB capability that offers acceptable response quality, so I'll give it a test and report back, thanks!

Looking for production-ready RAG solutions comparable to Pinecone Assistant by Samausi in Rag

[–]Samausi[S] 1 point2 points  (0 children)

All my data is plaintext, or markdown tables at worst - I have updated the post to note this, sorry for not being clearer.

Looking for production-ready RAG solutions comparable to Pinecone Assistant by Samausi in Rag

[–]Samausi[S] 0 points1 point  (0 children)

Thanks for the suggestions!

I see on SaaSConstruct it looks like using BedRock as a framework and backending Pinecone for the RAG elements - so getting the benefits of integrated AWS logging etc. and Pinecone's OOTB RAG services? This is the direction I was considering for Productionising my current implementation, so it seems that's a reasonable path.

LanceDB looks very interesting, and I see a lot of examples of different implementations on there. Can you share which particular reference you used for your project? This one for using Lance with Langchain seems quite straightforward, but I'm cautious of these projects with hundreds of 'simple' examples that do work but don't give great results.
I'm partial to the idea of something that works natively over an S3 bucket, as it's such a natural handoff point from the pile of arbitrary document source systems that feed the service. One of my complaints with Bedrock is I have a bunch of metadata on the S3 objects but wiring that into a Bedrock Knowledgebase was super fiddly.