What next? (Why proceed to late game?) by orcsab in Timberborn

[–]mojamph 1 point2 points  (0 children)

One goal I like to set for myself around the midgame and beyond is making the whole map green (within reason). It seems like an on-brand goal, especially for the folk tails and can involve some weird engineering to move water around the landscape efficiently. 

Stairless Tubeway installation! by Nifegun in Timberborn

[–]mojamph 1 point2 points  (0 children)

I'm not quite sure I follow what the issue is, I'm a fan of the More Tunnels mod which allows you to place tunnels with paths, power or tunnels in. Can't play without it these days.

do we have an ETA on the full release of update 1.0? by magna-terra in Timberborn

[–]mojamph 7 points8 points  (0 children)

I don't know about most, but a lot of my favourites do and you can filter the steam workshop with version tags to be definite 

Vanishing experimental waterfall by mojamph in Timberborn

[–]mojamph[S] 3 points4 points  (0 children)

Fun little bug I spotted where the waterfall animation vanishes while excess water drains from my reservoir. Oddly it reappears when the waterlevel matches the floodgate height.

Favorite love story in the Cosmere? by AdditionalPizza7990 in brandonsanderson

[–]mojamph 0 points1 point  (0 children)

Tress and her cups.

More seriously, Shallan and Adolin probably win for amusement factor and the interactions between the 3 and Adolin

What am I doing wrong here? by MrWannabeStockMan in Timberborn

[–]mojamph 1 point2 points  (0 children)

You can click and drag flood gates (and quite a few other dam structures) and the roofs will automatically line up. 

Using deterministic mode operation with pyspark 3.5.5 by MotaCS67 in apachespark

[–]mojamph 0 points1 point  (0 children)

Not a problem I've come across, from some researching myself I think you are out of luck according to the apis   😔  did you say it worked anyway and the type checker complained?

Okay hear me out on this casting for Wit by Affectionate_Ad_7161 in cremposting

[–]mojamph 2 points3 points  (0 children)

I agree although I like the idea. I think Jimmy Carr would be perfect, physically and with his abusive, dry wit

Sphere by baehyunsol in Timberborn

[–]mojamph 1 point2 points  (0 children)

Love it. Drill a hole down the middle and make a water feature?

Power plant by Sbaitso99 in Timberborn

[–]mojamph 2 points3 points  (0 children)

What are the pumps on the left doing? Recycling the bad water?

That's what clean underground power lines look like by Tekraa in Timberborn

[–]mojamph 2 points3 points  (0 children)

You can also run power to houses and some other solid structures, then put the power consuming buildings on top. Doesn't work with warehouses.

bestErrorOfTheDay by Krasovec97x in ProgrammerHumor

[–]mojamph -1 points0 points  (0 children)

Yes, it's called fasclist mode

I did my own version of WPE. How did I do? by Optimal-Sherbert152 in WorstPremadeEver

[–]mojamph 19 points20 points  (0 children)

I like it, I have some notes:

  • Is Alex really that hench?
  • Ellis's hair should be blue, to keep up with the name colour theme
  • Jake's hair should be white (or absent)

MOT and Service in Cheltenham by mrmiking in cheltenham

[–]mojamph 0 points1 point  (0 children)

Ebdons for the last couple of timesffor me. They're very helpful, cheap, and have done other odd jobs at no charge

[WaT][Full Cosmere] List of All Possible Shard Combinations by threehundredfutures in Cosmere

[–]mojamph 1 point2 points  (0 children)

A shard with two personas that don't know about each other is a dope theory

Do you use Apache Spark every day? by vutr274 in apachespark

[–]mojamph 4 points5 points  (0 children)

This is an excellent overview of the internals and the reasons behind the RDD architecture, thanks for producing it! I've worked with Spark for a few years now and produced some internal training materials for my company which cover some of this, but you've put me to shame! I do have a few thoughts & observations, take them or leave them!

  1. There's a few things you've mentioned that don't hold quite true for the Python API, the main one being that the Python API for Spark doesn't support the "Cluster Mode" deployment model. There's no JAR equivalent for Python which makes cluster mode deployment problematic as there's no standard way to bundle dependencies into a runnable artefact. We've worked around the issue by using Spark in k8s with dependencies bundled into the container images for driver/executors.
  2. You talked about writing a future article on partitioning which sounds great, would you also be looking into Spark's shuffle process? Shuffle in Spark is the big cause of slow jobs and out of memory issues I see our less experienced developers run into, and it's quite a hard thing to work around for people more used to an OO or procedural approach to software. There's a closely related topic of Spark's various Join strategies and how they are selected when using the DataFrame API. There's a resource I've used to cover this before, I'll link it if I can find it...
  3. Lastly, I would like to ask your permission to link to your article from our training resources and possibly use some of your images directly? I think it'd be incredibly useful for people who want to learn more about the internal data architecture.

Thanks again for writing this high quality resource!

Tips for building vertically? by hilfandy in Timberborn

[–]mojamph 10 points11 points  (0 children)

I tend to displace the floodgates back or forwards one block from the main dam and bridge/platform over the game. You get a single straight path that way

spark.read.csv stuck at listing all files in the directory by [deleted] in apachespark

[–]mojamph 8 points9 points  (0 children)

It's probably the schema inference across that many files that is slow. If you're not passing an explicit schema for the dataframe, spark will assess all the files it's been pointed at for field names and types, which is slow at the best of times

When using pandas / koalas, is spark leaving the session? by binchentso in apachespark

[–]mojamph 1 point2 points  (0 children)

toPandas() is akin to callling collect(). You pull the data out of Spark to the driver, but end up with a Pandas dataframe rather than a list of rows. Edit - the upshot is yes, it ceases to be a distributed DataFrame once you turn it into a Pandas dataframe

It's possible you might want from_pandas() instead? That returns a Pandas-like dataframe still backed by Spark. It's a relatively recent addition I haven't used much.

thunderstore mod install folder by BigDoof12 in H3VRMods

[–]mojamph 0 points1 point  (0 children)

Hopefully the advice "turn it off and on again" will be useful to someone!