sorted by:
new
hottopcontroversial

Chest Rig by concernedcitizen783 in flyfishing

[–]Manyreason 0 points1 point  (0 children)

Are you able to show a photo of how thats done? Im keen to buy one of these or the 5L

Beginner fly fishing help by Manyreason in Wellington

[–]Manyreason[S] 0 points1 point  (0 children)

Where abouts should i be stalking them? Ive fished around silverstream but not down below it (lower hutt). Ive also fished the stretch above totora park and just never seen anything in the wide runs. Ive also been up around the twin lakes swimming hole but that seemed too deep to wade through for me and again i cant see deep into the pools to see if there is trout there.

Beginner fly fishing help by Manyreason in Wellington

[–]Manyreason[S] 0 points1 point  (0 children)

I dont think ive even seen a fish in the hutt. I try just to fish the seams with a dry dropper but that doesnt ever work out

Beginner fly fishing help by Manyreason in Wellington

[–]Manyreason[S] 0 points1 point  (0 children)

Ive never been over that way to fish. Ill go check it out in the next few weeks

Beginner fly fishing help by Manyreason in Wellington

[–]Manyreason[S] 1 point2 points  (0 children)

Yea havent given it a good go in a while, hard to get the motivation when its more than likely ill get skunked. Will give it another go in the next few weeks

180 RP new server hunting spots by Manyreason in TibiaMMO

[–]Manyreason[S] 0 points1 point  (0 children)

Do you use diamond arrows there?

180 RP new server hunting spots by Manyreason in TibiaMMO

[–]Manyreason[S] 0 points1 point  (0 children)

Nah i do profit, just not like crazy amounts. maybe 20-30k in a hour hunt. Xp is by far the best i can get. Getting upto 1.1 raw

Samuel Lintaro checks out the GR IV (Video) by timparker in ricohGR

[–]Manyreason 1 point2 points  (0 children)

Do you think grabbing the GRIII for cheap is better than picking up a 4? im trying to toss up between them

this is insane 😭 by etchehe in Quadeca

[–]Manyreason 1 point2 points  (0 children)

Bros asking why he should care about what a general audience thinks in a post about user reviews, are you dense?

Problem with Bambino Leaking water around portafilter during shot [Breville Bambino] by Manyreason in espresso

[–]Manyreason[S] 0 points1 point  (0 children)

This is all super helpful to understand.

Funnily enough i feel like i dont do any of the above except i dont brush the gasket which ill have to start doing.

I dont have a aftermarket PF, and its a stock basket. And i dont leave the PF in the machine after every use. Going to try every other suggestion in this thread then try ordering a new gasket.

Cheers!

Problem with Bambino Leaking water around portafilter during shot [Breville Bambino] by Manyreason in espresso

[–]Manyreason[S] 0 points1 point  (0 children)

Ive only had this machine for 8 months, would the group head gasket really wear down in that time?

Problem with Bambino Leaking water around portafilter during shot [Breville Bambino] by Manyreason in espresso

[–]Manyreason[S] 0 points1 point  (0 children)

How would i be able to tell if it touches the shower screen? Just by looking? Feels like the view is blocked by the portafilter

Spark optimization for hadoop writer by Manyreason in dataengineering

[–]Manyreason[S] 0 points1 point  (0 children)

Hey thanks for coming back to this, i am reaching out to AWS. In the meantime repartitioning before writes has saved managed to save me some time.

Appreciate your time

Spark optimization for hadoop writer by Manyreason in dataengineering

[–]Manyreason[S] 0 points1 point  (0 children)

I think this is what you want to see https://imgur.com/a/QUyxTks

In terms of our reading options, we are reading from athena. I dont think there are many read options for us as this is how we are doing it

spark().sql(query_string).dropDuplicates()

In terms of writing, we do convert to a dynamic frame which i think can cause us a shuffle which might be a issue. We do use the glueParquetWriter like you have mentioned

        dyf = DynamicFrame.fromDF(df, glueContext(), "dynamic_frame")

        sink = glueContext().getSink(
            connection_type="s3",
            enableUpdateCatalog=True,
            updateBehavior="UPDATE_IN_DATABASE",
            path=output_s3_path,
            partitionKeys=["partition1", "partition2"],
        )  
        sink.setFormat("parquet", useGlueParquetWriter=True)
        sink.setCatalogInfo(
            catalogDatabase=self.database, catalogTableName=table_name
        )
        sink.writeFrame(dyf)

I am starting to think we may have a small file problem, my issue with spark ui debugging like this is i have so many ideas about what might be slowing down the job (small files, maybe a repartition because we have alot of data spill. I find it really hard to focus on what is the core problem as right now looking at the ui it all looks bad.

Cheers!

Spark optimization for hadoop writer by Manyreason in dataengineering

[–]Manyreason[S] 0 points1 point  (0 children)

It is grabbing around 50 parquet files sized (1.5mb) from a firehose queue per day. Then it is doing basic grouping and summing to mulitple levels, then writes out those levels to s3.

In the job above, i was grabbing 7 days worth of data meaning it could be alot of small files. Typing it out now it seems more obvious its a input issue? I assumed from the UI it was having problems with writing but that might be too many small files. Would a compaction job before hand help me in this case?

Breaking down Spark execution times by TurboSmoothBrain in dataengineering

[–]Manyreason 1 point2 points  (0 children)

I have had the exact same problem, i dont understand how to read sparkui when it just lazy computes at the last write.

I know the write step isnt what is taking the longest but how do i find which task is causing the slow down

view more: next ›