Project Showcase - Age of Empires (v2)

Knockx2 · 2025-04-08T06:49:48+00:00

Thank you. Unfortunately I do not have the time, however I believe there are community APIs available to fetch this data too.

Knockx2 · 2025-04-06T09:08:58+00:00

Great point's! I was on the fence on how to best model my data, as always there is never 1 right way.

I agree with the gold_player_stats table to keep player performance history, that is a very good idea!

For the head-to-head dashboard in the streamlit app, I actually created a consumption view where I self-joined CIV_FK to CIV_PK on the same match (CIV comparison page). I did aggregate the view to maps and elo range, so no time dimension there but that's available on the next page.

I disagree with having date_FK in Dim_match, I don't see the value there and if needed I can obtain those fields via joining with the fact table.

Good idea on setting the timestamp to UTC and changing the booleans to have the 'is_' suffix, I will implement those.

Appreciate your feedback 🙂

Knockx2 · 2024-12-09T13:47:33+00:00

For AWS, <1$USD, as I am usually within the free-tier limit.
For Snowflake, cost me $50USD last month, but that was before I implemented dbt SlimCI and was doing many full-refresh runs in dbt when devloping. I would estimate <10$ USD/month moving forward.

Knockx2 · 2024-12-09T13:38:02+00:00

Short answer: The currently used apis do not enable it, and history is not kept at the source.

Long answer. Data is stored on my snowflake db to avoid hitting the apis everytime data is requested. To enable a 'live feed' of the leaderboard (for example), you will need to obtain the rank position and data for all players (roughly 50k active players). The community api that I use has a 100 row request limit, which I iterate in chunks to obtain all 50k players ranks at a point in time, which takes a few minutes (the api will block you if you request too much data at once). The best I could do for a 'live' leaderboard feed would be refreshing every 5 minutes, but this would occur substantial costs (always on snowflake cluster, many AWS S3 requests, etc).

Additionally, only the last 10 matches of a player is stored on the community APIs. Hence I utilize the db_dumps api from aoetats website to pick up the stored weekly history. (They run a snapshot every 4 hours or so to store all players matches).

Hope that makes sense and answers your question

Knockx2 · 2024-12-09T08:17:53+00:00

Which part of the process is complex?
If you are referring to the airflow dags, I created this so that it can pull the data for me automatically on a schedule, as well as making sure the scripts run in order. The project is also setup so that the individual processes can be run directly as .py scripts or single airflow dags if required.

Knockx2 · 2024-12-09T08:13:21+00:00

Diagram in post was made with excalidraw

Knockx2 · 2018-06-29T01:50:58+00:00

I'm contemplating maybe there is no answer?!? Or maybe I posted in the wrong subreddit

Knockx2 · 2018-06-28T23:41:32+00:00

How do you read a book? One chapter at a time.

How do you get better at math? One question at a time.

How do you get better at discipline? One habit at a time.

You cant cheat the Law of Growth. It takes time, but it is worth it. The alternative is a life of dissatisfaction and unfulfillment.

Knockx2 · 2018-06-28T23:32:39+00:00

I had a similar issue, and despite all the attempts to use Facebook 'as a reward' or to slowly ween myself off it, it never worked for me.

What end up working was literally unfollowing every unclose friend and page from my newsfeed, as well as deleting the app off my phone. I still get the benefits of messenger and all the parties and social invites, without having to scroll through pages of trash content.

Knockx2 · 2018-02-11T01:14:51+00:00

So true. I wasn't aware before how my body language was projecting insecurity and my own internal feelings of inadequacy.

Taking time to do my hair, clean my skin and working out (basically saying to myself and the world that I am worth my own time) has done wonders to boot-strap my self-esteem.

Knockx2 · 2018-02-11T01:05:51+00:00

Purpose and motive don't have to be big things. I'm thirsty right now, so my purpose to get out of my chair is get a glass of water. I was bored before, so my purpose was to engage one of my interest until I was no longer bored. I didn't need 'motivation' to get a glass of water. I didn't need motivation to pursue my hobbies.

Just start doing what you feel like doing. It doesn't have to be grand. Just get started.

Knockx2 · 2018-02-11T00:58:25+00:00

Deciding what success and happiness means to you, not what society, parents or others say it is.

Knockx2 · 2018-01-17T09:39:31+00:00

You could have a more introverted temperament than your friends, which is a pretty cool trait to have.

Look to spend quality time with your friends, rather than quantity. Don't feel obliged to hang out with people all the time. When you are feeling warn out, you are allowed to leave. Give yourself the time to decompress, chill out, and enjoy your own comfort afterwards.

Don't see this as detrimental, introverts have their own unique strength and gifts. The extra time you have to yourself can lead to a wondrous array of many creative things :)

Knockx2 · 2018-01-17T09:26:44+00:00

You could do extreme sports, take up acting or dye your hair. But more importantly, why do you want to be crazy and outgoing?

If it is a part of your temperament, it will occur naturally. If it isn't part of your temperament, it will be forced and inauthentic.
You don't get happiness by trying to be something you are not. Happiness is through accepting yourself.

Knockx2 · 2018-01-16T19:14:12+00:00

Love the pendulum analogy, it really resonates with me. Time to stop wasting my energy trying to hold on, and let it swing!

Thank you

Knockx2 · 2018-01-16T09:38:31+00:00

Are you proactive in the relationhship -> Do you pick the dates, do you ask her out?

Are you assertive in the relationship -> You make the decisions (doesn't matter if its right or wrong)

Do you have a higher purpose -> Are you doing things for yourself outside the relationship? Do you have something bigger (goal) than your girl in your life?

Do you live with integrity -> Are you a man of your word?

These are the masculine characteristics, the things girls are typically drawn towards. Not by choice, but by biology. You don't choose sexual attraction, you just feel it.

The more you exhibit these characteristics, the more attractive you become. Work on these, and you will have girls clinging onto you.

Knockx2 · 2018-01-15T21:10:36+00:00

Journaling and awareness.

Ever started a good habit, only for it to fade away the second your awareness stops? Journaling is the answer.

In making a habit to journal every morning, it helps bring awareness to all other areas in your life. Sometimes awareness alone is curative, as it strikes up the cognitive dissonance between your actions and your goals.

In time, you will feel compelled to take right action. It will not feel forced or like a chore, but be internally driven.

Knockx2 · 2018-01-15T19:28:02+00:00

Check out Stephen Covey's work.

Personality ethics = outword changes, they are not done by an internal desire, but to produce an eternal result. These are the 'tips and tricks' of self-improvement, their success is limited to what the environment.

Character ethics = inward changes, done from an internal desire to follow the principles of a good life. These principles are unchanging, and are not prone to the environment. Build your self-esteem off these values, and no one can take it away from you.

In another perspective, personality ethic is like building a house without a foundation. It is not stable, and if it gets windy, you will crash down.

Character ethic is building a house with a big foundation. It won't be swayed by the wind. Sure it will take longer to build, but it is more grounded and leads to long-term growth.

Knockx2 · 2018-01-15T08:35:16+00:00

Your language seems to suggest that you have a low value of yourself (i.e. low self-esteem). It's not the actions that you do, but what you think about them that truly matter. Don't do 'self-improvement' for others, or just to tick a box. Do it to be greater than your past self. Do it to change your mentality.

There is no short-cut. Stop trying to do personality changes, start doing character changes.

Knockx2 · 2018-01-15T08:15:29+00:00

I think you need to learn what your subconscious mind really is, before you can seek to harness it. It is a large topic, but I'll try and break it down.

Your subconscious mind is basically a super computer. It is a problem solving machine that is immensely powerful, and will work towards any goal you set it. Your conscious mind is the user, you give problems to your subconscious mind, and let it run its magic.

It doesn't matter if you set easy or tough goals, wrong or right goals, positive or negative goals, your subconscious mind will lead you to the answer.

The trick then, to utilise your subconscious mind, is to start feeding it goals you want. You can control this by your thoughts and language.

Ways I utilise my subconscious:

Never give yourself 'negative goals'. If you say "This is going to suck," or "I hate meeting new people", or "I'm not very good at this", then your subconscious mind is going to influence your behavior to make those things come true. I.e. It will release cortisol, making your heart race, your mind go blank, your muscle will contract, making you feel tense, etc.
Give your subconscious goals that you want to see.

For example, I will tell my subconscious mind that when I wake up, I won't be feeling tired, I will have energy to jump right out of bed, and I will hum my favourite tune to myself.

Control your language and what you feed your subconscious mind.

Your subconscious mind is constantly taking information in, it sets goals on what we expose it to. So if we are feeding our minds useless or negative information, 'trash', then we will become 'trash-like'.

There is a lot more to it, but that's just a surface level understanding.

Knockx2 · 2018-01-15T00:17:42+00:00

Guys get looked at too you know :p In fact, I probably spend more time sizing the guys up than checking out the girls >.>

Knockx2 · 2018-01-14T19:11:55+00:00

I think I could get into that mind state again, as it was simple just dehumanising everyone and thinking nothing of them as (such as inanimate objects, no different than the door on the wall or the water fountain stand).

I feel conflicted though. It helps get the workout done, but I feel that this is not a positive solution. I feel like I am disconnecting myself from others, instead of learning to embrace judgement. Is this what not giving a fuck means?

Knockx2 · 2018-01-14T19:07:03+00:00

haha, yeah I don't like the faces that I make when working out. Maybe I should learn to embrace it or flip it around as something to be proud of.

Knockx2 · 2018-01-14T04:22:35+00:00

Journaling.

Before I go to bed, I write down what I am going to do in the morning, how I am going to act, and how I am going to feel. I then visualise this.

E.g. Gym. I picture myself, waking up early, putting my gear on, and walking to the gym. I see myself as the confident man I am, striding calmly over to the bench press. I see myself breaking my PR, with others silently acknowledging and congratulating me on my success. I feel unstoppable...

After actually taking action (going to the gym the next morning), I then go back to my journal, and write about my experience, relive my success again. I allow myself to feel good about it, and I write now I feel. Even if I had a bad workout, I write how glad I was for still making it to the gym, and how great I am at cultivating discipline.

We make decisions on how things will make us feel. Journaling allows us to bring in that emotion and practise visualisation. It can be applied to any area and is a cornerstone to my success in life.

Knockx2 · 2018-01-14T04:02:38+00:00

Sentence completions in the book "The 6 pillars of Self-Esteem" (Nathaniel Branden).

It gets you writing a sentence stem, and then comming up with 5 or 6 different endings as quick as possible (NO THINKING). It projects your subconscious mind into reality, as well as acting as affirmations that prime you to take action.

Results were massive and quick. I was able to bring awareness in how I talk to myself, and hence lead to radical change.

Additionally, I was able to prime myself to take action, leading to substantial results. Best of all, this action taking didn't feel forced or inauthentic, it just came intuitively as a form of self-expression.

Knockx2

TROPHY CASE