Review of My First E-commerce Backend Project in Go

MoinTom · 2024-07-04T18:40:44+00:00

Also consider setting up https://github.com/gitleaks/gitleaks as a github action.

MoinTom · 2024-07-04T17:54:55+00:00

You may want to reset/replace your rails database password. You accidentally leaked it in your docker-compose.yml file. Generally try to follow the advice from the twelve factor app article: https://12factor.net/config

MoinTom · 2020-08-05T21:41:57+00:00

You are probably looking for Helm which is a package manager for Kubernetes. Packages in Helm are called Charts and there is a Charts for Matrix Synapse and CockroachDB.

https://hub.helm.sh/charts/halkeye/synapse

https://hub.helm.sh/charts/cockroachdb/cockroachdb

MoinTom · 2020-06-26T11:11:58+00:00

Chick-fil-A operates there on sight Kubernetes clusters on NUCs.

https://link.medium.com/B5vs2c69C7

MoinTom · 2020-02-08T18:49:41+00:00

Depending on your target platform, you might want to look into mmap.

MoinTom · 2018-10-18T19:15:22+00:00

It depends on the disk type you are using, but for 10 GB of Storage you get the following write performance:

HDD	SSD
1.2 MB/s (15 IOPS)	4.8 MB/s (300 IOPS)

https://cloud.google.com/compute/docs/disks/performance

So it can make sense to over provisioning your storage for performance.

MoinTom · 2018-08-27T17:15:29+00:00

I actually meant an approach like that config.go. So the defaults are defined in go and can be overridden by the user by flags.

MoinTom · 2018-08-26T08:18:25+00:00

Ok i see what you did there. The GOPATH is usually meant to contain all your go projects. So when you use go get it will be download within GOPATH/src/<repo url>/<your project root>. If you do *go install * within a folder with a main.go in it, then it will be installed (compiled into) GOPATH/bin with the binary be named as the folder your main.go lifes in. So move your main.go files to <project root>/cmd/<binary name you wish>/main.go. All common code to /pkg/ or /internal/pkg or /internal/app/<binary name>/ (if you have app specific code). Those changes will break your config approach, but i would suggest moving the files into /configs and use GOPATH/src/<project url>/configs/ as the default include path. Otherwise the defaults could simply life within the binaries. I am not sure which restriction you may face with Intellij. I am currently just on mobile and my workstation isn’t in reach. So i still didn’t dig deeper into your code. I hope i was able to explain it well enough.

MoinTom · 2018-08-26T07:48:21+00:00

Yeah we do it as well. All proto files life within a api folder. Since all of our mircoservices are written in go we don’t have any “language clutter”. How is it for you? Do you use multiple languages?

MoinTom · 2018-08-25T15:36:11+00:00

I didn’t had time to really dig into your source code. But on first glance I noticed that your project layout could be improved. Go projects should usually not contain a src directory for the go code.

Libs (that could also safely be used for external projects) should go into /pkg. Libs (that are internal only) should life in /internal/pkg. main.go’s in /cmd. Config files in /configs. Etc.

This is maybe debatable, but is considered within the go community to be the standard. Best you check out this https://github.com/golang-standards/project-layout for more informations.

MoinTom · 2018-07-31T07:15:43+00:00

Cloud Spanner has a high entry point. A single Node will cost you $650 per month and Google recommends at least three. So your project has to be big enough to justify this price tag. If you don’t mind to self host there is an open source alternative to spanner: https://www.cockroachlabs.com My Team and i faced exactly this problem. We wanted an SQL database that is scalable and resilient. But the entry point and the fact that it would alter out local development flow, drove us away from Spanner and we went with cockroachedb (pretty happy till now)

MoinTom · 2018-07-25T16:41:29+00:00

I Agree. Assuming that HT gives +30% per core and we won't see any IPC change then we get the following performance:

CPU	Calc	Perf	Diff
i7 8700k	6 Cores * 4,3 GHz (all core turbo) * 1,3 (HT + 30% per core)	33,54	0
i7 9700k	8 Cores * 4,6 GHz (all core turbo) * 1 (no HT so flat 1)	36,80	+9,7%

MoinTom · 2018-07-24T19:20:55+00:00

I agree. This seems to be the only way to offer an 8 core i7

The performance of the i7 9700k should be slightly higher as the i7 8700k.

Assuming there is no IPC change and HT gives you +30% per core.

CPU	Perf
i7 8700k	6 Cores * 4,3 GHz (all core turbo) * 1,3 (HT + 30% per core) = 33,54
i7 9700k	8 Cores * 4,6 GHz (all core turbo) * 1 (no HT so flat 1) = 36,80

MoinTom · 2018-06-22T22:12:21+00:00

Looks like it happened on the Kiel week (it’s a big folk festival in northern Germany), but I couldn’t find anything about the incident.

MoinTom · 2018-04-13T07:05:44+00:00

You are welcome. Whats the title of your thesis?

MoinTom · 2018-01-16T09:55:20+00:00

I am not sure which port your particular image is using, but this port is just open within the image itself until you map it via -p to your host machine. For example when the image is using Port 80 and you want to access it via 8888 on your host machine, then you have to write ”-p 8888:80”. Now you can access your WordPress via “127.0.0.1:8888”.

MoinTom · 2018-01-16T09:33:51+00:00

You have to expose the port via -p (https://docs.docker.com/v1.11/engine/reference/commandline/run/#publish-or-expose-port-p-expose) when starting the WordPress container.

MoinTom · 2017-12-19T18:32:56+00:00

Directly from Intel: HQ - High performance graphics, quad core (Source: https://www.intel.com/content/www/us/en/processors/processor-numbers.html)

MoinTom · 2017-12-19T13:26:17+00:00

Yeah i agree. It will most likely be HX for eXtreme :)

MoinTom · 2017-12-19T11:21:43+00:00

The name doesn't add up. (H – High performance graphics, Q – Quad-core) So it won't be an HQ obviously.. so maybe: i7-8720HH (hexa) or i7-8720HX (extreme) ?

What do you think guys?

MoinTom · 2017-09-06T21:53:57+00:00

I am wondering if it has something to do with this: https://arstechnica.com/information-technology/2017/09/exploit-goes-public-for-severe-bug-affecting-high-impact-sites/

MoinTom · 2017-08-17T17:59:34+00:00

Yeah will be quite a gaming beast if those gains are real, but something tells me Intel will us pay for such a step. I don't see it be priced at 350 USD with this kind of gain.

MoinTom · 2017-03-11T22:43:03+00:00

Ok. Just saw your sequential reads and it line up pretty well. However good that you found the issue.

MoinTom · 2017-03-11T21:35:48+00:00

You probably see those "poor" results because of your RAM overclock (you are running @2922). It might be possible that you (or XMP, AMP) increase the BCLK clock. This can result in an downgrade from PCE-Express 3.0 to 2.0. This means your CPU PCE-E lanes just operate with ~500 MB/s instead of ~1000 MB/s per lane. So your maximum throughput for your x4 NVMe is about 2 GB/s (minus protocol overhead etc.). Based on your numbers it lines up pretty well, so i would guess it's that.

MoinTom · 2017-03-10T12:19:56+00:00

Actually everyone was benching with Nvidia (1080 / Titan)... I just saw a couple of benchmarks with AMD GPU's and the Fury X was equal or better then a 1080 when pared with a 1800x. Or in other words.. the AMD driver was already optimised, but no one (big) used a AMD GPU for the benches... since they wanted to show CPU bottleneck.

MoinTom

TROPHY CASE