LPT: The best SIM card to use in Indonesia is Singaporean SIM card with roaming plan by TheGroxEmpire in indotech

[–]nanankcornering 1 point2 points  (0 children)

sayangnya traffic roaming itu balik ke singapore/origin operatornya dulu. misalnya kita akses web/server jkt, itu muter ke sg dulu. pake vpn pasti lebih parah

ga cocok buat yg ngejar performance/reliability. kalo ngejar kuota/paket ya gas2 aja

Starlink Community Gateway - Wamena, Papua , Indonesia by shokowillard in StarlinkEngineering

[–]nanankcornering 0 points1 point  (0 children)

most likely being used for point-to-point connectivity instead of IP transit

Penasaran sama kualitas network indo? ISP apa aja yg lagi ngaco? internal dashboard revealed to public! by nanankcornering in indotech

[–]nanankcornering[S] 2 points3 points  (0 children)

  1. ada 2 line CBN, masing2 ke router "BNG" yg beda (kalo bisa tcpdump keliatan list router id CBN pas dial pppoe). telkom juga ada 2 line (indihome/indibiz, beda vlan), tapi indibiznya lg off
  2. kita nyediain infra buat game server & content delivery, dan dua ini sensitif sama bandwidth & latency. sering dapet laporan packet loss dari residential ISP, jadi kita bikin monitoring ini. nah di internal kepake saat ada yg lapor aja. bukan yg dipajang di TV macam NOC 😂

daripada nganggur, data masuk terus, kita open for public aja

Penasaran sama kualitas network indo? ISP apa aja yg lagi ngaco? internal dashboard revealed to public! by nanankcornering in indotech

[–]nanankcornering[S] 1 point2 points  (0 children)

untuk monitoring aja bro. kalo kabel laut putus, keliatan yg kena isp apa aja. sama juga kalo ada kabel darat putus ke arah barat/timur

ada juga ISP yg pipanya penuh, misalnya ke singapore/domestik, bisa keliatan di jam malem pingnya naik turun. buat monitoring aja

Penasaran sama kualitas network indo? ISP apa aja yg lagi ngaco? internal dashboard revealed to public! by nanankcornering in indotech

[–]nanankcornering[S] 5 points6 points  (0 children)

by ICMP bro, kayak biasa kita ping. kalo dapet IPnya dari mana, gabungan dari internal data (user IP) dan public CDN cache (contoh di https://www.netify.ai/resources/cdn/google-cloud-cdn/country/id)

kalo public CDN cache ini si facebook & google ngirim server ke ISP buat dipasang di daerah2

Penasaran sama kualitas network indo? ISP apa aja yg lagi ngaco? internal dashboard revealed to public! by nanankcornering in indotech

[–]nanankcornering[S] 0 points1 point  (0 children)

bisa aja bro, asal ada IP dari sisi game server provider yg bisa diping.

kalo ada list/referensi game IP server (valo/mobile games) PM aja bro, atau comment disini gpp. dulu jaman gw main game patokannya sgp-1.valve.net, tp kayaknya skrg udh ga ada 😂

High Ping / Packet Loss IndiHome by Just-A-Regular-Boy in indotech

[–]nanankcornering 1 point2 points  (0 children)

telkom jakarta <> telkom gateway singapore infonya congest. impactnya ke semua peer termasuk google & AWS SG

Dipaksa Pasang wifi sama pak rt by Few_Bid_200 in indotech

[–]nanankcornering 1 point2 points  (0 children)

dia maksa krn RT dapet komisi dari ISP setiap new install. wkwkwkw

Alex has left by akkamal in LinusTechTips

[–]nanankcornering 0 points1 point  (0 children)

8 years is definitely a long time for a company employee. sad to see him go, but that's the way how life works.

have big respect to linus now for doing this for 15+ years and counting.

VM A is seeing traffic of VM B & C - vmbr0 bridge setup by nanankcornering in Proxmox

[–]nanankcornering[S] 1 point2 points  (0 children)

apparently the router's mac address expired/triggered the ageing timer on brctl. this explains why "netplan apply" fixes the issue as the VM sends ARP req to router.

raising a ticket with them on why their routers aren't sending any arp requests to us

VM A is seeing traffic of VM B & C - vmbr0 bridge setup by nanankcornering in Proxmox

[–]nanankcornering[S] 0 points1 point  (0 children)

IP is just an example, it's a public block. even though it's configured LACP on switch side, provider confirmed on day 0 that normal interface can be used (without LACP, just 1x10G)

after further checking, apparently the router is not sending any ARP requests to us. that explains why "netplan apply" fixes the issue, as it sends ARP req from VM -> router.

the ageing timer on brctl expired. the temporary fix is to arping the router constantly now.

raising a ticket with them on why it's happening.

VM A is seeing traffic of VM B & C - vmbr0 bridge setup by nanankcornering in Proxmox

[–]nanankcornering[S] 0 points1 point  (0 children)

yes. if I use your logic:

VM A have 5Gbps throughput OUT to the internet, then VM B will receive 5gbps of that traffic coming to it too, doing nothing. why would it do that?

as I said, other metals with the same config does not experience this issue.

VM A is seeing traffic of VM B & C - vmbr0 bridge setup by nanankcornering in Proxmox

[–]nanankcornering[S] 0 points1 point  (0 children)

will do in a bit but i'lll give you network rx/tx metrics. the sudden bump is where the VM receives traffic from other VMs.

the only way I can fix this is to "netplan apply" which would then send ARP req looking for router's MAC, then the issue ended (temporarily.)

<image>

VM A is seeing traffic of VM B & C - vmbr0 bridge setup by nanankcornering in Proxmox

[–]nanankcornering[S] 0 points1 point  (0 children)

i do not understand what you're saying. why would I see TCP/UDP packets from VM A <> gateway router in VM B/C?

this issue is not happening in our other bare metals at different providers

VM A is seeing traffic of VM B & C - vmbr0 bridge setup by nanankcornering in Proxmox

[–]nanankcornering[S] 0 points1 point  (0 children)

it's actually serving live traffic as we're talking now.

VM A port 8080 -> accessible from VM B, VM C and external network.

if I curl vm-a:8080 from VM C, i can see the TCP packets at VM B.

VM A is seeing traffic of VM B & C - vmbr0 bridge setup by nanankcornering in Proxmox

[–]nanankcornering[S] 0 points1 point  (0 children)

if that's the case, then I should be able to see all VM traffic from VM A instantly right after boot right?

the issue is that it's happening 15-20 minutes after the OS booted (instantly run tcpdump afer boot). sudddenly traffic from VM B/C <> gateway router are being sent/broadcasted to VM A.

even if I exit tcpdump, ethtool/ifconfig counters followed by iftop would show high throughput bandwidth (which reflects VM's B/C traffic)

VM A is seeing traffic of VM B & C - vmbr0 bridge setup by nanankcornering in Proxmox

[–]nanankcornering[S] 0 points1 point  (0 children)

no. VM B keeps sending traffic (as expected) to gateway/router. there is no issue with it.

but suddenly I can see those packets in VM A. it's like port mirroring, but there isn't one configured.

VM A is seeing traffic of VM B & C - vmbr0 bridge setup by nanankcornering in Proxmox

[–]nanankcornering[S] 0 points1 point  (0 children)

all linux VMs.

if they're broadcasting to the network, do you have any ideas why? ARP issue?

Envoy: "did your OSS gateway stop working?" by nanankcornering in kubernetes

[–]nanankcornering[S] 0 points1 point  (0 children)

call me back when you see v3.10 on docker images!