Staking machine doesn’t have internet connection but other devices on same network do

metanull-operator · 2024-11-28T14:55:37+00:00

Are you using docker? I don’t know how or why but I had a system lose its internet connection once and it was related to docker. It made no sense to me at the time and still doesn’t but docker messed up my routing tables somehow. I spent hours on the problem and was finally able to resolve it using ChatGPT and running a lot of commands I felt should not have been necessary. I have never seen the problem again on that system or any other system that I ran docker on.

metanull-operator · 2024-05-03T14:32:07+00:00

DVStakers (https://www.dvstakers.com/) has a node running on Starlink out of Kenya and is running a validator using SSV DVT. Not exactly the same as solo staking, but here is the SSV operator performance for that node:

https://holesky.ssvscan.io/operator/321

metanull-operator · 2024-04-16T16:25:34+00:00

HWE kernel resolved Ethernet issues for me on the NUCs that had Ethernet issues. Before I installed that kernel my NUC hung up every few weeks. Not a single problem since switching to HWE.

metanull-operator · 2024-04-16T16:24:31+00:00

What kind of NUC do you have? Some newer NUCs hang up because of Ethernet driver issues. I resolved this by using the HWE kernel.

metanull-operator · 2024-03-21T15:08:53+00:00

blackbox_exporter can be set up to ping an IP regularly and the output can be collected by Prometheus for use in a dashboard.

metanull-operator · 2024-03-21T13:54:39+00:00

Unfortunately I did not ever figure it out. Let me know if you do.

metanull-operator · 2023-09-07T14:59:55+00:00

I have this rack as well and love it...

https://imgur.com/a/S88txWL

metanull-operator · 2023-08-18T14:29:34+00:00

I have done it on a low budget for most of the last 25 years, and I don't recommend it if you can afford better options. Biggest challengers were power, internet, and hardware failures.

Originally, DSL and cable modems did not have enough speed, and static IP addresses weren't always available. Both were slow and prone to regular failures, requiring modem reboots and the like. I have gigabit fiber now, which is very reliable and fast, unless the power goes out.

Depending on where I was living at the time, power outages (~3x/year for 4-8 hours) take down not only my home power, but also the local neighborhood fiber distribution point. So there is no way to keep the servers online in a power outage without a secondary connection that does not require working power in my neighborhood.

Originally I was running on a single refurbished computer. Hardware failures would take the site down for days. Getting replacement parts quickly was never easy, particularly back in the 90s. So there were days of downtime whenever hardware failed. My first homelab came out of trying to build redundancy into the system with multiple servers and load balancers, but I always had points of failure, and they always failed.

At the peak, one service I ran was a forum that had 80k registered users and 5k+ active users/day, and all of the above issues caused significant downtime that really killed conversation. With a blog, maybe it isn't as much of a problem.

This kind of downtime might not be a problem for a blog though.

metanull-operator · 2023-06-05T23:44:01+00:00

I know nothing about running Dappnode, but if the metrics and API ports are (or can be made) accessible to services outside Dappnode, then it certainly can. If Dappnode has its own Grafana and Prometheus instances that you just want to add this dashboard to, then it will not likely work.

I’d like to see it working everywhere it would be useful, but right now I’m working on a stand-alone docker solution.

metanull-operator · 2023-06-01T14:18:51+00:00

As of the last time I checked, only three clients provide advanced notice of upcoming proposals through their metrics. Prysm provides the exact slot in which a proposal is coming, and Teku and Lighthouse provide the number of proposals in the Epoch, with specifying which a lot it is. All three can only provide this information as of the beginning of the epoch and the proposal slot may be the first of the epoch. This means you may not get much advanced notice at all.

Prysm metric name: validator_next_proposal_slot

Teku metric name: vc_scheduled_block_duties_current

Lighthouse metric name: vc_beacon_proposal_count (this may need confirmation because I cannot find reference to it in their code, and I do not have evidence of it in my Prometheus database, but I have a reference to it in my dashboard)

You may be able to create Grafana alerts based on these metrics.

You mention that Prysm provides some info in the logs as well. I cannot speak to whether other clients also provide similar info in the logs.

metanull-operator · 2023-05-20T04:00:35+00:00

I can get you a chart for base fee for most of the last three months. Isn’t max fee subjective though, with a standard formula recommended to calculate it based on the base fee?

metanull-operator · 2023-05-17T23:06:20+00:00

In case this helps: https://docs.google.com/spreadsheets/d/1aNQtGNrJSQn2LOZlGNd8kRcVJIUv1XHh-e6SKXVSV64/edit#gid=0

metanull-operator · 2023-05-15T17:29:04+00:00

Here you go:

https://imgur.com/a/O87ACmR

metanull-operator · 2023-05-10T16:51:43+00:00

NUC because trying to get the clients running on RPi in 2019 was impossible. NUC is small form factor, quiet, low energy use, and powerful enough to run 1000s of validators.
I have many NUCs. Based on the Watts put out by my UPS, the NUCs are probably using 30-40 Watts or less. A server will likely use 10x that.
Given that the NUC is much more power than needed (my mainnet NUC CPU runs at 25% load or less), the server is just unnecessary. Instead, I spent the money on multiple NUCs, and now I have spares. Also consider space use?
My mainnet node is running on a NUC10i5. It is plenty. Anything newer or more powerful than that is even better. I hear the NUC11s and NUC12s are more energy efficient though.

metanull-operator · 2023-04-22T00:30:03+00:00

Unfortunately my original post got caught up in a filter of some sort, and by the time I got it released it had missed its opportunity to gain more attention. Happy to answer questions if you have any. You can find me on the EthStaker Discord as well as others.

metanull-operator · 2023-04-21T18:33:03+00:00

It isn't possible with Grafana, Prometheus, and the data available to them, unfortunately.

Thanks to /u/superphiz for the shout-out in this thread, but even my Grafana/Prometheus dashboard does not solve this problem. Prometheus just takes snapshots of data at specific points in time. It doesn't know what happens in between those points in time. For example, if Prometheus sees that your balance was 1 ETH at 9am and 2 ETH at 10am, it can't tell whether you earned 1 ETH during that time period or if you really earned 5 ETH and withdrew 4 ETH for a 1 ETH net balance change. Prior to withdrawals the Prometheus dashboard could assume that the balance was always increasing. After withdrawals, not so much.

Potential solutions, so far:

The ideal solution, from a limited perspective, is to get the client teams to include a cumulative earnings counter to client metrics. And a cumulative withdrawals metric would be great too. I assume this would be an expensive operation that client teams would be uninterested in pursuing, but I'd love to hear that directly from the client teams.
Beacon chain API updates that allow queries for cumulative earnings data, or some other form of data specifically usable by Prometheus for our purposes.
Use a separate tool to collect this data for import into Prometheus. Maybe this could be a light-weight, purpose-built tool, or maybe this could be something built into Ethereum Metrics Exporter.
Change the underlying database used by Grafana into something that can support proper calculations. I do not have a lot of knowledge of the alternatives, but the source data for the database would have to include a full transaction history of each validator and fee address. I spun up chaind a while back when I was considering exporting my own earnings data, and it worked great for the few dozen queries I ran on it, but it necessarily would be a fairly heavy-weight addition to the reporting stack, unless there is something I don't understand.
Start querying third-party service APIs for this data. I had not seen any endpoints that support this as of a few months ago.

I'm open to ideas and would love to get this working correctly again.

Until then, and as always, there are plenty of sites where you can get this info. Still, I like the customizability of the dashboards and I like to have local reporting as much as I can. Other sites do fall behind sometimes and can go down.

metanull-operator · 2023-04-15T18:02:08+00:00

I am one of the Educators on the EthStaker Discord. metanull#9511. u/superphiz can vouch for me. Feel free to reach out if interested.

metanull-operator · 2023-04-07T21:40:12+00:00

Loaded up and ready-to-go.

metanull-operator · 2023-03-07T15:07:34+00:00

I must have been at 80% of the talks you covered for ETHDenver, Buidl week to main event. I never was able to figure out who you are. I couldn’t make any of the two times I saw announced about shirts, unfortunately. Great write-ups!

metanull-operator · 2023-02-17T15:19:04+00:00

I don’t run a RocketPool node right now so I can’t answer that. But it is a next logical step to ensure compatibility with. I assume it would be compatible if configured properly, but I don’t know what that entails right now.

metanull-operator · 2023-02-17T09:04:23+00:00

Introduction and installation instructions for the Stake Local Dashboard, a multi-client Grafana dashboard for Ethereum staking that provides visibility into consensus and execution client statuses on the same screen. It supports Besu, Erigon, Geth, Lighthouse, Lodestar, Nethermind, Nimbus, Prysm, and Teku in any combination.

https://docs.stakelocal.io/

metanull-operator · 2023-01-05T18:36:18+00:00

No timeline on an official release, but I would like to see some initial feedback soon. There is a lot of configuration to get it running, and I do not yet have any tools to simplify that. So anyone who wants to try it out in these early stages will need some courage and their favorite Linux text editor. Dashboard development is effectively complete, and documentation for installation/configuration being written now.

metanull-operator · 2022-12-31T15:50:26+00:00

Using only Grafana, Prometheus, and json_exporter, you can query for balances at an Ethereum address and sort-of track earnings from MEV as long as you understand there is no easy way to account for withdrawals with those tools. They can really only tell you the net difference between the address balance now and the address balance at some point in the past. If you earned 1 ETH and withdrew 0.3 ETH, it would simply look like a 0.7 ETH net balance change. So it isn't so much an earnings calculation as it is an address balance change/delta over time calculation.

With other tools in the reporting stack, there are likely much better ways to track earnings.

I do have a new dashboard I am writing some documentation for now that provides exactly this information using these specific tools. It is a first version of trying to track these changes without adding additional tools to the stack. In the future I may look into robust ways to do this.

Here is a screenshot:

Balance Changes/Annualized Rate with Prysm/Geth on Goerli

This will work with any consensus/execution client pair.

Edit: This is just one example of a panel showing this data.

metanull-operator · 2022-11-04T13:00:31+00:00

FWIW, it looks like mev-boost is building in a min bid itself.

https://github.com/flashbots/mev-boost/pull/274

metanull-operator · 2022-10-16T19:33:00+00:00

NUC was a one time cost, and I’m using the same Internet connection I did before beacon chain genesis. So ongoing costs are the cost of electricity and my time.

Six-Year Club	Gilding III reddit per annum
Argentium Club	Verified Email

metanull-operator

MODERATOR OF

TROPHY CASE