Local dev environments

[dzmitry-lahoda]

[aldoborrero]

Hi, @dzmitry-lahoda do you want to have a dev environment? Can you elaborate more on your request?

[dzmitry-lahoda]

{ self, lib, ... }: {
  perSystem = { config, self', inputs', pkgs, system, ... }: {
    devenv.shells.default = with self.inputs.ethereum-nix.packages.${system};
      {
        process.implementation = "process-compose";
        enterShell = ''
          (
            cd eth-pos-devnet
            git clean --force -d -x && git reset --hard HEAD
          )
        '';
        packages = [ geth prysm ];
        processes.ethexecgen.exec = "geth --datadir=./eth-pos-devnet/execution init ./eth-pos-devnet/execution/genesis.json; sleep 5";
        processes.ethexec = {
          exec = (pkgs.writeShellScript "complex-process" ''
            sleep 5
            geth --http --http.api=eth --http.addr=0.0.0.0 --authrpc.vhosts=* --authrpc.addr=0.0.0.0 --authrpc.jwtsecret=./eth-pos-devnet/jwtsecret --datadir=./eth-pos-devnet/execution/ --allow-insecure-unlock --unlock=0x123463a4b065722e99115d6c222f267d9cabb524 --password=./eth-pos-devnet/execution/geth_password.txt --nodiscover --syncmode=full
          '').outPath;

          process-compose = {
            depends_on.ethexecgen.condition = "process_completed_successfully";
          };
        };

        processes.ethconsensusgen = {
          exec = (pkgs.writeShellScript "complex-process" ''
            prysmctl \
            testnet \
            generate-genesis \
            --fork=bellatrix \
            --num-validators=64 \
            --output-ssz=./eth-pos-devnet/consensus/genesis.ssz \
            --chain-config-file=./eth-pos-devnet/consensus/config.yml \
            --geth-genesis-json-in=./eth-pos-devnet/execution/genesis.json \
            --geth-genesis-json-out=./eth-pos-devnet/execution/consensus-genesis.json
          '').outPath;
        };

        processes.ethconsensus = {
          exec = (pkgs.writeShellScript "complex-process" ''
            beacon-chain \
            --datadir=./eth-pos-devnet/consensus/beacondata \
            --min-sync-peers=0 \
            --genesis-state=./eth-pos-devnet/consensus/genesis.ssz \
            --interop-eth1data-votes \
            --bootstrap-node= \
            --chain-config-file=./eth-pos-devnet/consensus/config.yml \
            --chain-id=32382 \
            --rpc-host=0.0.0.0 \
            --grpc-gateway-host=0.0.0.0 \
            --execution-endpoint=http://localhost:8551 \
            --accept-terms-of-use \
            --jwt-secret=./eth-pos-devnet/jwtsecret \
            --suggested-fee-recipient=0x123463a4b065722e99115d6c222f267d9cabb524
          '').outPath;
          process-compose = {
            depends_on.ethconsensusgen.condition = "process_completed_successfully";
            depends_on.ethexec.condition = "service_started";
          };
        };

        processes.ethvalidator = {
          exec = (pkgs.writeShellScript "complex-process" ''
          mkdir --parents ./eth-pos-devnet/consensus/validatordata
          ls
           #--datadir=./eth-pos-devnet/consensus/validatordata \
           
          validator \
            --force-clear-db \
            --accept-terms-of-use \
            --interop-num-validators=64 \
            --interop-start-index=0 \
            --chain-config-file=./eth-pos-devnet/consensus/config.yml
          '').outPath;
          process-compose = {
            depends_on.ethconsensus.condition = "service_started";
          };
        };
      };
  };
}

[dzmitry-lahoda]

something like this ported to nix, not compose built some hoops around of non nix ways to build.

[aldoborrero]

I have built a proof of concept for having a local dev environment on this ethereum-pos-dev-kit repository with nix and flake-parts support for Manifold Finance (feel free to fork it).

In terms of adding more generic support here, I would advocate integrating more sedge with nix and flake-parts (although sedge is more suited towards generating docker-compose files, it can be tweaked to add support for process-compose as well).

But, in general, I would prefer to move this first into a discussion rather than an issue, so we can continue discussions until a formal implementation can be agreed upon.

[dzmitry-lahoda]

@aldoborrero so it works for you. that process compose config it kit repo?

[aldoborrero]

I think there's a misconfiguration on the PoS beacon config, but mostly should work, yeah.

[dzmitry-lahoda]

sedge imho controversial. it does not support native. only docker. why than sedge?

[aldoborrero]

We can propose adding support to process-compose to sedge and see if their team is up to accepting such PR.

[aldoborrero]

I think we can go directly to use process-compose rather than sedge for now. If more complex use-cases are necessary we can aim to use the tool.

[aldoborrero]

I've started an initial implementation on a branch named feat/devnet. It's incomplete and it doesn't work, for now, I'm just shaking the general API.

The main idea is to support different devnets, that are named by the tool or team that implemented it (like the anvil devnet or the offchainlabs one).

[dzmitry-lahoda]

Hello, i am running IBC, i have Dotsama and Cosmos chains, not adding Ethereum. Need some example to run producing nodes of Ethereum. Will work on that.

@aldoborrero how is you branch?