Docker Utilities for Node Execution (DUNE)
Docker Utilities for Node Execution (DUNE) is a tool to abstract over Leap programs, CDT, and other services/tools to perform the functions of node management, compiling smart contracts, running tests, and several other common tasks required to develop smart contracts on Antelope blockchains.
Getting started
First we must install Docker.
Once you select the Docker Desktop for your operating system the installation process is very straight forward.
Linux
They have both .DEB and .RPM packages available. If you can't get these to work for some reason most repos have packages available for the engine and auxillary components.
When finished installing.
Start your Docker Desktop, visit to its settings and add the root directory of the host system to shared directories.
Check the installation with the command
$ docker --help
This should display the list of commands and features. If it fails with unknown command the installation did not work correctly.
Python 3
Depending on the distro you are using will determine which python3
package to install.
Distro | Package Name |
---|---|
Ubuntu | python3 |
RHEL | rh-python36 * (need to use scl enable rh-python36 bash ) |
Centos | python3 |
Arch | python |
Add DUNE to PATH
To keep from having to install files to the user's system, the preferred method of usage is to add this directory to your PATH
.
$ echo "PATH=<LocationOfDUNE>:$PATH" >> .bashrc
Bootstrap DUNE
Pick your preferred terminal application and input the following command:
<PathToDUNE>/DUNE$ ./bootstrap.sh
Windows 10 & 11
You might need to turn on hardware virtualization in the BIOS of your computer. Docker should give an error stating this failure. Because of the variance of motherboards and BIOS implementations we can't give a clear description as to how to turn this on, but a quick google search with your PC make and model should find the information you would need.
You can then start the program Docker Desktop
.
You should see the following:
Python 3
To install Python 3 on Windows is pretty straightforward.
Visit the download page for Python 3. You should see the link for Python 3.10.4:
Add DUNE to Path
To keep from having to install files to the user's system, the preferred method of usage is to add this directory to your Path
.
Go to Start Search and type edit the system
and choose Edit the system environment variables
.
From here you should click on the button marked Environment Variables
.
From here select the line with Path
and select Edit...
From here add a new line with the location of the downloaded DUNE project:
Bootstrap DUNE
Pick your preferred command line application and input the following command:
C:\<PathToDUNE>\DUNE$ .\bootstrap.bat
Mac OS
When finished installing. Check the installation with the command.
$ docker --help
Python 3
Python 3 should already be installed.
Add DUNE to PATH
To keep from having to install files to the user's system, the preferred method of usage is to add this directory to your PATH
.
$ echo "PATH=<LocationOfDUNE>:$PATH" >> .bashrc
Bootstrap DUNE
Pick your preferred terminal application and input the following command:
<PathToDUNE>/DUNE$ ./bootstrap.sh
DUNE commands
-h or --help This will display the available commands and a small description of each and argument values.
--start
This will start a new node for deploying smart contracts and send actions against.
This command takes a name of your choosing and an optional config.ini
(look at scripts/config.ini for reference).
--stop This will stop a node that is running. This command takes a name of a node that was previously started.
--remove This will remove a node from the system. This command takes a name of a node that was previously started.
--list This will print the status of all nodes currently in the system. It will display if the node is active, running, and the ports for http/p2p/SHiP.
--simple-list
Does the same thing as --list
but does not use unicode and other formatting for use with scripts or plugins.
--set-active This will set a node as the current active node. This command takes a name of a node that was previously started.
--get-active This will return the name of the currently active node.
--export-node This will create a snapshot and tar ball the state snapshot, blocklog and index and export to desired location. This command takes a name of a node that was previously started, and a directory to save the exported node contents.
--import-node This will import a previously exported node.tgz. This command takes the path of the export and the name of what you want to name the imported node.
--monitor This will return information from the currently active node.
--import-dev-key This will import a private key into the pre-created developer wallet. This command takes a private key.
--create-key This will produce a public key and private key pair for development uses.
--export-wallet This will export the system wallet to your current directory.
--import-wallet This will import an exported wallet from a given location. This command takes a path that points to the exported wallet.
--create-account This will create a new on-chain account. This command takes a compatible name for the new Antelope account and an optional creator (also a valid Antelope account name).
--create-cmake-app This will produce a new smart contract project that utilizes CMake as its build system. This command takes a project name and a directory.
--create-bare-app
This will produce a new smart contract project that is bare, i.e. uses only cdt-cpp
tools. This command takes a project name and a directory.
--cmake-build This will build a given CMake app project. This command takes a directory to the project and optional CMake flags.
--destroy-container This will destroy and remove the currently running container. WARNING! This will delete all data that is running. This is useful if you need to update to a new version of DUNE or if you corrupt the container some how.
--stop-container This will stop the currently running container.
--start-container
This will start the dune
container.
--set-core-contract This will deploy the core contract to an account. This command takes a valid Antelope account name.
--set-bios-contract This will deploy the bios contract to an account. This command takes a valid Antelope account name.
--set-token-contract This will deploy the token contract to an account. This command takes a valid Antelope account name.
--bootstrap-system
This will install the boot contract to the eosio
account and activate all protocol features.
--bootstrap-system-full
This will install the boot contract to the eosio
account and activate all protocol features.
It will also create all the accounts needed by the core, token, and multisig contracts from reference-contracts and deploy those three contracts to their corresponding accounts. Note that the core contract will replace the boot contract on the eosio
account.
--send-acton This will send an action to an account. This command takes a valid Antelope account name, a valid Antelope action name, the data payload needed and the permission.
--get-table This will get table data from the specified table. This command takes a valid Antelope account name, table scope, and table name.
--activate-feature This will activate a protocol feature. This command takes a code name for the protocol feature.
--list-features This will list the available protocol feature code names.
-- (Not listed with help) This will allow you to call the tool and pass through to the underlying system.
Concepts and operations
The core concept of this utility is to abstract over Leap programs such as nodeos
and cleos
, CDT, etc.
As such some of the commands might seem restrictive. Please take note that if you find any of the commands to be too
restrictive then you can use the command --
followed by whatever normal cleos
, nodeos
, CDT and OS commands that you need.
When you run any command with DUNE, if a container has not been created yet it will automatically create one for you.
The command of start-container
shouldn't necessarily be needed during normal operation.
A developer wallet is automatically created for you and is always unlocked
and none of the commands will ever ask you to unlock the wallet.
If you need to run any cleos
wallet commands or keosd
commands via --
and the wallet is locked,
then simply run one of the wallet commands from DUNE first and it will unlock the wallet.
If you deploy a smart contract to an account it will automatically add the code
permission to that account for you.
The drive/directory that your workspace is in is mapped into the container and prefixed with /host
.
So on Windows this would be /host/Users/<name>/<some path>
.
On Linux and Mac this would be something like /host/home/<name>/<some path>
.
Node management
For all of the deployment commands and most of the commands in general you have to have at least one node up and running.
Let's create a new node.
$ dune --start test_node
This will create a new Leap node and start it running.
If you have custom ports or options you need for the node, a config.ini file can be provided.
$ dune --start test_node <path-to-config>/config.ini
Now let's say that we are done with that node for a while, then we can stop any node we want.
$ dune --stop test_node
From here we can also remove any node via --remove <node name>
.
The command --list
will provide a listing of nodes in the current container.
$ dune --list
This gives us information about the nodes, their particular ports, if the node is running and a new concept of is the node active
.
The way DUNE operates is state based, so you set the active node to which node you want and fire away at the commands and any that are directed towards the nodes or are listening to nodes will set their URL information correctly and immediately. This state persists after shutting down the software.
When you create a new node, as long as it is successful, it will automatically switch to that node as the active node.
You can manually set the active node with the command --set-active <node name>
.
Multiple nodes
When creating multiple nodes you have the option to stop the currently running node if the ports clash or change the ports via the config.ini and start the node in parallel.
If we start them in parallel we can create complex topologies of nodes via the config.ini and try to replicate things like an EOS mainnet or the like.
These types of topologies are out of the scope of this README but please look at documentation for Leap node configurations.
Contract development
CMake contract development
Let's start by creating a new project in our workspace.
$ dune --create-cmake-app hello ./
This should produce a file structure like the picture below:
Modify the source code how you like.
Then, let's compile the contract.
$ dune --cmake-build ./
Bare contract development
Let's start by create a new bare project in our workspace.
$ dune --create-bare-app hello ./
This should produce a file structure like the picture below:
Modify the source code how you like.
Then, let's compile the contract.
$ dune -- cdt-cpp /host/<path>/hello/hello.cpp -o /host/<path>/hello/hello.wasm
Creating accounts and deploying smart contracts
Let's start off by creating some accounts.
$ dune --create-account bucky
$ dune --create-account test
$ dune --create-account areg
From here we can deploy built smart contracts.
$ dune --deploy ./hello bucky
$ dune --deploy ./example/talk/build/talk test
$ dune --deploy ./sudo/build/sudo areg
Sending actions
Let's send some actions to the accounts.
$ dune --send-action bucky hi '[bucky]' bucky@active
$ dune --send-action test post '[1, 0, bucky, "message"]' test
$ dune --send-action areg wrap ...
Table information
The only current command open is --get-table
which is analogous to cleos get table
.
$ dune --get-table <ACCOUNT> <SCOPE> <TABLE NAME>
This will allow for all of the same utilities from cleos itself. As we move forward we hope to greatly expand upon these utilities.
DApp/WebApp
The services through the docker container are exposed at 8888 for http, 9876 for p2p and 8080 for SHiP. You will need to ensure the running node is using those ports.
Account management
Earlier we saw a simple way above to create accounts using --create-account <ACCOUNT NAME>
.
But we also have the ability to supply the creator of the account and the public and private key optionally.
$ dune --create-account bucky foo
The above command will use the existing foo
account to create a new account account called bucky
and it will automatically generate the public and private key pair for this account and import the private key into the development wallet.
Or, to explicitly specify the public and private key pair of the new account:
$ dune --create-account bucky foo EOS7qPSKJhqygQTSNjMy8aH6TL6NtsYJnBJ7fxh7Y4SFLiXYdhjGD 5KNYGzaLo9aTjiXG7oeKGy5JWkQVkAha1Xi9DXNedvojovPhnLC
Clearly you don't want to do this with real private keys or sensitive accounts.
Bootstrapping nodes
At some point you will want to activate protocol features for your chain.
This can be achieved in a few ways with DUNE.
The first is by using the command --activate-feature
.
This will require you to know which protocol features you want to enable.
A list of available features are listed via --list-features
.
If will try to preactivate the protocol features if it hasn't already done so, so you shouldn't have to worry about that step.
Next is using one of the two bootstrapping
commands.
The first is bootstrap-system
.
$ dune --bootstrap-system
This will preactivate protocol features, set the boot contract and activate all protocol features.
The second is bootstrap-system-full
.
$ dune --bootstrap-system-full
This will do the same as --bootstrap-system
but additionally set the contracts
from reference-contracts
and create the correct accounts needed for those.
System-level commands
Wallet
The default wallet is created for you and always unlocked for you when using this system.
The wallet of DUNE is not in any way designed to be a secure
wallet.
During testing or replication of state we sometimes might want to import a previous wallet.
DUNE exposes two commands --export-wallet
and --import-wallet <WALLET DIR>
.
export-wallet
will produce a .tgz
at the current location called wallet.tgz
.
import-wallet
will take the directory of the wallet.tgz
and import it over the current wallet of the system.
You can also create a public key private key pair with the command --create-key
.
And lastly, we can import a development key if we need to manually do so with the command --import-dev-key
.
Container
Sometimes the running container can get corrupted or overly large and you will want to purge it and start fresh.
To do this use the command destroy-container
.
$ dune --destroy-container
This will stop the running container and erase it.
When you are done for the day it is best practice to stop the container, which is exposed via stop-container
.
$ dune --stop-container
This will stop all running nodes safely, and then stop the running container.
And lastly, if you are building some IDE plugin support or ancillary tooling you will want to start the container.
$ dune --start-container
As mentioned above all commands that use the container will automatically create a new container if one does not exist and automatically start the container if is stopped.