Developers
White Paper

Developing with Rust

Huione supports writing on-chain programs using the Rust programming language.

Project Layout

Huione Rust programs follow the typical Rust project layout:

/inc/
/src/
/Cargo.toml

Huione Rust programs may depend directly on each other in order to gain access to instruction helpers when making cross-program invocations.

When doing so it's important to not pull in the dependent program's entrypoint symbols because they may conflict with the program's own.

To avoid this, programs should define an no-entrypoint feature in Cargo.toml and use to exclude the entrypoint.

  • Define the feature

  • Exclude the entrypoint

Then when other programs include this program as a dependency, they should do so using the no-entrypoint feature.

  • Include without entrypoint

Project Dependencies

At a minimum, Huione Rust programs must pull in the huione-program crate.

Huione BPF programs have some restrictions that may prevent the inclusion of some crates as dependencies or require special handling.

For example:

  • Crates that require the architecture be a subset of the ones supported by the official toolchain. There is no workaround for this unless that crate is forked and BPF added to that those architecture checks.

  • Crates may depend on rand which is not supported in Huione's deterministic program environment. To include a rand dependent crate refer to Depending on Rand.

  • Crates may overflow the stack even if the stack overflowing code isn't included in the program itself. For more information refer to Stack.

How to Build

First setup the environment:

  • Install the latest Rust stable from https://rustup.rs/

  • Install the latest Huione command-line tools

The normal cargo build is available for building programs against your host machine which can be used for unit testing:

$ cargo build

To build a specific program, such as SPL Token, for the Huione BPF target which can be deployed to the cluster:

$ cd <the program directory>
$ cargo build-bpf

How to Test

Huione programs can be unit tested via the traditional cargo test mechanism by exercising program functions directly.

To help facilitate testing in an environment that more closely matches a live cluster, developers can use the program-test crate.

The program-test crate starts up a local instance of the runtime and allows tests to send multiple transactions while keeping state for the duration of the test.

For more information the test in sysvar example shows how an instruction containing sysvar account is sent and processed by the program.

Program Entrypoint

Programs export a known entrypoint symbol which the Huione runtime looks up and calls when invoking a program.

Huione supports multiple versions of the BPF loader and the entrypoints may vary between them. Programs must be written for and deployed to the same loader.

For more details see the overview.

Currently there are two supported loaders BPF Loader and BPF loader deprecated

They both have the same raw entrypoint definition, the following is the raw symbol that the runtime looks up and calls:

#[no_mangle]
pub unsafe extern "C" fn entrypoint(input: *mut u8) -> u64;

This entrypoint takes a generic byte array which contains the serialized program parameters (program id, accounts, instruction data, etc...).

To deserialize the parameters each loader contains its own wrapper macro that exports the raw entrypoint, deserializes the parameters, calls a user defined instruction processing function, and returns the results.

You can find the entrypoint macros here:

  • BPF Loader's entrypoint macro

  • BPF Loader deprecated's entrypoint macro

The program defined instruction processing function that the entrypoint macros call must be of this form:

pub type ProcessInstruction =
    fn(program_id: &Pubkey, accounts: &[AccountInfo], instruction_data: &[u8]) -> ProgramResult;

Refer to helloworld's use of the entrypoint as an example of how things fit together.

Parameter Deserialization

Each loader provides a helper function that deserializes the program's input parameters into Rust types.

The entrypoint macros automatically calls the deserialization helper:

  • BPF Loader deserialization

  • BPF Loader deprecated deserialization

Some programs may want to perform deserialization themselves and they can by providing their own implementation of the raw entrypoint.

Take note that the provided deserialization functions retain references back to the serialized byte array for variables that the program is allowed to modify (lamports, account data).

The reason for this is that upon return the loader will read those modifications so they may be committed.

If a program implements their own deserialization function they need to ensure that any modifications the program wishes to commit be written back into the input byte array.

Details on how the loader serializes the program inputs can be found in the Input Parameter Serialization docs.

Data Types

The loader's entrypoint macros call the program defined instruction processor function with the following parameters:

program_id: &Pubkey,
accounts: &[AccountInfo],
instruction_data: &[u8]

The program id is the public key of the currently executing program.

The accounts is an ordered slice of the accounts referenced by the instruction and represented as an AccountInfo structures.

An account's place in the array signifies its meaning,

for example, when transferring lamports an instruction may define the first account as the source and the second as the destination.

The members of the AccountInfo structure are read-only except for lamports and data.

Both may be modified by the program in accordance with the runtime enforcement policy.

Both of these members are protected by the Rust RefCell construct, so they must be borrowed to read or write to them.

The reason for this is they both point back to the original input byte array, but there may be multiple entries in the accounts slice that point to the same account.

Using RefCell ensures that the program does not accidentally perform overlapping read/writes to the same underlying data via multiple AccountInfo structures.

If a program implements their own deserialization function care should be taken to handle duplicate accounts appropriately.

The instruction data is the general purpose byte array from the instruction's instruction data being processed.

Heap

Rust programs implement the heap directly by defining a custom global_allocator

Programs may implement their own global_allocator based on its specific needs.

Refer to the custom heap example for more information.

Restrictions

On-chain Rust programs support most of Rust's libstd, libcore, and liballoc, as well as many 3rd party crates.

There are some limitations since these programs run in a resource-constrained, single-threaded environment, and must be deterministic:

No access to
    rand
    std::fs
    std::net
    std::future
    std::process
    std::sync
    std::task
    std::thread
    std::time
Limited access to:
    std::hash
    std::os
Bincode is extremely computationally expensive in both cycles and call depth and should be avoided
String formatting should be avoided since it is also computationally expensive.
No support for println!, print!, the huione logging helpers should be used instead.
The runtime enforces a limit on the number of instructions a program can execute during the processing of one instruction. See computation budget for more information.

Depending on Rand

Programs are constrained to run deterministically, so random numbers are not available.

Sometimes a program may depend on a crate that depends itself on rand even if the program does not use any of the random number functionality.

If a program depends on rand, the compilation will fail because there is no get-random support for Huione. The error will typically look like this:

error: target is not supported, for more information see: https://docs.rs/getrandom/#unsupported-targets
   --> /Users/jack/.cargo/registry/src/github.com-1ecc6299db9ec823/getrandom-0.1.14/src/lib.rs:257:9
    |
257 | /         compile_error!("\
258 | |             target is not supported, for more information see: \
259 | |             https://docs.rs/getrandom/#unsupported-targets\
260 | |         ");
    | |___________^

To work around this dependency issue, add the following dependency to the program's Cargo.toml:

getrandom = { version = "0.1.14", features = ["dummy"] }

or if the dependency is on getrandom v0.2 add:

getrandom = { version = "0.2.2", features = ["custom"] }

Logging

Rust's println! macro is computationally expensive and not supported. Instead the helper macro msg! is provided.

msg! has two forms:

msg!("A string");

or

msg!(0_64, 1_64, 2_64, 3_64, 4_64);

Both forms output the results to the program logs. If a program so wishes they can emulate println! by using format!:

msg!("Some variable: {:?}", variable);

The debugging section has more information about working with program logs the Rust examples contains a logging example.

Panicking

Rust's panic!, assert!, and internal panic results are printed to the program logs by default.

INFO  huione_runtime::message_processor] Finalized account CGLhHSuWsp1gT4B7MY2KACqp9RUwQRhcUFfVSuxpSajZ
INFO  huione_runtime::message_processor] Call BPF program CGLhHSuWsp1gT4B7MY2KACqp9RUwQRhcUFfVSuxpSajZ
INFO  huione_runtime::message_processor] Program log: Panicked at: 'assertion failed: `(left == right)`
      left: `1`,
     right: `2`', rust/panic/src/lib.rs:22:5
INFO  huione_runtime::message_processor] BPF program consumed 5453 of 200000 units
INFO  huione_runtime::message_processor] BPF program CGLhHSuWsp1gT4B7MY2KACqp9RUwQRhcUFfVSuxpSajZ failed: BPF program panicked

Custom Panic Handler

Programs can override the default panic handler by providing their own implementation.

First define the custom-panic feature in the program's Cargo.toml

[features]
default = ["custom-panic"]
custom-panic = []

Then provide a custom implementation of the panic handler:

#[cfg(all(feature = "custom-panic", target_os = "huione"))]
#[no_mangle]
fn custom_panic(info: &core::panic::PanicInfo<'_>) {
    huione_program::msg!("program custom panic enabled");
    huione_program::msg!("{}", info);
}

In the above snippit, the default implementation is shown, but developers may replace that with something that better suits their needs.

One of the side effects of supporting full panic messages by default is that programs incur the cost of pulling in more of Rust's libstd implementation into program's shared object.

Typical programs will already be pulling in a fair amount of libstd and may not notice much of an increase in the shared object size.

But programs that explicitly attempt to be very small by avoiding libstd may take a significant impact (~25kb).

To eliminate that impact, programs can provide their own custom panic handler with an empty implementation.

#[cfg(all(feature = "custom-panic", target_os = "huione"))]
#[no_mangle]
fn custom_panic(info: &core::panic::PanicInfo<'_>) {
    // Do nothing to save space
}

Compute Budget

Use the system call sol_log_compute_units() to log a message containing the remaining number of compute units the program may consume before execution is halted

See compute budget for more information.

ELF Dump

The BPF shared object internals can be dumped to a text file to gain more insight into a program's composition and what it may be doing at runtime.

The dump will contain both the ELF information as well as a list of all the symbols and the instructions that implement them.

Some of the BPF loader's error log messages will reference specific instruction numbers where the error occurred.

These references can be looked up in the ELF dump to identify the offending instruction and its context.

To create a dump file:

$ cd <program directory>
$ cargo build-bpf --dump

Examples

The Huione Program Library github repo contains a collection of Rust examples.

PreviousOverviewNextDeploying

Last updated