Development Guide¶
TLDR
Install rustup, uv, and just. Then run just setup to install all dependencies and setup your development environment. Use just --list to see all available commands.
Development Workflow¶
For all development we recommend using uv to manage your environment. The guidelines for contributing, developing, and extending brahe assume you are using uv.
Setting up your environment¶
If you need to setup the development environment, including installing the necessary development dependencies.
First, you need to install Rust from rustup.rs and just. Brahe uses just commands extensively to provide helpful shortcuts for building, testing, and development. You can check the available commands with:
To get a list of all available commands and their descriptions.
To setup your development environment, run the following command:
to setup your development environment. This will install all necessary dependencies, including Python, and setup a virtual environment for you.
Alternatively you can run the following commands to setup your environment manually:
Setup your python environment with:
Finally, you can install the pre-commit hooks with:
Testing¶
The package includes Rust tests, Python tests, and documentation example tests.
Developer Environment Variables¶
| Variable | Used by | Purpose |
|---|---|---|
TEST_SPACETRACK_USER / TEST_SPACETRACK_PASS | just test-integration | Credentials for the Space-Track integration tests. |
TEST_SPACETRACK_BASE_URL | just test-integration-rust | Space-Track endpoint for integration tests; defaults to https://for-testing-only.space-track.org. |
BRAHE_FIGURE_OUTPUT_DIR | just make-plots, scripts/make_plot.py | Directory that plot scripts write figures into; defaults to ./docs/figures/. |
Variables that affect the library itself (BRAHE_CACHE, BRAHE_NETWORK_MODE, SPACETRACK_USER, SPACETRACK_PASS) are documented for users in Environment Variables.
Development Workflow: Implementing a New Feature¶
When adding new functionality to Brahe, follow this sequence:
1. Rust Implementation - Implement functionality in the appropriate module under src/ - Use SI base units (meters, seconds) in all public APIs - Follow existing patterns and naming conventions
2. Rust Tests - Write comprehensive unit tests in the same file (in a #[cfg(test)] mod tests {} module) - Test edge cases and typical use cases - Run: cargo test - Ensure all tests pass before proceeding
3. Python Bindings - Create 1:1 Python bindings in src/pymodule/ - Use identical function names and parameter names as Rust - Add complete Google-style docstrings with Args, Returns, Examples - Export new classes in src/pymodule/mod.rs - Export in Python package (brahe/*.py files) - Reinstall: uv pip install -e .
4. Python Tests - Write Python tests that mirror Rust tests in tests/ - Follow the same test structure and assertions - Run: uv run pytest tests/ -v
5. Documentation Examples - Create standalone example files in examples/<module>/ - Create both Python and Rust versions (see templates below) - Test: just test-examples
6. Documentation - Update or create documentation in docs/ - Reference examples using snippet includes (see template below) - Build Locally: uv run properdocs serve
7. Final Checks
Rust Standards and Guidelines¶
Rust Testing Conventions¶
New functions implemented in rust are expected to have unit tests and documentation tests. Unit tests should cover all edge cases and typical use cases for the function. Documentation tests should provide examples of how to use the function.
Unit tests should be placed in the same file as the function they are testing, in a module named tests. The names of tests should follow the general convention of test_<struct>_<trait>_<method>_<case> or test_<function>_<case>.
Rust Docstring Template¶
New functions implemented in rust are expected to use the following docstring to standardize information on functions to enable users to more easily navigate and learn the library.
Python Standards and Guidelines¶
Python Testing Conventions¶
Python tests should be placed in the tests directory. The test structure and names should mirror the structure of the brahe package. For example, tests for brahe.orbits.keplerian should be placed in tests/orbits/test_keplerian.py.
All Python tests should be exact mirrors of the Rust tests, ensuring that both implementations are equivalent and consistent. There are a few exceptions to this rule, such as tests that check for Python-specific functionality or behavior, or capabilities that are not possible to reproduce in Python due to language limitations.
Documentation Examples¶
Documentation examples are standalone executable files that demonstrate library functionality. Every example must exist in both Python and Rust versions to ensure API parity.
Example File Structure¶
Examples are organized by module in examples/:
Naming Convention¶
Example files should follow this pattern:
Examples: - time_epoch_creation.py / time_epoch_creation.rs - orbits_keplerian_conversion.py / orbits_keplerian_conversion.rs - coordinates_geodetic_transform.py / coordinates_geodetic_transform.rs
Python Example Template¶
See examples/TEMPLATE.py:
Note: The # /// script header makes this a uv script, allowing it to be run standalone with uv run example.py.
Rust Example Template¶
See examples/TEMPLATE.rs:
Testing Examples¶
Test examples locally:
The build system will: 1. Execute all .rs files via rust-script 2. Execute all .py files via uv run python 3. Verify every .rs has a matching .py (and vice versa) 4. Report pass/fail for each example
Documentation figures are generated by actually running the example scripts, not by hand. just setup runs download-resources, which warms every network resource the examples and plots read, once, serially; test-examples, test-example, make-plots, and make-plot then run from that cache without touching the network, so run just download-resources again after editing .github/brahe-data-manifest.txt or clearing BRAHE_CACHE. On a machine without network access, run them with BRAHE_NETWORK_MODE=offline against a previously warmed BRAHE_CACHE. Examples flagged NETWORK fetch data that cannot be served from the warmed CI caches and are skipped by default so just test-examples works offline; building docs with all figures locally therefore requires just test-examples --network. A single example can be run the same way with just test-example <example_name> --lang python --network. A per-example failure - e.g. a third-party API outage - does not block the other examples' figures from being generated. Celestrak GP examples are not flagged NETWORK; they run from the Celestrak groups committed under test_assets/celestrak, so a Celestrak outage cannot affect them.
CI data caches and network mode¶
Every CI test, example, plot, and docs step — including the Rust and Python unit-test jobs (test_rust.yml, test_python.yml), and excepting the live integration jobs in integration_tests.yml — runs with BRAHE_NETWORK_MODE=offline. The unit-test workflows front their matrix with a single data-cache job built on the .github/actions/data-cache composite action: it restores the families the unit suites read (only naif), and when a family is missing or its cache predates the manifest it builds the extension once, downloads the missing entries with scripts/warm_data_cache.py --only <family>, saves them for later runs (best effort; fork pull requests cannot write the cache), and hands the files to the matrix legs as a run artifact, so the legs never touch the cache or the network themselves. A test whose data is still missing therefore fails with the BRAHE_NETWORK_MODE error naming the resource, which points at a gap in .github/brahe-data-manifest.txt. test_examples.yml uses the same composite for all four families in its single job — restore, warm only the misses online, save — plus the plot-resource caches, before running the examples offline; the docs and integration workflows still carry inline restore blocks. Off main, saves use a run-suffixed key that later runs of the same ref find by prefix, so a pull request heals its own cold cache without ever writing main's keys. Loopback URLs (localhost, 127.0.0.1, ::1) are exempt from BRAHE_NETWORK_MODE, which is why the unit-test jobs' local mock servers — tests/plots/test_download.py's http.server fixture and Rust's httpmock-based tests — keep working offline. The unit suites auto-load moon_pa_de440_200625.bpc and mar099s.bsp, which the manifest lists so the NAIF cache carries them. Each family is read from its own cache (naif-kernels-v1-<manifest hash>, brahe-icgem-v1-<manifest hash>, brahe-sbdb-horizons-v1-<manifest hash>, star-catalogs-v1, plus the plot textures and basemaps); the manifest-driven families roll their key on a manifest change and fall back to the newest previous entry by prefix on a miss. The weekly warm_data_cache.yml workflow restores, warms, and saves each family independently from .github/brahe-data-manifest.txt via scripts/warm_data_cache.py --only <family>, while test_examples.yml also saves them from main whenever their restore misses. The Celestrak GP groups the examples and doc plots read are not a cache family at all: they are committed under test_assets/celestrak and copied into ~/.cache/brahe/celestrak, so those runs never contact Celestrak. Refresh them with just refresh-celestrak-snapshots; live client behavior is covered by the integration suites, which deliberately query Celestrak directly. A pull request that adds a manifest entry downloads it live in its own run (the warm step is online) but cannot save; the key change is picked up automatically by the next main push (test_examples.yml) or the weekly warm_data_cache.yml run, whichever saves the new entry first — dispatch warm_data_cache.yml manually only to do so sooner. The weekly integration workflow passes network_mode: online to the example workflow so the NETWORK-flagged examples still run live there.
Including Examples in Documentation¶
Use the pymdownx.snippets directive to include examples in markdown files. See the snippets plugin documentation for additional details on usage.
This will: - Create tabbed interface with Python shown first - Include the actual file contents (always in sync) - Automatically update when examples change
Documentation Plots¶
Interactive plots are generated from Python scripts in plots/ and embedded in documentation.
Plot Naming Convention¶
Plot files should follow this pattern:
Examples: - fig_time_system_offsets.py - fig_orbital_period.py - fig_anomaly_conversions.py
Plot Template¶
See plots/TEMPLATE_plot.py:
Note: The # /// script header allows standalone execution with uv run fig_plot.py.
Generating Plots¶
Generate all plots:
Plots are written to docs/figures/ as partial HTML files for embedding.
Including Plots in Documentation¶
This will: - Embed the interactive Plotly plot - Add a collapsible section showing the source code
Pull Request Changelog¶
When you open a pull request, fill in the ## Changelog section of the PR description with entries under the appropriate Keep a Changelog headings:
- Added - new features
- Changed - changes to existing functionality
- Deprecated - APIs still present but scheduled for removal
- Removed - APIs that have been removed
- Fixed - bug fixes
A single PR may contribute to multiple sections. The PR description is the single source of truth — there is no separate fragment file to maintain.
Example¶
How It Works¶
- Validation on open: a GitHub Action checks that the PR description has at least one non-empty section. It posts a comment with instructions if validation fails. Dependabot PRs are exempt.
- At release time:
scripts/generate_release_notes.pywalks every PR merged intomainsince the previous release tag, parses each PR's### Sectionblocks, aggregates them under the version heading inCHANGELOG.md, and writes the same content torelease_notes.mdfor use as the GitHub Release body. Each entry is attributed as[@author](url) ([#PR](url)). - Skipped PRs: PRs labeled
automated,data-update, ordependencies, and any PR opened by a bot account, are excluded from the generated changelog.
Previewing the Changelog Locally¶
To see what the next release's changelog would look like without writing any files:
This requires the gh CLI to be authenticated (gh auth status).
Release Process¶
CHANGELOG generation and version bumps happen locally before tagging, so the tagged commit contains everything the published artifacts ship. CI never mutates the repository during a release.
Initiating a Release¶
-
Bump the workspace version:
This updates[workspace.package].versioninCargo.toml(inherited bybraheandbrahe-py) and refreshesCargo.lock. -
Regenerate the CHANGELOG entry for this release:
By default, the version is read fromCargo.tomland the previous tag fromgit describe --tags --abbrev=0. Override either withjust generate-changelog 1.2.3 v1.2.2. The script aggregates### Sectionblocks from PR bodies merged since the previous tag —ghmust be authenticated (gh auth status).
Review the diff to CHANGELOG.md and edit if needed; it is the canonical source of release notes.
-
Run quality checks:
-
Commit and tag:
Automated Workflow¶
Once the tag is pushed, GitHub Actions automatically:
- Validates the tag version matches
Cargo.tomland thatCHANGELOG.mdcontains a## [1.2.3]entry (fails fast ifjust generate-changelogwas skipped). - Runs all tests (Rust, Python, examples).
- Extracts
release_notes.mdfrom the committedCHANGELOG.md(viascripts/extract_release_notes.py) for use as the GitHub Release body — no commits or pushes from CI. - Builds documentation and deploys to GitHub Pages.
- Builds Python wheels and source distribution.
- Publishes to PyPI and crates.io.
- Publishes the GitHub Release (non-draft) with artifacts and release notes.
- Updates the "latest" tag and release.
Verification¶
After publishing, verify:
- PyPI: https://pypi.org/project/brahe/
- Crates.io: https://crates.io/crates/brahe
- Docs: https://docs.brahe.space/latest/
- GitHub: https://github.com/duncaneddy/brahe/releases
Benchmarks¶
Brahe has two benchmark layers: Criterion micro-benchmarks for internal Rust performance regression testing, and a comparative benchmark framework that measures both runtime performance and numerical accuracy across Python (Brahe), Rust (Brahe), and Java (OreKit).
Criterion Micro-Benchmarks¶
These are standard Rust benchmarks using the Criterion harness, located in benchmarks/:
Criterion generates HTML reports in target/criterion/ with statistical analysis, regression detection, and timing distributions.
Comparative Benchmark Framework¶
The comparative framework lives in benchmarks/comparative/ and compares equivalent implementations across languages using a standardized JSON stdin/stdout protocol. Each language implementation is a standalone process that receives task parameters as JSON and returns timing data and numerical results.
Setup¶
Before running comparative benchmarks, install all dependencies with a single command:
This builds the Rust benchmark binary, builds the Java/Gradle project (generating a Gradle wrapper if needed), and downloads OreKit data to ~/.orekit/orekit-data.
Prerequisites:
- Rust: Install from rustup.rs (used for the Rust benchmark binary)
- JDK 17+: Install via
brew install openjdk(macOS) or your system package manager (used for Java/OreKit benchmarks) - Gradle: Install via
brew install gradle(macOS) orsdk install gradlevia SDKMAN (Linux). Only needed if the Gradle wrapper doesn't exist yet — after first setup,gradlewis committed and Gradle is no longer required.
You can override the OreKit data location with the OREKIT_DATA environment variable.
Running Benchmarks¶
Output¶
Each run prints two Rich tables to the console:
- Performance Comparison — mean, median, std, min, max per task per language, with speedup ratios relative to the OreKit (Java) baseline.
- Numerical Accuracy (vs OreKit baseline) — max absolute error, max relative error, and RMS error for each implementation compared against OreKit.
Results are saved as JSON to benchmarks/comparative/results/ (gitignored). Plots are generated as themed Plotly HTML to docs/figures/.
Architecture¶
The orchestrator dispatches each task to each language. Python implementations run in-process. Rust and Java implementations are invoked as subprocesses with JSON piped to stdin and results read from stdout.
Adding a New Benchmark Task¶
To add a new benchmark task (e.g., a frame transformation benchmark):
1. Define the task specification in benchmarks/comparative/tasks/:
2. Register the task in benchmarks/comparative/tasks/__init__.py:
3. Add the Python implementation in benchmarks/comparative/implementations/python/:
Register the function in implementations/python/__init__.py by adding it to _DISPATCH_TABLE.
4. Add the Rust implementation in benchmarks/comparative/implementations/rust/src/:
Create the module file (e.g., frames.rs) with functions that deserialize JSON params, run the benchmark loop with std::time::Instant, and return (Vec<f64>, serde_json::Value). Add the module and dispatch arm in main.rs.
5. (Optional) Add the Java/OreKit implementation following the same pattern in the Gradle project.
Key Design Decisions¶
- OreKit as baseline: Java/OreKit is the reference implementation for both performance speedup ratios and numerical accuracy comparisons. OreKit runs first for each task, and all other implementations are compared against it.
- Deterministic parameters:
generate_params(seed)ensures reproducible benchmarks across runs. Always use the seed to initialize your RNG. - JSON protocol: Language implementations are decoupled from the orchestrator. Any language that can read JSON from stdin and write JSON to stdout can participate.
- First-iteration results: Only the first iteration's numerical results are stored for accuracy comparison. All iterations contribute timing data.
- Angle normalization: Orbital element comparisons normalize angular differences modulo 360 degrees to handle different library conventions for angle ranges.
- EOP initialization: Benchmarks use
StaticEOPProvider.from_zero()(zero EOP values) to avoid file I/O overhead and ensure reproducibility. This is sufficient for coordinate and orbital element conversions that don't depend on Earth orientation.