Cameron Harris, EO Solutions; Miguel Rodriguez, AFRL; Virginia Wright, AFRL; Jonathan Kadan, Space Systems Command; Justin Fletcher, Space Systems Command
Keywords: Space Domain Awareness, Testing and Evaluation, System Performance, Benchmark Data
Abstract:
The Space Force is actively engaged in addressing the complex operational landscape within Space Domain Awareness and Space Control (SDA/SC).
Prior SDA/SC initiatives have encountered challenges in transitioning capabilities to operational effectiveness, often stemming from limitations in Testing and Evaluation (T&E) processes and a need for more comprehensive mission effectiveness analysis.
Verification and validation of intricate SDA/SC systems requires testbeds capable of exercising the full spectrum of operational scenarios.
Traditionally, system testing methods have relied on simplified models or limited datasets to verify functional performance.
While valuable, these approaches may not provide the depth of evaluation required for the assessment of complex systems at the mission scope.
To address these limitations, this paper introduces the Decisive Mission Analysis Capability (DMAC), a physics-based T&E framework designed to enhance the development and evaluation of SDA/SC capabilities.
A fundamental feature of DMAC is its modular software architecture, designed for plug-and-play integration of algorithms and modules from various providers.
The framework is structured into abstract components representative of typical SDA/SC systems, including (but not limited to) image processing, orbit determination, orbital threat screening, and sensor tasker/scheduler modules.
Importantly, the DMAC test harness supports both component-level and end-to-end system testing, aiming to establish a comprehensive and repeatable test environment.
This approach facilitates rigorous evaluation of SDA/SC systems, enhancing their reliability and effectiveness, and promoting the development and validation of advanced algorithms and methodologies.
The ultimate objective of DMAC is to facilitate the quantifiable assessment of system performance and mission effectiveness.
This is achieved through the two-tiered testing approach, encompassing both component-level and mission-level tests.
Component testing allows for the isolation and detailed performance analysis of individual system modules, leveraging both real and simulated benchmark datasets.
Examples of component test metrics include target precision and recall of optical imagery processing modules, or orbit accuracy evaluation from noisy, short-arc observation tracklets in orbit determination modules.
Testing at the component level enables the assessment of functional correctness and performance against known ground truth in benchmark datasets.
A key feature of the manuscript will be a detailed walkthrough of the component-level test metrics and methods, with the goal of establishing standard test measures of core SDA system components.
Alternatively, the mission-level testing capability of DMAC integrates all modules into a cohesive system under test, enabling system evaluation under simulated operational conditions.
This test approach enables higher level analysis about system behaviors; specifically, whether or not the system meets mission requirements.
In mission-level testing, full scenarios are executed with simulated sensor agents.
Simulated sensor agents, driven by a full physics simulation backend, allow for a dynamic closed-loop workflow consistent with real-world operations.
The full physics simulation is configurable to simulate diverse scenarios, with various space object populations, sensor locations, and orbital events.
This simulator models orbital dynamics and sensor physics (e.g., optical, radar) at a high fidelity, generating realistic sensor agent data, which is in turn processed by the system under test in a closed loop until the scenario terminates.
The primary use-case of DMAC is to evaluate a system’s capability to acquire and maintain custody of orbital threats.
In accordance with the problem statements of the SDA TAP Lab, two pertinent adversary kill chains in the current space domain are GEO Direct Ascent and Co-orbital anti-satellite weapons.
The exquisite mission-level testing capability of the DMAC framework enables critical evaluation of a full integrated system in scenarios for which real data is not available, such as the above adversary kill chains.
Further, the modularity of the DMAC framework allows swapping of system components to evaluate differences in mission effectiveness.
A major focus of the manuscript results will be statistical analysis of a full SDA/SC system against scenarios involving GEO Direct Ascent and Co-orbital anti-satellite weapons.
Initial applications of DMAC have already demonstrated its potential for identifying system deficiencies.
Recent testing of an examplar system revealed a weakness in the orbit determination component.
When tracking an uncorrelated object on a Geostationary Transfer Orbit near perigee, the system under test was unable to maintain custody of the target after several minutes due to the inaccuracy of the orbit solution.
The result prompted subsequent modifications to the relevant orbit determination components, enhancing the system’s future mission effectiveness.
Similar analysis will be presented in the manuscript, extending to all system components.
In summary, DMAC provides a robust T&E tool for advancing the development and validation of SDA/SC systems.
Its modular design and full physics simulation capability enables rigorous testing of both individual components and integrated systems, enhancing their reliability and effectiveness.
Future work will focus on expanding support for a wider range of sensor types and operational scenarios, pushing for broader adoption within the SDA community.
Date of Conference: September 16-19, 2025
Track: Space Domain Awareness