using provided RNG seed: reconfigurator-cli-test
> # Load example system
> load-example --nsleds 3 --ndisks-per-sled 3
loaded example system with:
- collection: f45ba181-4b56-42cc-a762-874d90184a43
- blueprint: dbcbd3d6-41ff-48ae-ac0b-1becc9b2fd21


> # Print the default target release
> show
configured external DNS zone name: oxide.example
configured silo names: example-silo
internal DNS generations: 1
external DNS generations: 1
target number of Nexus instances: default
target release (generation 1): unset
active nexus zone generation: 1
active nexus zones: inferred from generation
not-yet nexus zones: inferred from generation
cockroachdb settings:
    state fingerprint::   (none)
    version::::::::::::   (none)
    preserve downgrade:   (not set)
planner config:
    (no current planner configs)



> # Create a TUF repository from a fake manifest. (The output TUF repo is
> # written to a temporary directory that this invocation of `reconfigurator-cli`
> # is running out of as its working directory.)
> #
> # This is used to simulate the initial version of the system.
> generate-fake-repo 0.0.1
created repo-0.0.1.zip for system version 0.0.1


> # Load the target release from the assembled TUF repository.
> set target-release repo-0.0.1.zip
set target release based on repo-0.0.1.zip


> # Print the default target release.
> show
configured external DNS zone name: oxide.example
configured silo names: example-silo
internal DNS generations: 1
external DNS generations: 1
target number of Nexus instances: default
target release (generation 2): 0.0.1 (repo-0.0.1.zip)
    artifact: 2f8b4d6e35886a8e17fbbb30c6c6ee13c4f7becd9387d6f8529529317adbc824 kind=installinator_document version 0.0.1
    artifact: b0db8f64463a377a302082c5752056ee191adf904daa625d38a2094059f55248 kind=measurement_corpus version 0.0.1
    artifact: dbea4039b6ed82dbdd8d794d398a5c647ffa6991bd7d063702c2acbc7a0b90c7 kind=measurement_corpus version 0.0.1
    artifact: 812d8e99d0fd6138c76be04c43e6b696eb08d5b93e7e8c2dfefc959e89bc5aff kind=os_phase1,os_board=cosmo,os_variant=host version 0.0.1
    artifact: d6dcae50bc293f6d9a4bf03d2cfc698d17bce9327c63670348ec3241ab191fdd kind=os_phase1,os_board=cosmo,os_variant=recovery version 0.0.1
    artifact: 7a3232a3a559db2e9029de9960e392f51811a7415fde2d7923c1b27e6e1e155a kind=os_phase1,os_board=gimlet,os_variant=host version 0.0.1
    artifact: b422f23968f2b7ce5a84613d942cf203465f353ef92551c224497559f146c66b kind=os_phase1,os_board=gimlet,os_variant=recovery version 0.0.1
    artifact: 4a07d9994c760188e5c9faf538be61a2d7aa07017159eea66b338d86151b3fd5 kind=os_phase2,os_variant=host version 0.0.1
    artifact: 3edf9e84f482ca0fa029e3169796aa8877527c4cbcc33e1a6bff2d5785ed8d29 kind=os_phase2,os_variant=recovery version 0.0.1
    artifact: 431d7bc16f5e7b2e7cac88463d97e890fd8c5327908924823c11f37c08d60214 kind=rot,rot_board=SimRot,rot_rkth=0000000000000000000000000000000000000000000000000000000000000000,rot_slot=a version 0.0.1
    artifact: 431d7bc16f5e7b2e7cac88463d97e890fd8c5327908924823c11f37c08d60214 kind=rot,rot_board=SimRot,rot_rkth=0000000000000000000000000000000000000000000000000000000000000000,rot_slot=b version 0.0.1
    artifact: 5681be3ed8701d2adf1e77dae1ea2ae226e0b84fc88366df238b3788c84fe34c kind=rot_bootloader,rot_board=SimRot,rot_rkth=0000000000000000000000000000000000000000000000000000000000000000 version 0.0.1
    artifact: 2405f91cfbcc5de9f1082a1b1a088e9f5ded1c015f08189f3e35181fc4f42fe0 kind=sp,sp_board=SimCosmoSp version 0.0.1
    artifact: a002855676d7ca5fc448d11f1c99fa916ff0763d9d9b0b306c34b84b00529444 kind=sp,sp_board=SimGimletSp version 0.0.1
    artifact: 18f2dac7de150d24837bf47cc5021da40a03a50be5e851617e74f3d3e209e443 kind=sp,sp_board=SimPscSp version 0.0.1
    artifact: 79997f16c711ddb964b26b4751dedcb79a95e337bc79561b1f67a065e45d30c0 kind=sp,sp_board=SimSidecarSp version 0.0.1
    artifact: bf1644cb268752c8369377f9300c398bcb3dd822c5234b465461166944a745df kind=zone,zone_name=clickhouse version 0.0.1
    artifact: 4d7d1b049e3ad61351824c040f3c50708e3d3c89b7892fd25b9e12e151d56dea kind=zone,zone_name=clickhouse_keeper version 0.0.1
    artifact: 3140c5e79f3bed0b0034e6dfa4e8423fd2fa9d567291c9b1b703aaf769b10756 kind=zone,zone_name=clickhouse_server version 0.0.1
    artifact: 541bb4d38385c684f2629b970e23442fc567761917ab7b6e35410c0e2070ea54 kind=zone,zone_name=cockroachdb version 0.0.1
    artifact: 3446b183b3e1343803ed392fcb4de00e8bbf4d4c2569b24bf40240f0bca92db8 kind=zone,zone_name=crucible-pantry-zone version 0.0.1
    artifact: 3303ca32f7f4ee36461654b8928ee50341208e6d5269357859034c3ebd938c2d kind=zone,zone_name=crucible-zone version 0.0.1
    artifact: affc53c414c4eddc35fe049e9368774c5ae7a35d5c531107b4f0370b7e4daaae kind=zone,zone_name=external-dns version 0.0.1
    artifact: c114fd7044f42f82e51d97a56cb9d492941292e1922d01160ed9d53229b8111d kind=zone,zone_name=internal-dns version 0.0.1
    artifact: c562f60324e6c312445d89aae05bdefc3b70ab5145277c0fafd27e6bd95a5110 kind=zone,zone_name=nexus version 0.0.1
    artifact: dcb132105ebbe9bb80c711f12a06acc3377426d317d00b725ef045a33e8a6e8e kind=zone,zone_name=ntp version 0.0.1
    artifact: d704d9f63e858b53b480cee4eb16985a9fcb65018ae05819fd4fd5532122382e kind=zone,zone_name=oximeter version 0.0.1
active nexus zone generation: 1
active nexus zones: inferred from generation
not-yet nexus zones: inferred from generation
cockroachdb settings:
    state fingerprint::   (none)
    version::::::::::::   (none)
    preserve downgrade:   (not set)
planner config:
    (no current planner configs)



> # Update the install dataset on all sleds to the target release.
> # This will cause zones to be noop converted over to Artifact,
> # unblocking upgrades.
> sled-update-install-dataset serial0 --to-target-release
sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6: install dataset updated: to target release (system version 0.0.1)

> sled-update-install-dataset serial1 --to-target-release
sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c: install dataset updated: to target release (system version 0.0.1)

> sled-update-install-dataset serial2 --to-target-release
sled d81c6a84-79b8-4958-ae41-ea46c9b19763: install dataset updated: to target release (system version 0.0.1)


> # Generate inventory, then do a planning run to ensure that all zones
> # are set to Artifact.
> inventory-generate
generated inventory collection eb0796d5-ab8a-4f7b-a884-b4aeacb8ab51 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 0, num_eligible: 9, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO current sled measurements are in an unknown state, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 0, num_eligible: 8, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO current sled measurements are in an unknown state, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 0, num_eligible: 8, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO current sled measurements are in an unknown state, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763
generated blueprint 8da82a8e-bf97-4fbd-8ddd-9f6462732cf1 based on parent blueprint dbcbd3d6-41ff-48ae-ac0b-1becc9b2fd21
blueprint source: planner with report:
planning report:
* noop converting 9/9 install-dataset zones to artifact store on sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c
* noop converting 8/8 install-dataset zones to artifact store on sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6
* noop converting 8/8 install-dataset zones to artifact store on sled d81c6a84-79b8-4958-ae41-ea46c9b19763
* zone updates waiting on reference measurement changes
Measurement updates:
3 modifications



> blueprint-diff latest
from: blueprint dbcbd3d6-41ff-48ae-ac0b-1becc9b2fd21
to:   blueprint 8da82a8e-bf97-4fbd-8ddd-9f6462732cf1

 MODIFIED SLEDS:

  sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c (active, config generation 2 -> 3):

    measurements:
    ------------------------------------------------------------------------------------
    hash                                                               version          
    ------------------------------------------------------------------------------------
-   unknown                                                            (unknown version)
+   b0db8f64463a377a302082c5752056ee191adf904daa625d38a2094059f55248   version 0.0.1    
+   dbea4039b6ed82dbdd8d794d398a5c647ffa6991bd7d063702c2acbc7a0b90c7   version 0.0.1    


    host phase 2 contents:
    ------------------------
    slot   boot image source
    ------------------------
    A      current contents 
    B      current contents 


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-727522a7-934f-494d-b5b3-160968e74463   in service 
    fake-vendor   fake-model   serial-72c59873-31ff-4e36-8d76-ff834009349a   in service 
    fake-vendor   fake-model   serial-b5fd5bc1-099e-4e77-8028-a9793c11f43b   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_727522a7-934f-494d-b5b3-160968e74463/crucible                                                              feecfda1-9966-43d4-aaef-440b77f0b26d   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crucible                                                              956966b9-8201-437b-81ba-3c8ad2032080   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crucible                                                              4b0b09bf-94b7-45bf-a6b3-d46af53ae44a   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/clickhouse                                                      5ae11c7e-08fa-4d78-a4ea-14b4a9a10241   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    3e0d6188-c503-49cf-a441-fa7df40ceb43   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    b8f2a09f-8bd2-4418-872b-a4457a3f958c   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone                                                            4829f422-aa31-41a8-ab73-95684ff1ef48   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone                                                            3b66453b-7148-4c1b-84a9-499e43290ab4   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone                                                            841d5648-05f0-47b0-b446-92f6b60fe9a6   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_clickhouse_353b3b65-20f7-48c3-88f7-495bd5d31545        49f8fbb6-5bac-4609-907f-6e3dfc206059   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone/oxz_crucible_86a22a56-0168-453d-9df1-cb2a7c64b5d3          6e218d0a-13fd-4f70-884e-47e960fa8bb8   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_bd354eef-d8a6-4165-9124-283fb5e46d77          9073fb6b-f973-4bbd-b7cc-ba1abf6cb238   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone/oxz_crucible_e2fdefe7-95b2-4fd2-ae37-56929a06d58c          0582030b-aab6-4d0e-b1d2-64562ee712cd   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_ad6a3a03-8d0f-4504-99a4-cbf73d69b973   1640adb6-70bf-44cf-b05c-bff6dd300cf3   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_6c3ae381-04f7-41ea-b0ac-74db387dbc3a      78f34ce7-42f1-41da-995f-318f32054ad2   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_99e2f30b-3174-40bf-a78a-90da8abba8ca      2f204c50-a327-479c-8852-f53ec7a19c1f   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_nexus_466a9f29-62bf-4e63-924a-b9efdb86afec             8e0bd2bd-23b7-4bc6-9e73-c4d4ebc0bc8c   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_62620961-fc4a-481e-968b-f5acbac0dc63               8c4fa711-1d5d-4e93-85f0-d17bff47b063   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/debug                                                           93957ca0-9ed1-4e7b-8c34-2ce07a69541c   in service    100 GiB   none          gzip-9     
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/debug                                                           318fae85-abcb-4259-b1b6-ac96d193f7b7   in service    100 GiB   none          gzip-9     
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/debug                                                           b46de15d-33e7-4cd0-aa7c-e7be2a61e71b   in service    100 GiB   none          gzip-9     
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/local_storage                                                   2db6b7c1-0f46-4ced-a3ad-48872793360e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/local_storage                                                   09b9cc9b-3426-470b-a7bc-538f82dede03   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/local_storage                                                   c31623de-c19b-4615-9f1d-5e1daa5d3bda   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/local_storage_unencrypted                                             775f9207-c42d-4af2-9186-27ffef67735e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/local_storage_unencrypted                                             3560dd69-3b23-4c69-807d-d673104cfc68   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/local_storage_unencrypted                                             2ad1875a-92ac-472f-8c26-593309f0e4da   in service    none      none          off        


    omicron zones:
    ------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source                disposition   underlay IP          
    ------------------------------------------------------------------------------------------------------------------------
*   clickhouse        353b3b65-20f7-48c3-88f7-495bd5d31545   - install dataset           in service    fd00:1122:3344:102::5
     └─                                                      + artifact: version 0.0.1                                      
*   crucible          86a22a56-0168-453d-9df1-cb2a7c64b5d3   - install dataset           in service    fd00:1122:3344:102::a
     └─                                                      + artifact: version 0.0.1                                      
*   crucible          bd354eef-d8a6-4165-9124-283fb5e46d77   - install dataset           in service    fd00:1122:3344:102::8
     └─                                                      + artifact: version 0.0.1                                      
*   crucible          e2fdefe7-95b2-4fd2-ae37-56929a06d58c   - install dataset           in service    fd00:1122:3344:102::9
     └─                                                      + artifact: version 0.0.1                                      
*   crucible_pantry   ad6a3a03-8d0f-4504-99a4-cbf73d69b973   - install dataset           in service    fd00:1122:3344:102::7
     └─                                                      + artifact: version 0.0.1                                      
*   external_dns      6c3ae381-04f7-41ea-b0ac-74db387dbc3a   - install dataset           in service    fd00:1122:3344:102::6
     └─                                                      + artifact: version 0.0.1                                      
*   internal_dns      99e2f30b-3174-40bf-a78a-90da8abba8ca   - install dataset           in service    fd00:1122:3344:1::1  
     └─                                                      + artifact: version 0.0.1                                      
*   internal_ntp      62620961-fc4a-481e-968b-f5acbac0dc63   - install dataset           in service    fd00:1122:3344:102::3
     └─                                                      + artifact: version 0.0.1                                      
*   nexus             466a9f29-62bf-4e63-924a-b9efdb86afec   - install dataset           in service    fd00:1122:3344:102::4
     └─                                                      + artifact: version 0.0.1                                      


  sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 (active, config generation 2 -> 3):

    measurements:
    ------------------------------------------------------------------------------------
    hash                                                               version          
    ------------------------------------------------------------------------------------
-   unknown                                                            (unknown version)
+   b0db8f64463a377a302082c5752056ee191adf904daa625d38a2094059f55248   version 0.0.1    
+   dbea4039b6ed82dbdd8d794d398a5c647ffa6991bd7d063702c2acbc7a0b90c7   version 0.0.1    


    host phase 2 contents:
    ------------------------
    slot   boot image source
    ------------------------
    A      current contents 
    B      current contents 


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-073979dd-3248-44a5-9fa1-cc72a140d682   in service 
    fake-vendor   fake-model   serial-c6d33b64-fb96-4129-bab1-7878a06a5f9b   in service 
    fake-vendor   fake-model   serial-e4d937e1-6ddc-4eca-bb08-c1f73791e608   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crucible                                                              335e1dc3-b610-48dd-90bb-9ca5cce1a6d0   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crucible                                                              d5fef28b-4ee8-4443-8c06-7e872c2502f3   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crucible                                                              6477f019-088c-43cf-8508-aa93f868830f   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    02c56a30-7d97-406d-bd34-1eb437fd517d   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    4d7e3e8e-06bd-414c-a468-779e056a9b75   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone                                                            4617d206-4330-4dfa-b9f3-f63a3db834f9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone                                                            4f60b534-eaa3-40a1-b60f-bfdf147af478   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone                                                            ad41be71-6c15-4428-b510-20ceacde4fa6   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone/oxz_crucible_058fd5f9-60a8-4e11-9302-15172782e17d          55a2a61a-1471-49b2-a6d0-b191ed94e057   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_5199c033-4cf9-4ab6-8ae7-566bd7606363          90b46084-4238-45ba-9e26-d3f2623e640e   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_crucible_dfac80b4-a887-430a-ae87-a4e065dba787          bcdc7bf3-bbae-4e7f-81b2-4d94c8f752a4   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_ba4994a8-23f9-4b1a-a84f-a08d74591389   50b029e3-96aa-41e5-bf39-023193a4355e   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_803bfb63-c246-41db-b0da-d3b87ddfc63d      ea8a11bf-a884-4c4f-8df0-3ef9b7aacf43   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_427ec88f-f467-42fa-9bbb-66a91a36103c      7b4ce6bf-95bb-42fe-a4a0-dff31211ab88   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_0c71b3b2-6ceb-4e8f-b020-b08675e83038             832fd140-d467-4bad-b5e9-63171634087c   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_6444f8a5-6465-4f0b-a549-1993c113569c               42430c80-7836-4191-a4f6-bcee749010fe   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/debug                                                           248c6c10-1ac6-45de-bb55-ede36ca56bbd   in service    100 GiB   none          gzip-9     
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/debug                                                           686c19cf-a0d7-45f6-866f-c564612b2664   in service    100 GiB   none          gzip-9     
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/debug                                                           1bca7f71-5e42-4749-91ec-fa40793a3a9a   in service    100 GiB   none          gzip-9     
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/local_storage                                                   cdf3684f-a6cf-4449-b9ec-e696b2c663e2   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/local_storage                                                   3ac089c9-9dec-465b-863a-188e80d71fb4   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/local_storage                                                   43931274-7fe8-4077-825d-dff2bc8efa58   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/local_storage_unencrypted                                             793ac181-1b01-403c-850d-7f5c54bda6c9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/local_storage_unencrypted                                             a4c3032e-21fa-4d4a-b040-a7e3c572cf3c   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/local_storage_unencrypted                                             4847a96e-a267-4ae7-aa3d-805c1e77f81e   in service    none      none          off        


    omicron zones:
    ------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source                disposition   underlay IP          
    ------------------------------------------------------------------------------------------------------------------------
*   crucible          058fd5f9-60a8-4e11-9302-15172782e17d   - install dataset           in service    fd00:1122:3344:101::9
     └─                                                      + artifact: version 0.0.1                                      
*   crucible          5199c033-4cf9-4ab6-8ae7-566bd7606363   - install dataset           in service    fd00:1122:3344:101::7
     └─                                                      + artifact: version 0.0.1                                      
*   crucible          dfac80b4-a887-430a-ae87-a4e065dba787   - install dataset           in service    fd00:1122:3344:101::8
     └─                                                      + artifact: version 0.0.1                                      
*   crucible_pantry   ba4994a8-23f9-4b1a-a84f-a08d74591389   - install dataset           in service    fd00:1122:3344:101::6
     └─                                                      + artifact: version 0.0.1                                      
*   external_dns      803bfb63-c246-41db-b0da-d3b87ddfc63d   - install dataset           in service    fd00:1122:3344:101::5
     └─                                                      + artifact: version 0.0.1                                      
*   internal_dns      427ec88f-f467-42fa-9bbb-66a91a36103c   - install dataset           in service    fd00:1122:3344:2::1  
     └─                                                      + artifact: version 0.0.1                                      
*   internal_ntp      6444f8a5-6465-4f0b-a549-1993c113569c   - install dataset           in service    fd00:1122:3344:101::3
     └─                                                      + artifact: version 0.0.1                                      
*   nexus             0c71b3b2-6ceb-4e8f-b020-b08675e83038   - install dataset           in service    fd00:1122:3344:101::4
     └─                                                      + artifact: version 0.0.1                                      


  sled d81c6a84-79b8-4958-ae41-ea46c9b19763 (active, config generation 2 -> 3):

    measurements:
    ------------------------------------------------------------------------------------
    hash                                                               version          
    ------------------------------------------------------------------------------------
-   unknown                                                            (unknown version)
+   b0db8f64463a377a302082c5752056ee191adf904daa625d38a2094059f55248   version 0.0.1    
+   dbea4039b6ed82dbdd8d794d398a5c647ffa6991bd7d063702c2acbc7a0b90c7   version 0.0.1    


    host phase 2 contents:
    ------------------------
    slot   boot image source
    ------------------------
    A      current contents 
    B      current contents 


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-18b20749-0748-4105-bb10-7b13cfc776e2   in service 
    fake-vendor   fake-model   serial-30c16fe4-4229-49d0-ab01-3138f2c7dff2   in service 
    fake-vendor   fake-model   serial-4930954e-9ac7-4453-b63f-5ab97c389a99   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crucible                                                              ba9311dd-89ac-47db-a5e8-d64e8a5fcf70   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crucible                                                              3c2cb304-a466-4ab5-8597-5db8172e2388   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crucible                                                              41107868-c6cc-4ec4-9159-aed688c3ceaf   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/external_dns                                                    429da94b-19f7-48bd-98e9-47842863ba7b   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    3443a368-199e-4d26-b59f-3f2bbd507761   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone                                                            45cd9687-20be-4247-b62a-dfdacf324929   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone                                                            252ac39f-b9e2-4697-8c07-3a833115d704   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone                                                            1cb0a47a-59ac-4892-8e92-cf87b4290f96   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone/oxz_crucible_694bd14f-cb24-4be4-bb19-876e79cda2c8          543fc3b8-08eb-4e5e-9e05-cf7a91732d5d   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone/oxz_crucible_7c252b64-c5af-4ec1-989e-9a03f3b0f111          3d9537b8-05be-4b1b-a051-f47becf8ec75   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_f55647d4-5500-4ad3-893a-df45bd50d622          c895e8d5-1434-4ecf-8d46-9bf1ecc8cbc9   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_75b220ba-a0f4-4872-8202-dc7c87f062d0   a50cd13a-5749-4e79-bb8b-19229500a8b3   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_external_dns_f6ec9c67-946a-4da3-98d5-581f72ce8bf0      6f04dd20-5e2c-4fa8-8430-a886470ed140   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_ea5b4030-b52f-44b2-8d70-45f15f987d01      7ea73f80-c4e0-450a-92dc-8397ce2af14f   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_nexus_3eeb8d49-eb1a-43f8-bb64-c2338421c2c6             50ea8c15-c4c0-4403-a490-d14b3405dfc2   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f10a4fb9-759f-4a65-b25e-5794ad2d07d8               54bbadaf-ec04-41a2-a62f-f5ac5bf321be   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/debug                                                           7a6a2058-ea78-49de-9730-cce5e28b4cfb   in service    100 GiB   none          gzip-9     
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/debug                                                           21fd4f3a-ec31-469b-87b1-087c343a2422   in service    100 GiB   none          gzip-9     
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/debug                                                           b1deff4b-51df-4a37-9043-afbd7c70a1cb   in service    100 GiB   none          gzip-9     
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/local_storage                                                   41071985-1dfd-4ce5-8bc2-897161a8bce4   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/local_storage                                                   c65a9c1c-36dc-4ddb-8aac-ec3be8dbb209   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/local_storage                                                   090bd88d-0a43-4040-a832-b13ae721f74f   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/local_storage_unencrypted                                             e009d8b8-4695-4322-b53f-f03f2744aef7   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/local_storage_unencrypted                                             4da74a5b-6911-4cca-b624-b90c65530117   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/local_storage_unencrypted                                             96ae8389-3027-4260-9374-e0f6ce851de2   in service    none      none          off        


    omicron zones:
    ------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source                disposition   underlay IP          
    ------------------------------------------------------------------------------------------------------------------------
*   crucible          694bd14f-cb24-4be4-bb19-876e79cda2c8   - install dataset           in service    fd00:1122:3344:103::8
     └─                                                      + artifact: version 0.0.1                                      
*   crucible          7c252b64-c5af-4ec1-989e-9a03f3b0f111   - install dataset           in service    fd00:1122:3344:103::9
     └─                                                      + artifact: version 0.0.1                                      
*   crucible          f55647d4-5500-4ad3-893a-df45bd50d622   - install dataset           in service    fd00:1122:3344:103::7
     └─                                                      + artifact: version 0.0.1                                      
*   crucible_pantry   75b220ba-a0f4-4872-8202-dc7c87f062d0   - install dataset           in service    fd00:1122:3344:103::6
     └─                                                      + artifact: version 0.0.1                                      
*   external_dns      f6ec9c67-946a-4da3-98d5-581f72ce8bf0   - install dataset           in service    fd00:1122:3344:103::5
     └─                                                      + artifact: version 0.0.1                                      
*   internal_dns      ea5b4030-b52f-44b2-8d70-45f15f987d01   - install dataset           in service    fd00:1122:3344:3::1  
     └─                                                      + artifact: version 0.0.1                                      
*   internal_ntp      f10a4fb9-759f-4a65-b25e-5794ad2d07d8   - install dataset           in service    fd00:1122:3344:103::3
     └─                                                      + artifact: version 0.0.1                                      
*   nexus             3eeb8d49-eb1a-43f8-bb64-c2338421c2c6   - install dataset           in service    fd00:1122:3344:103::4
     └─                                                      + artifact: version 0.0.1                                      


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)



> # The above blueprint includes a pending MGS update, which we should delete
> # (we want to start from a fresh state).
> blueprint-edit latest delete-sp-update serial0
blueprint 58d5e830-0884-47d8-a7cd-b2b3751adeb4 created from latest blueprint (8da82a8e-bf97-4fbd-8ddd-9f6462732cf1): deleted configured update for serial serial0

> # Also set the Omicron config for all sleds to reflect the
> # corresponding image sources.
> sled-set serial0 omicron-config latest
set sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron config from latest blueprint (58d5e830-0884-47d8-a7cd-b2b3751adeb4)

> sled-set serial1 omicron-config latest
set sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron config from latest blueprint (58d5e830-0884-47d8-a7cd-b2b3751adeb4)

> sled-set serial2 omicron-config latest
set sled d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron config from latest blueprint (58d5e830-0884-47d8-a7cd-b2b3751adeb4)

> # Generate inventory once more to reflect the omicron config changes.
> inventory-generate
generated inventory collection 61f451b3-2121-4ed6-91c7-a550054f6c21 from configured sleds

> inventory-show latest
collection: 61f451b3-2121-4ed6-91c7-a550054f6c21
collector:  example
started:    <REDACTED_TIMESTAMP>
done:       <REDACTED_TIMESTAMP>
errors:     0

Sled serial0
    part number: 913-0000019
    power:    A2
    revision: 0
    MGS slot: Sled 0
    found at: <REDACTED_TIMESTAMP> from fake MGS 1
    host phase 1 active slot: A
    host phase 1 hashes:
        SLOT HASH                                                             
        A    0101010101010101010101010101010101010101010101010101010101010101 
        B    0202020202020202020202020202020202020202020202020202020202020202 
    cabooses:
        SLOT     BOARD       NAME        VERSION GIT_COMMIT SIGN                                                             
        SpSlot0  SimGimletSp SimGimletSp 0.0.1   unknown    n/a                                                              
        RotSlotA SimRot      SimRot      0.0.2   unknown    0000000000000000000000000000000000000000000000000000000000000000 
        Stage0   SimRot      SimRot      0.0.1   unknown    0000000000000000000000000000000000000000000000000000000000000000 
    RoT pages:
        SLOT DATA_BASE64 
    RoT: active slot: slot A
    RoT: persistent boot preference: slot A
    RoT: pending persistent boot preference: -
    RoT: transient boot preference: -
    RoT: slot A SHA3-256: slotAdigest1
    RoT: slot B SHA3-256: slotBdigest1

Sled serial1
    part number: 913-0000019
    power:    A2
    revision: 0
    MGS slot: Sled 1
    found at: <REDACTED_TIMESTAMP> from fake MGS 1
    host phase 1 active slot: A
    host phase 1 hashes:
        SLOT HASH                                                             
        A    0101010101010101010101010101010101010101010101010101010101010101 
        B    0202020202020202020202020202020202020202020202020202020202020202 
    cabooses:
        SLOT     BOARD       NAME        VERSION GIT_COMMIT SIGN                                                             
        SpSlot0  SimGimletSp SimGimletSp 0.0.1   unknown    n/a                                                              
        RotSlotA SimRot      SimRot      0.0.2   unknown    0000000000000000000000000000000000000000000000000000000000000000 
        Stage0   SimRot      SimRot      0.0.1   unknown    0000000000000000000000000000000000000000000000000000000000000000 
    RoT pages:
        SLOT DATA_BASE64 
    RoT: active slot: slot A
    RoT: persistent boot preference: slot A
    RoT: pending persistent boot preference: -
    RoT: transient boot preference: -
    RoT: slot A SHA3-256: slotAdigest1
    RoT: slot B SHA3-256: slotBdigest1

Sled serial2
    part number: 913-0000019
    power:    A2
    revision: 0
    MGS slot: Sled 2
    found at: <REDACTED_TIMESTAMP> from fake MGS 1
    host phase 1 active slot: A
    host phase 1 hashes:
        SLOT HASH                                                             
        A    0101010101010101010101010101010101010101010101010101010101010101 
        B    0202020202020202020202020202020202020202020202020202020202020202 
    cabooses:
        SLOT     BOARD       NAME        VERSION GIT_COMMIT SIGN                                                             
        SpSlot0  SimGimletSp SimGimletSp 0.0.1   unknown    n/a                                                              
        RotSlotA SimRot      SimRot      0.0.2   unknown    0000000000000000000000000000000000000000000000000000000000000000 
        Stage0   SimRot      SimRot      0.0.1   unknown    0000000000000000000000000000000000000000000000000000000000000000 
    RoT pages:
        SLOT DATA_BASE64 
    RoT: active slot: slot A
    RoT: persistent boot preference: slot A
    RoT: pending persistent boot preference: -
    RoT: transient boot preference: -
    RoT: slot A SHA3-256: slotAdigest1
    RoT: slot B SHA3-256: slotBdigest1

SLED AGENTS

sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c (role = Gimlet, serial serial1)
    found at:    <REDACTED_TIMESTAMP> from fake sled agent
    address:     [fd00:1122:3344:102::1]:12345
    usable hw threads:   10
    CPU family:          amd_milan
    usable memory (GiB): 0
    reservoir (GiB):     0
    physical disks:
      U2: DiskIdentity { vendor: "fake-vendor", model: "fake-model", serial: "serial-727522a7-934f-494d-b5b3-160968e74463" } in 0
      U2: DiskIdentity { vendor: "fake-vendor", model: "fake-model", serial: "serial-72c59873-31ff-4e36-8d76-ff834009349a" } in 1
      U2: DiskIdentity { vendor: "fake-vendor", model: "fake-model", serial: "serial-b5fd5bc1-099e-4e77-8028-a9793c11f43b" } in 2
    zpools
      727522a7-934f-494d-b5b3-160968e74463: total size: 100 GiB health: online
      72c59873-31ff-4e36-8d76-ff834009349a: total size: 100 GiB health: online
      b5fd5bc1-099e-4e77-8028-a9793c11f43b: total size: 100 GiB health: online
    datasets:
      oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone/oxz_crucible_e2fdefe7-95b2-4fd2-ae37-56929a06d58c - id: 0582030b-aab6-4d0e-b1d2-64562ee712cd, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/local_storage - id: 09b9cc9b-3426-470b-a7bc-538f82dede03, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_ad6a3a03-8d0f-4504-99a4-cbf73d69b973 - id: 1640adb6-70bf-44cf-b05c-bff6dd300cf3, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/local_storage_unencrypted - id: 2ad1875a-92ac-472f-8c26-593309f0e4da, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/local_storage - id: 2db6b7c1-0f46-4ced-a3ad-48872793360e, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_99e2f30b-3174-40bf-a78a-90da8abba8ca - id: 2f204c50-a327-479c-8852-f53ec7a19c1f, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/debug - id: 318fae85-abcb-4259-b1b6-ac96d193f7b7, compression: gzip-9
        available: 1 GiB, used: 0 B
        reservation: None, quota: Some(ByteCount(107374182400))
      oxp_72c59873-31ff-4e36-8d76-ff834009349a/local_storage_unencrypted - id: 3560dd69-3b23-4c69-807d-d673104cfc68, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone - id: 3b66453b-7148-4c1b-84a9-499e43290ab4, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns - id: 3e0d6188-c503-49cf-a441-fa7df40ceb43, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone - id: 4829f422-aa31-41a8-ab73-95684ff1ef48, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_clickhouse_353b3b65-20f7-48c3-88f7-495bd5d31545 - id: 49f8fbb6-5bac-4609-907f-6e3dfc206059, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crucible - id: 4b0b09bf-94b7-45bf-a6b3-d46af53ae44a, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/clickhouse - id: 5ae11c7e-08fa-4d78-a4ea-14b4a9a10241, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone/oxz_crucible_86a22a56-0168-453d-9df1-cb2a7c64b5d3 - id: 6e218d0a-13fd-4f70-884e-47e960fa8bb8, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_727522a7-934f-494d-b5b3-160968e74463/local_storage_unencrypted - id: 775f9207-c42d-4af2-9186-27ffef67735e, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_6c3ae381-04f7-41ea-b0ac-74db387dbc3a - id: 78f34ce7-42f1-41da-995f-318f32054ad2, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone - id: 841d5648-05f0-47b0-b446-92f6b60fe9a6, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_62620961-fc4a-481e-968b-f5acbac0dc63 - id: 8c4fa711-1d5d-4e93-85f0-d17bff47b063, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_nexus_466a9f29-62bf-4e63-924a-b9efdb86afec - id: 8e0bd2bd-23b7-4bc6-9e73-c4d4ebc0bc8c, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_bd354eef-d8a6-4165-9124-283fb5e46d77 - id: 9073fb6b-f973-4bbd-b7cc-ba1abf6cb238, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/debug - id: 93957ca0-9ed1-4e7b-8c34-2ce07a69541c, compression: gzip-9
        available: 1 GiB, used: 0 B
        reservation: None, quota: Some(ByteCount(107374182400))
      oxp_72c59873-31ff-4e36-8d76-ff834009349a/crucible - id: 956966b9-8201-437b-81ba-3c8ad2032080, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/debug - id: b46de15d-33e7-4cd0-aa7c-e7be2a61e71b, compression: gzip-9
        available: 1 GiB, used: 0 B
        reservation: None, quota: Some(ByteCount(107374182400))
      oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns - id: b8f2a09f-8bd2-4418-872b-a4457a3f958c, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/local_storage - id: c31623de-c19b-4615-9f1d-5e1daa5d3bda, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_727522a7-934f-494d-b5b3-160968e74463/crucible - id: feecfda1-9966-43d4-aaef-440b77f0b26d, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None

LEDGERED SLED CONFIG
    generation: 3
    remove_mupdate_override: None
    desired host phase 2 slot a: keep current contents
    desired host phase 2 slot b: keep current contents
    DISKS: 3
        ID                                       ZPOOL_ID                                 VENDOR          MODEL          SERIAL                                      
        141ce987-3dd1-4650-8af2-6b3ace85de1e     b5fd5bc1-099e-4e77-8028-a9793c11f43b     fake-vendor     fake-model     serial-b5fd5bc1-099e-4e77-8028-a9793c11f43b 
        15778f9b-fe94-4aed-86c1-e88d7f4c3b47     727522a7-934f-494d-b5b3-160968e74463     fake-vendor     fake-model     serial-727522a7-934f-494d-b5b3-160968e74463 
        f26df0e3-46bb-4c85-8146-efcab46179da     72c59873-31ff-4e36-8d76-ff834009349a     fake-vendor     fake-model     serial-72c59873-31ff-4e36-8d76-ff834009349a 
    DATASETS: 27
        ID                                       NAME                                                                                                             COMPRESSION     QUOTA       RESERVATION 
        0582030b-aab6-4d0e-b1d2-64562ee712cd     oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone/oxz_crucible_e2fdefe7-95b2-4fd2-ae37-56929a06d58c            off             none        none        
        09b9cc9b-3426-470b-a7bc-538f82dede03     oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/local_storage                                                     off             none        none        
        1640adb6-70bf-44cf-b05c-bff6dd300cf3     oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_ad6a3a03-8d0f-4504-99a4-cbf73d69b973     off             none        none        
        2ad1875a-92ac-472f-8c26-593309f0e4da     oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/local_storage_unencrypted                                               off             none        none        
        2db6b7c1-0f46-4ced-a3ad-48872793360e     oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/local_storage                                                     off             none        none        
        2f204c50-a327-479c-8852-f53ec7a19c1f     oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_99e2f30b-3174-40bf-a78a-90da8abba8ca        off             none        none        
        318fae85-abcb-4259-b1b6-ac96d193f7b7     oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/debug                                                             gzip-9          100 GiB     none        
        3560dd69-3b23-4c69-807d-d673104cfc68     oxp_72c59873-31ff-4e36-8d76-ff834009349a/local_storage_unencrypted                                               off             none        none        
        3b66453b-7148-4c1b-84a9-499e43290ab4     oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone                                                              off             none        none        
        3e0d6188-c503-49cf-a441-fa7df40ceb43     oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                      off             none        none        
        4829f422-aa31-41a8-ab73-95684ff1ef48     oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone                                                              off             none        none        
        49f8fbb6-5bac-4609-907f-6e3dfc206059     oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_clickhouse_353b3b65-20f7-48c3-88f7-495bd5d31545          off             none        none        
        4b0b09bf-94b7-45bf-a6b3-d46af53ae44a     oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crucible                                                                off             none        none        
        5ae11c7e-08fa-4d78-a4ea-14b4a9a10241     oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/clickhouse                                                        off             none        none        
        6e218d0a-13fd-4f70-884e-47e960fa8bb8     oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone/oxz_crucible_86a22a56-0168-453d-9df1-cb2a7c64b5d3            off             none        none        
        775f9207-c42d-4af2-9186-27ffef67735e     oxp_727522a7-934f-494d-b5b3-160968e74463/local_storage_unencrypted                                               off             none        none        
        78f34ce7-42f1-41da-995f-318f32054ad2     oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_6c3ae381-04f7-41ea-b0ac-74db387dbc3a        off             none        none        
        841d5648-05f0-47b0-b446-92f6b60fe9a6     oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone                                                              off             none        none        
        8c4fa711-1d5d-4e93-85f0-d17bff47b063     oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_62620961-fc4a-481e-968b-f5acbac0dc63                 off             none        none        
        8e0bd2bd-23b7-4bc6-9e73-c4d4ebc0bc8c     oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_nexus_466a9f29-62bf-4e63-924a-b9efdb86afec               off             none        none        
        9073fb6b-f973-4bbd-b7cc-ba1abf6cb238     oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_bd354eef-d8a6-4165-9124-283fb5e46d77            off             none        none        
        93957ca0-9ed1-4e7b-8c34-2ce07a69541c     oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/debug                                                             gzip-9          100 GiB     none        
        956966b9-8201-437b-81ba-3c8ad2032080     oxp_72c59873-31ff-4e36-8d76-ff834009349a/crucible                                                                off             none        none        
        b46de15d-33e7-4cd0-aa7c-e7be2a61e71b     oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/debug                                                             gzip-9          100 GiB     none        
        b8f2a09f-8bd2-4418-872b-a4457a3f958c     oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                      off             none        none        
        c31623de-c19b-4615-9f1d-5e1daa5d3bda     oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/local_storage                                                     off             none        none        
        feecfda1-9966-43d4-aaef-440b77f0b26d     oxp_727522a7-934f-494d-b5b3-160968e74463/crucible                                                                off             none        none        
    ZONES: 9
        ID                                       KIND                IMAGE_SOURCE                                                               
        353b3b65-20f7-48c3-88f7-495bd5d31545     clickhouse          artifact: bf1644cb268752c8369377f9300c398bcb3dd822c5234b465461166944a745df 
        466a9f29-62bf-4e63-924a-b9efdb86afec     nexus               artifact: c562f60324e6c312445d89aae05bdefc3b70ab5145277c0fafd27e6bd95a5110 
        62620961-fc4a-481e-968b-f5acbac0dc63     internal_ntp        artifact: dcb132105ebbe9bb80c711f12a06acc3377426d317d00b725ef045a33e8a6e8e 
        6c3ae381-04f7-41ea-b0ac-74db387dbc3a     external_dns        artifact: affc53c414c4eddc35fe049e9368774c5ae7a35d5c531107b4f0370b7e4daaae 
        86a22a56-0168-453d-9df1-cb2a7c64b5d3     crucible            artifact: 3303ca32f7f4ee36461654b8928ee50341208e6d5269357859034c3ebd938c2d 
        99e2f30b-3174-40bf-a78a-90da8abba8ca     internal_dns        artifact: c114fd7044f42f82e51d97a56cb9d492941292e1922d01160ed9d53229b8111d 
        ad6a3a03-8d0f-4504-99a4-cbf73d69b973     crucible_pantry     artifact: 3446b183b3e1343803ed392fcb4de00e8bbf4d4c2569b24bf40240f0bca92db8 
        bd354eef-d8a6-4165-9124-283fb5e46d77     crucible            artifact: 3303ca32f7f4ee36461654b8928ee50341208e6d5269357859034c3ebd938c2d 
        e2fdefe7-95b2-4fd2-ae37-56929a06d58c     crucible            artifact: 3303ca32f7f4ee36461654b8928ee50341208e6d5269357859034c3ebd938c2d 
    MEASUREMENTS: 2
      HASH                                                                      
      artifact b0db8f64463a377a302082c5752056ee191adf904daa625d38a2094059f55248 
      artifact dbea4039b6ed82dbdd8d794d398a5c647ffa6991bd7d063702c2acbc7a0b90c7 
    zone image resolver status:
        zone manifest:
            path on boot disk: /fake/path/install/zones.json
            boot disk inventory:
                manifest generated by sled-agent
                artifacts in install dataset:
                  - clickhouse.tar.gz (expected 143 bytes with hash bf1644cb268752c8369377f9300c398bcb3dd822c5234b465461166944a745df): ok
                  - clickhouse_keeper.tar.gz (expected 147 bytes with hash 4d7d1b049e3ad61351824c040f3c50708e3d3c89b7892fd25b9e12e151d56dea): ok
                  - clickhouse_server.tar.gz (expected 146 bytes with hash 3140c5e79f3bed0b0034e6dfa4e8423fd2fa9d567291c9b1b703aaf769b10756): ok
                  - cockroachdb.tar.gz (expected 144 bytes with hash 541bb4d38385c684f2629b970e23442fc567761917ab7b6e35410c0e2070ea54): ok
                  - crucible.tar.gz (expected 144 bytes with hash 3303ca32f7f4ee36461654b8928ee50341208e6d5269357859034c3ebd938c2d): ok
                  - crucible_pantry.tar.gz (expected 150 bytes with hash 3446b183b3e1343803ed392fcb4de00e8bbf4d4c2569b24bf40240f0bca92db8): ok
                  - external_dns.tar.gz (expected 142 bytes with hash affc53c414c4eddc35fe049e9368774c5ae7a35d5c531107b4f0370b7e4daaae): ok
                  - internal_dns.tar.gz (expected 142 bytes with hash c114fd7044f42f82e51d97a56cb9d492941292e1922d01160ed9d53229b8111d): ok
                  - nexus.tar.gz (expected 136 bytes with hash c562f60324e6c312445d89aae05bdefc3b70ab5145277c0fafd27e6bd95a5110): ok
                  - ntp.tar.gz (expected 135 bytes with hash dcb132105ebbe9bb80c711f12a06acc3377426d317d00b725ef045a33e8a6e8e): ok
                  - oximeter.tar.gz (expected 138 bytes with hash d704d9f63e858b53b480cee4eb16985a9fcb65018ae05819fd4fd5532122382e): ok
            no non-boot disks
        measurement manifest:
            path on boot disk: /fake/path/install/zones.json
            boot disk inventory:
                manifest generated by sled-agent
                artifacts in install dataset:
                  - b0db8f64463a377a302082c5752056ee191adf904daa625d38a2094059f55248 (expected 865 bytes with hash b0db8f64463a377a302082c5752056ee191adf904daa625d38a2094059f55248): ok
                  - dbea4039b6ed82dbdd8d794d398a5c647ffa6991bd7d063702c2acbc7a0b90c7 (expected 270 bytes with hash dbea4039b6ed82dbdd8d794d398a5c647ffa6991bd7d063702c2acbc7a0b90c7): ok
            no non-boot disks
        mupdate override:
            path on boot disk: /fake/path/install/mupdate_override.json
            no override on boot disk
            no non-boot disks
    boot disk slot: A
    slot A details:
        artifact: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a (1000 bytes)
        image name: fake from debug_assume_success()
        phase 2 hash: 0000000000000000000000000000000000000000000000000000000000000000
    slot B details:
        artifact: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b (1000 bytes)
        image name: fake from debug_assume_success()
        phase 2 hash: 0101010101010101010101010101010101010101010101010101010101010101
    last reconciled config: matches ledgered config
        no mupdate override to clear
        no orphaned datasets
        all disks reconciled successfully
        all datasets reconciled successfully
        all zones reconciled successfully
    reconciler task status: idle (finished at <REDACTED_TIMESTAMP> after running for <REDACTED_DURATION>s)
    reference measurements:
        (measurement set is empty)
    fmd:
        no faults reported

SMF SERVICES STATUS
    no data on SMF services has been collected

sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 (role = Gimlet, serial serial0)
    found at:    <REDACTED_TIMESTAMP> from fake sled agent
    address:     [fd00:1122:3344:101::1]:12345
    usable hw threads:   10
    CPU family:          amd_milan
    usable memory (GiB): 0
    reservoir (GiB):     0
    physical disks:
      U2: DiskIdentity { vendor: "fake-vendor", model: "fake-model", serial: "serial-073979dd-3248-44a5-9fa1-cc72a140d682" } in 0
      U2: DiskIdentity { vendor: "fake-vendor", model: "fake-model", serial: "serial-c6d33b64-fb96-4129-bab1-7878a06a5f9b" } in 1
      U2: DiskIdentity { vendor: "fake-vendor", model: "fake-model", serial: "serial-e4d937e1-6ddc-4eca-bb08-c1f73791e608" } in 2
    zpools
      073979dd-3248-44a5-9fa1-cc72a140d682: total size: 100 GiB health: online
      c6d33b64-fb96-4129-bab1-7878a06a5f9b: total size: 100 GiB health: online
      e4d937e1-6ddc-4eca-bb08-c1f73791e608: total size: 100 GiB health: online
    datasets:
      oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns - id: 02c56a30-7d97-406d-bd34-1eb437fd517d, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/debug - id: 1bca7f71-5e42-4749-91ec-fa40793a3a9a, compression: gzip-9
        available: 1 GiB, used: 0 B
        reservation: None, quota: Some(ByteCount(107374182400))
      oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/debug - id: 248c6c10-1ac6-45de-bb55-ede36ca56bbd, compression: gzip-9
        available: 1 GiB, used: 0 B
        reservation: None, quota: Some(ByteCount(107374182400))
      oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crucible - id: 335e1dc3-b610-48dd-90bb-9ca5cce1a6d0, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/local_storage - id: 3ac089c9-9dec-465b-863a-188e80d71fb4, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_6444f8a5-6465-4f0b-a549-1993c113569c - id: 42430c80-7836-4191-a4f6-bcee749010fe, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/local_storage - id: 43931274-7fe8-4077-825d-dff2bc8efa58, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone - id: 4617d206-4330-4dfa-b9f3-f63a3db834f9, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/local_storage_unencrypted - id: 4847a96e-a267-4ae7-aa3d-805c1e77f81e, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns - id: 4d7e3e8e-06bd-414c-a468-779e056a9b75, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone - id: 4f60b534-eaa3-40a1-b60f-bfdf147af478, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_ba4994a8-23f9-4b1a-a84f-a08d74591389 - id: 50b029e3-96aa-41e5-bf39-023193a4355e, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone/oxz_crucible_058fd5f9-60a8-4e11-9302-15172782e17d - id: 55a2a61a-1471-49b2-a6d0-b191ed94e057, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crucible - id: 6477f019-088c-43cf-8508-aa93f868830f, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/debug - id: 686c19cf-a0d7-45f6-866f-c564612b2664, compression: gzip-9
        available: 1 GiB, used: 0 B
        reservation: None, quota: Some(ByteCount(107374182400))
      oxp_073979dd-3248-44a5-9fa1-cc72a140d682/local_storage_unencrypted - id: 793ac181-1b01-403c-850d-7f5c54bda6c9, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_427ec88f-f467-42fa-9bbb-66a91a36103c - id: 7b4ce6bf-95bb-42fe-a4a0-dff31211ab88, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_0c71b3b2-6ceb-4e8f-b020-b08675e83038 - id: 832fd140-d467-4bad-b5e9-63171634087c, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_5199c033-4cf9-4ab6-8ae7-566bd7606363 - id: 90b46084-4238-45ba-9e26-d3f2623e640e, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/local_storage_unencrypted - id: a4c3032e-21fa-4d4a-b040-a7e3c572cf3c, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone - id: ad41be71-6c15-4428-b510-20ceacde4fa6, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_crucible_dfac80b4-a887-430a-ae87-a4e065dba787 - id: bcdc7bf3-bbae-4e7f-81b2-4d94c8f752a4, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/local_storage - id: cdf3684f-a6cf-4449-b9ec-e696b2c663e2, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crucible - id: d5fef28b-4ee8-4443-8c06-7e872c2502f3, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_803bfb63-c246-41db-b0da-d3b87ddfc63d - id: ea8a11bf-a884-4c4f-8df0-3ef9b7aacf43, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None

LEDGERED SLED CONFIG
    generation: 3
    remove_mupdate_override: None
    desired host phase 2 slot a: keep current contents
    desired host phase 2 slot b: keep current contents
    DISKS: 3
        ID                                       ZPOOL_ID                                 VENDOR          MODEL          SERIAL                                      
        099f869a-0f0d-430b-9c49-a7fb7fcaf3b2     e4d937e1-6ddc-4eca-bb08-c1f73791e608     fake-vendor     fake-model     serial-e4d937e1-6ddc-4eca-bb08-c1f73791e608 
        3f399219-7701-414c-9f07-8e97f688765c     c6d33b64-fb96-4129-bab1-7878a06a5f9b     fake-vendor     fake-model     serial-c6d33b64-fb96-4129-bab1-7878a06a5f9b 
        f06acce3-ce96-4761-a070-e5e2fb87d8aa     073979dd-3248-44a5-9fa1-cc72a140d682     fake-vendor     fake-model     serial-073979dd-3248-44a5-9fa1-cc72a140d682 
    DATASETS: 25
        ID                                       NAME                                                                                                             COMPRESSION     QUOTA       RESERVATION 
        02c56a30-7d97-406d-bd34-1eb437fd517d     oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                      off             none        none        
        1bca7f71-5e42-4749-91ec-fa40793a3a9a     oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/debug                                                             gzip-9          100 GiB     none        
        248c6c10-1ac6-45de-bb55-ede36ca56bbd     oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/debug                                                             gzip-9          100 GiB     none        
        335e1dc3-b610-48dd-90bb-9ca5cce1a6d0     oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crucible                                                                off             none        none        
        3ac089c9-9dec-465b-863a-188e80d71fb4     oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/local_storage                                                     off             none        none        
        42430c80-7836-4191-a4f6-bcee749010fe     oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_6444f8a5-6465-4f0b-a549-1993c113569c                 off             none        none        
        43931274-7fe8-4077-825d-dff2bc8efa58     oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/local_storage                                                     off             none        none        
        4617d206-4330-4dfa-b9f3-f63a3db834f9     oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone                                                              off             none        none        
        4847a96e-a267-4ae7-aa3d-805c1e77f81e     oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/local_storage_unencrypted                                               off             none        none        
        4d7e3e8e-06bd-414c-a468-779e056a9b75     oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                      off             none        none        
        4f60b534-eaa3-40a1-b60f-bfdf147af478     oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone                                                              off             none        none        
        50b029e3-96aa-41e5-bf39-023193a4355e     oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_ba4994a8-23f9-4b1a-a84f-a08d74591389     off             none        none        
        55a2a61a-1471-49b2-a6d0-b191ed94e057     oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone/oxz_crucible_058fd5f9-60a8-4e11-9302-15172782e17d            off             none        none        
        6477f019-088c-43cf-8508-aa93f868830f     oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crucible                                                                off             none        none        
        686c19cf-a0d7-45f6-866f-c564612b2664     oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/debug                                                             gzip-9          100 GiB     none        
        793ac181-1b01-403c-850d-7f5c54bda6c9     oxp_073979dd-3248-44a5-9fa1-cc72a140d682/local_storage_unencrypted                                               off             none        none        
        7b4ce6bf-95bb-42fe-a4a0-dff31211ab88     oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_427ec88f-f467-42fa-9bbb-66a91a36103c        off             none        none        
        832fd140-d467-4bad-b5e9-63171634087c     oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_0c71b3b2-6ceb-4e8f-b020-b08675e83038               off             none        none        
        90b46084-4238-45ba-9e26-d3f2623e640e     oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_5199c033-4cf9-4ab6-8ae7-566bd7606363            off             none        none        
        a4c3032e-21fa-4d4a-b040-a7e3c572cf3c     oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/local_storage_unencrypted                                               off             none        none        
        ad41be71-6c15-4428-b510-20ceacde4fa6     oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone                                                              off             none        none        
        bcdc7bf3-bbae-4e7f-81b2-4d94c8f752a4     oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_crucible_dfac80b4-a887-430a-ae87-a4e065dba787            off             none        none        
        cdf3684f-a6cf-4449-b9ec-e696b2c663e2     oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/local_storage                                                     off             none        none        
        d5fef28b-4ee8-4443-8c06-7e872c2502f3     oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crucible                                                                off             none        none        
        ea8a11bf-a884-4c4f-8df0-3ef9b7aacf43     oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_803bfb63-c246-41db-b0da-d3b87ddfc63d        off             none        none        
    ZONES: 8
        ID                                       KIND                IMAGE_SOURCE                                                               
        058fd5f9-60a8-4e11-9302-15172782e17d     crucible            artifact: 3303ca32f7f4ee36461654b8928ee50341208e6d5269357859034c3ebd938c2d 
        0c71b3b2-6ceb-4e8f-b020-b08675e83038     nexus               artifact: c562f60324e6c312445d89aae05bdefc3b70ab5145277c0fafd27e6bd95a5110 
        427ec88f-f467-42fa-9bbb-66a91a36103c     internal_dns        artifact: c114fd7044f42f82e51d97a56cb9d492941292e1922d01160ed9d53229b8111d 
        5199c033-4cf9-4ab6-8ae7-566bd7606363     crucible            artifact: 3303ca32f7f4ee36461654b8928ee50341208e6d5269357859034c3ebd938c2d 
        6444f8a5-6465-4f0b-a549-1993c113569c     internal_ntp        artifact: dcb132105ebbe9bb80c711f12a06acc3377426d317d00b725ef045a33e8a6e8e 
        803bfb63-c246-41db-b0da-d3b87ddfc63d     external_dns        artifact: affc53c414c4eddc35fe049e9368774c5ae7a35d5c531107b4f0370b7e4daaae 
        ba4994a8-23f9-4b1a-a84f-a08d74591389     crucible_pantry     artifact: 3446b183b3e1343803ed392fcb4de00e8bbf4d4c2569b24bf40240f0bca92db8 
        dfac80b4-a887-430a-ae87-a4e065dba787     crucible            artifact: 3303ca32f7f4ee36461654b8928ee50341208e6d5269357859034c3ebd938c2d 
    MEASUREMENTS: 2
      HASH                                                                      
      artifact b0db8f64463a377a302082c5752056ee191adf904daa625d38a2094059f55248 
      artifact dbea4039b6ed82dbdd8d794d398a5c647ffa6991bd7d063702c2acbc7a0b90c7 
    zone image resolver status:
        zone manifest:
            path on boot disk: /fake/path/install/zones.json
            boot disk inventory:
                manifest generated by sled-agent
                artifacts in install dataset:
                  - clickhouse.tar.gz (expected 143 bytes with hash bf1644cb268752c8369377f9300c398bcb3dd822c5234b465461166944a745df): ok
                  - clickhouse_keeper.tar.gz (expected 147 bytes with hash 4d7d1b049e3ad61351824c040f3c50708e3d3c89b7892fd25b9e12e151d56dea): ok
                  - clickhouse_server.tar.gz (expected 146 bytes with hash 3140c5e79f3bed0b0034e6dfa4e8423fd2fa9d567291c9b1b703aaf769b10756): ok
                  - cockroachdb.tar.gz (expected 144 bytes with hash 541bb4d38385c684f2629b970e23442fc567761917ab7b6e35410c0e2070ea54): ok
                  - crucible.tar.gz (expected 144 bytes with hash 3303ca32f7f4ee36461654b8928ee50341208e6d5269357859034c3ebd938c2d): ok
                  - crucible_pantry.tar.gz (expected 150 bytes with hash 3446b183b3e1343803ed392fcb4de00e8bbf4d4c2569b24bf40240f0bca92db8): ok
                  - external_dns.tar.gz (expected 142 bytes with hash affc53c414c4eddc35fe049e9368774c5ae7a35d5c531107b4f0370b7e4daaae): ok
                  - internal_dns.tar.gz (expected 142 bytes with hash c114fd7044f42f82e51d97a56cb9d492941292e1922d01160ed9d53229b8111d): ok
                  - nexus.tar.gz (expected 136 bytes with hash c562f60324e6c312445d89aae05bdefc3b70ab5145277c0fafd27e6bd95a5110): ok
                  - ntp.tar.gz (expected 135 bytes with hash dcb132105ebbe9bb80c711f12a06acc3377426d317d00b725ef045a33e8a6e8e): ok
                  - oximeter.tar.gz (expected 138 bytes with hash d704d9f63e858b53b480cee4eb16985a9fcb65018ae05819fd4fd5532122382e): ok
            no non-boot disks
        measurement manifest:
            path on boot disk: /fake/path/install/zones.json
            boot disk inventory:
                manifest generated by sled-agent
                artifacts in install dataset:
                  - b0db8f64463a377a302082c5752056ee191adf904daa625d38a2094059f55248 (expected 865 bytes with hash b0db8f64463a377a302082c5752056ee191adf904daa625d38a2094059f55248): ok
                  - dbea4039b6ed82dbdd8d794d398a5c647ffa6991bd7d063702c2acbc7a0b90c7 (expected 270 bytes with hash dbea4039b6ed82dbdd8d794d398a5c647ffa6991bd7d063702c2acbc7a0b90c7): ok
            no non-boot disks
        mupdate override:
            path on boot disk: /fake/path/install/mupdate_override.json
            no override on boot disk
            no non-boot disks
    boot disk slot: A
    slot A details:
        artifact: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a (1000 bytes)
        image name: fake from debug_assume_success()
        phase 2 hash: 0000000000000000000000000000000000000000000000000000000000000000
    slot B details:
        artifact: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b (1000 bytes)
        image name: fake from debug_assume_success()
        phase 2 hash: 0101010101010101010101010101010101010101010101010101010101010101
    last reconciled config: matches ledgered config
        no mupdate override to clear
        no orphaned datasets
        all disks reconciled successfully
        all datasets reconciled successfully
        all zones reconciled successfully
    reconciler task status: idle (finished at <REDACTED_TIMESTAMP> after running for <REDACTED_DURATION>s)
    reference measurements:
        (measurement set is empty)
    fmd:
        no faults reported

SMF SERVICES STATUS
    no data on SMF services has been collected

sled d81c6a84-79b8-4958-ae41-ea46c9b19763 (role = Gimlet, serial serial2)
    found at:    <REDACTED_TIMESTAMP> from fake sled agent
    address:     [fd00:1122:3344:103::1]:12345
    usable hw threads:   10
    CPU family:          amd_milan
    usable memory (GiB): 0
    reservoir (GiB):     0
    physical disks:
      U2: DiskIdentity { vendor: "fake-vendor", model: "fake-model", serial: "serial-18b20749-0748-4105-bb10-7b13cfc776e2" } in 0
      U2: DiskIdentity { vendor: "fake-vendor", model: "fake-model", serial: "serial-30c16fe4-4229-49d0-ab01-3138f2c7dff2" } in 1
      U2: DiskIdentity { vendor: "fake-vendor", model: "fake-model", serial: "serial-4930954e-9ac7-4453-b63f-5ab97c389a99" } in 2
    zpools
      18b20749-0748-4105-bb10-7b13cfc776e2: total size: 100 GiB health: online
      30c16fe4-4229-49d0-ab01-3138f2c7dff2: total size: 100 GiB health: online
      4930954e-9ac7-4453-b63f-5ab97c389a99: total size: 100 GiB health: online
    datasets:
      oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/local_storage - id: 090bd88d-0a43-4040-a832-b13ae721f74f, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone - id: 1cb0a47a-59ac-4892-8e92-cf87b4290f96, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/debug - id: 21fd4f3a-ec31-469b-87b1-087c343a2422, compression: gzip-9
        available: 1 GiB, used: 0 B
        reservation: None, quota: Some(ByteCount(107374182400))
      oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone - id: 252ac39f-b9e2-4697-8c07-3a833115d704, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns - id: 3443a368-199e-4d26-b59f-3f2bbd507761, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crucible - id: 3c2cb304-a466-4ab5-8597-5db8172e2388, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone/oxz_crucible_7c252b64-c5af-4ec1-989e-9a03f3b0f111 - id: 3d9537b8-05be-4b1b-a051-f47becf8ec75, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/local_storage - id: 41071985-1dfd-4ce5-8bc2-897161a8bce4, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crucible - id: 41107868-c6cc-4ec4-9159-aed688c3ceaf, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/external_dns - id: 429da94b-19f7-48bd-98e9-47842863ba7b, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone - id: 45cd9687-20be-4247-b62a-dfdacf324929, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/local_storage_unencrypted - id: 4da74a5b-6911-4cca-b624-b90c65530117, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_nexus_3eeb8d49-eb1a-43f8-bb64-c2338421c2c6 - id: 50ea8c15-c4c0-4403-a490-d14b3405dfc2, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone/oxz_crucible_694bd14f-cb24-4be4-bb19-876e79cda2c8 - id: 543fc3b8-08eb-4e5e-9e05-cf7a91732d5d, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f10a4fb9-759f-4a65-b25e-5794ad2d07d8 - id: 54bbadaf-ec04-41a2-a62f-f5ac5bf321be, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_external_dns_f6ec9c67-946a-4da3-98d5-581f72ce8bf0 - id: 6f04dd20-5e2c-4fa8-8430-a886470ed140, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/debug - id: 7a6a2058-ea78-49de-9730-cce5e28b4cfb, compression: gzip-9
        available: 1 GiB, used: 0 B
        reservation: None, quota: Some(ByteCount(107374182400))
      oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_ea5b4030-b52f-44b2-8d70-45f15f987d01 - id: 7ea73f80-c4e0-450a-92dc-8397ce2af14f, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/local_storage_unencrypted - id: 96ae8389-3027-4260-9374-e0f6ce851de2, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_75b220ba-a0f4-4872-8202-dc7c87f062d0 - id: a50cd13a-5749-4e79-bb8b-19229500a8b3, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/debug - id: b1deff4b-51df-4a37-9043-afbd7c70a1cb, compression: gzip-9
        available: 1 GiB, used: 0 B
        reservation: None, quota: Some(ByteCount(107374182400))
      oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crucible - id: ba9311dd-89ac-47db-a5e8-d64e8a5fcf70, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/local_storage - id: c65a9c1c-36dc-4ddb-8aac-ec3be8dbb209, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_f55647d4-5500-4ad3-893a-df45bd50d622 - id: c895e8d5-1434-4ecf-8d46-9bf1ecc8cbc9, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None
      oxp_18b20749-0748-4105-bb10-7b13cfc776e2/local_storage_unencrypted - id: e009d8b8-4695-4322-b53f-f03f2744aef7, compression: off
        available: 1 GiB, used: 0 B
        reservation: None, quota: None

LEDGERED SLED CONFIG
    generation: 3
    remove_mupdate_override: None
    desired host phase 2 slot a: keep current contents
    desired host phase 2 slot b: keep current contents
    DISKS: 3
        ID                                       ZPOOL_ID                                 VENDOR          MODEL          SERIAL                                      
        08724339-3d5b-432c-b7f3-55efdcf9f098     4930954e-9ac7-4453-b63f-5ab97c389a99     fake-vendor     fake-model     serial-4930954e-9ac7-4453-b63f-5ab97c389a99 
        3bea44bb-c1c1-462f-a105-b2aae3b17373     18b20749-0748-4105-bb10-7b13cfc776e2     fake-vendor     fake-model     serial-18b20749-0748-4105-bb10-7b13cfc776e2 
        d1b24eb3-c174-4d23-9f94-58a8fee73135     30c16fe4-4229-49d0-ab01-3138f2c7dff2     fake-vendor     fake-model     serial-30c16fe4-4229-49d0-ab01-3138f2c7dff2 
    DATASETS: 25
        ID                                       NAME                                                                                                             COMPRESSION     QUOTA       RESERVATION 
        090bd88d-0a43-4040-a832-b13ae721f74f     oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/local_storage                                                     off             none        none        
        1cb0a47a-59ac-4892-8e92-cf87b4290f96     oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone                                                              off             none        none        
        21fd4f3a-ec31-469b-87b1-087c343a2422     oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/debug                                                             gzip-9          100 GiB     none        
        252ac39f-b9e2-4697-8c07-3a833115d704     oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone                                                              off             none        none        
        3443a368-199e-4d26-b59f-3f2bbd507761     oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                      off             none        none        
        3c2cb304-a466-4ab5-8597-5db8172e2388     oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crucible                                                                off             none        none        
        3d9537b8-05be-4b1b-a051-f47becf8ec75     oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone/oxz_crucible_7c252b64-c5af-4ec1-989e-9a03f3b0f111            off             none        none        
        41071985-1dfd-4ce5-8bc2-897161a8bce4     oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/local_storage                                                     off             none        none        
        41107868-c6cc-4ec4-9159-aed688c3ceaf     oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crucible                                                                off             none        none        
        429da94b-19f7-48bd-98e9-47842863ba7b     oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/external_dns                                                      off             none        none        
        45cd9687-20be-4247-b62a-dfdacf324929     oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone                                                              off             none        none        
        4da74a5b-6911-4cca-b624-b90c65530117     oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/local_storage_unencrypted                                               off             none        none        
        50ea8c15-c4c0-4403-a490-d14b3405dfc2     oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_nexus_3eeb8d49-eb1a-43f8-bb64-c2338421c2c6               off             none        none        
        543fc3b8-08eb-4e5e-9e05-cf7a91732d5d     oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone/oxz_crucible_694bd14f-cb24-4be4-bb19-876e79cda2c8            off             none        none        
        54bbadaf-ec04-41a2-a62f-f5ac5bf321be     oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f10a4fb9-759f-4a65-b25e-5794ad2d07d8                 off             none        none        
        6f04dd20-5e2c-4fa8-8430-a886470ed140     oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_external_dns_f6ec9c67-946a-4da3-98d5-581f72ce8bf0        off             none        none        
        7a6a2058-ea78-49de-9730-cce5e28b4cfb     oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/debug                                                             gzip-9          100 GiB     none        
        7ea73f80-c4e0-450a-92dc-8397ce2af14f     oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_ea5b4030-b52f-44b2-8d70-45f15f987d01        off             none        none        
        96ae8389-3027-4260-9374-e0f6ce851de2     oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/local_storage_unencrypted                                               off             none        none        
        a50cd13a-5749-4e79-bb8b-19229500a8b3     oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_75b220ba-a0f4-4872-8202-dc7c87f062d0     off             none        none        
        b1deff4b-51df-4a37-9043-afbd7c70a1cb     oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/debug                                                             gzip-9          100 GiB     none        
        ba9311dd-89ac-47db-a5e8-d64e8a5fcf70     oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crucible                                                                off             none        none        
        c65a9c1c-36dc-4ddb-8aac-ec3be8dbb209     oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/local_storage                                                     off             none        none        
        c895e8d5-1434-4ecf-8d46-9bf1ecc8cbc9     oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_f55647d4-5500-4ad3-893a-df45bd50d622            off             none        none        
        e009d8b8-4695-4322-b53f-f03f2744aef7     oxp_18b20749-0748-4105-bb10-7b13cfc776e2/local_storage_unencrypted                                               off             none        none        
    ZONES: 8
        ID                                       KIND                IMAGE_SOURCE                                                               
        3eeb8d49-eb1a-43f8-bb64-c2338421c2c6     nexus               artifact: c562f60324e6c312445d89aae05bdefc3b70ab5145277c0fafd27e6bd95a5110 
        694bd14f-cb24-4be4-bb19-876e79cda2c8     crucible            artifact: 3303ca32f7f4ee36461654b8928ee50341208e6d5269357859034c3ebd938c2d 
        75b220ba-a0f4-4872-8202-dc7c87f062d0     crucible_pantry     artifact: 3446b183b3e1343803ed392fcb4de00e8bbf4d4c2569b24bf40240f0bca92db8 
        7c252b64-c5af-4ec1-989e-9a03f3b0f111     crucible            artifact: 3303ca32f7f4ee36461654b8928ee50341208e6d5269357859034c3ebd938c2d 
        ea5b4030-b52f-44b2-8d70-45f15f987d01     internal_dns        artifact: c114fd7044f42f82e51d97a56cb9d492941292e1922d01160ed9d53229b8111d 
        f10a4fb9-759f-4a65-b25e-5794ad2d07d8     internal_ntp        artifact: dcb132105ebbe9bb80c711f12a06acc3377426d317d00b725ef045a33e8a6e8e 
        f55647d4-5500-4ad3-893a-df45bd50d622     crucible            artifact: 3303ca32f7f4ee36461654b8928ee50341208e6d5269357859034c3ebd938c2d 
        f6ec9c67-946a-4da3-98d5-581f72ce8bf0     external_dns        artifact: affc53c414c4eddc35fe049e9368774c5ae7a35d5c531107b4f0370b7e4daaae 
    MEASUREMENTS: 2
      HASH                                                                      
      artifact b0db8f64463a377a302082c5752056ee191adf904daa625d38a2094059f55248 
      artifact dbea4039b6ed82dbdd8d794d398a5c647ffa6991bd7d063702c2acbc7a0b90c7 
    zone image resolver status:
        zone manifest:
            path on boot disk: /fake/path/install/zones.json
            boot disk inventory:
                manifest generated by sled-agent
                artifacts in install dataset:
                  - clickhouse.tar.gz (expected 143 bytes with hash bf1644cb268752c8369377f9300c398bcb3dd822c5234b465461166944a745df): ok
                  - clickhouse_keeper.tar.gz (expected 147 bytes with hash 4d7d1b049e3ad61351824c040f3c50708e3d3c89b7892fd25b9e12e151d56dea): ok
                  - clickhouse_server.tar.gz (expected 146 bytes with hash 3140c5e79f3bed0b0034e6dfa4e8423fd2fa9d567291c9b1b703aaf769b10756): ok
                  - cockroachdb.tar.gz (expected 144 bytes with hash 541bb4d38385c684f2629b970e23442fc567761917ab7b6e35410c0e2070ea54): ok
                  - crucible.tar.gz (expected 144 bytes with hash 3303ca32f7f4ee36461654b8928ee50341208e6d5269357859034c3ebd938c2d): ok
                  - crucible_pantry.tar.gz (expected 150 bytes with hash 3446b183b3e1343803ed392fcb4de00e8bbf4d4c2569b24bf40240f0bca92db8): ok
                  - external_dns.tar.gz (expected 142 bytes with hash affc53c414c4eddc35fe049e9368774c5ae7a35d5c531107b4f0370b7e4daaae): ok
                  - internal_dns.tar.gz (expected 142 bytes with hash c114fd7044f42f82e51d97a56cb9d492941292e1922d01160ed9d53229b8111d): ok
                  - nexus.tar.gz (expected 136 bytes with hash c562f60324e6c312445d89aae05bdefc3b70ab5145277c0fafd27e6bd95a5110): ok
                  - ntp.tar.gz (expected 135 bytes with hash dcb132105ebbe9bb80c711f12a06acc3377426d317d00b725ef045a33e8a6e8e): ok
                  - oximeter.tar.gz (expected 138 bytes with hash d704d9f63e858b53b480cee4eb16985a9fcb65018ae05819fd4fd5532122382e): ok
            no non-boot disks
        measurement manifest:
            path on boot disk: /fake/path/install/zones.json
            boot disk inventory:
                manifest generated by sled-agent
                artifacts in install dataset:
                  - b0db8f64463a377a302082c5752056ee191adf904daa625d38a2094059f55248 (expected 865 bytes with hash b0db8f64463a377a302082c5752056ee191adf904daa625d38a2094059f55248): ok
                  - dbea4039b6ed82dbdd8d794d398a5c647ffa6991bd7d063702c2acbc7a0b90c7 (expected 270 bytes with hash dbea4039b6ed82dbdd8d794d398a5c647ffa6991bd7d063702c2acbc7a0b90c7): ok
            no non-boot disks
        mupdate override:
            path on boot disk: /fake/path/install/mupdate_override.json
            no override on boot disk
            no non-boot disks
    boot disk slot: A
    slot A details:
        artifact: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a (1000 bytes)
        image name: fake from debug_assume_success()
        phase 2 hash: 0000000000000000000000000000000000000000000000000000000000000000
    slot B details:
        artifact: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b (1000 bytes)
        image name: fake from debug_assume_success()
        phase 2 hash: 0101010101010101010101010101010101010101010101010101010101010101
    last reconciled config: matches ledgered config
        no mupdate override to clear
        no orphaned datasets
        all disks reconciled successfully
        all datasets reconciled successfully
        all zones reconciled successfully
    reconciler task status: idle (finished at <REDACTED_TIMESTAMP> after running for <REDACTED_DURATION>s)
    reference measurements:
        (measurement set is empty)
    fmd:
        no faults reported

SMF SERVICES STATUS
    no data on SMF services has been collected

KEEPER MEMBERSHIP
    no membership retrieved


COCKROACH STATUS
    no cockroach status retrieved


NTP STATUS
    Zone 62620961-fc4a-481e-968b-f5acbac0dc63: NTP reports that time is synced
    Zone 6444f8a5-6465-4f0b-a549-1993c113569c: NTP reports that time is synced
    Zone f10a4fb9-759f-4a65-b25e-5794ad2d07d8: NTP reports that time is synced

INTERNAL DNS STATUS
    Zone 427ec88f-f467-42fa-9bbb-66a91a36103c: Internal DNS generation @ 1
    Zone 99e2f30b-3174-40bf-a78a-90da8abba8ca: Internal DNS generation @ 1
    Zone ea5b4030-b52f-44b2-8d70-45f15f987d01: Internal DNS generation @ 1



> # Setup is now done -- create another TUF repository which will act as the
> # target release being updated to.
> generate-fake-repo 1.0.0
created repo-1.0.0.zip for system version 1.0.0


> # Load the target release from the assembled TUF repository.
> set target-release repo-1.0.0.zip
set target release based on repo-1.0.0.zip


> # Print the default target release again.
> show
configured external DNS zone name: oxide.example
configured silo names: example-silo
internal DNS generations: 1
external DNS generations: 1
target number of Nexus instances: default
target release (generation 3): 1.0.0 (repo-1.0.0.zip)
    artifact: 6d4e4a64aaa5b94273845c63cd8b26dd2dbd6f37a68a4d253e43ca05a8222fa8 kind=installinator_document version 1.0.0
    artifact: 9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb kind=measurement_corpus version 1.0.0
    artifact: ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096 kind=measurement_corpus version 1.0.0
    artifact: 6086843f554e75aefb3f08c7e89b57ed72d69dc88bb1326977689826bb16a9da kind=os_phase1,os_board=cosmo,os_variant=host version 1.0.0
    artifact: dac1a9e8de9e42dd31d73638026fb07df74db673418cf49e737cc7d3aa350349 kind=os_phase1,os_board=cosmo,os_variant=recovery version 1.0.0
    artifact: 2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c kind=os_phase1,os_board=gimlet,os_variant=host version 1.0.0
    artifact: 9f20d75a9490245c3409a18d67ddc50a806ce9f3c7a388f9990d07be369b97ef kind=os_phase1,os_board=gimlet,os_variant=recovery version 1.0.0
    artifact: c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d kind=os_phase2,os_variant=host version 1.0.0
    artifact: b0572bb7cfad90e50391b1dd8f7a5b0eb444fda7690e62e35dda7e7e2a9b4ba3 kind=os_phase2,os_variant=recovery version 1.0.0
    artifact: dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751 kind=rot,rot_board=SimRot,rot_rkth=0000000000000000000000000000000000000000000000000000000000000000,rot_slot=a version 1.0.0
    artifact: dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751 kind=rot,rot_board=SimRot,rot_rkth=0000000000000000000000000000000000000000000000000000000000000000,rot_slot=b version 1.0.0
    artifact: 9f0d143c76b66c62584789c5d57c03068b6fb6fd4e128b019f57071fdcccd68c kind=rot_bootloader,rot_board=SimRot,rot_rkth=0000000000000000000000000000000000000000000000000000000000000000 version 1.0.0
    artifact: 5a539e32340133f0f67da4e8ef86bee23936466682960f1a823d2af6c38f9a07 kind=sp,sp_board=SimCosmoSp version 1.0.0
    artifact: 3f6a641e1a26b718b351ed286e22b4c055d2dc7898e7ea873cd634796c2fb918 kind=sp,sp_board=SimGimletSp version 1.0.0
    artifact: 0e4e2af1b28ad4fc15057df37e2ba1b9d26bed891c210b59c72013637209bf40 kind=sp,sp_board=SimPscSp version 1.0.0
    artifact: 3f419973eca2724bdfef47f4219913809861b37d7259c812be9722ebc80035bc kind=sp,sp_board=SimSidecarSp version 1.0.0
    artifact: 789283e5083ac3ed9ca24f33a6cad81793798298cd5c536c93981829abab9d15 kind=zone,zone_name=clickhouse version 1.0.0
    artifact: 2ce04cd4cb5aa9a525637b9f30c2f93f365048221808d95aae16e5c1127d6492 kind=zone,zone_name=clickhouse_keeper version 1.0.0
    artifact: 7245b29a4f07273fb8b7a4860f8847babf2b130fe437d30c3ab47b4f274a704e kind=zone,zone_name=clickhouse_server version 1.0.0
    artifact: 25d7b7f1aa8420f54bf09243ec3206a9bb50eba2cd252cf2279356cdfbbfa101 kind=zone,zone_name=cockroachdb version 1.0.0
    artifact: c537a3ec3f4600cdf0d0d3e279005b54910c87d5ef1b99b8fd85016b79fdedd1 kind=zone,zone_name=crucible-pantry-zone version 1.0.0
    artifact: 1d071b06c9e0739af8797557d81c84a7dc6d0bf00081ca1ef5c5a40672e11139 kind=zone,zone_name=crucible-zone version 1.0.0
    artifact: 263973cc7d40b6bbe6b33020a903ad0a13e72eff92fa19af51888219588e6cf4 kind=zone,zone_name=external-dns version 1.0.0
    artifact: 4ff68308ffa11980380de9036697cd11f94dace9e1d0afae95116541f7f5ffd2 kind=zone,zone_name=internal-dns version 1.0.0
    artifact: 7033ac7186a9e1f01a1a9e46d4e8756f3c953cf3cc30e333ceaa0a6bc0d55961 kind=zone,zone_name=nexus version 1.0.0
    artifact: 2c7a661d288567335a1cabbbb96ec43c648bdfa1323b9c7c4e8de7ff23edeed0 kind=zone,zone_name=ntp version 1.0.0
    artifact: cb41cb81f67ffabf0f832927162245fbd79fa2be82430ad6dd03132a34bafefb kind=zone,zone_name=oximeter version 1.0.0
active nexus zone generation: 1
active nexus zones: inferred from generation
not-yet nexus zones: inferred from generation
cockroachdb settings:
    state fingerprint::   (none)
    version::::::::::::   (none)
    preserve downgrade:   (not set)
planner config:
    (no current planner configs)



> # Test that this state survives a save/load operation.
> save saved.out
saved planning input, collections, and blueprints to "saved.out"

> wipe system
wiped system

> # This should NOT show the target release.
> show
configured external DNS zone name: oxide.example
configured silo names: example-silo
internal DNS generations: 
external DNS generations: 
target number of Nexus instances: default
target release (generation 1): unset
active nexus zone generation: 1
active nexus zones: inferred from generation
not-yet nexus zones: inferred from generation
cockroachdb settings:
    state fingerprint::   (none)
    version::::::::::::   (none)
    preserve downgrade:   (not set)
planner config:
    (no current planner configs)


> load saved.out --collection-id 61f451b3-2121-4ed6-91c7-a550054f6c21
loaded data from "saved.out"
result:
  system:
    using collection 61f451b3-2121-4ed6-91c7-a550054f6c21 as source of sled inventory data
    loaded sleds: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, d81c6a84-79b8-4958-ae41-ea46c9b19763
    loaded collections: 61f451b3-2121-4ed6-91c7-a550054f6c21, eb0796d5-ab8a-4f7b-a884-b4aeacb8ab51, f45ba181-4b56-42cc-a762-874d90184a43
    loaded blueprints: 184f10b3-61cb-41ef-9b93-3489b2bac559, 58d5e830-0884-47d8-a7cd-b2b3751adeb4, 8da82a8e-bf97-4fbd-8ddd-9f6462732cf1, dbcbd3d6-41ff-48ae-ac0b-1becc9b2fd21
    loaded external IP policy: ExternalIpPolicy { service_pool_ipv4_ranges: [Ipv4Range { first: 192.0.2.2, last: 192.0.2.20 }, Ipv4Range { first: 198.51.100.1, last: 198.51.100.30 }], service_pool_ipv6_ranges: [], external_dns_ips: {198.51.100.1, 198.51.100.2, 198.51.100.3} }
    loaded cockroachdb settings: fingerprint = (none), version = (none), preserve downgrade = (not set)
    loaded internal DNS generations: (none)
    loaded external DNS generations: (none)
  config:
    configured external DNS zone name: oxide.example
    configured silo names: example-silo
    active Nexus generation: 1


> # This should show the target release.
> show
configured external DNS zone name: oxide.example
configured silo names: example-silo
internal DNS generations: 1
external DNS generations: 1
target number of Nexus instances: default
target release (generation 3): 1.0.0 (repo-1.0.0.zip)
    artifact: 6d4e4a64aaa5b94273845c63cd8b26dd2dbd6f37a68a4d253e43ca05a8222fa8 kind=installinator_document version 1.0.0
    artifact: 9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb kind=measurement_corpus version 1.0.0
    artifact: ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096 kind=measurement_corpus version 1.0.0
    artifact: 6086843f554e75aefb3f08c7e89b57ed72d69dc88bb1326977689826bb16a9da kind=os_phase1,os_board=cosmo,os_variant=host version 1.0.0
    artifact: dac1a9e8de9e42dd31d73638026fb07df74db673418cf49e737cc7d3aa350349 kind=os_phase1,os_board=cosmo,os_variant=recovery version 1.0.0
    artifact: 2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c kind=os_phase1,os_board=gimlet,os_variant=host version 1.0.0
    artifact: 9f20d75a9490245c3409a18d67ddc50a806ce9f3c7a388f9990d07be369b97ef kind=os_phase1,os_board=gimlet,os_variant=recovery version 1.0.0
    artifact: c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d kind=os_phase2,os_variant=host version 1.0.0
    artifact: b0572bb7cfad90e50391b1dd8f7a5b0eb444fda7690e62e35dda7e7e2a9b4ba3 kind=os_phase2,os_variant=recovery version 1.0.0
    artifact: dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751 kind=rot,rot_board=SimRot,rot_rkth=0000000000000000000000000000000000000000000000000000000000000000,rot_slot=a version 1.0.0
    artifact: dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751 kind=rot,rot_board=SimRot,rot_rkth=0000000000000000000000000000000000000000000000000000000000000000,rot_slot=b version 1.0.0
    artifact: 9f0d143c76b66c62584789c5d57c03068b6fb6fd4e128b019f57071fdcccd68c kind=rot_bootloader,rot_board=SimRot,rot_rkth=0000000000000000000000000000000000000000000000000000000000000000 version 1.0.0
    artifact: 5a539e32340133f0f67da4e8ef86bee23936466682960f1a823d2af6c38f9a07 kind=sp,sp_board=SimCosmoSp version 1.0.0
    artifact: 3f6a641e1a26b718b351ed286e22b4c055d2dc7898e7ea873cd634796c2fb918 kind=sp,sp_board=SimGimletSp version 1.0.0
    artifact: 0e4e2af1b28ad4fc15057df37e2ba1b9d26bed891c210b59c72013637209bf40 kind=sp,sp_board=SimPscSp version 1.0.0
    artifact: 3f419973eca2724bdfef47f4219913809861b37d7259c812be9722ebc80035bc kind=sp,sp_board=SimSidecarSp version 1.0.0
    artifact: 789283e5083ac3ed9ca24f33a6cad81793798298cd5c536c93981829abab9d15 kind=zone,zone_name=clickhouse version 1.0.0
    artifact: 2ce04cd4cb5aa9a525637b9f30c2f93f365048221808d95aae16e5c1127d6492 kind=zone,zone_name=clickhouse_keeper version 1.0.0
    artifact: 7245b29a4f07273fb8b7a4860f8847babf2b130fe437d30c3ab47b4f274a704e kind=zone,zone_name=clickhouse_server version 1.0.0
    artifact: 25d7b7f1aa8420f54bf09243ec3206a9bb50eba2cd252cf2279356cdfbbfa101 kind=zone,zone_name=cockroachdb version 1.0.0
    artifact: c537a3ec3f4600cdf0d0d3e279005b54910c87d5ef1b99b8fd85016b79fdedd1 kind=zone,zone_name=crucible-pantry-zone version 1.0.0
    artifact: 1d071b06c9e0739af8797557d81c84a7dc6d0bf00081ca1ef5c5a40672e11139 kind=zone,zone_name=crucible-zone version 1.0.0
    artifact: 263973cc7d40b6bbe6b33020a903ad0a13e72eff92fa19af51888219588e6cf4 kind=zone,zone_name=external-dns version 1.0.0
    artifact: 4ff68308ffa11980380de9036697cd11f94dace9e1d0afae95116541f7f5ffd2 kind=zone,zone_name=internal-dns version 1.0.0
    artifact: 7033ac7186a9e1f01a1a9e46d4e8756f3c953cf3cc30e333ceaa0a6bc0d55961 kind=zone,zone_name=nexus version 1.0.0
    artifact: 2c7a661d288567335a1cabbbb96ec43c648bdfa1323b9c7c4e8de7ff23edeed0 kind=zone,zone_name=ntp version 1.0.0
    artifact: cb41cb81f67ffabf0f832927162245fbd79fa2be82430ad6dd03132a34bafefb kind=zone,zone_name=oximeter version 1.0.0
active nexus zone generation: 1
active nexus zones: inferred from generation
not-yet nexus zones: inferred from generation
cockroachdb settings:
    state fingerprint::   (none)
    version::::::::::::   (none)
    preserve downgrade:   (not set)
planner config:
    (no current planner configs)



> # Great.  Now, let's run through an upgrade!
> # First, print out what we've got.
> sled-list
ID                                   SERIAL  NZPOOLS SUBNET                  
2b8f0cb3-0295-4b3c-bc58-4fe88b57112c serial1 3       fd00:1122:3344:102::/64 
98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 serial0 3       fd00:1122:3344:101::/64 
d81c6a84-79b8-4958-ae41-ea46c9b19763 serial2 3       fd00:1122:3344:103::/64 

> blueprint-list
T ENA ID                                   PARENT                               TIME_CREATED             
      184f10b3-61cb-41ef-9b93-3489b2bac559 <none>                               <REDACTED_TIMESTAMP> 
* yes dbcbd3d6-41ff-48ae-ac0b-1becc9b2fd21 184f10b3-61cb-41ef-9b93-3489b2bac559 <REDACTED_TIMESTAMP> 
      8da82a8e-bf97-4fbd-8ddd-9f6462732cf1 dbcbd3d6-41ff-48ae-ac0b-1becc9b2fd21 <REDACTED_TIMESTAMP> 
      58d5e830-0884-47d8-a7cd-b2b3751adeb4 8da82a8e-bf97-4fbd-8ddd-9f6462732cf1 <REDACTED_TIMESTAMP> 

> inventory-list
ID                                   NERRORS TIME_DONE                
f45ba181-4b56-42cc-a762-874d90184a43 0       <REDACTED_TIMESTAMP> 
eb0796d5-ab8a-4f7b-a884-b4aeacb8ab51 0       <REDACTED_TIMESTAMP> 
61f451b3-2121-4ed6-91c7-a550054f6c21 0       <REDACTED_TIMESTAMP> 


> # Measurements will block further planning progress, run a planning step
> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
generated blueprint af934083-59b5-4bf6-8966-6fb5292c29e1 based on parent blueprint 58d5e830-0884-47d8-a7cd-b2b3751adeb4
blueprint source: planner with report:
planning report:
* zone updates waiting on reference measurement changes
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated
Measurement updates:
3 modifications



> blueprint-diff latest
from: blueprint 58d5e830-0884-47d8-a7cd-b2b3751adeb4
to:   blueprint af934083-59b5-4bf6-8966-6fb5292c29e1

 MODIFIED SLEDS:

  sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c (active, config generation 3 -> 4):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
-   b0db8f64463a377a302082c5752056ee191adf904daa625d38a2094059f55248   version 0.0.1
-   dbea4039b6ed82dbdd8d794d398a5c647ffa6991bd7d063702c2acbc7a0b90c7   version 0.0.1
+   9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
+   ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------
    slot   boot image source
    ------------------------
    A      current contents 
    B      current contents 


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-727522a7-934f-494d-b5b3-160968e74463   in service 
    fake-vendor   fake-model   serial-72c59873-31ff-4e36-8d76-ff834009349a   in service 
    fake-vendor   fake-model   serial-b5fd5bc1-099e-4e77-8028-a9793c11f43b   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_727522a7-934f-494d-b5b3-160968e74463/crucible                                                              feecfda1-9966-43d4-aaef-440b77f0b26d   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crucible                                                              956966b9-8201-437b-81ba-3c8ad2032080   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crucible                                                              4b0b09bf-94b7-45bf-a6b3-d46af53ae44a   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/clickhouse                                                      5ae11c7e-08fa-4d78-a4ea-14b4a9a10241   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    3e0d6188-c503-49cf-a441-fa7df40ceb43   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    b8f2a09f-8bd2-4418-872b-a4457a3f958c   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone                                                            4829f422-aa31-41a8-ab73-95684ff1ef48   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone                                                            3b66453b-7148-4c1b-84a9-499e43290ab4   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone                                                            841d5648-05f0-47b0-b446-92f6b60fe9a6   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_clickhouse_353b3b65-20f7-48c3-88f7-495bd5d31545        49f8fbb6-5bac-4609-907f-6e3dfc206059   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone/oxz_crucible_86a22a56-0168-453d-9df1-cb2a7c64b5d3          6e218d0a-13fd-4f70-884e-47e960fa8bb8   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_bd354eef-d8a6-4165-9124-283fb5e46d77          9073fb6b-f973-4bbd-b7cc-ba1abf6cb238   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone/oxz_crucible_e2fdefe7-95b2-4fd2-ae37-56929a06d58c          0582030b-aab6-4d0e-b1d2-64562ee712cd   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_ad6a3a03-8d0f-4504-99a4-cbf73d69b973   1640adb6-70bf-44cf-b05c-bff6dd300cf3   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_6c3ae381-04f7-41ea-b0ac-74db387dbc3a      78f34ce7-42f1-41da-995f-318f32054ad2   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_99e2f30b-3174-40bf-a78a-90da8abba8ca      2f204c50-a327-479c-8852-f53ec7a19c1f   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_nexus_466a9f29-62bf-4e63-924a-b9efdb86afec             8e0bd2bd-23b7-4bc6-9e73-c4d4ebc0bc8c   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_62620961-fc4a-481e-968b-f5acbac0dc63               8c4fa711-1d5d-4e93-85f0-d17bff47b063   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/debug                                                           93957ca0-9ed1-4e7b-8c34-2ce07a69541c   in service    100 GiB   none          gzip-9     
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/debug                                                           318fae85-abcb-4259-b1b6-ac96d193f7b7   in service    100 GiB   none          gzip-9     
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/debug                                                           b46de15d-33e7-4cd0-aa7c-e7be2a61e71b   in service    100 GiB   none          gzip-9     
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/local_storage                                                   2db6b7c1-0f46-4ced-a3ad-48872793360e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/local_storage                                                   09b9cc9b-3426-470b-a7bc-538f82dede03   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/local_storage                                                   c31623de-c19b-4615-9f1d-5e1daa5d3bda   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/local_storage_unencrypted                                             775f9207-c42d-4af2-9186-27ffef67735e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/local_storage_unencrypted                                             3560dd69-3b23-4c69-807d-d673104cfc68   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/local_storage_unencrypted                                             2ad1875a-92ac-472f-8c26-593309f0e4da   in service    none      none          off        


    omicron zones:
    ----------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition   underlay IP          
    ----------------------------------------------------------------------------------------------------------------------
    clickhouse        353b3b65-20f7-48c3-88f7-495bd5d31545   artifact: version 0.0.1   in service    fd00:1122:3344:102::5
    crucible          86a22a56-0168-453d-9df1-cb2a7c64b5d3   artifact: version 0.0.1   in service    fd00:1122:3344:102::a
    crucible          bd354eef-d8a6-4165-9124-283fb5e46d77   artifact: version 0.0.1   in service    fd00:1122:3344:102::8
    crucible          e2fdefe7-95b2-4fd2-ae37-56929a06d58c   artifact: version 0.0.1   in service    fd00:1122:3344:102::9
    crucible_pantry   ad6a3a03-8d0f-4504-99a4-cbf73d69b973   artifact: version 0.0.1   in service    fd00:1122:3344:102::7
    external_dns      6c3ae381-04f7-41ea-b0ac-74db387dbc3a   artifact: version 0.0.1   in service    fd00:1122:3344:102::6
    internal_dns      99e2f30b-3174-40bf-a78a-90da8abba8ca   artifact: version 0.0.1   in service    fd00:1122:3344:1::1  
    internal_ntp      62620961-fc4a-481e-968b-f5acbac0dc63   artifact: version 0.0.1   in service    fd00:1122:3344:102::3
    nexus             466a9f29-62bf-4e63-924a-b9efdb86afec   artifact: version 0.0.1   in service    fd00:1122:3344:102::4


  sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 (active, config generation 3 -> 4):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
-   b0db8f64463a377a302082c5752056ee191adf904daa625d38a2094059f55248   version 0.0.1
-   dbea4039b6ed82dbdd8d794d398a5c647ffa6991bd7d063702c2acbc7a0b90c7   version 0.0.1
+   9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
+   ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------
    slot   boot image source
    ------------------------
    A      current contents 
    B      current contents 


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-073979dd-3248-44a5-9fa1-cc72a140d682   in service 
    fake-vendor   fake-model   serial-c6d33b64-fb96-4129-bab1-7878a06a5f9b   in service 
    fake-vendor   fake-model   serial-e4d937e1-6ddc-4eca-bb08-c1f73791e608   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crucible                                                              335e1dc3-b610-48dd-90bb-9ca5cce1a6d0   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crucible                                                              d5fef28b-4ee8-4443-8c06-7e872c2502f3   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crucible                                                              6477f019-088c-43cf-8508-aa93f868830f   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    02c56a30-7d97-406d-bd34-1eb437fd517d   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    4d7e3e8e-06bd-414c-a468-779e056a9b75   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone                                                            4617d206-4330-4dfa-b9f3-f63a3db834f9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone                                                            4f60b534-eaa3-40a1-b60f-bfdf147af478   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone                                                            ad41be71-6c15-4428-b510-20ceacde4fa6   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone/oxz_crucible_058fd5f9-60a8-4e11-9302-15172782e17d          55a2a61a-1471-49b2-a6d0-b191ed94e057   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_5199c033-4cf9-4ab6-8ae7-566bd7606363          90b46084-4238-45ba-9e26-d3f2623e640e   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_crucible_dfac80b4-a887-430a-ae87-a4e065dba787          bcdc7bf3-bbae-4e7f-81b2-4d94c8f752a4   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_ba4994a8-23f9-4b1a-a84f-a08d74591389   50b029e3-96aa-41e5-bf39-023193a4355e   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_803bfb63-c246-41db-b0da-d3b87ddfc63d      ea8a11bf-a884-4c4f-8df0-3ef9b7aacf43   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_427ec88f-f467-42fa-9bbb-66a91a36103c      7b4ce6bf-95bb-42fe-a4a0-dff31211ab88   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_0c71b3b2-6ceb-4e8f-b020-b08675e83038             832fd140-d467-4bad-b5e9-63171634087c   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_6444f8a5-6465-4f0b-a549-1993c113569c               42430c80-7836-4191-a4f6-bcee749010fe   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/debug                                                           248c6c10-1ac6-45de-bb55-ede36ca56bbd   in service    100 GiB   none          gzip-9     
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/debug                                                           686c19cf-a0d7-45f6-866f-c564612b2664   in service    100 GiB   none          gzip-9     
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/debug                                                           1bca7f71-5e42-4749-91ec-fa40793a3a9a   in service    100 GiB   none          gzip-9     
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/local_storage                                                   cdf3684f-a6cf-4449-b9ec-e696b2c663e2   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/local_storage                                                   3ac089c9-9dec-465b-863a-188e80d71fb4   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/local_storage                                                   43931274-7fe8-4077-825d-dff2bc8efa58   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/local_storage_unencrypted                                             793ac181-1b01-403c-850d-7f5c54bda6c9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/local_storage_unencrypted                                             a4c3032e-21fa-4d4a-b040-a7e3c572cf3c   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/local_storage_unencrypted                                             4847a96e-a267-4ae7-aa3d-805c1e77f81e   in service    none      none          off        


    omicron zones:
    ----------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition   underlay IP          
    ----------------------------------------------------------------------------------------------------------------------
    crucible          058fd5f9-60a8-4e11-9302-15172782e17d   artifact: version 0.0.1   in service    fd00:1122:3344:101::9
    crucible          5199c033-4cf9-4ab6-8ae7-566bd7606363   artifact: version 0.0.1   in service    fd00:1122:3344:101::7
    crucible          dfac80b4-a887-430a-ae87-a4e065dba787   artifact: version 0.0.1   in service    fd00:1122:3344:101::8
    crucible_pantry   ba4994a8-23f9-4b1a-a84f-a08d74591389   artifact: version 0.0.1   in service    fd00:1122:3344:101::6
    external_dns      803bfb63-c246-41db-b0da-d3b87ddfc63d   artifact: version 0.0.1   in service    fd00:1122:3344:101::5
    internal_dns      427ec88f-f467-42fa-9bbb-66a91a36103c   artifact: version 0.0.1   in service    fd00:1122:3344:2::1  
    internal_ntp      6444f8a5-6465-4f0b-a549-1993c113569c   artifact: version 0.0.1   in service    fd00:1122:3344:101::3
    nexus             0c71b3b2-6ceb-4e8f-b020-b08675e83038   artifact: version 0.0.1   in service    fd00:1122:3344:101::4


  sled d81c6a84-79b8-4958-ae41-ea46c9b19763 (active, config generation 3 -> 4):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
-   b0db8f64463a377a302082c5752056ee191adf904daa625d38a2094059f55248   version 0.0.1
-   dbea4039b6ed82dbdd8d794d398a5c647ffa6991bd7d063702c2acbc7a0b90c7   version 0.0.1
+   9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
+   ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------
    slot   boot image source
    ------------------------
    A      current contents 
    B      current contents 


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-18b20749-0748-4105-bb10-7b13cfc776e2   in service 
    fake-vendor   fake-model   serial-30c16fe4-4229-49d0-ab01-3138f2c7dff2   in service 
    fake-vendor   fake-model   serial-4930954e-9ac7-4453-b63f-5ab97c389a99   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crucible                                                              ba9311dd-89ac-47db-a5e8-d64e8a5fcf70   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crucible                                                              3c2cb304-a466-4ab5-8597-5db8172e2388   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crucible                                                              41107868-c6cc-4ec4-9159-aed688c3ceaf   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/external_dns                                                    429da94b-19f7-48bd-98e9-47842863ba7b   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    3443a368-199e-4d26-b59f-3f2bbd507761   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone                                                            45cd9687-20be-4247-b62a-dfdacf324929   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone                                                            252ac39f-b9e2-4697-8c07-3a833115d704   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone                                                            1cb0a47a-59ac-4892-8e92-cf87b4290f96   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone/oxz_crucible_694bd14f-cb24-4be4-bb19-876e79cda2c8          543fc3b8-08eb-4e5e-9e05-cf7a91732d5d   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone/oxz_crucible_7c252b64-c5af-4ec1-989e-9a03f3b0f111          3d9537b8-05be-4b1b-a051-f47becf8ec75   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_f55647d4-5500-4ad3-893a-df45bd50d622          c895e8d5-1434-4ecf-8d46-9bf1ecc8cbc9   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_75b220ba-a0f4-4872-8202-dc7c87f062d0   a50cd13a-5749-4e79-bb8b-19229500a8b3   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_external_dns_f6ec9c67-946a-4da3-98d5-581f72ce8bf0      6f04dd20-5e2c-4fa8-8430-a886470ed140   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_ea5b4030-b52f-44b2-8d70-45f15f987d01      7ea73f80-c4e0-450a-92dc-8397ce2af14f   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_nexus_3eeb8d49-eb1a-43f8-bb64-c2338421c2c6             50ea8c15-c4c0-4403-a490-d14b3405dfc2   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f10a4fb9-759f-4a65-b25e-5794ad2d07d8               54bbadaf-ec04-41a2-a62f-f5ac5bf321be   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/debug                                                           7a6a2058-ea78-49de-9730-cce5e28b4cfb   in service    100 GiB   none          gzip-9     
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/debug                                                           21fd4f3a-ec31-469b-87b1-087c343a2422   in service    100 GiB   none          gzip-9     
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/debug                                                           b1deff4b-51df-4a37-9043-afbd7c70a1cb   in service    100 GiB   none          gzip-9     
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/local_storage                                                   41071985-1dfd-4ce5-8bc2-897161a8bce4   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/local_storage                                                   c65a9c1c-36dc-4ddb-8aac-ec3be8dbb209   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/local_storage                                                   090bd88d-0a43-4040-a832-b13ae721f74f   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/local_storage_unencrypted                                             e009d8b8-4695-4322-b53f-f03f2744aef7   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/local_storage_unencrypted                                             4da74a5b-6911-4cca-b624-b90c65530117   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/local_storage_unencrypted                                             96ae8389-3027-4260-9374-e0f6ce851de2   in service    none      none          off        


    omicron zones:
    ----------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition   underlay IP          
    ----------------------------------------------------------------------------------------------------------------------
    crucible          694bd14f-cb24-4be4-bb19-876e79cda2c8   artifact: version 0.0.1   in service    fd00:1122:3344:103::8
    crucible          7c252b64-c5af-4ec1-989e-9a03f3b0f111   artifact: version 0.0.1   in service    fd00:1122:3344:103::9
    crucible          f55647d4-5500-4ad3-893a-df45bd50d622   artifact: version 0.0.1   in service    fd00:1122:3344:103::7
    crucible_pantry   75b220ba-a0f4-4872-8202-dc7c87f062d0   artifact: version 0.0.1   in service    fd00:1122:3344:103::6
    external_dns      f6ec9c67-946a-4da3-98d5-581f72ce8bf0   artifact: version 0.0.1   in service    fd00:1122:3344:103::5
    internal_dns      ea5b4030-b52f-44b2-8d70-45f15f987d01   artifact: version 0.0.1   in service    fd00:1122:3344:3::1  
    internal_ntp      f10a4fb9-759f-4a65-b25e-5794ad2d07d8   artifact: version 0.0.1   in service    fd00:1122:3344:103::3
    nexus             3eeb8d49-eb1a-43f8-bb64-c2338421c2c6   artifact: version 0.0.1   in service    fd00:1122:3344:103::4


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)



> # Make sure the measurements are up to date for inventory
> sled-set serial0 omicron-config latest
set sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron config from latest blueprint (af934083-59b5-4bf6-8966-6fb5292c29e1)

> sled-set serial1 omicron-config latest
set sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron config from latest blueprint (af934083-59b5-4bf6-8966-6fb5292c29e1)

> sled-set serial2 omicron-config latest
set sled d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron config from latest blueprint (af934083-59b5-4bf6-8966-6fb5292c29e1)

> inventory-generate
generated inventory collection b1bda47d-2c19-4fba-96e3-d9df28db7436 from configured sleds


> # First step: upgrade one RoT bootloader.
> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO configuring MGS-driven update, artifact_version: 1.0.0, artifact_hash: 9f0d143c76b66c62584789c5d57c03068b6fb6fd4e128b019f57071fdcccd68c, expected_stage0_next_version: NoValidVersion, expected_stage0_version: 0.0.1, component: rot_bootloader, sp_slot: 0, sp_type: Sled, serial_number: serial0, part_number: 913-0000019
INFO reached maximum number of pending MGS-driven updates, max: 1
generated blueprint df06bb57-ad42-4431-9206-abff322896c7 based on parent blueprint af934083-59b5-4bf6-8966-6fb5292c29e1
blueprint source: planner with report:
planning report:
* 1 pending MGS update:
  * 913-0000019:serial0: RotBootloader(PendingMgsUpdateRotBootloaderDetails { expected_stage0_version: ArtifactVersion("0.0.1"), expected_stage0_next_version: NoValidVersion })
* zone updates waiting on pending MGS updates (RoT bootloader / RoT / SP / Host OS)
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint af934083-59b5-4bf6-8966-6fb5292c29e1
to:   blueprint df06bb57-ad42-4431-9206-abff322896c7

 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)

 PENDING MGS UPDATES:

    Pending MGS-managed updates (all baseboards):
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    sp_type   slot   part_number   serial_number   artifact_hash                                                      artifact_version   details                                                                                                                                                
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
+   sled      0      913-0000019   serial0         9f0d143c76b66c62584789c5d57c03068b6fb6fd4e128b019f57071fdcccd68c   1.0.0              RotBootloader(PendingMgsUpdateRotBootloaderDetails { expected_stage0_version: ArtifactVersion("0.0.1"), expected_stage0_next_version: NoValidVersion })


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # If we generate another plan, there should be no change.
> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO MGS-driven update not yet completed (will keep it), artifact_version: 1.0.0, artifact_hash: 9f0d143c76b66c62584789c5d57c03068b6fb6fd4e128b019f57071fdcccd68c, expected_stage0_next_version: NoValidVersion, expected_stage0_version: 0.0.1, component: rot_bootloader, sp_slot: 0, sp_type: Sled, serial_number: serial0, part_number: 913-0000019
INFO reached maximum number of pending MGS-driven updates, max: 1
generated blueprint 7f976e0d-d2a5-4eeb-9e82-c82bc2824aba based on parent blueprint df06bb57-ad42-4431-9206-abff322896c7
blueprint source: planner with report:
planning report:
* 1 pending MGS update:
  * 913-0000019:serial0: RotBootloader(PendingMgsUpdateRotBootloaderDetails { expected_stage0_version: ArtifactVersion("0.0.1"), expected_stage0_next_version: NoValidVersion })
* zone updates waiting on pending MGS updates (RoT bootloader / RoT / SP / Host OS)
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint df06bb57-ad42-4431-9206-abff322896c7
to:   blueprint 7f976e0d-d2a5-4eeb-9e82-c82bc2824aba

 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # Now, update the simulated RoT bootloader to reflect that the update completed.
> # Collect inventory from it and use that collection for another planning step.
> # This should report that the update completed, remove that update, and add one
> # for an RoT on the same sled.
> sled-update-rot-bootloader 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 --stage0 1.0.0
set sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 RoT bootloader versions: stage0 -> 1.0.0

> inventory-generate
generated inventory collection a71f7a73-35a6-45e8-acbe-f1c5925eed69 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO MGS-driven update completed (will remove it and re-evaluate board), artifact_version: 1.0.0, artifact_hash: 9f0d143c76b66c62584789c5d57c03068b6fb6fd4e128b019f57071fdcccd68c, expected_stage0_next_version: NoValidVersion, expected_stage0_version: 0.0.1, component: rot_bootloader, sp_slot: 0, sp_type: Sled, serial_number: serial0, part_number: 913-0000019
INFO configuring MGS-driven update, artifact_version: 1.0.0, artifact_hash: dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751, expected_transient_boot_preference: None, expected_pending_persistent_boot_preference: None, expected_persistent_boot_preference: A, expected_active_slot: ExpectedActiveRotSlot { slot: A, version: ArtifactVersion("0.0.2") }, expected_inactive_version: NoValidVersion, component: rot, sp_slot: 0, sp_type: Sled, serial_number: serial0, part_number: 913-0000019
INFO reached maximum number of pending MGS-driven updates, max: 1
generated blueprint 9034c710-3e57-45f3-99e5-4316145e87ac based on parent blueprint 7f976e0d-d2a5-4eeb-9e82-c82bc2824aba
blueprint source: planner with report:
planning report:
* 1 pending MGS update:
  * 913-0000019:serial0: Rot(PendingMgsUpdateRotDetails { expected_active_slot: ExpectedActiveRotSlot { slot: A, version: ArtifactVersion("0.0.2") }, expected_inactive_version: NoValidVersion, expected_persistent_boot_preference: A, expected_pending_persistent_boot_preference: None, expected_transient_boot_preference: None })
* zone updates waiting on pending MGS updates (RoT bootloader / RoT / SP / Host OS)
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 7f976e0d-d2a5-4eeb-9e82-c82bc2824aba
to:   blueprint 9034c710-3e57-45f3-99e5-4316145e87ac

 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)

 PENDING MGS UPDATES:

    Pending MGS-managed updates (all baseboards):
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    sp_type   slot   part_number   serial_number   artifact_hash                                                        artifact_version   details                                                                                                                                                                                                                                                                                                         
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
*   sled      0      913-0000019   serial0         - 9f0d143c76b66c62584789c5d57c03068b6fb6fd4e128b019f57071fdcccd68c   1.0.0              - RotBootloader(PendingMgsUpdateRotBootloaderDetails { expected_stage0_version: ArtifactVersion("0.0.1"), expected_stage0_next_version: NoValidVersion })                                                                                                                                                       
     └─                                            + dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751                      + Rot(PendingMgsUpdateRotDetails { expected_active_slot: ExpectedActiveRotSlot { slot: A, version: ArtifactVersion("0.0.2") }, expected_inactive_version: NoValidVersion, expected_persistent_boot_preference: A, expected_pending_persistent_boot_preference: None, expected_transient_boot_preference: None })


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # After the RoT bootloader update has completed, we update the simulated RoT to
> # reflect that update has completed as well. Like before, collect inventory from
> # it and use that collection for the next step. This should report that the
> # update completed, remove that update, and add one for another sled.
> sled-update-rot 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 --slot-b 1.0.0 --active-slot b --persistent-boot-preference b
set sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 RoT settings: slot b -> 1.0.0, active slot -> B, persistent boot preference -> B

> inventory-generate
generated inventory collection 0b5efbb3-0b1b-4bbf-b7d8-a2d6fca074c6 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO MGS-driven update completed (will remove it and re-evaluate board), artifact_version: 1.0.0, artifact_hash: dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751, expected_transient_boot_preference: None, expected_pending_persistent_boot_preference: None, expected_persistent_boot_preference: A, expected_active_slot: ExpectedActiveRotSlot { slot: A, version: ArtifactVersion("0.0.2") }, expected_inactive_version: NoValidVersion, component: rot, sp_slot: 0, sp_type: Sled, serial_number: serial0, part_number: 913-0000019
INFO configuring MGS-driven update, artifact_version: 1.0.0, artifact_hash: 3f6a641e1a26b718b351ed286e22b4c055d2dc7898e7ea873cd634796c2fb918, expected_inactive_version: NoValidVersion, expected_active_version: 0.0.1, component: sp, sp_slot: 0, sp_type: Sled, serial_number: serial0, part_number: 913-0000019
INFO reached maximum number of pending MGS-driven updates, max: 1
generated blueprint d60afc57-f15d-476c-bd0f-b1071e2bb976 based on parent blueprint 9034c710-3e57-45f3-99e5-4316145e87ac
blueprint source: planner with report:
planning report:
* 1 pending MGS update:
  * 913-0000019:serial0: Sp(PendingMgsUpdateSpDetails { expected_active_version: ArtifactVersion("0.0.1"), expected_inactive_version: NoValidVersion })
* zone updates waiting on pending MGS updates (RoT bootloader / RoT / SP / Host OS)
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 9034c710-3e57-45f3-99e5-4316145e87ac
to:   blueprint d60afc57-f15d-476c-bd0f-b1071e2bb976

 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)

 PENDING MGS UPDATES:

    Pending MGS-managed updates (all baseboards):
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    sp_type   slot   part_number   serial_number   artifact_hash                                                        artifact_version   details                                                                                                                                                                                                                                                                                                         
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
*   sled      0      913-0000019   serial0         - dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751   1.0.0              - Rot(PendingMgsUpdateRotDetails { expected_active_slot: ExpectedActiveRotSlot { slot: A, version: ArtifactVersion("0.0.2") }, expected_inactive_version: NoValidVersion, expected_persistent_boot_preference: A, expected_pending_persistent_boot_preference: None, expected_transient_boot_preference: None })
     └─                                            + 3f6a641e1a26b718b351ed286e22b4c055d2dc7898e7ea873cd634796c2fb918                      + Sp(PendingMgsUpdateSpDetails { expected_active_version: ArtifactVersion("0.0.1"), expected_inactive_version: NoValidVersion })                                                                                                                                                                                


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # We repeat the same procedure with the SP
> sled-update-sp 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 --active 1.0.0
set sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 SP versions: active -> 1.0.0


> # Collect inventory from it and use that collection for another planning step.
> # This should report that the update completed, remove that update, and add a
> # host OS update for this same sled.
> inventory-generate
generated inventory collection 78f72e8d-46a9-40a9-8618-602f54454d80 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO MGS-driven update completed (will remove it and re-evaluate board), artifact_version: 1.0.0, artifact_hash: 3f6a641e1a26b718b351ed286e22b4c055d2dc7898e7ea873cd634796c2fb918, expected_inactive_version: NoValidVersion, expected_active_version: 0.0.1, component: sp, sp_slot: 0, sp_type: Sled, serial_number: serial0, part_number: 913-0000019
INFO configuring MGS-driven update, artifact_version: 1.0.0, artifact_hash: 2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c, sled_agent_address: [fd00:1122:3344:101::1]:12345, expected_inactive_phase_2_hash: c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d, expected_inactive_phase_1_hash: 0202020202020202020202020202020202020202020202020202020202020202, expected_active_phase_2_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a, expected_active_phase_1_hash: 0101010101010101010101010101010101010101010101010101010101010101, expected_boot_disk: A, expected_active_phase_1_slot: A, component: host_phase_1, sp_slot: 0, sp_type: Sled, serial_number: serial0, part_number: 913-0000019
INFO reached maximum number of pending MGS-driven updates, max: 1
generated blueprint a5a8f242-ffa5-473c-8efd-2acf2dc0b736 based on parent blueprint d60afc57-f15d-476c-bd0f-b1071e2bb976
blueprint source: planner with report:
planning report:
* 1 pending MGS update:
  * 913-0000019:serial0: HostPhase1(PendingMgsUpdateHostPhase1Details { expected_active_phase_1_slot: A, expected_boot_disk: A, expected_active_phase_1_hash: ArtifactHash(HexArray(0101010101010101010101010101010101010101010101010101010101010101)), expected_active_phase_2_hash: ArtifactHash(HexArray(0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a)), expected_inactive_phase_1_hash: ArtifactHash(HexArray(0202020202020202020202020202020202020202020202020202020202020202)), expected_inactive_phase_2_hash: ArtifactHash(HexArray(c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d)), sled_agent_address: [fd00:1122:3344:101::1]:12345 })
* zone updates waiting on pending MGS updates (RoT bootloader / RoT / SP / Host OS)
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint d60afc57-f15d-476c-bd0f-b1071e2bb976
to:   blueprint a5a8f242-ffa5-473c-8efd-2acf2dc0b736

 MODIFIED SLEDS:

  sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 (active, config generation 4 -> 5):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    --------------------------------
    slot   boot image source        
    --------------------------------
    A      current contents         
*   B      - current contents       
     └─    + artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-073979dd-3248-44a5-9fa1-cc72a140d682   in service 
    fake-vendor   fake-model   serial-c6d33b64-fb96-4129-bab1-7878a06a5f9b   in service 
    fake-vendor   fake-model   serial-e4d937e1-6ddc-4eca-bb08-c1f73791e608   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crucible                                                              335e1dc3-b610-48dd-90bb-9ca5cce1a6d0   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crucible                                                              d5fef28b-4ee8-4443-8c06-7e872c2502f3   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crucible                                                              6477f019-088c-43cf-8508-aa93f868830f   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    02c56a30-7d97-406d-bd34-1eb437fd517d   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    4d7e3e8e-06bd-414c-a468-779e056a9b75   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone                                                            4617d206-4330-4dfa-b9f3-f63a3db834f9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone                                                            4f60b534-eaa3-40a1-b60f-bfdf147af478   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone                                                            ad41be71-6c15-4428-b510-20ceacde4fa6   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone/oxz_crucible_058fd5f9-60a8-4e11-9302-15172782e17d          55a2a61a-1471-49b2-a6d0-b191ed94e057   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_5199c033-4cf9-4ab6-8ae7-566bd7606363          90b46084-4238-45ba-9e26-d3f2623e640e   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_crucible_dfac80b4-a887-430a-ae87-a4e065dba787          bcdc7bf3-bbae-4e7f-81b2-4d94c8f752a4   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_ba4994a8-23f9-4b1a-a84f-a08d74591389   50b029e3-96aa-41e5-bf39-023193a4355e   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_803bfb63-c246-41db-b0da-d3b87ddfc63d      ea8a11bf-a884-4c4f-8df0-3ef9b7aacf43   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_427ec88f-f467-42fa-9bbb-66a91a36103c      7b4ce6bf-95bb-42fe-a4a0-dff31211ab88   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_0c71b3b2-6ceb-4e8f-b020-b08675e83038             832fd140-d467-4bad-b5e9-63171634087c   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_6444f8a5-6465-4f0b-a549-1993c113569c               42430c80-7836-4191-a4f6-bcee749010fe   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/debug                                                           248c6c10-1ac6-45de-bb55-ede36ca56bbd   in service    100 GiB   none          gzip-9     
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/debug                                                           686c19cf-a0d7-45f6-866f-c564612b2664   in service    100 GiB   none          gzip-9     
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/debug                                                           1bca7f71-5e42-4749-91ec-fa40793a3a9a   in service    100 GiB   none          gzip-9     
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/local_storage                                                   cdf3684f-a6cf-4449-b9ec-e696b2c663e2   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/local_storage                                                   3ac089c9-9dec-465b-863a-188e80d71fb4   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/local_storage                                                   43931274-7fe8-4077-825d-dff2bc8efa58   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/local_storage_unencrypted                                             793ac181-1b01-403c-850d-7f5c54bda6c9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/local_storage_unencrypted                                             a4c3032e-21fa-4d4a-b040-a7e3c572cf3c   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/local_storage_unencrypted                                             4847a96e-a267-4ae7-aa3d-805c1e77f81e   in service    none      none          off        


    omicron zones:
    ----------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition   underlay IP          
    ----------------------------------------------------------------------------------------------------------------------
    crucible          058fd5f9-60a8-4e11-9302-15172782e17d   artifact: version 0.0.1   in service    fd00:1122:3344:101::9
    crucible          5199c033-4cf9-4ab6-8ae7-566bd7606363   artifact: version 0.0.1   in service    fd00:1122:3344:101::7
    crucible          dfac80b4-a887-430a-ae87-a4e065dba787   artifact: version 0.0.1   in service    fd00:1122:3344:101::8
    crucible_pantry   ba4994a8-23f9-4b1a-a84f-a08d74591389   artifact: version 0.0.1   in service    fd00:1122:3344:101::6
    external_dns      803bfb63-c246-41db-b0da-d3b87ddfc63d   artifact: version 0.0.1   in service    fd00:1122:3344:101::5
    internal_dns      427ec88f-f467-42fa-9bbb-66a91a36103c   artifact: version 0.0.1   in service    fd00:1122:3344:2::1  
    internal_ntp      6444f8a5-6465-4f0b-a549-1993c113569c   artifact: version 0.0.1   in service    fd00:1122:3344:101::3
    nexus             0c71b3b2-6ceb-4e8f-b020-b08675e83038   artifact: version 0.0.1   in service    fd00:1122:3344:101::4


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)

 PENDING MGS UPDATES:

    Pending MGS-managed updates (all baseboards):
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    sp_type   slot   part_number   serial_number   artifact_hash                                                        artifact_version   details                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
*   sled      0      913-0000019   serial0         - 3f6a641e1a26b718b351ed286e22b4c055d2dc7898e7ea873cd634796c2fb918   1.0.0              - Sp(PendingMgsUpdateSpDetails { expected_active_version: ArtifactVersion("0.0.1"), expected_inactive_version: NoValidVersion })                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 
     └─                                            + 2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c                      + HostPhase1(PendingMgsUpdateHostPhase1Details { expected_active_phase_1_slot: A, expected_boot_disk: A, expected_active_phase_1_hash: ArtifactHash(HexArray(0101010101010101010101010101010101010101010101010101010101010101)), expected_active_phase_2_hash: ArtifactHash(HexArray(0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a)), expected_inactive_phase_1_hash: ArtifactHash(HexArray(0202020202020202020202020202020202020202020202020202020202020202)), expected_inactive_phase_2_hash: ArtifactHash(HexArray(c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d)), sled_agent_address: [fd00:1122:3344:101::1]:12345 })


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # If we generate another plan, there should be no change.
> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO MGS-driven update not yet completed (will keep it), artifact_version: 1.0.0, artifact_hash: 2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c, sled_agent_address: [fd00:1122:3344:101::1]:12345, expected_inactive_phase_2_hash: c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d, expected_inactive_phase_1_hash: 0202020202020202020202020202020202020202020202020202020202020202, expected_active_phase_2_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a, expected_active_phase_1_hash: 0101010101010101010101010101010101010101010101010101010101010101, expected_boot_disk: A, expected_active_phase_1_slot: A, component: host_phase_1, sp_slot: 0, sp_type: Sled, serial_number: serial0, part_number: 913-0000019
INFO reached maximum number of pending MGS-driven updates, max: 1
generated blueprint 626487fa-7139-45ec-8416-902271fc730b based on parent blueprint a5a8f242-ffa5-473c-8efd-2acf2dc0b736
blueprint source: planner with report:
planning report:
* 1 pending MGS update:
  * 913-0000019:serial0: HostPhase1(PendingMgsUpdateHostPhase1Details { expected_active_phase_1_slot: A, expected_boot_disk: A, expected_active_phase_1_hash: ArtifactHash(HexArray(0101010101010101010101010101010101010101010101010101010101010101)), expected_active_phase_2_hash: ArtifactHash(HexArray(0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a)), expected_inactive_phase_1_hash: ArtifactHash(HexArray(0202020202020202020202020202020202020202020202020202020202020202)), expected_inactive_phase_2_hash: ArtifactHash(HexArray(c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d)), sled_agent_address: [fd00:1122:3344:101::1]:12345 })
* zone updates waiting on pending MGS updates (RoT bootloader / RoT / SP / Host OS)
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint a5a8f242-ffa5-473c-8efd-2acf2dc0b736
to:   blueprint 626487fa-7139-45ec-8416-902271fc730b

 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # Update only the simulated host phase 2; this is a prerequisite for updating
> # the phase 1, and must be done first.
> sled-update-host-phase2 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 --slot-b c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d
set sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 host phase 2 details: B -> c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d

> inventory-generate
generated inventory collection 39363465-89ae-4ac2-9be1-099068da9d45 from configured sleds


> # Planning after only phase 2 has changed should make no changes. We're still
> # waiting on phase 1 to change.
> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO MGS-driven update not yet completed (will keep it), artifact_version: 1.0.0, artifact_hash: 2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c, sled_agent_address: [fd00:1122:3344:101::1]:12345, expected_inactive_phase_2_hash: c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d, expected_inactive_phase_1_hash: 0202020202020202020202020202020202020202020202020202020202020202, expected_active_phase_2_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a, expected_active_phase_1_hash: 0101010101010101010101010101010101010101010101010101010101010101, expected_boot_disk: A, expected_active_phase_1_slot: A, component: host_phase_1, sp_slot: 0, sp_type: Sled, serial_number: serial0, part_number: 913-0000019
INFO reached maximum number of pending MGS-driven updates, max: 1
generated blueprint c1a0d242-9160-40f4-96ae-61f8f40a0b1b based on parent blueprint 626487fa-7139-45ec-8416-902271fc730b
blueprint source: planner with report:
planning report:
* 1 pending MGS update:
  * 913-0000019:serial0: HostPhase1(PendingMgsUpdateHostPhase1Details { expected_active_phase_1_slot: A, expected_boot_disk: A, expected_active_phase_1_hash: ArtifactHash(HexArray(0101010101010101010101010101010101010101010101010101010101010101)), expected_active_phase_2_hash: ArtifactHash(HexArray(0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a)), expected_inactive_phase_1_hash: ArtifactHash(HexArray(0202020202020202020202020202020202020202020202020202020202020202)), expected_inactive_phase_2_hash: ArtifactHash(HexArray(c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d)), sled_agent_address: [fd00:1122:3344:101::1]:12345 })
* zone updates waiting on pending MGS updates (RoT bootloader / RoT / SP / Host OS)
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 626487fa-7139-45ec-8416-902271fc730b
to:   blueprint c1a0d242-9160-40f4-96ae-61f8f40a0b1b

 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # Now update the simulated SP to reflect that the phase 1 update is done.
> sled-update-host-phase1 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 --active B --slot-b 2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c
set sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 host phase 1 details: active -> B, B -> 2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c

> inventory-generate
generated inventory collection 04bc9001-0836-4fec-b9cb-9d4760caf8b4 from configured sleds


> # Planning _still_ shouldn't make any new changes; the OS update as a whole
> # isn't done until sled-agent reports it has booted from the new image.
> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO keeping apparently-impossible MGS-driven update (waiting for recent update to be applied), artifact_version: 1.0.0, artifact_hash: 2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c, sled_agent_address: [fd00:1122:3344:101::1]:12345, expected_inactive_phase_2_hash: c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d, expected_inactive_phase_1_hash: 0202020202020202020202020202020202020202020202020202020202020202, expected_active_phase_2_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a, expected_active_phase_1_hash: 0101010101010101010101010101010101010101010101010101010101010101, expected_boot_disk: A, expected_active_phase_1_slot: A, component: host_phase_1, sp_slot: 0, sp_type: Sled, serial_number: serial0, part_number: 913-0000019
INFO reached maximum number of pending MGS-driven updates, max: 1
generated blueprint afb09faf-a586-4483-9289-04d4f1d8ba23 based on parent blueprint c1a0d242-9160-40f4-96ae-61f8f40a0b1b
blueprint source: planner with report:
planning report:
* 1 pending MGS update:
  * 913-0000019:serial0: HostPhase1(PendingMgsUpdateHostPhase1Details { expected_active_phase_1_slot: A, expected_boot_disk: A, expected_active_phase_1_hash: ArtifactHash(HexArray(0101010101010101010101010101010101010101010101010101010101010101)), expected_active_phase_2_hash: ArtifactHash(HexArray(0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a)), expected_inactive_phase_1_hash: ArtifactHash(HexArray(0202020202020202020202020202020202020202020202020202020202020202)), expected_inactive_phase_2_hash: ArtifactHash(HexArray(c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d)), sled_agent_address: [fd00:1122:3344:101::1]:12345 })
* zone updates waiting on pending MGS updates (RoT bootloader / RoT / SP / Host OS)
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint c1a0d242-9160-40f4-96ae-61f8f40a0b1b
to:   blueprint afb09faf-a586-4483-9289-04d4f1d8ba23

 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # Update the sled's boot disk; this finishes the host OS update.
> sled-update-host-phase2 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 --boot-disk B
set sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 host phase 2 details: boot_disk -> B

> inventory-generate
generated inventory collection 08abe624-4b5f-491c-90cb-d74a84e4ba3e from configured sleds


> # Planning should now remove the host OS update and plan the next RoT bootloader
> # update.
> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO MGS-driven update completed (will remove it and re-evaluate board), artifact_version: 1.0.0, artifact_hash: 2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c, sled_agent_address: [fd00:1122:3344:101::1]:12345, expected_inactive_phase_2_hash: c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d, expected_inactive_phase_1_hash: 0202020202020202020202020202020202020202020202020202020202020202, expected_active_phase_2_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a, expected_active_phase_1_hash: 0101010101010101010101010101010101010101010101010101010101010101, expected_boot_disk: A, expected_active_phase_1_slot: A, component: host_phase_1, sp_slot: 0, sp_type: Sled, serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO configuring MGS-driven update, artifact_version: 1.0.0, artifact_hash: 9f0d143c76b66c62584789c5d57c03068b6fb6fd4e128b019f57071fdcccd68c, expected_stage0_next_version: NoValidVersion, expected_stage0_version: 0.0.1, component: rot_bootloader, sp_slot: 1, sp_type: Sled, serial_number: serial1, part_number: 913-0000019
INFO reached maximum number of pending MGS-driven updates, max: 1
generated blueprint ce365dff-2cdb-4f35-a186-b15e20e1e700 based on parent blueprint afb09faf-a586-4483-9289-04d4f1d8ba23
blueprint source: planner with report:
planning report:
* 1 pending MGS update:
  * 913-0000019:serial1: RotBootloader(PendingMgsUpdateRotBootloaderDetails { expected_stage0_version: ArtifactVersion("0.0.1"), expected_stage0_next_version: NoValidVersion })
* zone updates waiting on pending MGS updates (RoT bootloader / RoT / SP / Host OS)
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint afb09faf-a586-4483-9289-04d4f1d8ba23
to:   blueprint ce365dff-2cdb-4f35-a186-b15e20e1e700

 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)

 PENDING MGS UPDATES:

    Pending MGS-managed updates (all baseboards):
    ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    sp_type   slot   part_number   serial_number   artifact_hash                                                      artifact_version   details                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        
    ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-   sled      0      913-0000019   serial0         2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c   1.0.0              HostPhase1(PendingMgsUpdateHostPhase1Details { expected_active_phase_1_slot: A, expected_boot_disk: A, expected_active_phase_1_hash: ArtifactHash(HexArray(0101010101010101010101010101010101010101010101010101010101010101)), expected_active_phase_2_hash: ArtifactHash(HexArray(0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a)), expected_inactive_phase_1_hash: ArtifactHash(HexArray(0202020202020202020202020202020202020202020202020202020202020202)), expected_inactive_phase_2_hash: ArtifactHash(HexArray(c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d)), sled_agent_address: [fd00:1122:3344:101::1]:12345 })
+   sled      1      913-0000019   serial1         9f0d143c76b66c62584789c5d57c03068b6fb6fd4e128b019f57071fdcccd68c   1.0.0              RotBootloader(PendingMgsUpdateRotBootloaderDetails { expected_stage0_version: ArtifactVersion("0.0.1"), expected_stage0_next_version: NoValidVersion })                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # This time, make it more interesting.  Change the inactive slot contents of
> # the simulated RoT bootloader.  This should make the configured update
> # impossible and cause the planner to fix it. To test this, we also need to tell
> # the planner not to ignore this update even though it's quite new.
> set ignore-impossible-mgs-updates-since now
ignoring impossible MGS updates since <REDACTED_TIMESTAMP>

> sled-update-rot-bootloader 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c --stage0-next 0.5.0
set sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c RoT bootloader versions: stage0_next -> 0.5.0

> inventory-generate
generated inventory collection 005f6a30-7f65-4593-9f78-ee68f766f42b from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO MGS-driven update impossible (will remove it and re-evaluate board), artifact_version: 1.0.0, artifact_hash: 9f0d143c76b66c62584789c5d57c03068b6fb6fd4e128b019f57071fdcccd68c, expected_stage0_next_version: NoValidVersion, expected_stage0_version: 0.0.1, component: rot_bootloader, sp_slot: 1, sp_type: Sled, serial_number: serial1, part_number: 913-0000019
INFO configuring MGS-driven update, artifact_version: 1.0.0, artifact_hash: 9f0d143c76b66c62584789c5d57c03068b6fb6fd4e128b019f57071fdcccd68c, expected_stage0_next_version: Version(ArtifactVersion("0.5.0")), expected_stage0_version: 0.0.1, component: rot_bootloader, sp_slot: 1, sp_type: Sled, serial_number: serial1, part_number: 913-0000019
INFO reached maximum number of pending MGS-driven updates, max: 1
generated blueprint 8f2d1f39-7c88-4701-aa43-56bf281b28c1 based on parent blueprint ce365dff-2cdb-4f35-a186-b15e20e1e700
blueprint source: planner with report:
planning report:
* 1 pending MGS update:
  * 913-0000019:serial1: RotBootloader(PendingMgsUpdateRotBootloaderDetails { expected_stage0_version: ArtifactVersion("0.0.1"), expected_stage0_next_version: Version(ArtifactVersion("0.5.0")) })
* zone updates waiting on pending MGS updates (RoT bootloader / RoT / SP / Host OS)
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint ce365dff-2cdb-4f35-a186-b15e20e1e700
to:   blueprint 8f2d1f39-7c88-4701-aa43-56bf281b28c1

 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)

 PENDING MGS UPDATES:

    Pending MGS-managed updates (all baseboards):
    -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    sp_type   slot   part_number   serial_number   artifact_hash                                                      artifact_version   details                                                                                                                                                                     
    -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
*   sled      1      913-0000019   serial1         9f0d143c76b66c62584789c5d57c03068b6fb6fd4e128b019f57071fdcccd68c   1.0.0              - RotBootloader(PendingMgsUpdateRotBootloaderDetails { expected_stage0_version: ArtifactVersion("0.0.1"), expected_stage0_next_version: NoValidVersion })                   
     └─                                                                                                                                  + RotBootloader(PendingMgsUpdateRotBootloaderDetails { expected_stage0_version: ArtifactVersion("0.0.1"), expected_stage0_next_version: Version(ArtifactVersion("0.5.0")) })


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # Now simulate the update completing successfully.
> # Like before, we should see a pending RoT update for this sled.
> sled-update-rot-bootloader 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c --stage0 1.0.0
set sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c RoT bootloader versions: stage0 -> 1.0.0

> inventory-generate
generated inventory collection b5263998-e486-4cea-8842-b32bd326fa3a from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO MGS-driven update completed (will remove it and re-evaluate board), artifact_version: 1.0.0, artifact_hash: 9f0d143c76b66c62584789c5d57c03068b6fb6fd4e128b019f57071fdcccd68c, expected_stage0_next_version: Version(ArtifactVersion("0.5.0")), expected_stage0_version: 0.0.1, component: rot_bootloader, sp_slot: 1, sp_type: Sled, serial_number: serial1, part_number: 913-0000019
INFO configuring MGS-driven update, artifact_version: 1.0.0, artifact_hash: dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751, expected_transient_boot_preference: None, expected_pending_persistent_boot_preference: None, expected_persistent_boot_preference: A, expected_active_slot: ExpectedActiveRotSlot { slot: A, version: ArtifactVersion("0.0.2") }, expected_inactive_version: NoValidVersion, component: rot, sp_slot: 1, sp_type: Sled, serial_number: serial1, part_number: 913-0000019
INFO reached maximum number of pending MGS-driven updates, max: 1
generated blueprint 12d602a6-5ab4-487a-b94e-eb30cdf30300 based on parent blueprint 8f2d1f39-7c88-4701-aa43-56bf281b28c1
blueprint source: planner with report:
planning report:
* 1 pending MGS update:
  * 913-0000019:serial1: Rot(PendingMgsUpdateRotDetails { expected_active_slot: ExpectedActiveRotSlot { slot: A, version: ArtifactVersion("0.0.2") }, expected_inactive_version: NoValidVersion, expected_persistent_boot_preference: A, expected_pending_persistent_boot_preference: None, expected_transient_boot_preference: None })
* zone updates waiting on pending MGS updates (RoT bootloader / RoT / SP / Host OS)
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 8f2d1f39-7c88-4701-aa43-56bf281b28c1
to:   blueprint 12d602a6-5ab4-487a-b94e-eb30cdf30300

 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)

 PENDING MGS UPDATES:

    Pending MGS-managed updates (all baseboards):
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    sp_type   slot   part_number   serial_number   artifact_hash                                                        artifact_version   details                                                                                                                                                                                                                                                                                                         
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
*   sled      1      913-0000019   serial1         - 9f0d143c76b66c62584789c5d57c03068b6fb6fd4e128b019f57071fdcccd68c   1.0.0              - RotBootloader(PendingMgsUpdateRotBootloaderDetails { expected_stage0_version: ArtifactVersion("0.0.1"), expected_stage0_next_version: Version(ArtifactVersion("0.5.0")) })                                                                                                                                    
     └─                                            + dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751                      + Rot(PendingMgsUpdateRotDetails { expected_active_slot: ExpectedActiveRotSlot { slot: A, version: ArtifactVersion("0.0.2") }, expected_inactive_version: NoValidVersion, expected_persistent_boot_preference: A, expected_pending_persistent_boot_preference: None, expected_transient_boot_preference: None })


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # Now we'll change the inactive slot contents of the simulated RoT. Like with
> # the RoT bootloader, this should make the update impossible and cause the
> # planner to fix it.
> set ignore-impossible-mgs-updates-since now
ignoring impossible MGS updates since <REDACTED_TIMESTAMP>

> sled-update-rot 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c --slot-b 0.5.0
set sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c RoT settings: slot b -> 0.5.0

> inventory-generate
generated inventory collection 68767302-7fed-4eb1-9611-3dfd807ff0cd from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO MGS-driven update impossible (will remove it and re-evaluate board), artifact_version: 1.0.0, artifact_hash: dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751, expected_transient_boot_preference: None, expected_pending_persistent_boot_preference: None, expected_persistent_boot_preference: A, expected_active_slot: ExpectedActiveRotSlot { slot: A, version: ArtifactVersion("0.0.2") }, expected_inactive_version: NoValidVersion, component: rot, sp_slot: 1, sp_type: Sled, serial_number: serial1, part_number: 913-0000019
INFO configuring MGS-driven update, artifact_version: 1.0.0, artifact_hash: dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751, expected_transient_boot_preference: None, expected_pending_persistent_boot_preference: None, expected_persistent_boot_preference: A, expected_active_slot: ExpectedActiveRotSlot { slot: A, version: ArtifactVersion("0.0.2") }, expected_inactive_version: Version(ArtifactVersion("0.5.0")), component: rot, sp_slot: 1, sp_type: Sled, serial_number: serial1, part_number: 913-0000019
INFO reached maximum number of pending MGS-driven updates, max: 1
generated blueprint 61a93ea3-c872-48e0-aace-e86b0c52b839 based on parent blueprint 12d602a6-5ab4-487a-b94e-eb30cdf30300
blueprint source: planner with report:
planning report:
* 1 pending MGS update:
  * 913-0000019:serial1: Rot(PendingMgsUpdateRotDetails { expected_active_slot: ExpectedActiveRotSlot { slot: A, version: ArtifactVersion("0.0.2") }, expected_inactive_version: Version(ArtifactVersion("0.5.0")), expected_persistent_boot_preference: A, expected_pending_persistent_boot_preference: None, expected_transient_boot_preference: None })
* zone updates waiting on pending MGS updates (RoT bootloader / RoT / SP / Host OS)
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 12d602a6-5ab4-487a-b94e-eb30cdf30300
to:   blueprint 61a93ea3-c872-48e0-aace-e86b0c52b839

 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)

 PENDING MGS UPDATES:

    Pending MGS-managed updates (all baseboards):
    ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    sp_type   slot   part_number   serial_number   artifact_hash                                                      artifact_version   details                                                                                                                                                                                                                                                                                                                            
    ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
*   sled      1      913-0000019   serial1         dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751   1.0.0              - Rot(PendingMgsUpdateRotDetails { expected_active_slot: ExpectedActiveRotSlot { slot: A, version: ArtifactVersion("0.0.2") }, expected_inactive_version: NoValidVersion, expected_persistent_boot_preference: A, expected_pending_persistent_boot_preference: None, expected_transient_boot_preference: None })                   
     └─                                                                                                                                  + Rot(PendingMgsUpdateRotDetails { expected_active_slot: ExpectedActiveRotSlot { slot: A, version: ArtifactVersion("0.0.2") }, expected_inactive_version: Version(ArtifactVersion("0.5.0")), expected_persistent_boot_preference: A, expected_pending_persistent_boot_preference: None, expected_transient_boot_preference: None })


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # Now simulate the update completing successfully.
> # Like before, we should see a pending SP update for this sled.
> sled-update-rot 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c --slot-b 1.0.0 --active-slot b --persistent-boot-preference b
set sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c RoT settings: slot b -> 1.0.0, active slot -> B, persistent boot preference -> B

> inventory-generate
generated inventory collection 62898097-2ff1-48d0-8bc1-91b475daa33d from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO MGS-driven update completed (will remove it and re-evaluate board), artifact_version: 1.0.0, artifact_hash: dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751, expected_transient_boot_preference: None, expected_pending_persistent_boot_preference: None, expected_persistent_boot_preference: A, expected_active_slot: ExpectedActiveRotSlot { slot: A, version: ArtifactVersion("0.0.2") }, expected_inactive_version: Version(ArtifactVersion("0.5.0")), component: rot, sp_slot: 1, sp_type: Sled, serial_number: serial1, part_number: 913-0000019
INFO configuring MGS-driven update, artifact_version: 1.0.0, artifact_hash: 3f6a641e1a26b718b351ed286e22b4c055d2dc7898e7ea873cd634796c2fb918, expected_inactive_version: NoValidVersion, expected_active_version: 0.0.1, component: sp, sp_slot: 1, sp_type: Sled, serial_number: serial1, part_number: 913-0000019
INFO reached maximum number of pending MGS-driven updates, max: 1
generated blueprint 27e755bc-dc10-4647-853c-f89bb3a15a2c based on parent blueprint 61a93ea3-c872-48e0-aace-e86b0c52b839
blueprint source: planner with report:
planning report:
* 1 pending MGS update:
  * 913-0000019:serial1: Sp(PendingMgsUpdateSpDetails { expected_active_version: ArtifactVersion("0.0.1"), expected_inactive_version: NoValidVersion })
* zone updates waiting on pending MGS updates (RoT bootloader / RoT / SP / Host OS)
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 61a93ea3-c872-48e0-aace-e86b0c52b839
to:   blueprint 27e755bc-dc10-4647-853c-f89bb3a15a2c

 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)

 PENDING MGS UPDATES:

    Pending MGS-managed updates (all baseboards):
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    sp_type   slot   part_number   serial_number   artifact_hash                                                        artifact_version   details                                                                                                                                                                                                                                                                                                                            
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
*   sled      1      913-0000019   serial1         - dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751   1.0.0              - Rot(PendingMgsUpdateRotDetails { expected_active_slot: ExpectedActiveRotSlot { slot: A, version: ArtifactVersion("0.0.2") }, expected_inactive_version: Version(ArtifactVersion("0.5.0")), expected_persistent_boot_preference: A, expected_pending_persistent_boot_preference: None, expected_transient_boot_preference: None })
     └─                                            + 3f6a641e1a26b718b351ed286e22b4c055d2dc7898e7ea873cd634796c2fb918                      + Sp(PendingMgsUpdateSpDetails { expected_active_version: ArtifactVersion("0.0.1"), expected_inactive_version: NoValidVersion })                                                                                                                                                                                                   


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # We repeat the same procedure with the SP. Like with the RoT, this should make
> # the update impossible and cause the planner to fix it.
> set ignore-impossible-mgs-updates-since now
ignoring impossible MGS updates since <REDACTED_TIMESTAMP>

> sled-update-sp 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c --inactive 0.5.0
set sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c SP versions: inactive -> 0.5.0

> inventory-generate
generated inventory collection 3086f142-62d3-4f77-bda3-674afbb42d0d from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO MGS-driven update impossible (will remove it and re-evaluate board), artifact_version: 1.0.0, artifact_hash: 3f6a641e1a26b718b351ed286e22b4c055d2dc7898e7ea873cd634796c2fb918, expected_inactive_version: NoValidVersion, expected_active_version: 0.0.1, component: sp, sp_slot: 1, sp_type: Sled, serial_number: serial1, part_number: 913-0000019
INFO configuring MGS-driven update, artifact_version: 1.0.0, artifact_hash: 3f6a641e1a26b718b351ed286e22b4c055d2dc7898e7ea873cd634796c2fb918, expected_inactive_version: Version(ArtifactVersion("0.5.0")), expected_active_version: 0.0.1, component: sp, sp_slot: 1, sp_type: Sled, serial_number: serial1, part_number: 913-0000019
INFO reached maximum number of pending MGS-driven updates, max: 1
generated blueprint 9f89efdf-a23e-4137-b7cc-79f4a91cbe1f based on parent blueprint 27e755bc-dc10-4647-853c-f89bb3a15a2c
blueprint source: planner with report:
planning report:
* 1 pending MGS update:
  * 913-0000019:serial1: Sp(PendingMgsUpdateSpDetails { expected_active_version: ArtifactVersion("0.0.1"), expected_inactive_version: Version(ArtifactVersion("0.5.0")) })
* zone updates waiting on pending MGS updates (RoT bootloader / RoT / SP / Host OS)
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 27e755bc-dc10-4647-853c-f89bb3a15a2c
to:   blueprint 9f89efdf-a23e-4137-b7cc-79f4a91cbe1f

 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)

 PENDING MGS UPDATES:

    Pending MGS-managed updates (all baseboards):
    ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    sp_type   slot   part_number   serial_number   artifact_hash                                                      artifact_version   details                                                                                                                                            
    ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
*   sled      1      913-0000019   serial1         3f6a641e1a26b718b351ed286e22b4c055d2dc7898e7ea873cd634796c2fb918   1.0.0              - Sp(PendingMgsUpdateSpDetails { expected_active_version: ArtifactVersion("0.0.1"), expected_inactive_version: NoValidVersion })                   
     └─                                                                                                                                  + Sp(PendingMgsUpdateSpDetails { expected_active_version: ArtifactVersion("0.0.1"), expected_inactive_version: Version(ArtifactVersion("0.5.0")) })


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # Let's simulate the successful SP update as well.
> sled-update-sp 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c --active 1.0.0
set sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c SP versions: active -> 1.0.0

> inventory-generate
generated inventory collection ae5b3bb4-ce21-465f-b18e-857614732d66 from configured sleds


> # Planning should remove this update and add an OS update for this sled.
> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO MGS-driven update completed (will remove it and re-evaluate board), artifact_version: 1.0.0, artifact_hash: 3f6a641e1a26b718b351ed286e22b4c055d2dc7898e7ea873cd634796c2fb918, expected_inactive_version: Version(ArtifactVersion("0.5.0")), expected_active_version: 0.0.1, component: sp, sp_slot: 1, sp_type: Sled, serial_number: serial1, part_number: 913-0000019
INFO configuring MGS-driven update, artifact_version: 1.0.0, artifact_hash: 2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c, sled_agent_address: [fd00:1122:3344:102::1]:12345, expected_inactive_phase_2_hash: c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d, expected_inactive_phase_1_hash: 0202020202020202020202020202020202020202020202020202020202020202, expected_active_phase_2_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a, expected_active_phase_1_hash: 0101010101010101010101010101010101010101010101010101010101010101, expected_boot_disk: A, expected_active_phase_1_slot: A, component: host_phase_1, sp_slot: 1, sp_type: Sled, serial_number: serial1, part_number: 913-0000019
INFO reached maximum number of pending MGS-driven updates, max: 1
generated blueprint 9a9e6c32-5a84-4020-a159-33dceff18d35 based on parent blueprint 9f89efdf-a23e-4137-b7cc-79f4a91cbe1f
blueprint source: planner with report:
planning report:
* 1 pending MGS update:
  * 913-0000019:serial1: HostPhase1(PendingMgsUpdateHostPhase1Details { expected_active_phase_1_slot: A, expected_boot_disk: A, expected_active_phase_1_hash: ArtifactHash(HexArray(0101010101010101010101010101010101010101010101010101010101010101)), expected_active_phase_2_hash: ArtifactHash(HexArray(0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a)), expected_inactive_phase_1_hash: ArtifactHash(HexArray(0202020202020202020202020202020202020202020202020202020202020202)), expected_inactive_phase_2_hash: ArtifactHash(HexArray(c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d)), sled_agent_address: [fd00:1122:3344:102::1]:12345 })
* zone updates waiting on pending MGS updates (RoT bootloader / RoT / SP / Host OS)
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 9f89efdf-a23e-4137-b7cc-79f4a91cbe1f
to:   blueprint 9a9e6c32-5a84-4020-a159-33dceff18d35

 MODIFIED SLEDS:

  sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c (active, config generation 4 -> 5):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    --------------------------------
    slot   boot image source        
    --------------------------------
    A      current contents         
*   B      - current contents       
     └─    + artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-727522a7-934f-494d-b5b3-160968e74463   in service 
    fake-vendor   fake-model   serial-72c59873-31ff-4e36-8d76-ff834009349a   in service 
    fake-vendor   fake-model   serial-b5fd5bc1-099e-4e77-8028-a9793c11f43b   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_727522a7-934f-494d-b5b3-160968e74463/crucible                                                              feecfda1-9966-43d4-aaef-440b77f0b26d   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crucible                                                              956966b9-8201-437b-81ba-3c8ad2032080   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crucible                                                              4b0b09bf-94b7-45bf-a6b3-d46af53ae44a   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/clickhouse                                                      5ae11c7e-08fa-4d78-a4ea-14b4a9a10241   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    3e0d6188-c503-49cf-a441-fa7df40ceb43   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    b8f2a09f-8bd2-4418-872b-a4457a3f958c   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone                                                            4829f422-aa31-41a8-ab73-95684ff1ef48   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone                                                            3b66453b-7148-4c1b-84a9-499e43290ab4   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone                                                            841d5648-05f0-47b0-b446-92f6b60fe9a6   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_clickhouse_353b3b65-20f7-48c3-88f7-495bd5d31545        49f8fbb6-5bac-4609-907f-6e3dfc206059   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone/oxz_crucible_86a22a56-0168-453d-9df1-cb2a7c64b5d3          6e218d0a-13fd-4f70-884e-47e960fa8bb8   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_bd354eef-d8a6-4165-9124-283fb5e46d77          9073fb6b-f973-4bbd-b7cc-ba1abf6cb238   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone/oxz_crucible_e2fdefe7-95b2-4fd2-ae37-56929a06d58c          0582030b-aab6-4d0e-b1d2-64562ee712cd   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_ad6a3a03-8d0f-4504-99a4-cbf73d69b973   1640adb6-70bf-44cf-b05c-bff6dd300cf3   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_6c3ae381-04f7-41ea-b0ac-74db387dbc3a      78f34ce7-42f1-41da-995f-318f32054ad2   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_99e2f30b-3174-40bf-a78a-90da8abba8ca      2f204c50-a327-479c-8852-f53ec7a19c1f   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_nexus_466a9f29-62bf-4e63-924a-b9efdb86afec             8e0bd2bd-23b7-4bc6-9e73-c4d4ebc0bc8c   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_62620961-fc4a-481e-968b-f5acbac0dc63               8c4fa711-1d5d-4e93-85f0-d17bff47b063   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/debug                                                           93957ca0-9ed1-4e7b-8c34-2ce07a69541c   in service    100 GiB   none          gzip-9     
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/debug                                                           318fae85-abcb-4259-b1b6-ac96d193f7b7   in service    100 GiB   none          gzip-9     
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/debug                                                           b46de15d-33e7-4cd0-aa7c-e7be2a61e71b   in service    100 GiB   none          gzip-9     
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/local_storage                                                   2db6b7c1-0f46-4ced-a3ad-48872793360e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/local_storage                                                   09b9cc9b-3426-470b-a7bc-538f82dede03   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/local_storage                                                   c31623de-c19b-4615-9f1d-5e1daa5d3bda   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/local_storage_unencrypted                                             775f9207-c42d-4af2-9186-27ffef67735e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/local_storage_unencrypted                                             3560dd69-3b23-4c69-807d-d673104cfc68   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/local_storage_unencrypted                                             2ad1875a-92ac-472f-8c26-593309f0e4da   in service    none      none          off        


    omicron zones:
    ----------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition   underlay IP          
    ----------------------------------------------------------------------------------------------------------------------
    clickhouse        353b3b65-20f7-48c3-88f7-495bd5d31545   artifact: version 0.0.1   in service    fd00:1122:3344:102::5
    crucible          86a22a56-0168-453d-9df1-cb2a7c64b5d3   artifact: version 0.0.1   in service    fd00:1122:3344:102::a
    crucible          bd354eef-d8a6-4165-9124-283fb5e46d77   artifact: version 0.0.1   in service    fd00:1122:3344:102::8
    crucible          e2fdefe7-95b2-4fd2-ae37-56929a06d58c   artifact: version 0.0.1   in service    fd00:1122:3344:102::9
    crucible_pantry   ad6a3a03-8d0f-4504-99a4-cbf73d69b973   artifact: version 0.0.1   in service    fd00:1122:3344:102::7
    external_dns      6c3ae381-04f7-41ea-b0ac-74db387dbc3a   artifact: version 0.0.1   in service    fd00:1122:3344:102::6
    internal_dns      99e2f30b-3174-40bf-a78a-90da8abba8ca   artifact: version 0.0.1   in service    fd00:1122:3344:1::1  
    internal_ntp      62620961-fc4a-481e-968b-f5acbac0dc63   artifact: version 0.0.1   in service    fd00:1122:3344:102::3
    nexus             466a9f29-62bf-4e63-924a-b9efdb86afec   artifact: version 0.0.1   in service    fd00:1122:3344:102::4


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)

 PENDING MGS UPDATES:

    Pending MGS-managed updates (all baseboards):
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    sp_type   slot   part_number   serial_number   artifact_hash                                                        artifact_version   details                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
*   sled      1      913-0000019   serial1         - 3f6a641e1a26b718b351ed286e22b4c055d2dc7898e7ea873cd634796c2fb918   1.0.0              - Sp(PendingMgsUpdateSpDetails { expected_active_version: ArtifactVersion("0.0.1"), expected_inactive_version: Version(ArtifactVersion("0.5.0")) })                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
     └─                                            + 2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c                      + HostPhase1(PendingMgsUpdateHostPhase1Details { expected_active_phase_1_slot: A, expected_boot_disk: A, expected_active_phase_1_hash: ArtifactHash(HexArray(0101010101010101010101010101010101010101010101010101010101010101)), expected_active_phase_2_hash: ArtifactHash(HexArray(0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a)), expected_inactive_phase_1_hash: ArtifactHash(HexArray(0202020202020202020202020202020202020202020202020202020202020202)), expected_inactive_phase_2_hash: ArtifactHash(HexArray(c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d)), sled_agent_address: [fd00:1122:3344:102::1]:12345 })


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # Try a host OS impossible update replacement: write an unknown artifact to the
> # sled's phase 1. The planner should realize the update is impossible and
> # replace it. As with the impossible SP update test above, we have to bump the
> # "ignore impossible MGS updates" timestamp.)
> set ignore-impossible-mgs-updates-since now
ignoring impossible MGS updates since <REDACTED_TIMESTAMP>

> sled-update-host-phase1 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c --slot-b ffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffff
set sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c host phase 1 details: B -> ffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffff

> inventory-generate
generated inventory collection 34c3258c-b2ab-4da9-9720-41a3a703c3d7 from configured sleds

> blueprint-plan latest latest
INFO skipped noop image source check on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO MGS-driven update impossible (will remove it and re-evaluate board), artifact_version: 1.0.0, artifact_hash: 2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c, sled_agent_address: [fd00:1122:3344:102::1]:12345, expected_inactive_phase_2_hash: c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d, expected_inactive_phase_1_hash: 0202020202020202020202020202020202020202020202020202020202020202, expected_active_phase_2_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a, expected_active_phase_1_hash: 0101010101010101010101010101010101010101010101010101010101010101, expected_boot_disk: A, expected_active_phase_1_slot: A, component: host_phase_1, sp_slot: 1, sp_type: Sled, serial_number: serial1, part_number: 913-0000019
INFO configuring MGS-driven update, artifact_version: 1.0.0, artifact_hash: 2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c, sled_agent_address: [fd00:1122:3344:102::1]:12345, expected_inactive_phase_2_hash: c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d, expected_inactive_phase_1_hash: ffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffff, expected_active_phase_2_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a, expected_active_phase_1_hash: 0101010101010101010101010101010101010101010101010101010101010101, expected_boot_disk: A, expected_active_phase_1_slot: A, component: host_phase_1, sp_slot: 1, sp_type: Sled, serial_number: serial1, part_number: 913-0000019
INFO reached maximum number of pending MGS-driven updates, max: 1
generated blueprint 13cfdd24-52ba-4e94-8c83-02e3a48fc746 based on parent blueprint 9a9e6c32-5a84-4020-a159-33dceff18d35
blueprint source: planner with report:
planning report:
* 1 pending MGS update:
  * 913-0000019:serial1: HostPhase1(PendingMgsUpdateHostPhase1Details { expected_active_phase_1_slot: A, expected_boot_disk: A, expected_active_phase_1_hash: ArtifactHash(HexArray(0101010101010101010101010101010101010101010101010101010101010101)), expected_active_phase_2_hash: ArtifactHash(HexArray(0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a)), expected_inactive_phase_1_hash: ArtifactHash(HexArray(ffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffff)), expected_inactive_phase_2_hash: ArtifactHash(HexArray(c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d)), sled_agent_address: [fd00:1122:3344:102::1]:12345 })
* zone updates waiting on pending MGS updates (RoT bootloader / RoT / SP / Host OS)
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 9a9e6c32-5a84-4020-a159-33dceff18d35
to:   blueprint 13cfdd24-52ba-4e94-8c83-02e3a48fc746

 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)

 PENDING MGS UPDATES:

    Pending MGS-managed updates (all baseboards):
    ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    sp_type   slot   part_number   serial_number   artifact_hash                                                      artifact_version   details                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
    ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
*   sled      1      913-0000019   serial1         2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c   1.0.0              - HostPhase1(PendingMgsUpdateHostPhase1Details { expected_active_phase_1_slot: A, expected_boot_disk: A, expected_active_phase_1_hash: ArtifactHash(HexArray(0101010101010101010101010101010101010101010101010101010101010101)), expected_active_phase_2_hash: ArtifactHash(HexArray(0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a)), expected_inactive_phase_1_hash: ArtifactHash(HexArray(0202020202020202020202020202020202020202020202020202020202020202)), expected_inactive_phase_2_hash: ArtifactHash(HexArray(c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d)), sled_agent_address: [fd00:1122:3344:102::1]:12345 })
     └─                                                                                                                                  + HostPhase1(PendingMgsUpdateHostPhase1Details { expected_active_phase_1_slot: A, expected_boot_disk: A, expected_active_phase_1_hash: ArtifactHash(HexArray(0101010101010101010101010101010101010101010101010101010101010101)), expected_active_phase_2_hash: ArtifactHash(HexArray(0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a)), expected_inactive_phase_1_hash: ArtifactHash(HexArray(ffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffff)), expected_inactive_phase_2_hash: ArtifactHash(HexArray(c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d)), sled_agent_address: [fd00:1122:3344:102::1]:12345 })


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # Now simulate the update completing successfully.
> sled-update-host-phase2 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c --boot-disk B --slot-b c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d
set sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c host phase 2 details: boot_disk -> B, B -> c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d

> sled-update-host-phase1 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c --active B --slot-b 2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c
set sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c host phase 1 details: active -> B, B -> 2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c

> inventory-generate
generated inventory collection 5e106b73-6a14-4955-b8a8-a4f8afed6405 from configured sleds


> # Another planning step should try to update the last sled, starting with the
> # RoT bootloader.
> blueprint-plan latest latest
INFO skipped noop image source check on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO MGS-driven update completed (will remove it and re-evaluate board), artifact_version: 1.0.0, artifact_hash: 2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c, sled_agent_address: [fd00:1122:3344:102::1]:12345, expected_inactive_phase_2_hash: c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d, expected_inactive_phase_1_hash: ffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffff, expected_active_phase_2_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a, expected_active_phase_1_hash: 0101010101010101010101010101010101010101010101010101010101010101, expected_boot_disk: A, expected_active_phase_1_slot: A, component: host_phase_1, sp_slot: 1, sp_type: Sled, serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO configuring MGS-driven update, artifact_version: 1.0.0, artifact_hash: 9f0d143c76b66c62584789c5d57c03068b6fb6fd4e128b019f57071fdcccd68c, expected_stage0_next_version: NoValidVersion, expected_stage0_version: 0.0.1, component: rot_bootloader, sp_slot: 2, sp_type: Sled, serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint b82656b0-a9be-433d-83d0-e2bdf371777a based on parent blueprint 13cfdd24-52ba-4e94-8c83-02e3a48fc746
blueprint source: planner with report:
planning report:
* 1 pending MGS update:
  * 913-0000019:serial2: RotBootloader(PendingMgsUpdateRotBootloaderDetails { expected_stage0_version: ArtifactVersion("0.0.1"), expected_stage0_next_version: NoValidVersion })
* zone updates waiting on pending MGS updates (RoT bootloader / RoT / SP / Host OS)
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 13cfdd24-52ba-4e94-8c83-02e3a48fc746
to:   blueprint b82656b0-a9be-433d-83d0-e2bdf371777a

 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)

 PENDING MGS UPDATES:

    Pending MGS-managed updates (all baseboards):
    ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    sp_type   slot   part_number   serial_number   artifact_hash                                                      artifact_version   details                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        
    ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-   sled      1      913-0000019   serial1         2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c   1.0.0              HostPhase1(PendingMgsUpdateHostPhase1Details { expected_active_phase_1_slot: A, expected_boot_disk: A, expected_active_phase_1_hash: ArtifactHash(HexArray(0101010101010101010101010101010101010101010101010101010101010101)), expected_active_phase_2_hash: ArtifactHash(HexArray(0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a)), expected_inactive_phase_1_hash: ArtifactHash(HexArray(ffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffff)), expected_inactive_phase_2_hash: ArtifactHash(HexArray(c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d)), sled_agent_address: [fd00:1122:3344:102::1]:12345 })
+   sled      2      913-0000019   serial2         9f0d143c76b66c62584789c5d57c03068b6fb6fd4e128b019f57071fdcccd68c   1.0.0              RotBootloader(PendingMgsUpdateRotBootloaderDetails { expected_stage0_version: ArtifactVersion("0.0.1"), expected_stage0_next_version: NoValidVersion })                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # Update the RoT bootloader on the last sled.
> # There should be a pending RoT update.
> sled-update-rot-bootloader d81c6a84-79b8-4958-ae41-ea46c9b19763 --stage0 1.0.0
set sled d81c6a84-79b8-4958-ae41-ea46c9b19763 RoT bootloader versions: stage0 -> 1.0.0

> inventory-generate
generated inventory collection 36ef425f-a672-4bf4-8d29-14815a84ccad from configured sleds

> blueprint-plan latest latest
INFO skipped noop image source check on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO MGS-driven update completed (will remove it and re-evaluate board), artifact_version: 1.0.0, artifact_hash: 9f0d143c76b66c62584789c5d57c03068b6fb6fd4e128b019f57071fdcccd68c, expected_stage0_next_version: NoValidVersion, expected_stage0_version: 0.0.1, component: rot_bootloader, sp_slot: 2, sp_type: Sled, serial_number: serial2, part_number: 913-0000019
INFO configuring MGS-driven update, artifact_version: 1.0.0, artifact_hash: dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751, expected_transient_boot_preference: None, expected_pending_persistent_boot_preference: None, expected_persistent_boot_preference: A, expected_active_slot: ExpectedActiveRotSlot { slot: A, version: ArtifactVersion("0.0.2") }, expected_inactive_version: NoValidVersion, component: rot, sp_slot: 2, sp_type: Sled, serial_number: serial2, part_number: 913-0000019
INFO reached maximum number of pending MGS-driven updates, max: 1
generated blueprint 31c84831-be52-4630-bc3f-128d72cd8f22 based on parent blueprint b82656b0-a9be-433d-83d0-e2bdf371777a
blueprint source: planner with report:
planning report:
* 1 pending MGS update:
  * 913-0000019:serial2: Rot(PendingMgsUpdateRotDetails { expected_active_slot: ExpectedActiveRotSlot { slot: A, version: ArtifactVersion("0.0.2") }, expected_inactive_version: NoValidVersion, expected_persistent_boot_preference: A, expected_pending_persistent_boot_preference: None, expected_transient_boot_preference: None })
* zone updates waiting on pending MGS updates (RoT bootloader / RoT / SP / Host OS)
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint b82656b0-a9be-433d-83d0-e2bdf371777a
to:   blueprint 31c84831-be52-4630-bc3f-128d72cd8f22

 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)

 PENDING MGS UPDATES:

    Pending MGS-managed updates (all baseboards):
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    sp_type   slot   part_number   serial_number   artifact_hash                                                        artifact_version   details                                                                                                                                                                                                                                                                                                         
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
*   sled      2      913-0000019   serial2         - 9f0d143c76b66c62584789c5d57c03068b6fb6fd4e128b019f57071fdcccd68c   1.0.0              - RotBootloader(PendingMgsUpdateRotBootloaderDetails { expected_stage0_version: ArtifactVersion("0.0.1"), expected_stage0_next_version: NoValidVersion })                                                                                                                                                       
     └─                                            + dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751                      + Rot(PendingMgsUpdateRotDetails { expected_active_slot: ExpectedActiveRotSlot { slot: A, version: ArtifactVersion("0.0.2") }, expected_inactive_version: NoValidVersion, expected_persistent_boot_preference: A, expected_pending_persistent_boot_preference: None, expected_transient_boot_preference: None })


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # Now let's simulate an RoT update that hasn't completed by setting the persistent
> # boot preference to a different slot than the active one. This should cause the
> # planner to mark it as impossible, and replace it.
> set ignore-impossible-mgs-updates-since now
ignoring impossible MGS updates since <REDACTED_TIMESTAMP>

> sled-update-rot d81c6a84-79b8-4958-ae41-ea46c9b19763 --slot-b 1.0.0 --active-slot a --persistent-boot-preference b
set sled d81c6a84-79b8-4958-ae41-ea46c9b19763 RoT settings: slot b -> 1.0.0, active slot -> A, persistent boot preference -> B

> inventory-generate
generated inventory collection 70bea701-e212-4877-8e6c-925f1f73ddd2 from configured sleds

> blueprint-plan latest latest
INFO skipped noop image source check on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO MGS-driven update impossible (will remove it and re-evaluate board), artifact_version: 1.0.0, artifact_hash: dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751, expected_transient_boot_preference: None, expected_pending_persistent_boot_preference: None, expected_persistent_boot_preference: A, expected_active_slot: ExpectedActiveRotSlot { slot: A, version: ArtifactVersion("0.0.2") }, expected_inactive_version: NoValidVersion, component: rot, sp_slot: 2, sp_type: Sled, serial_number: serial2, part_number: 913-0000019
INFO configuring MGS-driven update, artifact_version: 1.0.0, artifact_hash: dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751, expected_transient_boot_preference: None, expected_pending_persistent_boot_preference: None, expected_persistent_boot_preference: B, expected_active_slot: ExpectedActiveRotSlot { slot: A, version: ArtifactVersion("0.0.2") }, expected_inactive_version: Version(ArtifactVersion("1.0.0")), component: rot, sp_slot: 2, sp_type: Sled, serial_number: serial2, part_number: 913-0000019
INFO reached maximum number of pending MGS-driven updates, max: 1
generated blueprint 778e3f3a-58b1-4a5e-acff-d23c5d7124c2 based on parent blueprint 31c84831-be52-4630-bc3f-128d72cd8f22
blueprint source: planner with report:
planning report:
* 1 pending MGS update:
  * 913-0000019:serial2: Rot(PendingMgsUpdateRotDetails { expected_active_slot: ExpectedActiveRotSlot { slot: A, version: ArtifactVersion("0.0.2") }, expected_inactive_version: Version(ArtifactVersion("1.0.0")), expected_persistent_boot_preference: B, expected_pending_persistent_boot_preference: None, expected_transient_boot_preference: None })
* zone updates waiting on pending MGS updates (RoT bootloader / RoT / SP / Host OS)
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 31c84831-be52-4630-bc3f-128d72cd8f22
to:   blueprint 778e3f3a-58b1-4a5e-acff-d23c5d7124c2

 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)

 PENDING MGS UPDATES:

    Pending MGS-managed updates (all baseboards):
    ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    sp_type   slot   part_number   serial_number   artifact_hash                                                      artifact_version   details                                                                                                                                                                                                                                                                                                                            
    ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
*   sled      2      913-0000019   serial2         dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751   1.0.0              - Rot(PendingMgsUpdateRotDetails { expected_active_slot: ExpectedActiveRotSlot { slot: A, version: ArtifactVersion("0.0.2") }, expected_inactive_version: NoValidVersion, expected_persistent_boot_preference: A, expected_pending_persistent_boot_preference: None, expected_transient_boot_preference: None })                   
     └─                                                                                                                                  + Rot(PendingMgsUpdateRotDetails { expected_active_slot: ExpectedActiveRotSlot { slot: A, version: ArtifactVersion("0.0.2") }, expected_inactive_version: Version(ArtifactVersion("1.0.0")), expected_persistent_boot_preference: B, expected_pending_persistent_boot_preference: None, expected_transient_boot_preference: None })


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # An RoT update cannot continue if pending persistent boot preference is set.
> # The slot B is set to a different version so it does not appear to be active
> # and on the correct version, and the corresponding checks are triggered.
> # Like before, this should cause the planner to mark it as impossible, and
> # replace it.
> set ignore-impossible-mgs-updates-since now
ignoring impossible MGS updates since <REDACTED_TIMESTAMP>

> sled-update-rot d81c6a84-79b8-4958-ae41-ea46c9b19763 --slot-b 1.1.0 --active-slot b --persistent-boot-preference b --pending-persistent-boot-preference b
set sled d81c6a84-79b8-4958-ae41-ea46c9b19763 RoT settings: slot b -> 1.1.0, active slot -> B, persistent boot preference -> B, pending persistent boot preference -> Some(B)

> inventory-generate
generated inventory collection 8187f847-81c7-4750-88ac-d691937461af from configured sleds

> blueprint-plan latest latest
INFO skipped noop image source check on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO MGS-driven update impossible (will remove it and re-evaluate board), artifact_version: 1.0.0, artifact_hash: dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751, expected_transient_boot_preference: None, expected_pending_persistent_boot_preference: None, expected_persistent_boot_preference: B, expected_active_slot: ExpectedActiveRotSlot { slot: A, version: ArtifactVersion("0.0.2") }, expected_inactive_version: Version(ArtifactVersion("1.0.0")), component: rot, sp_slot: 2, sp_type: Sled, serial_number: serial2, part_number: 913-0000019
INFO configuring MGS-driven update, artifact_version: 1.0.0, artifact_hash: dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751, expected_transient_boot_preference: None, expected_pending_persistent_boot_preference: Some(B), expected_persistent_boot_preference: B, expected_active_slot: ExpectedActiveRotSlot { slot: B, version: ArtifactVersion("1.1.0") }, expected_inactive_version: Version(ArtifactVersion("0.0.2")), component: rot, sp_slot: 2, sp_type: Sled, serial_number: serial2, part_number: 913-0000019
INFO reached maximum number of pending MGS-driven updates, max: 1
generated blueprint 386a7ec3-7c2e-43cf-8f00-999e91e1d5e6 based on parent blueprint 778e3f3a-58b1-4a5e-acff-d23c5d7124c2
blueprint source: planner with report:
planning report:
* 1 pending MGS update:
  * 913-0000019:serial2: Rot(PendingMgsUpdateRotDetails { expected_active_slot: ExpectedActiveRotSlot { slot: B, version: ArtifactVersion("1.1.0") }, expected_inactive_version: Version(ArtifactVersion("0.0.2")), expected_persistent_boot_preference: B, expected_pending_persistent_boot_preference: Some(B), expected_transient_boot_preference: None })
* zone updates waiting on pending MGS updates (RoT bootloader / RoT / SP / Host OS)
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 778e3f3a-58b1-4a5e-acff-d23c5d7124c2
to:   blueprint 386a7ec3-7c2e-43cf-8f00-999e91e1d5e6

 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)

 PENDING MGS UPDATES:

    Pending MGS-managed updates (all baseboards):
    ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    sp_type   slot   part_number   serial_number   artifact_hash                                                      artifact_version   details                                                                                                                                                                                                                                                                                                                               
    ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
*   sled      2      913-0000019   serial2         dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751   1.0.0              - Rot(PendingMgsUpdateRotDetails { expected_active_slot: ExpectedActiveRotSlot { slot: A, version: ArtifactVersion("0.0.2") }, expected_inactive_version: Version(ArtifactVersion("1.0.0")), expected_persistent_boot_preference: B, expected_pending_persistent_boot_preference: None, expected_transient_boot_preference: None })   
     └─                                                                                                                                  + Rot(PendingMgsUpdateRotDetails { expected_active_slot: ExpectedActiveRotSlot { slot: B, version: ArtifactVersion("1.1.0") }, expected_inactive_version: Version(ArtifactVersion("0.0.2")), expected_persistent_boot_preference: B, expected_pending_persistent_boot_preference: Some(B), expected_transient_boot_preference: None })


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # We do the same for transient boot preference. Note that we need to set the
> # pending-persistent-boot-preference back to None
> set ignore-impossible-mgs-updates-since now
ignoring impossible MGS updates since <REDACTED_TIMESTAMP>

> sled-update-rot d81c6a84-79b8-4958-ae41-ea46c9b19763 --slot-b 1.1.0 --active-slot b --persistent-boot-preference b --transient-boot-preference b --pending-persistent-boot-preference
set sled d81c6a84-79b8-4958-ae41-ea46c9b19763 RoT settings: slot b -> 1.1.0, active slot -> B, persistent boot preference -> B, pending persistent boot preference -> None, transient boot preference -> Some(B)

> inventory-generate
generated inventory collection 45c1c7bb-984a-43f7-bb3f-4a5437ed7b82 from configured sleds

> blueprint-plan latest latest
INFO skipped noop image source check on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO MGS-driven update impossible (will remove it and re-evaluate board), artifact_version: 1.0.0, artifact_hash: dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751, expected_transient_boot_preference: None, expected_pending_persistent_boot_preference: Some(B), expected_persistent_boot_preference: B, expected_active_slot: ExpectedActiveRotSlot { slot: B, version: ArtifactVersion("1.1.0") }, expected_inactive_version: Version(ArtifactVersion("0.0.2")), component: rot, sp_slot: 2, sp_type: Sled, serial_number: serial2, part_number: 913-0000019
INFO configuring MGS-driven update, artifact_version: 1.0.0, artifact_hash: dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751, expected_transient_boot_preference: Some(B), expected_pending_persistent_boot_preference: None, expected_persistent_boot_preference: B, expected_active_slot: ExpectedActiveRotSlot { slot: B, version: ArtifactVersion("1.1.0") }, expected_inactive_version: Version(ArtifactVersion("0.0.2")), component: rot, sp_slot: 2, sp_type: Sled, serial_number: serial2, part_number: 913-0000019
INFO reached maximum number of pending MGS-driven updates, max: 1
generated blueprint e54a0836-53e1-4948-a3af-0b77165289b5 based on parent blueprint 386a7ec3-7c2e-43cf-8f00-999e91e1d5e6
blueprint source: planner with report:
planning report:
* 1 pending MGS update:
  * 913-0000019:serial2: Rot(PendingMgsUpdateRotDetails { expected_active_slot: ExpectedActiveRotSlot { slot: B, version: ArtifactVersion("1.1.0") }, expected_inactive_version: Version(ArtifactVersion("0.0.2")), expected_persistent_boot_preference: B, expected_pending_persistent_boot_preference: None, expected_transient_boot_preference: Some(B) })
* zone updates waiting on pending MGS updates (RoT bootloader / RoT / SP / Host OS)
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 386a7ec3-7c2e-43cf-8f00-999e91e1d5e6
to:   blueprint e54a0836-53e1-4948-a3af-0b77165289b5

 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)

 PENDING MGS UPDATES:

    Pending MGS-managed updates (all baseboards):
    ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    sp_type   slot   part_number   serial_number   artifact_hash                                                      artifact_version   details                                                                                                                                                                                                                                                                                                                               
    ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
*   sled      2      913-0000019   serial2         dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751   1.0.0              - Rot(PendingMgsUpdateRotDetails { expected_active_slot: ExpectedActiveRotSlot { slot: B, version: ArtifactVersion("1.1.0") }, expected_inactive_version: Version(ArtifactVersion("0.0.2")), expected_persistent_boot_preference: B, expected_pending_persistent_boot_preference: Some(B), expected_transient_boot_preference: None })
     └─                                                                                                                                  + Rot(PendingMgsUpdateRotDetails { expected_active_slot: ExpectedActiveRotSlot { slot: B, version: ArtifactVersion("1.1.0") }, expected_inactive_version: Version(ArtifactVersion("0.0.2")), expected_persistent_boot_preference: B, expected_pending_persistent_boot_preference: None, expected_transient_boot_preference: Some(B) })


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # Update the RoT on the last sled. Note that we need to set the
> # transient-boot-preference back to None
> # There should be one last pending SP update.
> sled-update-rot d81c6a84-79b8-4958-ae41-ea46c9b19763 --slot-b 1.0.0 --active-slot b --persistent-boot-preference b --transient-boot-preference
set sled d81c6a84-79b8-4958-ae41-ea46c9b19763 RoT settings: slot b -> 1.0.0, active slot -> B, persistent boot preference -> B, transient boot preference -> None

> inventory-generate
generated inventory collection ca7f27e8-5949-4ac1-8f32-18ad76d9c217 from configured sleds

> blueprint-plan latest latest
INFO skipped noop image source check on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO MGS-driven update completed (will remove it and re-evaluate board), artifact_version: 1.0.0, artifact_hash: dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751, expected_transient_boot_preference: Some(B), expected_pending_persistent_boot_preference: None, expected_persistent_boot_preference: B, expected_active_slot: ExpectedActiveRotSlot { slot: B, version: ArtifactVersion("1.1.0") }, expected_inactive_version: Version(ArtifactVersion("0.0.2")), component: rot, sp_slot: 2, sp_type: Sled, serial_number: serial2, part_number: 913-0000019
INFO configuring MGS-driven update, artifact_version: 1.0.0, artifact_hash: 3f6a641e1a26b718b351ed286e22b4c055d2dc7898e7ea873cd634796c2fb918, expected_inactive_version: NoValidVersion, expected_active_version: 0.0.1, component: sp, sp_slot: 2, sp_type: Sled, serial_number: serial2, part_number: 913-0000019
INFO reached maximum number of pending MGS-driven updates, max: 1
generated blueprint 459a45a5-616e-421f-873b-2fb08c36205c based on parent blueprint e54a0836-53e1-4948-a3af-0b77165289b5
blueprint source: planner with report:
planning report:
* 1 pending MGS update:
  * 913-0000019:serial2: Sp(PendingMgsUpdateSpDetails { expected_active_version: ArtifactVersion("0.0.1"), expected_inactive_version: NoValidVersion })
* zone updates waiting on pending MGS updates (RoT bootloader / RoT / SP / Host OS)
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint e54a0836-53e1-4948-a3af-0b77165289b5
to:   blueprint 459a45a5-616e-421f-873b-2fb08c36205c

 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)

 PENDING MGS UPDATES:

    Pending MGS-managed updates (all baseboards):
    -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    sp_type   slot   part_number   serial_number   artifact_hash                                                        artifact_version   details                                                                                                                                                                                                                                                                                                                               
    -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
*   sled      2      913-0000019   serial2         - dd3796ded0832379bc40a2c27791cd5177a621c7aee0ecfbe7ebd896befdc751   1.0.0              - Rot(PendingMgsUpdateRotDetails { expected_active_slot: ExpectedActiveRotSlot { slot: B, version: ArtifactVersion("1.1.0") }, expected_inactive_version: Version(ArtifactVersion("0.0.2")), expected_persistent_boot_preference: B, expected_pending_persistent_boot_preference: None, expected_transient_boot_preference: Some(B) })
     └─                                            + 3f6a641e1a26b718b351ed286e22b4c055d2dc7898e7ea873cd634796c2fb918                      + Sp(PendingMgsUpdateSpDetails { expected_active_version: ArtifactVersion("0.0.1"), expected_inactive_version: NoValidVersion })                                                                                                                                                                                                      


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # Finish updating the last sled's SP.
> # There should be a pending host phase 1 update.
> sled-update-sp d81c6a84-79b8-4958-ae41-ea46c9b19763 --active 1.0.0
set sled d81c6a84-79b8-4958-ae41-ea46c9b19763 SP versions: active -> 1.0.0

> inventory-generate
generated inventory collection 8a02a1c6-9e86-4dc0-9293-cd17da34f319 from configured sleds

> blueprint-plan latest latest
INFO skipped noop image source check on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: b, expected_hash: 0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b0b
INFO MGS-driven update completed (will remove it and re-evaluate board), artifact_version: 1.0.0, artifact_hash: 3f6a641e1a26b718b351ed286e22b4c055d2dc7898e7ea873cd634796c2fb918, expected_inactive_version: NoValidVersion, expected_active_version: 0.0.1, component: sp, sp_slot: 2, sp_type: Sled, serial_number: serial2, part_number: 913-0000019
INFO configuring MGS-driven update, artifact_version: 1.0.0, artifact_hash: 2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c, sled_agent_address: [fd00:1122:3344:103::1]:12345, expected_inactive_phase_2_hash: c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d, expected_inactive_phase_1_hash: 0202020202020202020202020202020202020202020202020202020202020202, expected_active_phase_2_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a, expected_active_phase_1_hash: 0101010101010101010101010101010101010101010101010101010101010101, expected_boot_disk: A, expected_active_phase_1_slot: A, component: host_phase_1, sp_slot: 2, sp_type: Sled, serial_number: serial2, part_number: 913-0000019
INFO reached maximum number of pending MGS-driven updates, max: 1
generated blueprint b2295597-5788-482e-acf9-1731ec63fbd2 based on parent blueprint 459a45a5-616e-421f-873b-2fb08c36205c
blueprint source: planner with report:
planning report:
* 1 pending MGS update:
  * 913-0000019:serial2: HostPhase1(PendingMgsUpdateHostPhase1Details { expected_active_phase_1_slot: A, expected_boot_disk: A, expected_active_phase_1_hash: ArtifactHash(HexArray(0101010101010101010101010101010101010101010101010101010101010101)), expected_active_phase_2_hash: ArtifactHash(HexArray(0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a)), expected_inactive_phase_1_hash: ArtifactHash(HexArray(0202020202020202020202020202020202020202020202020202020202020202)), expected_inactive_phase_2_hash: ArtifactHash(HexArray(c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d)), sled_agent_address: [fd00:1122:3344:103::1]:12345 })
* zone updates waiting on pending MGS updates (RoT bootloader / RoT / SP / Host OS)
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 459a45a5-616e-421f-873b-2fb08c36205c
to:   blueprint b2295597-5788-482e-acf9-1731ec63fbd2

 MODIFIED SLEDS:

  sled d81c6a84-79b8-4958-ae41-ea46c9b19763 (active, config generation 4 -> 5):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    --------------------------------
    slot   boot image source        
    --------------------------------
    A      current contents         
*   B      - current contents       
     └─    + artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-18b20749-0748-4105-bb10-7b13cfc776e2   in service 
    fake-vendor   fake-model   serial-30c16fe4-4229-49d0-ab01-3138f2c7dff2   in service 
    fake-vendor   fake-model   serial-4930954e-9ac7-4453-b63f-5ab97c389a99   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crucible                                                              ba9311dd-89ac-47db-a5e8-d64e8a5fcf70   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crucible                                                              3c2cb304-a466-4ab5-8597-5db8172e2388   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crucible                                                              41107868-c6cc-4ec4-9159-aed688c3ceaf   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/external_dns                                                    429da94b-19f7-48bd-98e9-47842863ba7b   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    3443a368-199e-4d26-b59f-3f2bbd507761   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone                                                            45cd9687-20be-4247-b62a-dfdacf324929   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone                                                            252ac39f-b9e2-4697-8c07-3a833115d704   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone                                                            1cb0a47a-59ac-4892-8e92-cf87b4290f96   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone/oxz_crucible_694bd14f-cb24-4be4-bb19-876e79cda2c8          543fc3b8-08eb-4e5e-9e05-cf7a91732d5d   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone/oxz_crucible_7c252b64-c5af-4ec1-989e-9a03f3b0f111          3d9537b8-05be-4b1b-a051-f47becf8ec75   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_f55647d4-5500-4ad3-893a-df45bd50d622          c895e8d5-1434-4ecf-8d46-9bf1ecc8cbc9   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_75b220ba-a0f4-4872-8202-dc7c87f062d0   a50cd13a-5749-4e79-bb8b-19229500a8b3   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_external_dns_f6ec9c67-946a-4da3-98d5-581f72ce8bf0      6f04dd20-5e2c-4fa8-8430-a886470ed140   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_ea5b4030-b52f-44b2-8d70-45f15f987d01      7ea73f80-c4e0-450a-92dc-8397ce2af14f   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_nexus_3eeb8d49-eb1a-43f8-bb64-c2338421c2c6             50ea8c15-c4c0-4403-a490-d14b3405dfc2   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f10a4fb9-759f-4a65-b25e-5794ad2d07d8               54bbadaf-ec04-41a2-a62f-f5ac5bf321be   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/debug                                                           7a6a2058-ea78-49de-9730-cce5e28b4cfb   in service    100 GiB   none          gzip-9     
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/debug                                                           21fd4f3a-ec31-469b-87b1-087c343a2422   in service    100 GiB   none          gzip-9     
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/debug                                                           b1deff4b-51df-4a37-9043-afbd7c70a1cb   in service    100 GiB   none          gzip-9     
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/local_storage                                                   41071985-1dfd-4ce5-8bc2-897161a8bce4   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/local_storage                                                   c65a9c1c-36dc-4ddb-8aac-ec3be8dbb209   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/local_storage                                                   090bd88d-0a43-4040-a832-b13ae721f74f   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/local_storage_unencrypted                                             e009d8b8-4695-4322-b53f-f03f2744aef7   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/local_storage_unencrypted                                             4da74a5b-6911-4cca-b624-b90c65530117   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/local_storage_unencrypted                                             96ae8389-3027-4260-9374-e0f6ce851de2   in service    none      none          off        


    omicron zones:
    ----------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition   underlay IP          
    ----------------------------------------------------------------------------------------------------------------------
    crucible          694bd14f-cb24-4be4-bb19-876e79cda2c8   artifact: version 0.0.1   in service    fd00:1122:3344:103::8
    crucible          7c252b64-c5af-4ec1-989e-9a03f3b0f111   artifact: version 0.0.1   in service    fd00:1122:3344:103::9
    crucible          f55647d4-5500-4ad3-893a-df45bd50d622   artifact: version 0.0.1   in service    fd00:1122:3344:103::7
    crucible_pantry   75b220ba-a0f4-4872-8202-dc7c87f062d0   artifact: version 0.0.1   in service    fd00:1122:3344:103::6
    external_dns      f6ec9c67-946a-4da3-98d5-581f72ce8bf0   artifact: version 0.0.1   in service    fd00:1122:3344:103::5
    internal_dns      ea5b4030-b52f-44b2-8d70-45f15f987d01   artifact: version 0.0.1   in service    fd00:1122:3344:3::1  
    internal_ntp      f10a4fb9-759f-4a65-b25e-5794ad2d07d8   artifact: version 0.0.1   in service    fd00:1122:3344:103::3
    nexus             3eeb8d49-eb1a-43f8-bb64-c2338421c2c6   artifact: version 0.0.1   in service    fd00:1122:3344:103::4


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)

 PENDING MGS UPDATES:

    Pending MGS-managed updates (all baseboards):
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    sp_type   slot   part_number   serial_number   artifact_hash                                                        artifact_version   details                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
*   sled      2      913-0000019   serial2         - 3f6a641e1a26b718b351ed286e22b4c055d2dc7898e7ea873cd634796c2fb918   1.0.0              - Sp(PendingMgsUpdateSpDetails { expected_active_version: ArtifactVersion("0.0.1"), expected_inactive_version: NoValidVersion })                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 
     └─                                            + 2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c                      + HostPhase1(PendingMgsUpdateHostPhase1Details { expected_active_phase_1_slot: A, expected_boot_disk: A, expected_active_phase_1_hash: ArtifactHash(HexArray(0101010101010101010101010101010101010101010101010101010101010101)), expected_active_phase_2_hash: ArtifactHash(HexArray(0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a)), expected_inactive_phase_1_hash: ArtifactHash(HexArray(0202020202020202020202020202020202020202020202020202020202020202)), expected_inactive_phase_2_hash: ArtifactHash(HexArray(c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d)), sled_agent_address: [fd00:1122:3344:103::1]:12345 })


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # Finish updating the last sled's host OS.
> sled-update-host-phase2 d81c6a84-79b8-4958-ae41-ea46c9b19763 --boot-disk B --slot-b c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d
set sled d81c6a84-79b8-4958-ae41-ea46c9b19763 host phase 2 details: boot_disk -> B, B -> c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d

> sled-update-host-phase1 d81c6a84-79b8-4958-ae41-ea46c9b19763 --active B --slot-b 2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c
set sled d81c6a84-79b8-4958-ae41-ea46c9b19763 host phase 1 details: active -> B, B -> 2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c

> inventory-generate
generated inventory collection c1adcd42-121f-4580-bfb9-d8a9937ca9e1 from configured sleds


> # Do another planning run. This should start updating zones (one at a time).
> blueprint-plan latest latest
INFO skipped noop image source check on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipped noop image source check on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO MGS-driven update completed (will remove it and re-evaluate board), artifact_version: 1.0.0, artifact_hash: 2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c, sled_agent_address: [fd00:1122:3344:103::1]:12345, expected_inactive_phase_2_hash: c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d, expected_inactive_phase_1_hash: 0202020202020202020202020202020202020202020202020202020202020202, expected_active_phase_2_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a, expected_active_phase_1_hash: 0101010101010101010101010101010101010101010101010101010101010101, expected_boot_disk: A, expected_active_phase_1_slot: A, component: host_phase_1, sp_slot: 2, sp_type: Sled, serial_number: serial2, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 6fad8fd4-e825-433f-b76d-495484e068ce based on parent blueprint b2295597-5788-482e-acf9-1731ec63fbd2
blueprint source: planner with report:
planning report:
* 1 out-of-date zone updated in-place:
  * sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, zone 353b3b65-20f7-48c3-88f7-495bd5d31545 (clickhouse)
* 24 remaining out-of-date zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint b2295597-5788-482e-acf9-1731ec63fbd2
to:   blueprint 6fad8fd4-e825-433f-b76d-495484e068ce

 MODIFIED SLEDS:

  sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c (active, config generation 5 -> 6):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-727522a7-934f-494d-b5b3-160968e74463   in service 
    fake-vendor   fake-model   serial-72c59873-31ff-4e36-8d76-ff834009349a   in service 
    fake-vendor   fake-model   serial-b5fd5bc1-099e-4e77-8028-a9793c11f43b   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_727522a7-934f-494d-b5b3-160968e74463/crucible                                                              feecfda1-9966-43d4-aaef-440b77f0b26d   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crucible                                                              956966b9-8201-437b-81ba-3c8ad2032080   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crucible                                                              4b0b09bf-94b7-45bf-a6b3-d46af53ae44a   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/clickhouse                                                      5ae11c7e-08fa-4d78-a4ea-14b4a9a10241   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    3e0d6188-c503-49cf-a441-fa7df40ceb43   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    b8f2a09f-8bd2-4418-872b-a4457a3f958c   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone                                                            4829f422-aa31-41a8-ab73-95684ff1ef48   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone                                                            3b66453b-7148-4c1b-84a9-499e43290ab4   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone                                                            841d5648-05f0-47b0-b446-92f6b60fe9a6   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_clickhouse_353b3b65-20f7-48c3-88f7-495bd5d31545        49f8fbb6-5bac-4609-907f-6e3dfc206059   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone/oxz_crucible_86a22a56-0168-453d-9df1-cb2a7c64b5d3          6e218d0a-13fd-4f70-884e-47e960fa8bb8   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_bd354eef-d8a6-4165-9124-283fb5e46d77          9073fb6b-f973-4bbd-b7cc-ba1abf6cb238   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone/oxz_crucible_e2fdefe7-95b2-4fd2-ae37-56929a06d58c          0582030b-aab6-4d0e-b1d2-64562ee712cd   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_ad6a3a03-8d0f-4504-99a4-cbf73d69b973   1640adb6-70bf-44cf-b05c-bff6dd300cf3   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_6c3ae381-04f7-41ea-b0ac-74db387dbc3a      78f34ce7-42f1-41da-995f-318f32054ad2   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_99e2f30b-3174-40bf-a78a-90da8abba8ca      2f204c50-a327-479c-8852-f53ec7a19c1f   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_nexus_466a9f29-62bf-4e63-924a-b9efdb86afec             8e0bd2bd-23b7-4bc6-9e73-c4d4ebc0bc8c   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_62620961-fc4a-481e-968b-f5acbac0dc63               8c4fa711-1d5d-4e93-85f0-d17bff47b063   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/debug                                                           93957ca0-9ed1-4e7b-8c34-2ce07a69541c   in service    100 GiB   none          gzip-9     
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/debug                                                           318fae85-abcb-4259-b1b6-ac96d193f7b7   in service    100 GiB   none          gzip-9     
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/debug                                                           b46de15d-33e7-4cd0-aa7c-e7be2a61e71b   in service    100 GiB   none          gzip-9     
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/local_storage                                                   2db6b7c1-0f46-4ced-a3ad-48872793360e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/local_storage                                                   09b9cc9b-3426-470b-a7bc-538f82dede03   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/local_storage                                                   c31623de-c19b-4615-9f1d-5e1daa5d3bda   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/local_storage_unencrypted                                             775f9207-c42d-4af2-9186-27ffef67735e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/local_storage_unencrypted                                             3560dd69-3b23-4c69-807d-d673104cfc68   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/local_storage_unencrypted                                             2ad1875a-92ac-472f-8c26-593309f0e4da   in service    none      none          off        


    omicron zones:
    ------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source                disposition   underlay IP          
    ------------------------------------------------------------------------------------------------------------------------
    crucible          86a22a56-0168-453d-9df1-cb2a7c64b5d3   artifact: version 0.0.1     in service    fd00:1122:3344:102::a
    crucible          bd354eef-d8a6-4165-9124-283fb5e46d77   artifact: version 0.0.1     in service    fd00:1122:3344:102::8
    crucible          e2fdefe7-95b2-4fd2-ae37-56929a06d58c   artifact: version 0.0.1     in service    fd00:1122:3344:102::9
    crucible_pantry   ad6a3a03-8d0f-4504-99a4-cbf73d69b973   artifact: version 0.0.1     in service    fd00:1122:3344:102::7
    external_dns      6c3ae381-04f7-41ea-b0ac-74db387dbc3a   artifact: version 0.0.1     in service    fd00:1122:3344:102::6
    internal_dns      99e2f30b-3174-40bf-a78a-90da8abba8ca   artifact: version 0.0.1     in service    fd00:1122:3344:1::1  
    internal_ntp      62620961-fc4a-481e-968b-f5acbac0dc63   artifact: version 0.0.1     in service    fd00:1122:3344:102::3
    nexus             466a9f29-62bf-4e63-924a-b9efdb86afec   artifact: version 0.0.1     in service    fd00:1122:3344:102::4
*   clickhouse        353b3b65-20f7-48c3-88f7-495bd5d31545   - artifact: version 0.0.1   in service    fd00:1122:3344:102::5
     └─                                                      + artifact: version 1.0.0                                      


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)

 PENDING MGS UPDATES:

    Pending MGS-managed updates (all baseboards):
    ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    sp_type   slot   part_number   serial_number   artifact_hash                                                      artifact_version   details                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        
    ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-   sled      2      913-0000019   serial2         2902cb5932fa703ed62fc6a0a330898fe6fd4bde68c74f6398a6aa916cb7e79c   1.0.0              HostPhase1(PendingMgsUpdateHostPhase1Details { expected_active_phase_1_slot: A, expected_boot_disk: A, expected_active_phase_1_hash: ArtifactHash(HexArray(0101010101010101010101010101010101010101010101010101010101010101)), expected_active_phase_2_hash: ArtifactHash(HexArray(0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a)), expected_inactive_phase_1_hash: ArtifactHash(HexArray(0202020202020202020202020202020202020202020202020202020202020202)), expected_inactive_phase_2_hash: ArtifactHash(HexArray(c2a8af75d6907ef138d033dc3be1fcbf7d7a78a87aee04796caf283a6bb0952d)), sled_agent_address: [fd00:1122:3344:103::1]:12345 })


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # Update the first control plane zone and plan again, which should update the
> # next zone on this sled.
> sled-set 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron-config latest
set sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron config from latest blueprint (6fad8fd4-e825-433f-b76d-495484e068ce)

> inventory-generate
generated inventory collection 94b231f9-80a3-48a9-8d25-70f9b42b64ca from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipped noop image source check on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 24b6e243-100c-428d-8ea6-35b504226f55 based on parent blueprint 6fad8fd4-e825-433f-b76d-495484e068ce
blueprint source: planner with report:
planning report:
* 1 out-of-date zone expunged:
  * sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, zone 62620961-fc4a-481e-968b-f5acbac0dc63 (internal_ntp)
* 23 remaining out-of-date zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 6fad8fd4-e825-433f-b76d-495484e068ce
to:   blueprint 24b6e243-100c-428d-8ea6-35b504226f55

 MODIFIED SLEDS:

  sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c (active, config generation 6 -> 7):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-727522a7-934f-494d-b5b3-160968e74463   in service 
    fake-vendor   fake-model   serial-72c59873-31ff-4e36-8d76-ff834009349a   in service 
    fake-vendor   fake-model   serial-b5fd5bc1-099e-4e77-8028-a9793c11f43b   in service 


    datasets:
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition    quota     reservation   compression
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_727522a7-934f-494d-b5b3-160968e74463/crucible                                                              feecfda1-9966-43d4-aaef-440b77f0b26d   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crucible                                                              956966b9-8201-437b-81ba-3c8ad2032080   in service     none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crucible                                                              4b0b09bf-94b7-45bf-a6b3-d46af53ae44a   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/clickhouse                                                      5ae11c7e-08fa-4d78-a4ea-14b4a9a10241   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    3e0d6188-c503-49cf-a441-fa7df40ceb43   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    b8f2a09f-8bd2-4418-872b-a4457a3f958c   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone                                                            4829f422-aa31-41a8-ab73-95684ff1ef48   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone                                                            3b66453b-7148-4c1b-84a9-499e43290ab4   in service     none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone                                                            841d5648-05f0-47b0-b446-92f6b60fe9a6   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_clickhouse_353b3b65-20f7-48c3-88f7-495bd5d31545        49f8fbb6-5bac-4609-907f-6e3dfc206059   in service     none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone/oxz_crucible_86a22a56-0168-453d-9df1-cb2a7c64b5d3          6e218d0a-13fd-4f70-884e-47e960fa8bb8   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_bd354eef-d8a6-4165-9124-283fb5e46d77          9073fb6b-f973-4bbd-b7cc-ba1abf6cb238   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone/oxz_crucible_e2fdefe7-95b2-4fd2-ae37-56929a06d58c          0582030b-aab6-4d0e-b1d2-64562ee712cd   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_ad6a3a03-8d0f-4504-99a4-cbf73d69b973   1640adb6-70bf-44cf-b05c-bff6dd300cf3   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_6c3ae381-04f7-41ea-b0ac-74db387dbc3a      78f34ce7-42f1-41da-995f-318f32054ad2   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_99e2f30b-3174-40bf-a78a-90da8abba8ca      2f204c50-a327-479c-8852-f53ec7a19c1f   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_nexus_466a9f29-62bf-4e63-924a-b9efdb86afec             8e0bd2bd-23b7-4bc6-9e73-c4d4ebc0bc8c   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/debug                                                           93957ca0-9ed1-4e7b-8c34-2ce07a69541c   in service     100 GiB   none          gzip-9     
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/debug                                                           318fae85-abcb-4259-b1b6-ac96d193f7b7   in service     100 GiB   none          gzip-9     
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/debug                                                           b46de15d-33e7-4cd0-aa7c-e7be2a61e71b   in service     100 GiB   none          gzip-9     
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/local_storage                                                   2db6b7c1-0f46-4ced-a3ad-48872793360e   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/local_storage                                                   09b9cc9b-3426-470b-a7bc-538f82dede03   in service     none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/local_storage                                                   c31623de-c19b-4615-9f1d-5e1daa5d3bda   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/local_storage_unencrypted                                             775f9207-c42d-4af2-9186-27ffef67735e   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/local_storage_unencrypted                                             3560dd69-3b23-4c69-807d-d673104cfc68   in service     none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/local_storage_unencrypted                                             2ad1875a-92ac-472f-8c26-593309f0e4da   in service     none      none          off        
*   oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_62620961-fc4a-481e-968b-f5acbac0dc63               8c4fa711-1d5d-4e93-85f0-d17bff47b063   - in service   none      none          off        
     └─                                                                                                                                                   + expunged                                        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    clickhouse        353b3b65-20f7-48c3-88f7-495bd5d31545   artifact: version 1.0.0   in service       fd00:1122:3344:102::5
    crucible          86a22a56-0168-453d-9df1-cb2a7c64b5d3   artifact: version 0.0.1   in service       fd00:1122:3344:102::a
    crucible          bd354eef-d8a6-4165-9124-283fb5e46d77   artifact: version 0.0.1   in service       fd00:1122:3344:102::8
    crucible          e2fdefe7-95b2-4fd2-ae37-56929a06d58c   artifact: version 0.0.1   in service       fd00:1122:3344:102::9
    crucible_pantry   ad6a3a03-8d0f-4504-99a4-cbf73d69b973   artifact: version 0.0.1   in service       fd00:1122:3344:102::7
    external_dns      6c3ae381-04f7-41ea-b0ac-74db387dbc3a   artifact: version 0.0.1   in service       fd00:1122:3344:102::6
    internal_dns      99e2f30b-3174-40bf-a78a-90da8abba8ca   artifact: version 0.0.1   in service       fd00:1122:3344:1::1  
    nexus             466a9f29-62bf-4e63-924a-b9efdb86afec   artifact: version 0.0.1   in service       fd00:1122:3344:102::4
*   internal_ntp      62620961-fc4a-481e-968b-f5acbac0dc63   artifact: version 0.0.1   - in service     fd00:1122:3344:102::3
     └─                                                                                + expunged ⏳                          


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
* DNS zone: "control-plane.oxide.internal": 
-   name: 62620961-fc4a-481e-968b-f5acbac0dc63.host          (records: 1)
-       AAAA fd00:1122:3344:102::3
*   name: _internal-ntp._tcp                                 (records: 3 -> 2)
-       SRV  port   123 62620961-fc4a-481e-968b-f5acbac0dc63.host.control-plane.oxide.internal
-       SRV  port   123 6444f8a5-6465-4f0b-a549-1993c113569c.host.control-plane.oxide.internal
-       SRV  port   123 f10a4fb9-759f-4a65-b25e-5794ad2d07d8.host.control-plane.oxide.internal
+       SRV  port   123 6444f8a5-6465-4f0b-a549-1993c113569c.host.control-plane.oxide.internal
+       SRV  port   123 f10a4fb9-759f-4a65-b25e-5794ad2d07d8.host.control-plane.oxide.internal
    unchanged names: 50 (records: 64)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # Repeat until all non-Nexus zones on this sled have been updated. Some of these
> # steps update a zone in place; others expunge a zone and are followed by a zone
> # addition. It doesn't seem _particularly_ useful to spell out which step is
> # updating which zone, in terms of keeping this test up to date, but we will
> # have to tweak the number of times we iterate on this sled as our simulated
> # system or planner placement changes.
> sled-set 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron-config latest
set sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron config from latest blueprint (24b6e243-100c-428d-8ea6-35b504226f55)

> inventory-generate
generated inventory collection 756aecb6-8353-46ad-a6c4-10ad0f2bbb7f from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipped noop image source check on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
INFO some zones not yet up-to-date, zones_currently_updating: [ZonePropagationIncomplete { zone_id: c74e3068-8b20-4a62-953b-dab703a442db (omicron_zone), zone_kind: InternalNtp, reason: MissingInInventory { bp_image_source: Artifact { version: Available { version: ArtifactVersion("1.0.0") }, hash: ArtifactHash(HexArray(2c7a661d288567335a1cabbbb96ec43c648bdfa1323b9c7c4e8de7ff23edeed0)) } } }]
generated blueprint 79fff7a2-2495-4c75-8465-4dc01bab48ce based on parent blueprint 24b6e243-100c-428d-8ea6-35b504226f55
blueprint source: planner with report:
planning report:
* waiting for NTP zones to appear in inventory on sleds: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c
* sleds getting NTP zones and which have other services already, making them eligible for discretionary zones: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c
* missing NTP zone on sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c
* zone updates waiting on zone propagation to inventory
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 24b6e243-100c-428d-8ea6-35b504226f55
to:   blueprint 79fff7a2-2495-4c75-8465-4dc01bab48ce

 MODIFIED SLEDS:

  sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c (active, config generation 7 -> 8):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-727522a7-934f-494d-b5b3-160968e74463   in service 
    fake-vendor   fake-model   serial-72c59873-31ff-4e36-8d76-ff834009349a   in service 
    fake-vendor   fake-model   serial-b5fd5bc1-099e-4e77-8028-a9793c11f43b   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_727522a7-934f-494d-b5b3-160968e74463/crucible                                                              feecfda1-9966-43d4-aaef-440b77f0b26d   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crucible                                                              956966b9-8201-437b-81ba-3c8ad2032080   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crucible                                                              4b0b09bf-94b7-45bf-a6b3-d46af53ae44a   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/clickhouse                                                      5ae11c7e-08fa-4d78-a4ea-14b4a9a10241   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    3e0d6188-c503-49cf-a441-fa7df40ceb43   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    b8f2a09f-8bd2-4418-872b-a4457a3f958c   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone                                                            4829f422-aa31-41a8-ab73-95684ff1ef48   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone                                                            3b66453b-7148-4c1b-84a9-499e43290ab4   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone                                                            841d5648-05f0-47b0-b446-92f6b60fe9a6   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_clickhouse_353b3b65-20f7-48c3-88f7-495bd5d31545        49f8fbb6-5bac-4609-907f-6e3dfc206059   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone/oxz_crucible_86a22a56-0168-453d-9df1-cb2a7c64b5d3          6e218d0a-13fd-4f70-884e-47e960fa8bb8   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_bd354eef-d8a6-4165-9124-283fb5e46d77          9073fb6b-f973-4bbd-b7cc-ba1abf6cb238   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone/oxz_crucible_e2fdefe7-95b2-4fd2-ae37-56929a06d58c          0582030b-aab6-4d0e-b1d2-64562ee712cd   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_ad6a3a03-8d0f-4504-99a4-cbf73d69b973   1640adb6-70bf-44cf-b05c-bff6dd300cf3   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_6c3ae381-04f7-41ea-b0ac-74db387dbc3a      78f34ce7-42f1-41da-995f-318f32054ad2   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_99e2f30b-3174-40bf-a78a-90da8abba8ca      2f204c50-a327-479c-8852-f53ec7a19c1f   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_nexus_466a9f29-62bf-4e63-924a-b9efdb86afec             8e0bd2bd-23b7-4bc6-9e73-c4d4ebc0bc8c   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_62620961-fc4a-481e-968b-f5acbac0dc63               8c4fa711-1d5d-4e93-85f0-d17bff47b063   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/debug                                                           93957ca0-9ed1-4e7b-8c34-2ce07a69541c   in service    100 GiB   none          gzip-9     
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/debug                                                           318fae85-abcb-4259-b1b6-ac96d193f7b7   in service    100 GiB   none          gzip-9     
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/debug                                                           b46de15d-33e7-4cd0-aa7c-e7be2a61e71b   in service    100 GiB   none          gzip-9     
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/local_storage                                                   2db6b7c1-0f46-4ced-a3ad-48872793360e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/local_storage                                                   09b9cc9b-3426-470b-a7bc-538f82dede03   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/local_storage                                                   c31623de-c19b-4615-9f1d-5e1daa5d3bda   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/local_storage_unencrypted                                             775f9207-c42d-4af2-9186-27ffef67735e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/local_storage_unencrypted                                             3560dd69-3b23-4c69-807d-d673104cfc68   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/local_storage_unencrypted                                             2ad1875a-92ac-472f-8c26-593309f0e4da   in service    none      none          off        
+   oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_c74e3068-8b20-4a62-953b-dab703a442db               5b087884-f80b-4a4f-a672-6e088753933e   in service    none      none          off        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    clickhouse        353b3b65-20f7-48c3-88f7-495bd5d31545   artifact: version 1.0.0   in service       fd00:1122:3344:102::5
    crucible          86a22a56-0168-453d-9df1-cb2a7c64b5d3   artifact: version 0.0.1   in service       fd00:1122:3344:102::a
    crucible          bd354eef-d8a6-4165-9124-283fb5e46d77   artifact: version 0.0.1   in service       fd00:1122:3344:102::8
    crucible          e2fdefe7-95b2-4fd2-ae37-56929a06d58c   artifact: version 0.0.1   in service       fd00:1122:3344:102::9
    crucible_pantry   ad6a3a03-8d0f-4504-99a4-cbf73d69b973   artifact: version 0.0.1   in service       fd00:1122:3344:102::7
    external_dns      6c3ae381-04f7-41ea-b0ac-74db387dbc3a   artifact: version 0.0.1   in service       fd00:1122:3344:102::6
    internal_dns      99e2f30b-3174-40bf-a78a-90da8abba8ca   artifact: version 0.0.1   in service       fd00:1122:3344:1::1  
    nexus             466a9f29-62bf-4e63-924a-b9efdb86afec   artifact: version 0.0.1   in service       fd00:1122:3344:102::4
*   internal_ntp      62620961-fc4a-481e-968b-f5acbac0dc63   artifact: version 0.0.1   - expunged ⏳     fd00:1122:3344:102::3
     └─                                                                                + expunged ✓                          
+   internal_ntp      c74e3068-8b20-4a62-953b-dab703a442db   artifact: version 1.0.0   in service       fd00:1122:3344:102::b


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
* DNS zone: "control-plane.oxide.internal": 
*   name: _internal-ntp._tcp                                 (records: 2 -> 3)
-       SRV  port   123 6444f8a5-6465-4f0b-a549-1993c113569c.host.control-plane.oxide.internal
-       SRV  port   123 f10a4fb9-759f-4a65-b25e-5794ad2d07d8.host.control-plane.oxide.internal
+       SRV  port   123 6444f8a5-6465-4f0b-a549-1993c113569c.host.control-plane.oxide.internal
+       SRV  port   123 c74e3068-8b20-4a62-953b-dab703a442db.host.control-plane.oxide.internal
+       SRV  port   123 f10a4fb9-759f-4a65-b25e-5794ad2d07d8.host.control-plane.oxide.internal
+   name: c74e3068-8b20-4a62-953b-dab703a442db.host          (records: 1)
+       AAAA fd00:1122:3344:102::b
    unchanged names: 50 (records: 64)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> sled-set 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron-config latest
set sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron config from latest blueprint (79fff7a2-2495-4c75-8465-4dc01bab48ce)

> inventory-generate
generated inventory collection 84152e52-8c2e-46ab-880e-4cc2a1fb9dcb from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipped noop image source check on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 3bcc37b2-0c0b-44d0-b4ed-3bcb605e4312 based on parent blueprint 79fff7a2-2495-4c75-8465-4dc01bab48ce
blueprint source: planner with report:
planning report:
* 1 out-of-date zone expunged:
  * sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, zone 6c3ae381-04f7-41ea-b0ac-74db387dbc3a (external_dns)
* 22 remaining out-of-date zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 79fff7a2-2495-4c75-8465-4dc01bab48ce
to:   blueprint 3bcc37b2-0c0b-44d0-b4ed-3bcb605e4312

 MODIFIED SLEDS:

  sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c (active, config generation 8 -> 9):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-727522a7-934f-494d-b5b3-160968e74463   in service 
    fake-vendor   fake-model   serial-72c59873-31ff-4e36-8d76-ff834009349a   in service 
    fake-vendor   fake-model   serial-b5fd5bc1-099e-4e77-8028-a9793c11f43b   in service 


    datasets:
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition    quota     reservation   compression
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_727522a7-934f-494d-b5b3-160968e74463/crucible                                                              feecfda1-9966-43d4-aaef-440b77f0b26d   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crucible                                                              956966b9-8201-437b-81ba-3c8ad2032080   in service     none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crucible                                                              4b0b09bf-94b7-45bf-a6b3-d46af53ae44a   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/clickhouse                                                      5ae11c7e-08fa-4d78-a4ea-14b4a9a10241   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    b8f2a09f-8bd2-4418-872b-a4457a3f958c   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone                                                            4829f422-aa31-41a8-ab73-95684ff1ef48   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone                                                            3b66453b-7148-4c1b-84a9-499e43290ab4   in service     none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone                                                            841d5648-05f0-47b0-b446-92f6b60fe9a6   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_clickhouse_353b3b65-20f7-48c3-88f7-495bd5d31545        49f8fbb6-5bac-4609-907f-6e3dfc206059   in service     none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone/oxz_crucible_86a22a56-0168-453d-9df1-cb2a7c64b5d3          6e218d0a-13fd-4f70-884e-47e960fa8bb8   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_bd354eef-d8a6-4165-9124-283fb5e46d77          9073fb6b-f973-4bbd-b7cc-ba1abf6cb238   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone/oxz_crucible_e2fdefe7-95b2-4fd2-ae37-56929a06d58c          0582030b-aab6-4d0e-b1d2-64562ee712cd   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_ad6a3a03-8d0f-4504-99a4-cbf73d69b973   1640adb6-70bf-44cf-b05c-bff6dd300cf3   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_99e2f30b-3174-40bf-a78a-90da8abba8ca      2f204c50-a327-479c-8852-f53ec7a19c1f   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_nexus_466a9f29-62bf-4e63-924a-b9efdb86afec             8e0bd2bd-23b7-4bc6-9e73-c4d4ebc0bc8c   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_62620961-fc4a-481e-968b-f5acbac0dc63               8c4fa711-1d5d-4e93-85f0-d17bff47b063   expunged       none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_c74e3068-8b20-4a62-953b-dab703a442db               5b087884-f80b-4a4f-a672-6e088753933e   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/debug                                                           93957ca0-9ed1-4e7b-8c34-2ce07a69541c   in service     100 GiB   none          gzip-9     
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/debug                                                           318fae85-abcb-4259-b1b6-ac96d193f7b7   in service     100 GiB   none          gzip-9     
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/debug                                                           b46de15d-33e7-4cd0-aa7c-e7be2a61e71b   in service     100 GiB   none          gzip-9     
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/local_storage                                                   2db6b7c1-0f46-4ced-a3ad-48872793360e   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/local_storage                                                   09b9cc9b-3426-470b-a7bc-538f82dede03   in service     none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/local_storage                                                   c31623de-c19b-4615-9f1d-5e1daa5d3bda   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/local_storage_unencrypted                                             775f9207-c42d-4af2-9186-27ffef67735e   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/local_storage_unencrypted                                             3560dd69-3b23-4c69-807d-d673104cfc68   in service     none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/local_storage_unencrypted                                             2ad1875a-92ac-472f-8c26-593309f0e4da   in service     none      none          off        
*   oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    3e0d6188-c503-49cf-a441-fa7df40ceb43   - in service   none      none          off        
     └─                                                                                                                                                   + expunged                                        
*   oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_6c3ae381-04f7-41ea-b0ac-74db387dbc3a      78f34ce7-42f1-41da-995f-318f32054ad2   - in service   none      none          off        
     └─                                                                                                                                                   + expunged                                        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    clickhouse        353b3b65-20f7-48c3-88f7-495bd5d31545   artifact: version 1.0.0   in service       fd00:1122:3344:102::5
    crucible          86a22a56-0168-453d-9df1-cb2a7c64b5d3   artifact: version 0.0.1   in service       fd00:1122:3344:102::a
    crucible          bd354eef-d8a6-4165-9124-283fb5e46d77   artifact: version 0.0.1   in service       fd00:1122:3344:102::8
    crucible          e2fdefe7-95b2-4fd2-ae37-56929a06d58c   artifact: version 0.0.1   in service       fd00:1122:3344:102::9
    crucible_pantry   ad6a3a03-8d0f-4504-99a4-cbf73d69b973   artifact: version 0.0.1   in service       fd00:1122:3344:102::7
    internal_dns      99e2f30b-3174-40bf-a78a-90da8abba8ca   artifact: version 0.0.1   in service       fd00:1122:3344:1::1  
    internal_ntp      62620961-fc4a-481e-968b-f5acbac0dc63   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:102::3
    internal_ntp      c74e3068-8b20-4a62-953b-dab703a442db   artifact: version 1.0.0   in service       fd00:1122:3344:102::b
    nexus             466a9f29-62bf-4e63-924a-b9efdb86afec   artifact: version 0.0.1   in service       fd00:1122:3344:102::4
*   external_dns      6c3ae381-04f7-41ea-b0ac-74db387dbc3a   artifact: version 0.0.1   - in service     fd00:1122:3344:102::6
     └─                                                                                + expunged ⏳                          


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
* DNS zone: "control-plane.oxide.internal": 
-   name: 6c3ae381-04f7-41ea-b0ac-74db387dbc3a.host          (records: 1)
-       AAAA fd00:1122:3344:102::6
*   name: _external-dns._tcp                                 (records: 3 -> 2)
-       SRV  port  5353 6c3ae381-04f7-41ea-b0ac-74db387dbc3a.host.control-plane.oxide.internal
-       SRV  port  5353 803bfb63-c246-41db-b0da-d3b87ddfc63d.host.control-plane.oxide.internal
-       SRV  port  5353 f6ec9c67-946a-4da3-98d5-581f72ce8bf0.host.control-plane.oxide.internal
+       SRV  port  5353 803bfb63-c246-41db-b0da-d3b87ddfc63d.host.control-plane.oxide.internal
+       SRV  port  5353 f6ec9c67-946a-4da3-98d5-581f72ce8bf0.host.control-plane.oxide.internal
    unchanged names: 50 (records: 64)

external DNS:
* DNS zone: "oxide.example": 
*   name: @                                                  (records: 3 -> 2)
-       NS   ns1.oxide.example
-       NS   ns2.oxide.example
-       NS   ns3.oxide.example
+       NS   ns1.oxide.example
+       NS   ns2.oxide.example
*   name: ns1                                                (records: 1 -> 1)
-       A    198.51.100.1
+       A    198.51.100.2
*   name: ns2                                                (records: 1 -> 1)
-       A    198.51.100.2
+       A    198.51.100.3
-   name: ns3                                                (records: 1)
-       A    198.51.100.3
    unchanged names: 1 (records: 3)




> sled-set 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron-config latest
set sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron config from latest blueprint (3bcc37b2-0c0b-44d0-b4ed-3bcb605e4312)

> inventory-generate
generated inventory collection bcfc7436-77de-47e4-8158-daad15a54da2 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipped noop image source check on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 4d2eb6f3-7eb1-443a-8e76-7ecf05da2f6d based on parent blueprint 3bcc37b2-0c0b-44d0-b4ed-3bcb605e4312
blueprint source: planner with report:
planning report:
* discretionary zones placed:
  * external_dns zone on sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c from source artifact: version 1.0.0
* zone updates waiting on discretionary zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 3bcc37b2-0c0b-44d0-b4ed-3bcb605e4312
to:   blueprint 4d2eb6f3-7eb1-443a-8e76-7ecf05da2f6d

 MODIFIED SLEDS:

  sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c (active, config generation 9 -> 10):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-727522a7-934f-494d-b5b3-160968e74463   in service 
    fake-vendor   fake-model   serial-72c59873-31ff-4e36-8d76-ff834009349a   in service 
    fake-vendor   fake-model   serial-b5fd5bc1-099e-4e77-8028-a9793c11f43b   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_727522a7-934f-494d-b5b3-160968e74463/crucible                                                              feecfda1-9966-43d4-aaef-440b77f0b26d   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crucible                                                              956966b9-8201-437b-81ba-3c8ad2032080   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crucible                                                              4b0b09bf-94b7-45bf-a6b3-d46af53ae44a   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/clickhouse                                                      5ae11c7e-08fa-4d78-a4ea-14b4a9a10241   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    3e0d6188-c503-49cf-a441-fa7df40ceb43   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    b8f2a09f-8bd2-4418-872b-a4457a3f958c   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone                                                            4829f422-aa31-41a8-ab73-95684ff1ef48   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone                                                            3b66453b-7148-4c1b-84a9-499e43290ab4   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone                                                            841d5648-05f0-47b0-b446-92f6b60fe9a6   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_clickhouse_353b3b65-20f7-48c3-88f7-495bd5d31545        49f8fbb6-5bac-4609-907f-6e3dfc206059   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone/oxz_crucible_86a22a56-0168-453d-9df1-cb2a7c64b5d3          6e218d0a-13fd-4f70-884e-47e960fa8bb8   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_bd354eef-d8a6-4165-9124-283fb5e46d77          9073fb6b-f973-4bbd-b7cc-ba1abf6cb238   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone/oxz_crucible_e2fdefe7-95b2-4fd2-ae37-56929a06d58c          0582030b-aab6-4d0e-b1d2-64562ee712cd   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_ad6a3a03-8d0f-4504-99a4-cbf73d69b973   1640adb6-70bf-44cf-b05c-bff6dd300cf3   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_6c3ae381-04f7-41ea-b0ac-74db387dbc3a      78f34ce7-42f1-41da-995f-318f32054ad2   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_99e2f30b-3174-40bf-a78a-90da8abba8ca      2f204c50-a327-479c-8852-f53ec7a19c1f   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_nexus_466a9f29-62bf-4e63-924a-b9efdb86afec             8e0bd2bd-23b7-4bc6-9e73-c4d4ebc0bc8c   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_62620961-fc4a-481e-968b-f5acbac0dc63               8c4fa711-1d5d-4e93-85f0-d17bff47b063   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_c74e3068-8b20-4a62-953b-dab703a442db               5b087884-f80b-4a4f-a672-6e088753933e   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/debug                                                           93957ca0-9ed1-4e7b-8c34-2ce07a69541c   in service    100 GiB   none          gzip-9     
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/debug                                                           318fae85-abcb-4259-b1b6-ac96d193f7b7   in service    100 GiB   none          gzip-9     
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/debug                                                           b46de15d-33e7-4cd0-aa7c-e7be2a61e71b   in service    100 GiB   none          gzip-9     
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/local_storage                                                   2db6b7c1-0f46-4ced-a3ad-48872793360e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/local_storage                                                   09b9cc9b-3426-470b-a7bc-538f82dede03   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/local_storage                                                   c31623de-c19b-4615-9f1d-5e1daa5d3bda   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/local_storage_unencrypted                                             775f9207-c42d-4af2-9186-27ffef67735e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/local_storage_unencrypted                                             3560dd69-3b23-4c69-807d-d673104cfc68   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/local_storage_unencrypted                                             2ad1875a-92ac-472f-8c26-593309f0e4da   in service    none      none          off        
+   oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    5c01fdbd-ff37-44b4-a17b-6d625e6fa48d   in service    none      none          off        
+   oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_c821c39d-2b2c-4c55-8874-ac12315ba1e4      a21812e1-1b80-4faa-9f2b-51189e0f6999   in service    none      none          off        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    clickhouse        353b3b65-20f7-48c3-88f7-495bd5d31545   artifact: version 1.0.0   in service       fd00:1122:3344:102::5
    crucible          86a22a56-0168-453d-9df1-cb2a7c64b5d3   artifact: version 0.0.1   in service       fd00:1122:3344:102::a
    crucible          bd354eef-d8a6-4165-9124-283fb5e46d77   artifact: version 0.0.1   in service       fd00:1122:3344:102::8
    crucible          e2fdefe7-95b2-4fd2-ae37-56929a06d58c   artifact: version 0.0.1   in service       fd00:1122:3344:102::9
    crucible_pantry   ad6a3a03-8d0f-4504-99a4-cbf73d69b973   artifact: version 0.0.1   in service       fd00:1122:3344:102::7
    internal_dns      99e2f30b-3174-40bf-a78a-90da8abba8ca   artifact: version 0.0.1   in service       fd00:1122:3344:1::1  
    internal_ntp      62620961-fc4a-481e-968b-f5acbac0dc63   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:102::3
    internal_ntp      c74e3068-8b20-4a62-953b-dab703a442db   artifact: version 1.0.0   in service       fd00:1122:3344:102::b
    nexus             466a9f29-62bf-4e63-924a-b9efdb86afec   artifact: version 0.0.1   in service       fd00:1122:3344:102::4
*   external_dns      6c3ae381-04f7-41ea-b0ac-74db387dbc3a   artifact: version 0.0.1   - expunged ⏳     fd00:1122:3344:102::6
     └─                                                                                + expunged ✓                          
+   external_dns      c821c39d-2b2c-4c55-8874-ac12315ba1e4   artifact: version 1.0.0   in service       fd00:1122:3344:102::c


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
* DNS zone: "control-plane.oxide.internal": 
*   name: _external-dns._tcp                                 (records: 2 -> 3)
-       SRV  port  5353 803bfb63-c246-41db-b0da-d3b87ddfc63d.host.control-plane.oxide.internal
-       SRV  port  5353 f6ec9c67-946a-4da3-98d5-581f72ce8bf0.host.control-plane.oxide.internal
+       SRV  port  5353 803bfb63-c246-41db-b0da-d3b87ddfc63d.host.control-plane.oxide.internal
+       SRV  port  5353 c821c39d-2b2c-4c55-8874-ac12315ba1e4.host.control-plane.oxide.internal
+       SRV  port  5353 f6ec9c67-946a-4da3-98d5-581f72ce8bf0.host.control-plane.oxide.internal
+   name: c821c39d-2b2c-4c55-8874-ac12315ba1e4.host          (records: 1)
+       AAAA fd00:1122:3344:102::c
    unchanged names: 50 (records: 64)

external DNS:
* DNS zone: "oxide.example": 
*   name: @                                                  (records: 2 -> 3)
-       NS   ns1.oxide.example
-       NS   ns2.oxide.example
+       NS   ns1.oxide.example
+       NS   ns2.oxide.example
+       NS   ns3.oxide.example
*   name: ns1                                                (records: 1 -> 1)
-       A    198.51.100.2
+       A    198.51.100.1
*   name: ns2                                                (records: 1 -> 1)
-       A    198.51.100.3
+       A    198.51.100.2
+   name: ns3                                                (records: 1)
+       A    198.51.100.3
    unchanged names: 1 (records: 3)




> sled-set 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron-config latest
set sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron config from latest blueprint (4d2eb6f3-7eb1-443a-8e76-7ecf05da2f6d)

> inventory-generate
generated inventory collection 6dbdc88a-4828-480e-b41d-8946f41a3134 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipped noop image source check on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint e2125c83-b255-45c9-bc9b-802cff09a812 based on parent blueprint 4d2eb6f3-7eb1-443a-8e76-7ecf05da2f6d
blueprint source: planner with report:
planning report:
* 1 out-of-date zone updated in-place:
  * sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, zone 86a22a56-0168-453d-9df1-cb2a7c64b5d3 (crucible)
* 21 remaining out-of-date zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 4d2eb6f3-7eb1-443a-8e76-7ecf05da2f6d
to:   blueprint e2125c83-b255-45c9-bc9b-802cff09a812

 MODIFIED SLEDS:

  sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c (active, config generation 10 -> 11):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-727522a7-934f-494d-b5b3-160968e74463   in service 
    fake-vendor   fake-model   serial-72c59873-31ff-4e36-8d76-ff834009349a   in service 
    fake-vendor   fake-model   serial-b5fd5bc1-099e-4e77-8028-a9793c11f43b   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_727522a7-934f-494d-b5b3-160968e74463/crucible                                                              feecfda1-9966-43d4-aaef-440b77f0b26d   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crucible                                                              956966b9-8201-437b-81ba-3c8ad2032080   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crucible                                                              4b0b09bf-94b7-45bf-a6b3-d46af53ae44a   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/clickhouse                                                      5ae11c7e-08fa-4d78-a4ea-14b4a9a10241   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    3e0d6188-c503-49cf-a441-fa7df40ceb43   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    5c01fdbd-ff37-44b4-a17b-6d625e6fa48d   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    b8f2a09f-8bd2-4418-872b-a4457a3f958c   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone                                                            4829f422-aa31-41a8-ab73-95684ff1ef48   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone                                                            3b66453b-7148-4c1b-84a9-499e43290ab4   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone                                                            841d5648-05f0-47b0-b446-92f6b60fe9a6   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_clickhouse_353b3b65-20f7-48c3-88f7-495bd5d31545        49f8fbb6-5bac-4609-907f-6e3dfc206059   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone/oxz_crucible_86a22a56-0168-453d-9df1-cb2a7c64b5d3          6e218d0a-13fd-4f70-884e-47e960fa8bb8   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_bd354eef-d8a6-4165-9124-283fb5e46d77          9073fb6b-f973-4bbd-b7cc-ba1abf6cb238   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone/oxz_crucible_e2fdefe7-95b2-4fd2-ae37-56929a06d58c          0582030b-aab6-4d0e-b1d2-64562ee712cd   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_ad6a3a03-8d0f-4504-99a4-cbf73d69b973   1640adb6-70bf-44cf-b05c-bff6dd300cf3   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_6c3ae381-04f7-41ea-b0ac-74db387dbc3a      78f34ce7-42f1-41da-995f-318f32054ad2   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_c821c39d-2b2c-4c55-8874-ac12315ba1e4      a21812e1-1b80-4faa-9f2b-51189e0f6999   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_99e2f30b-3174-40bf-a78a-90da8abba8ca      2f204c50-a327-479c-8852-f53ec7a19c1f   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_nexus_466a9f29-62bf-4e63-924a-b9efdb86afec             8e0bd2bd-23b7-4bc6-9e73-c4d4ebc0bc8c   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_62620961-fc4a-481e-968b-f5acbac0dc63               8c4fa711-1d5d-4e93-85f0-d17bff47b063   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_c74e3068-8b20-4a62-953b-dab703a442db               5b087884-f80b-4a4f-a672-6e088753933e   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/debug                                                           93957ca0-9ed1-4e7b-8c34-2ce07a69541c   in service    100 GiB   none          gzip-9     
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/debug                                                           318fae85-abcb-4259-b1b6-ac96d193f7b7   in service    100 GiB   none          gzip-9     
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/debug                                                           b46de15d-33e7-4cd0-aa7c-e7be2a61e71b   in service    100 GiB   none          gzip-9     
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/local_storage                                                   2db6b7c1-0f46-4ced-a3ad-48872793360e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/local_storage                                                   09b9cc9b-3426-470b-a7bc-538f82dede03   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/local_storage                                                   c31623de-c19b-4615-9f1d-5e1daa5d3bda   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/local_storage_unencrypted                                             775f9207-c42d-4af2-9186-27ffef67735e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/local_storage_unencrypted                                             3560dd69-3b23-4c69-807d-d673104cfc68   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/local_storage_unencrypted                                             2ad1875a-92ac-472f-8c26-593309f0e4da   in service    none      none          off        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source                disposition    underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    clickhouse        353b3b65-20f7-48c3-88f7-495bd5d31545   artifact: version 1.0.0     in service     fd00:1122:3344:102::5
    crucible          bd354eef-d8a6-4165-9124-283fb5e46d77   artifact: version 0.0.1     in service     fd00:1122:3344:102::8
    crucible          e2fdefe7-95b2-4fd2-ae37-56929a06d58c   artifact: version 0.0.1     in service     fd00:1122:3344:102::9
    crucible_pantry   ad6a3a03-8d0f-4504-99a4-cbf73d69b973   artifact: version 0.0.1     in service     fd00:1122:3344:102::7
    external_dns      6c3ae381-04f7-41ea-b0ac-74db387dbc3a   artifact: version 0.0.1     expunged ✓     fd00:1122:3344:102::6
    external_dns      c821c39d-2b2c-4c55-8874-ac12315ba1e4   artifact: version 1.0.0     in service     fd00:1122:3344:102::c
    internal_dns      99e2f30b-3174-40bf-a78a-90da8abba8ca   artifact: version 0.0.1     in service     fd00:1122:3344:1::1  
    internal_ntp      62620961-fc4a-481e-968b-f5acbac0dc63   artifact: version 0.0.1     expunged ✓     fd00:1122:3344:102::3
    internal_ntp      c74e3068-8b20-4a62-953b-dab703a442db   artifact: version 1.0.0     in service     fd00:1122:3344:102::b
    nexus             466a9f29-62bf-4e63-924a-b9efdb86afec   artifact: version 0.0.1     in service     fd00:1122:3344:102::4
*   crucible          86a22a56-0168-453d-9df1-cb2a7c64b5d3   - artifact: version 0.0.1   in service     fd00:1122:3344:102::a
     └─                                                      + artifact: version 1.0.0                                       


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> sled-set 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron-config latest
set sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron config from latest blueprint (e2125c83-b255-45c9-bc9b-802cff09a812)

> inventory-generate
generated inventory collection eb500068-cd91-484b-a532-51081571ecbe from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipped noop image source check on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint f4a6848e-d13c-46e1-8c6a-944f886d7ba3 based on parent blueprint e2125c83-b255-45c9-bc9b-802cff09a812
blueprint source: planner with report:
planning report:
* 1 out-of-date zone expunged:
  * sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, zone 99e2f30b-3174-40bf-a78a-90da8abba8ca (internal_dns)
* 20 remaining out-of-date zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint e2125c83-b255-45c9-bc9b-802cff09a812
to:   blueprint f4a6848e-d13c-46e1-8c6a-944f886d7ba3

 MODIFIED SLEDS:

  sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c (active, config generation 11 -> 12):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-727522a7-934f-494d-b5b3-160968e74463   in service 
    fake-vendor   fake-model   serial-72c59873-31ff-4e36-8d76-ff834009349a   in service 
    fake-vendor   fake-model   serial-b5fd5bc1-099e-4e77-8028-a9793c11f43b   in service 


    datasets:
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition    quota     reservation   compression
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_727522a7-934f-494d-b5b3-160968e74463/crucible                                                              feecfda1-9966-43d4-aaef-440b77f0b26d   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crucible                                                              956966b9-8201-437b-81ba-3c8ad2032080   in service     none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crucible                                                              4b0b09bf-94b7-45bf-a6b3-d46af53ae44a   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/clickhouse                                                      5ae11c7e-08fa-4d78-a4ea-14b4a9a10241   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    3e0d6188-c503-49cf-a441-fa7df40ceb43   expunged       none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    5c01fdbd-ff37-44b4-a17b-6d625e6fa48d   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone                                                            4829f422-aa31-41a8-ab73-95684ff1ef48   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone                                                            3b66453b-7148-4c1b-84a9-499e43290ab4   in service     none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone                                                            841d5648-05f0-47b0-b446-92f6b60fe9a6   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_clickhouse_353b3b65-20f7-48c3-88f7-495bd5d31545        49f8fbb6-5bac-4609-907f-6e3dfc206059   in service     none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone/oxz_crucible_86a22a56-0168-453d-9df1-cb2a7c64b5d3          6e218d0a-13fd-4f70-884e-47e960fa8bb8   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_bd354eef-d8a6-4165-9124-283fb5e46d77          9073fb6b-f973-4bbd-b7cc-ba1abf6cb238   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone/oxz_crucible_e2fdefe7-95b2-4fd2-ae37-56929a06d58c          0582030b-aab6-4d0e-b1d2-64562ee712cd   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_ad6a3a03-8d0f-4504-99a4-cbf73d69b973   1640adb6-70bf-44cf-b05c-bff6dd300cf3   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_6c3ae381-04f7-41ea-b0ac-74db387dbc3a      78f34ce7-42f1-41da-995f-318f32054ad2   expunged       none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_c821c39d-2b2c-4c55-8874-ac12315ba1e4      a21812e1-1b80-4faa-9f2b-51189e0f6999   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_nexus_466a9f29-62bf-4e63-924a-b9efdb86afec             8e0bd2bd-23b7-4bc6-9e73-c4d4ebc0bc8c   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_62620961-fc4a-481e-968b-f5acbac0dc63               8c4fa711-1d5d-4e93-85f0-d17bff47b063   expunged       none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_c74e3068-8b20-4a62-953b-dab703a442db               5b087884-f80b-4a4f-a672-6e088753933e   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/debug                                                           93957ca0-9ed1-4e7b-8c34-2ce07a69541c   in service     100 GiB   none          gzip-9     
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/debug                                                           318fae85-abcb-4259-b1b6-ac96d193f7b7   in service     100 GiB   none          gzip-9     
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/debug                                                           b46de15d-33e7-4cd0-aa7c-e7be2a61e71b   in service     100 GiB   none          gzip-9     
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/local_storage                                                   2db6b7c1-0f46-4ced-a3ad-48872793360e   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/local_storage                                                   09b9cc9b-3426-470b-a7bc-538f82dede03   in service     none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/local_storage                                                   c31623de-c19b-4615-9f1d-5e1daa5d3bda   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/local_storage_unencrypted                                             775f9207-c42d-4af2-9186-27ffef67735e   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/local_storage_unencrypted                                             3560dd69-3b23-4c69-807d-d673104cfc68   in service     none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/local_storage_unencrypted                                             2ad1875a-92ac-472f-8c26-593309f0e4da   in service     none      none          off        
*   oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    b8f2a09f-8bd2-4418-872b-a4457a3f958c   - in service   none      none          off        
     └─                                                                                                                                                   + expunged                                        
*   oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_99e2f30b-3174-40bf-a78a-90da8abba8ca      2f204c50-a327-479c-8852-f53ec7a19c1f   - in service   none      none          off        
     └─                                                                                                                                                   + expunged                                        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    clickhouse        353b3b65-20f7-48c3-88f7-495bd5d31545   artifact: version 1.0.0   in service       fd00:1122:3344:102::5
    crucible          86a22a56-0168-453d-9df1-cb2a7c64b5d3   artifact: version 1.0.0   in service       fd00:1122:3344:102::a
    crucible          bd354eef-d8a6-4165-9124-283fb5e46d77   artifact: version 0.0.1   in service       fd00:1122:3344:102::8
    crucible          e2fdefe7-95b2-4fd2-ae37-56929a06d58c   artifact: version 0.0.1   in service       fd00:1122:3344:102::9
    crucible_pantry   ad6a3a03-8d0f-4504-99a4-cbf73d69b973   artifact: version 0.0.1   in service       fd00:1122:3344:102::7
    external_dns      6c3ae381-04f7-41ea-b0ac-74db387dbc3a   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:102::6
    external_dns      c821c39d-2b2c-4c55-8874-ac12315ba1e4   artifact: version 1.0.0   in service       fd00:1122:3344:102::c
    internal_ntp      62620961-fc4a-481e-968b-f5acbac0dc63   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:102::3
    internal_ntp      c74e3068-8b20-4a62-953b-dab703a442db   artifact: version 1.0.0   in service       fd00:1122:3344:102::b
    nexus             466a9f29-62bf-4e63-924a-b9efdb86afec   artifact: version 0.0.1   in service       fd00:1122:3344:102::4
*   internal_dns      99e2f30b-3174-40bf-a78a-90da8abba8ca   artifact: version 0.0.1   - in service     fd00:1122:3344:1::1  
     └─                                                                                + expunged ⏳                          


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
* DNS zone: "control-plane.oxide.internal": 
-   name: 99e2f30b-3174-40bf-a78a-90da8abba8ca.host          (records: 1)
-       AAAA fd00:1122:3344:1::1
*   name: @                                                  (records: 3 -> 2)
-       NS   ns1.control-plane.oxide.internal
-       NS   ns2.control-plane.oxide.internal
-       NS   ns3.control-plane.oxide.internal
+       NS   ns1.control-plane.oxide.internal
+       NS   ns2.control-plane.oxide.internal
*   name: _nameservice._tcp                                  (records: 3 -> 2)
-       SRV  port  5353 427ec88f-f467-42fa-9bbb-66a91a36103c.host.control-plane.oxide.internal
-       SRV  port  5353 99e2f30b-3174-40bf-a78a-90da8abba8ca.host.control-plane.oxide.internal
-       SRV  port  5353 ea5b4030-b52f-44b2-8d70-45f15f987d01.host.control-plane.oxide.internal
+       SRV  port  5353 427ec88f-f467-42fa-9bbb-66a91a36103c.host.control-plane.oxide.internal
+       SRV  port  5353 ea5b4030-b52f-44b2-8d70-45f15f987d01.host.control-plane.oxide.internal
*   name: ns1                                                (records: 1 -> 1)
-       AAAA fd00:1122:3344:1::1
+       AAAA fd00:1122:3344:2::1
*   name: ns2                                                (records: 1 -> 1)
-       AAAA fd00:1122:3344:2::1
+       AAAA fd00:1122:3344:3::1
-   name: ns3                                                (records: 1)
-       AAAA fd00:1122:3344:3::1
    unchanged names: 46 (records: 58)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> sled-set 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron-config latest
set sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron config from latest blueprint (f4a6848e-d13c-46e1-8c6a-944f886d7ba3)

> inventory-generate
generated inventory collection 4492baf6-5638-4c1f-bba2-608163519022 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipped noop image source check on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 834e4dbe-3b71-443d-bd4c-20e8253abc0c based on parent blueprint f4a6848e-d13c-46e1-8c6a-944f886d7ba3
blueprint source: planner with report:
planning report:
* discretionary zones placed:
  * internal_dns zone on sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c from source artifact: version 1.0.0
* zone updates waiting on discretionary zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint f4a6848e-d13c-46e1-8c6a-944f886d7ba3
to:   blueprint 834e4dbe-3b71-443d-bd4c-20e8253abc0c

 MODIFIED SLEDS:

  sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c (active, config generation 12 -> 13):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-727522a7-934f-494d-b5b3-160968e74463   in service 
    fake-vendor   fake-model   serial-72c59873-31ff-4e36-8d76-ff834009349a   in service 
    fake-vendor   fake-model   serial-b5fd5bc1-099e-4e77-8028-a9793c11f43b   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_727522a7-934f-494d-b5b3-160968e74463/crucible                                                              feecfda1-9966-43d4-aaef-440b77f0b26d   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crucible                                                              956966b9-8201-437b-81ba-3c8ad2032080   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crucible                                                              4b0b09bf-94b7-45bf-a6b3-d46af53ae44a   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/clickhouse                                                      5ae11c7e-08fa-4d78-a4ea-14b4a9a10241   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    3e0d6188-c503-49cf-a441-fa7df40ceb43   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    5c01fdbd-ff37-44b4-a17b-6d625e6fa48d   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    b8f2a09f-8bd2-4418-872b-a4457a3f958c   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone                                                            4829f422-aa31-41a8-ab73-95684ff1ef48   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone                                                            3b66453b-7148-4c1b-84a9-499e43290ab4   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone                                                            841d5648-05f0-47b0-b446-92f6b60fe9a6   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_clickhouse_353b3b65-20f7-48c3-88f7-495bd5d31545        49f8fbb6-5bac-4609-907f-6e3dfc206059   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone/oxz_crucible_86a22a56-0168-453d-9df1-cb2a7c64b5d3          6e218d0a-13fd-4f70-884e-47e960fa8bb8   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_bd354eef-d8a6-4165-9124-283fb5e46d77          9073fb6b-f973-4bbd-b7cc-ba1abf6cb238   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone/oxz_crucible_e2fdefe7-95b2-4fd2-ae37-56929a06d58c          0582030b-aab6-4d0e-b1d2-64562ee712cd   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_ad6a3a03-8d0f-4504-99a4-cbf73d69b973   1640adb6-70bf-44cf-b05c-bff6dd300cf3   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_6c3ae381-04f7-41ea-b0ac-74db387dbc3a      78f34ce7-42f1-41da-995f-318f32054ad2   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_c821c39d-2b2c-4c55-8874-ac12315ba1e4      a21812e1-1b80-4faa-9f2b-51189e0f6999   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_99e2f30b-3174-40bf-a78a-90da8abba8ca      2f204c50-a327-479c-8852-f53ec7a19c1f   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_nexus_466a9f29-62bf-4e63-924a-b9efdb86afec             8e0bd2bd-23b7-4bc6-9e73-c4d4ebc0bc8c   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_62620961-fc4a-481e-968b-f5acbac0dc63               8c4fa711-1d5d-4e93-85f0-d17bff47b063   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_c74e3068-8b20-4a62-953b-dab703a442db               5b087884-f80b-4a4f-a672-6e088753933e   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/debug                                                           93957ca0-9ed1-4e7b-8c34-2ce07a69541c   in service    100 GiB   none          gzip-9     
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/debug                                                           318fae85-abcb-4259-b1b6-ac96d193f7b7   in service    100 GiB   none          gzip-9     
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/debug                                                           b46de15d-33e7-4cd0-aa7c-e7be2a61e71b   in service    100 GiB   none          gzip-9     
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/local_storage                                                   2db6b7c1-0f46-4ced-a3ad-48872793360e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/local_storage                                                   09b9cc9b-3426-470b-a7bc-538f82dede03   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/local_storage                                                   c31623de-c19b-4615-9f1d-5e1daa5d3bda   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/local_storage_unencrypted                                             775f9207-c42d-4af2-9186-27ffef67735e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/local_storage_unencrypted                                             3560dd69-3b23-4c69-807d-d673104cfc68   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/local_storage_unencrypted                                             2ad1875a-92ac-472f-8c26-593309f0e4da   in service    none      none          off        
+   oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    a2e6e726-7cf1-432d-9ca7-b7cde2f1f742   in service    none      none          off        
+   oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_a729999a-6e45-46ca-b51e-0bbb5490387a      eece684d-17ae-4aae-93b3-6928f26722c2   in service    none      none          off        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    clickhouse        353b3b65-20f7-48c3-88f7-495bd5d31545   artifact: version 1.0.0   in service       fd00:1122:3344:102::5
    crucible          86a22a56-0168-453d-9df1-cb2a7c64b5d3   artifact: version 1.0.0   in service       fd00:1122:3344:102::a
    crucible          bd354eef-d8a6-4165-9124-283fb5e46d77   artifact: version 0.0.1   in service       fd00:1122:3344:102::8
    crucible          e2fdefe7-95b2-4fd2-ae37-56929a06d58c   artifact: version 0.0.1   in service       fd00:1122:3344:102::9
    crucible_pantry   ad6a3a03-8d0f-4504-99a4-cbf73d69b973   artifact: version 0.0.1   in service       fd00:1122:3344:102::7
    external_dns      6c3ae381-04f7-41ea-b0ac-74db387dbc3a   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:102::6
    external_dns      c821c39d-2b2c-4c55-8874-ac12315ba1e4   artifact: version 1.0.0   in service       fd00:1122:3344:102::c
    internal_ntp      62620961-fc4a-481e-968b-f5acbac0dc63   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:102::3
    internal_ntp      c74e3068-8b20-4a62-953b-dab703a442db   artifact: version 1.0.0   in service       fd00:1122:3344:102::b
    nexus             466a9f29-62bf-4e63-924a-b9efdb86afec   artifact: version 0.0.1   in service       fd00:1122:3344:102::4
*   internal_dns      99e2f30b-3174-40bf-a78a-90da8abba8ca   artifact: version 0.0.1   - expunged ⏳     fd00:1122:3344:1::1  
     └─                                                                                + expunged ✓                          
+   internal_dns      a729999a-6e45-46ca-b51e-0bbb5490387a   artifact: version 1.0.0   in service       fd00:1122:3344:1::1  


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
* DNS zone: "control-plane.oxide.internal": 
*   name: @                                                  (records: 2 -> 3)
-       NS   ns1.control-plane.oxide.internal
-       NS   ns2.control-plane.oxide.internal
+       NS   ns1.control-plane.oxide.internal
+       NS   ns2.control-plane.oxide.internal
+       NS   ns3.control-plane.oxide.internal
*   name: _nameservice._tcp                                  (records: 2 -> 3)
-       SRV  port  5353 427ec88f-f467-42fa-9bbb-66a91a36103c.host.control-plane.oxide.internal
-       SRV  port  5353 ea5b4030-b52f-44b2-8d70-45f15f987d01.host.control-plane.oxide.internal
+       SRV  port  5353 427ec88f-f467-42fa-9bbb-66a91a36103c.host.control-plane.oxide.internal
+       SRV  port  5353 a729999a-6e45-46ca-b51e-0bbb5490387a.host.control-plane.oxide.internal
+       SRV  port  5353 ea5b4030-b52f-44b2-8d70-45f15f987d01.host.control-plane.oxide.internal
+   name: a729999a-6e45-46ca-b51e-0bbb5490387a.host          (records: 1)
+       AAAA fd00:1122:3344:1::1
*   name: ns1                                                (records: 1 -> 1)
-       AAAA fd00:1122:3344:2::1
+       AAAA fd00:1122:3344:1::1
*   name: ns2                                                (records: 1 -> 1)
-       AAAA fd00:1122:3344:3::1
+       AAAA fd00:1122:3344:2::1
+   name: ns3                                                (records: 1)
+       AAAA fd00:1122:3344:3::1
    unchanged names: 46 (records: 58)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> sled-set 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron-config latest
set sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron config from latest blueprint (834e4dbe-3b71-443d-bd4c-20e8253abc0c)

> inventory-generate
generated inventory collection 73f58d4d-6be7-4007-811c-0e578279410e from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipped noop image source check on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint d9c5c5e3-c532-4c45-9ef5-22cb00f6a2e1 based on parent blueprint 834e4dbe-3b71-443d-bd4c-20e8253abc0c
blueprint source: planner with report:
planning report:
* 1 out-of-date zone expunged:
  * sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, zone ad6a3a03-8d0f-4504-99a4-cbf73d69b973 (crucible_pantry)
* 19 remaining out-of-date zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 834e4dbe-3b71-443d-bd4c-20e8253abc0c
to:   blueprint d9c5c5e3-c532-4c45-9ef5-22cb00f6a2e1

 MODIFIED SLEDS:

  sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c (active, config generation 13 -> 14):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-727522a7-934f-494d-b5b3-160968e74463   in service 
    fake-vendor   fake-model   serial-72c59873-31ff-4e36-8d76-ff834009349a   in service 
    fake-vendor   fake-model   serial-b5fd5bc1-099e-4e77-8028-a9793c11f43b   in service 


    datasets:
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition    quota     reservation   compression
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_727522a7-934f-494d-b5b3-160968e74463/crucible                                                              feecfda1-9966-43d4-aaef-440b77f0b26d   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crucible                                                              956966b9-8201-437b-81ba-3c8ad2032080   in service     none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crucible                                                              4b0b09bf-94b7-45bf-a6b3-d46af53ae44a   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/clickhouse                                                      5ae11c7e-08fa-4d78-a4ea-14b4a9a10241   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    3e0d6188-c503-49cf-a441-fa7df40ceb43   expunged       none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    5c01fdbd-ff37-44b4-a17b-6d625e6fa48d   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    b8f2a09f-8bd2-4418-872b-a4457a3f958c   expunged       none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    a2e6e726-7cf1-432d-9ca7-b7cde2f1f742   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone                                                            4829f422-aa31-41a8-ab73-95684ff1ef48   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone                                                            3b66453b-7148-4c1b-84a9-499e43290ab4   in service     none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone                                                            841d5648-05f0-47b0-b446-92f6b60fe9a6   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_clickhouse_353b3b65-20f7-48c3-88f7-495bd5d31545        49f8fbb6-5bac-4609-907f-6e3dfc206059   in service     none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone/oxz_crucible_86a22a56-0168-453d-9df1-cb2a7c64b5d3          6e218d0a-13fd-4f70-884e-47e960fa8bb8   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_bd354eef-d8a6-4165-9124-283fb5e46d77          9073fb6b-f973-4bbd-b7cc-ba1abf6cb238   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone/oxz_crucible_e2fdefe7-95b2-4fd2-ae37-56929a06d58c          0582030b-aab6-4d0e-b1d2-64562ee712cd   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_6c3ae381-04f7-41ea-b0ac-74db387dbc3a      78f34ce7-42f1-41da-995f-318f32054ad2   expunged       none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_c821c39d-2b2c-4c55-8874-ac12315ba1e4      a21812e1-1b80-4faa-9f2b-51189e0f6999   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_99e2f30b-3174-40bf-a78a-90da8abba8ca      2f204c50-a327-479c-8852-f53ec7a19c1f   expunged       none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_a729999a-6e45-46ca-b51e-0bbb5490387a      eece684d-17ae-4aae-93b3-6928f26722c2   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_nexus_466a9f29-62bf-4e63-924a-b9efdb86afec             8e0bd2bd-23b7-4bc6-9e73-c4d4ebc0bc8c   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_62620961-fc4a-481e-968b-f5acbac0dc63               8c4fa711-1d5d-4e93-85f0-d17bff47b063   expunged       none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_c74e3068-8b20-4a62-953b-dab703a442db               5b087884-f80b-4a4f-a672-6e088753933e   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/debug                                                           93957ca0-9ed1-4e7b-8c34-2ce07a69541c   in service     100 GiB   none          gzip-9     
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/debug                                                           318fae85-abcb-4259-b1b6-ac96d193f7b7   in service     100 GiB   none          gzip-9     
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/debug                                                           b46de15d-33e7-4cd0-aa7c-e7be2a61e71b   in service     100 GiB   none          gzip-9     
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/local_storage                                                   2db6b7c1-0f46-4ced-a3ad-48872793360e   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/local_storage                                                   09b9cc9b-3426-470b-a7bc-538f82dede03   in service     none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/local_storage                                                   c31623de-c19b-4615-9f1d-5e1daa5d3bda   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/local_storage_unencrypted                                             775f9207-c42d-4af2-9186-27ffef67735e   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/local_storage_unencrypted                                             3560dd69-3b23-4c69-807d-d673104cfc68   in service     none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/local_storage_unencrypted                                             2ad1875a-92ac-472f-8c26-593309f0e4da   in service     none      none          off        
*   oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_ad6a3a03-8d0f-4504-99a4-cbf73d69b973   1640adb6-70bf-44cf-b05c-bff6dd300cf3   - in service   none      none          off        
     └─                                                                                                                                                   + expunged                                        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    clickhouse        353b3b65-20f7-48c3-88f7-495bd5d31545   artifact: version 1.0.0   in service       fd00:1122:3344:102::5
    crucible          86a22a56-0168-453d-9df1-cb2a7c64b5d3   artifact: version 1.0.0   in service       fd00:1122:3344:102::a
    crucible          bd354eef-d8a6-4165-9124-283fb5e46d77   artifact: version 0.0.1   in service       fd00:1122:3344:102::8
    crucible          e2fdefe7-95b2-4fd2-ae37-56929a06d58c   artifact: version 0.0.1   in service       fd00:1122:3344:102::9
    external_dns      6c3ae381-04f7-41ea-b0ac-74db387dbc3a   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:102::6
    external_dns      c821c39d-2b2c-4c55-8874-ac12315ba1e4   artifact: version 1.0.0   in service       fd00:1122:3344:102::c
    internal_dns      99e2f30b-3174-40bf-a78a-90da8abba8ca   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:1::1  
    internal_dns      a729999a-6e45-46ca-b51e-0bbb5490387a   artifact: version 1.0.0   in service       fd00:1122:3344:1::1  
    internal_ntp      62620961-fc4a-481e-968b-f5acbac0dc63   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:102::3
    internal_ntp      c74e3068-8b20-4a62-953b-dab703a442db   artifact: version 1.0.0   in service       fd00:1122:3344:102::b
    nexus             466a9f29-62bf-4e63-924a-b9efdb86afec   artifact: version 0.0.1   in service       fd00:1122:3344:102::4
*   crucible_pantry   ad6a3a03-8d0f-4504-99a4-cbf73d69b973   artifact: version 0.0.1   - in service     fd00:1122:3344:102::7
     └─                                                                                + expunged ⏳                          


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
* DNS zone: "control-plane.oxide.internal": 
*   name: _crucible-pantry._tcp                              (records: 3 -> 2)
-       SRV  port 17000 75b220ba-a0f4-4872-8202-dc7c87f062d0.host.control-plane.oxide.internal
-       SRV  port 17000 ad6a3a03-8d0f-4504-99a4-cbf73d69b973.host.control-plane.oxide.internal
-       SRV  port 17000 ba4994a8-23f9-4b1a-a84f-a08d74591389.host.control-plane.oxide.internal
+       SRV  port 17000 75b220ba-a0f4-4872-8202-dc7c87f062d0.host.control-plane.oxide.internal
+       SRV  port 17000 ba4994a8-23f9-4b1a-a84f-a08d74591389.host.control-plane.oxide.internal
-   name: ad6a3a03-8d0f-4504-99a4-cbf73d69b973.host          (records: 1)
-       AAAA fd00:1122:3344:102::7
    unchanged names: 50 (records: 64)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> sled-set 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron-config latest
set sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron config from latest blueprint (d9c5c5e3-c532-4c45-9ef5-22cb00f6a2e1)

> inventory-generate
generated inventory collection 74448e29-ef07-4d7f-9d31-39079eba8296 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipped noop image source check on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint e2deb7c0-2262-49fe-855f-4250c22afb36 based on parent blueprint d9c5c5e3-c532-4c45-9ef5-22cb00f6a2e1
blueprint source: planner with report:
planning report:
* discretionary zones placed:
  * crucible_pantry zone on sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c from source artifact: version 1.0.0
* zone updates waiting on discretionary zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint d9c5c5e3-c532-4c45-9ef5-22cb00f6a2e1
to:   blueprint e2deb7c0-2262-49fe-855f-4250c22afb36

 MODIFIED SLEDS:

  sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c (active, config generation 14 -> 15):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-727522a7-934f-494d-b5b3-160968e74463   in service 
    fake-vendor   fake-model   serial-72c59873-31ff-4e36-8d76-ff834009349a   in service 
    fake-vendor   fake-model   serial-b5fd5bc1-099e-4e77-8028-a9793c11f43b   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_727522a7-934f-494d-b5b3-160968e74463/crucible                                                              feecfda1-9966-43d4-aaef-440b77f0b26d   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crucible                                                              956966b9-8201-437b-81ba-3c8ad2032080   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crucible                                                              4b0b09bf-94b7-45bf-a6b3-d46af53ae44a   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/clickhouse                                                      5ae11c7e-08fa-4d78-a4ea-14b4a9a10241   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    3e0d6188-c503-49cf-a441-fa7df40ceb43   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    5c01fdbd-ff37-44b4-a17b-6d625e6fa48d   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    b8f2a09f-8bd2-4418-872b-a4457a3f958c   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    a2e6e726-7cf1-432d-9ca7-b7cde2f1f742   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone                                                            4829f422-aa31-41a8-ab73-95684ff1ef48   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone                                                            3b66453b-7148-4c1b-84a9-499e43290ab4   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone                                                            841d5648-05f0-47b0-b446-92f6b60fe9a6   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_clickhouse_353b3b65-20f7-48c3-88f7-495bd5d31545        49f8fbb6-5bac-4609-907f-6e3dfc206059   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone/oxz_crucible_86a22a56-0168-453d-9df1-cb2a7c64b5d3          6e218d0a-13fd-4f70-884e-47e960fa8bb8   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_bd354eef-d8a6-4165-9124-283fb5e46d77          9073fb6b-f973-4bbd-b7cc-ba1abf6cb238   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone/oxz_crucible_e2fdefe7-95b2-4fd2-ae37-56929a06d58c          0582030b-aab6-4d0e-b1d2-64562ee712cd   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_ad6a3a03-8d0f-4504-99a4-cbf73d69b973   1640adb6-70bf-44cf-b05c-bff6dd300cf3   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_6c3ae381-04f7-41ea-b0ac-74db387dbc3a      78f34ce7-42f1-41da-995f-318f32054ad2   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_c821c39d-2b2c-4c55-8874-ac12315ba1e4      a21812e1-1b80-4faa-9f2b-51189e0f6999   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_99e2f30b-3174-40bf-a78a-90da8abba8ca      2f204c50-a327-479c-8852-f53ec7a19c1f   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_a729999a-6e45-46ca-b51e-0bbb5490387a      eece684d-17ae-4aae-93b3-6928f26722c2   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_nexus_466a9f29-62bf-4e63-924a-b9efdb86afec             8e0bd2bd-23b7-4bc6-9e73-c4d4ebc0bc8c   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_62620961-fc4a-481e-968b-f5acbac0dc63               8c4fa711-1d5d-4e93-85f0-d17bff47b063   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_c74e3068-8b20-4a62-953b-dab703a442db               5b087884-f80b-4a4f-a672-6e088753933e   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/debug                                                           93957ca0-9ed1-4e7b-8c34-2ce07a69541c   in service    100 GiB   none          gzip-9     
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/debug                                                           318fae85-abcb-4259-b1b6-ac96d193f7b7   in service    100 GiB   none          gzip-9     
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/debug                                                           b46de15d-33e7-4cd0-aa7c-e7be2a61e71b   in service    100 GiB   none          gzip-9     
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/local_storage                                                   2db6b7c1-0f46-4ced-a3ad-48872793360e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/local_storage                                                   09b9cc9b-3426-470b-a7bc-538f82dede03   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/local_storage                                                   c31623de-c19b-4615-9f1d-5e1daa5d3bda   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/local_storage_unencrypted                                             775f9207-c42d-4af2-9186-27ffef67735e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/local_storage_unencrypted                                             3560dd69-3b23-4c69-807d-d673104cfc68   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/local_storage_unencrypted                                             2ad1875a-92ac-472f-8c26-593309f0e4da   in service    none      none          off        
+   oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_c484718d-c38b-42d5-8171-743e0fd5e5b7   e9d249aa-4d3a-49c6-8d94-52fef693f8b9   in service    none      none          off        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    clickhouse        353b3b65-20f7-48c3-88f7-495bd5d31545   artifact: version 1.0.0   in service       fd00:1122:3344:102::5
    crucible          86a22a56-0168-453d-9df1-cb2a7c64b5d3   artifact: version 1.0.0   in service       fd00:1122:3344:102::a
    crucible          bd354eef-d8a6-4165-9124-283fb5e46d77   artifact: version 0.0.1   in service       fd00:1122:3344:102::8
    crucible          e2fdefe7-95b2-4fd2-ae37-56929a06d58c   artifact: version 0.0.1   in service       fd00:1122:3344:102::9
    external_dns      6c3ae381-04f7-41ea-b0ac-74db387dbc3a   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:102::6
    external_dns      c821c39d-2b2c-4c55-8874-ac12315ba1e4   artifact: version 1.0.0   in service       fd00:1122:3344:102::c
    internal_dns      99e2f30b-3174-40bf-a78a-90da8abba8ca   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:1::1  
    internal_dns      a729999a-6e45-46ca-b51e-0bbb5490387a   artifact: version 1.0.0   in service       fd00:1122:3344:1::1  
    internal_ntp      62620961-fc4a-481e-968b-f5acbac0dc63   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:102::3
    internal_ntp      c74e3068-8b20-4a62-953b-dab703a442db   artifact: version 1.0.0   in service       fd00:1122:3344:102::b
    nexus             466a9f29-62bf-4e63-924a-b9efdb86afec   artifact: version 0.0.1   in service       fd00:1122:3344:102::4
*   crucible_pantry   ad6a3a03-8d0f-4504-99a4-cbf73d69b973   artifact: version 0.0.1   - expunged ⏳     fd00:1122:3344:102::7
     └─                                                                                + expunged ✓                          
+   crucible_pantry   c484718d-c38b-42d5-8171-743e0fd5e5b7   artifact: version 1.0.0   in service       fd00:1122:3344:102::d


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
* DNS zone: "control-plane.oxide.internal": 
*   name: _crucible-pantry._tcp                              (records: 2 -> 3)
-       SRV  port 17000 75b220ba-a0f4-4872-8202-dc7c87f062d0.host.control-plane.oxide.internal
-       SRV  port 17000 ba4994a8-23f9-4b1a-a84f-a08d74591389.host.control-plane.oxide.internal
+       SRV  port 17000 75b220ba-a0f4-4872-8202-dc7c87f062d0.host.control-plane.oxide.internal
+       SRV  port 17000 ba4994a8-23f9-4b1a-a84f-a08d74591389.host.control-plane.oxide.internal
+       SRV  port 17000 c484718d-c38b-42d5-8171-743e0fd5e5b7.host.control-plane.oxide.internal
+   name: c484718d-c38b-42d5-8171-743e0fd5e5b7.host          (records: 1)
+       AAAA fd00:1122:3344:102::d
    unchanged names: 50 (records: 64)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> sled-set 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron-config latest
set sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron config from latest blueprint (e2deb7c0-2262-49fe-855f-4250c22afb36)

> inventory-generate
generated inventory collection a815c282-5564-4cea-b667-a7a5295fc2c1 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipped noop image source check on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 23ce505c-8991-44a5-8863-f2b906fba9cf based on parent blueprint e2deb7c0-2262-49fe-855f-4250c22afb36
blueprint source: planner with report:
planning report:
* 1 out-of-date zone updated in-place:
  * sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, zone bd354eef-d8a6-4165-9124-283fb5e46d77 (crucible)
* 18 remaining out-of-date zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint e2deb7c0-2262-49fe-855f-4250c22afb36
to:   blueprint 23ce505c-8991-44a5-8863-f2b906fba9cf

 MODIFIED SLEDS:

  sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c (active, config generation 15 -> 16):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-727522a7-934f-494d-b5b3-160968e74463   in service 
    fake-vendor   fake-model   serial-72c59873-31ff-4e36-8d76-ff834009349a   in service 
    fake-vendor   fake-model   serial-b5fd5bc1-099e-4e77-8028-a9793c11f43b   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_727522a7-934f-494d-b5b3-160968e74463/crucible                                                              feecfda1-9966-43d4-aaef-440b77f0b26d   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crucible                                                              956966b9-8201-437b-81ba-3c8ad2032080   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crucible                                                              4b0b09bf-94b7-45bf-a6b3-d46af53ae44a   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/clickhouse                                                      5ae11c7e-08fa-4d78-a4ea-14b4a9a10241   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    3e0d6188-c503-49cf-a441-fa7df40ceb43   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    5c01fdbd-ff37-44b4-a17b-6d625e6fa48d   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    a2e6e726-7cf1-432d-9ca7-b7cde2f1f742   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    b8f2a09f-8bd2-4418-872b-a4457a3f958c   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone                                                            4829f422-aa31-41a8-ab73-95684ff1ef48   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone                                                            3b66453b-7148-4c1b-84a9-499e43290ab4   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone                                                            841d5648-05f0-47b0-b446-92f6b60fe9a6   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_clickhouse_353b3b65-20f7-48c3-88f7-495bd5d31545        49f8fbb6-5bac-4609-907f-6e3dfc206059   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone/oxz_crucible_86a22a56-0168-453d-9df1-cb2a7c64b5d3          6e218d0a-13fd-4f70-884e-47e960fa8bb8   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_bd354eef-d8a6-4165-9124-283fb5e46d77          9073fb6b-f973-4bbd-b7cc-ba1abf6cb238   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone/oxz_crucible_e2fdefe7-95b2-4fd2-ae37-56929a06d58c          0582030b-aab6-4d0e-b1d2-64562ee712cd   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_ad6a3a03-8d0f-4504-99a4-cbf73d69b973   1640adb6-70bf-44cf-b05c-bff6dd300cf3   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_c484718d-c38b-42d5-8171-743e0fd5e5b7   e9d249aa-4d3a-49c6-8d94-52fef693f8b9   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_6c3ae381-04f7-41ea-b0ac-74db387dbc3a      78f34ce7-42f1-41da-995f-318f32054ad2   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_c821c39d-2b2c-4c55-8874-ac12315ba1e4      a21812e1-1b80-4faa-9f2b-51189e0f6999   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_99e2f30b-3174-40bf-a78a-90da8abba8ca      2f204c50-a327-479c-8852-f53ec7a19c1f   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_a729999a-6e45-46ca-b51e-0bbb5490387a      eece684d-17ae-4aae-93b3-6928f26722c2   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_nexus_466a9f29-62bf-4e63-924a-b9efdb86afec             8e0bd2bd-23b7-4bc6-9e73-c4d4ebc0bc8c   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_62620961-fc4a-481e-968b-f5acbac0dc63               8c4fa711-1d5d-4e93-85f0-d17bff47b063   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_c74e3068-8b20-4a62-953b-dab703a442db               5b087884-f80b-4a4f-a672-6e088753933e   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/debug                                                           93957ca0-9ed1-4e7b-8c34-2ce07a69541c   in service    100 GiB   none          gzip-9     
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/debug                                                           318fae85-abcb-4259-b1b6-ac96d193f7b7   in service    100 GiB   none          gzip-9     
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/debug                                                           b46de15d-33e7-4cd0-aa7c-e7be2a61e71b   in service    100 GiB   none          gzip-9     
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/local_storage                                                   2db6b7c1-0f46-4ced-a3ad-48872793360e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/local_storage                                                   09b9cc9b-3426-470b-a7bc-538f82dede03   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/local_storage                                                   c31623de-c19b-4615-9f1d-5e1daa5d3bda   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/local_storage_unencrypted                                             775f9207-c42d-4af2-9186-27ffef67735e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/local_storage_unencrypted                                             3560dd69-3b23-4c69-807d-d673104cfc68   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/local_storage_unencrypted                                             2ad1875a-92ac-472f-8c26-593309f0e4da   in service    none      none          off        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source                disposition    underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    clickhouse        353b3b65-20f7-48c3-88f7-495bd5d31545   artifact: version 1.0.0     in service     fd00:1122:3344:102::5
    crucible          86a22a56-0168-453d-9df1-cb2a7c64b5d3   artifact: version 1.0.0     in service     fd00:1122:3344:102::a
    crucible          e2fdefe7-95b2-4fd2-ae37-56929a06d58c   artifact: version 0.0.1     in service     fd00:1122:3344:102::9
    crucible_pantry   ad6a3a03-8d0f-4504-99a4-cbf73d69b973   artifact: version 0.0.1     expunged ✓     fd00:1122:3344:102::7
    crucible_pantry   c484718d-c38b-42d5-8171-743e0fd5e5b7   artifact: version 1.0.0     in service     fd00:1122:3344:102::d
    external_dns      6c3ae381-04f7-41ea-b0ac-74db387dbc3a   artifact: version 0.0.1     expunged ✓     fd00:1122:3344:102::6
    external_dns      c821c39d-2b2c-4c55-8874-ac12315ba1e4   artifact: version 1.0.0     in service     fd00:1122:3344:102::c
    internal_dns      99e2f30b-3174-40bf-a78a-90da8abba8ca   artifact: version 0.0.1     expunged ✓     fd00:1122:3344:1::1  
    internal_dns      a729999a-6e45-46ca-b51e-0bbb5490387a   artifact: version 1.0.0     in service     fd00:1122:3344:1::1  
    internal_ntp      62620961-fc4a-481e-968b-f5acbac0dc63   artifact: version 0.0.1     expunged ✓     fd00:1122:3344:102::3
    internal_ntp      c74e3068-8b20-4a62-953b-dab703a442db   artifact: version 1.0.0     in service     fd00:1122:3344:102::b
    nexus             466a9f29-62bf-4e63-924a-b9efdb86afec   artifact: version 0.0.1     in service     fd00:1122:3344:102::4
*   crucible          bd354eef-d8a6-4165-9124-283fb5e46d77   - artifact: version 0.0.1   in service     fd00:1122:3344:102::8
     └─                                                      + artifact: version 1.0.0                                       


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> sled-set 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron-config latest
set sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron config from latest blueprint (23ce505c-8991-44a5-8863-f2b906fba9cf)

> inventory-generate
generated inventory collection 18ca4fd2-190d-4ac5-b0f3-14a384bcd254 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipped noop image source check on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint c0d81ea6-909c-4efb-964e-beff67f6da0d based on parent blueprint 23ce505c-8991-44a5-8863-f2b906fba9cf
blueprint source: planner with report:
planning report:
* 1 out-of-date zone updated in-place:
  * sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, zone e2fdefe7-95b2-4fd2-ae37-56929a06d58c (crucible)
* 17 remaining out-of-date zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 23ce505c-8991-44a5-8863-f2b906fba9cf
to:   blueprint c0d81ea6-909c-4efb-964e-beff67f6da0d

 MODIFIED SLEDS:

  sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c (active, config generation 16 -> 17):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-727522a7-934f-494d-b5b3-160968e74463   in service 
    fake-vendor   fake-model   serial-72c59873-31ff-4e36-8d76-ff834009349a   in service 
    fake-vendor   fake-model   serial-b5fd5bc1-099e-4e77-8028-a9793c11f43b   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_727522a7-934f-494d-b5b3-160968e74463/crucible                                                              feecfda1-9966-43d4-aaef-440b77f0b26d   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crucible                                                              956966b9-8201-437b-81ba-3c8ad2032080   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crucible                                                              4b0b09bf-94b7-45bf-a6b3-d46af53ae44a   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/clickhouse                                                      5ae11c7e-08fa-4d78-a4ea-14b4a9a10241   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    3e0d6188-c503-49cf-a441-fa7df40ceb43   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    5c01fdbd-ff37-44b4-a17b-6d625e6fa48d   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    a2e6e726-7cf1-432d-9ca7-b7cde2f1f742   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    b8f2a09f-8bd2-4418-872b-a4457a3f958c   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone                                                            4829f422-aa31-41a8-ab73-95684ff1ef48   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone                                                            3b66453b-7148-4c1b-84a9-499e43290ab4   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone                                                            841d5648-05f0-47b0-b446-92f6b60fe9a6   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_clickhouse_353b3b65-20f7-48c3-88f7-495bd5d31545        49f8fbb6-5bac-4609-907f-6e3dfc206059   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone/oxz_crucible_86a22a56-0168-453d-9df1-cb2a7c64b5d3          6e218d0a-13fd-4f70-884e-47e960fa8bb8   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_bd354eef-d8a6-4165-9124-283fb5e46d77          9073fb6b-f973-4bbd-b7cc-ba1abf6cb238   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone/oxz_crucible_e2fdefe7-95b2-4fd2-ae37-56929a06d58c          0582030b-aab6-4d0e-b1d2-64562ee712cd   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_ad6a3a03-8d0f-4504-99a4-cbf73d69b973   1640adb6-70bf-44cf-b05c-bff6dd300cf3   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_c484718d-c38b-42d5-8171-743e0fd5e5b7   e9d249aa-4d3a-49c6-8d94-52fef693f8b9   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_6c3ae381-04f7-41ea-b0ac-74db387dbc3a      78f34ce7-42f1-41da-995f-318f32054ad2   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_c821c39d-2b2c-4c55-8874-ac12315ba1e4      a21812e1-1b80-4faa-9f2b-51189e0f6999   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_99e2f30b-3174-40bf-a78a-90da8abba8ca      2f204c50-a327-479c-8852-f53ec7a19c1f   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_a729999a-6e45-46ca-b51e-0bbb5490387a      eece684d-17ae-4aae-93b3-6928f26722c2   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_nexus_466a9f29-62bf-4e63-924a-b9efdb86afec             8e0bd2bd-23b7-4bc6-9e73-c4d4ebc0bc8c   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_62620961-fc4a-481e-968b-f5acbac0dc63               8c4fa711-1d5d-4e93-85f0-d17bff47b063   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_c74e3068-8b20-4a62-953b-dab703a442db               5b087884-f80b-4a4f-a672-6e088753933e   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/debug                                                           93957ca0-9ed1-4e7b-8c34-2ce07a69541c   in service    100 GiB   none          gzip-9     
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/debug                                                           318fae85-abcb-4259-b1b6-ac96d193f7b7   in service    100 GiB   none          gzip-9     
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/debug                                                           b46de15d-33e7-4cd0-aa7c-e7be2a61e71b   in service    100 GiB   none          gzip-9     
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/local_storage                                                   2db6b7c1-0f46-4ced-a3ad-48872793360e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/local_storage                                                   09b9cc9b-3426-470b-a7bc-538f82dede03   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/local_storage                                                   c31623de-c19b-4615-9f1d-5e1daa5d3bda   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/local_storage_unencrypted                                             775f9207-c42d-4af2-9186-27ffef67735e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/local_storage_unencrypted                                             3560dd69-3b23-4c69-807d-d673104cfc68   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/local_storage_unencrypted                                             2ad1875a-92ac-472f-8c26-593309f0e4da   in service    none      none          off        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source                disposition    underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    clickhouse        353b3b65-20f7-48c3-88f7-495bd5d31545   artifact: version 1.0.0     in service     fd00:1122:3344:102::5
    crucible          86a22a56-0168-453d-9df1-cb2a7c64b5d3   artifact: version 1.0.0     in service     fd00:1122:3344:102::a
    crucible          bd354eef-d8a6-4165-9124-283fb5e46d77   artifact: version 1.0.0     in service     fd00:1122:3344:102::8
    crucible_pantry   ad6a3a03-8d0f-4504-99a4-cbf73d69b973   artifact: version 0.0.1     expunged ✓     fd00:1122:3344:102::7
    crucible_pantry   c484718d-c38b-42d5-8171-743e0fd5e5b7   artifact: version 1.0.0     in service     fd00:1122:3344:102::d
    external_dns      6c3ae381-04f7-41ea-b0ac-74db387dbc3a   artifact: version 0.0.1     expunged ✓     fd00:1122:3344:102::6
    external_dns      c821c39d-2b2c-4c55-8874-ac12315ba1e4   artifact: version 1.0.0     in service     fd00:1122:3344:102::c
    internal_dns      99e2f30b-3174-40bf-a78a-90da8abba8ca   artifact: version 0.0.1     expunged ✓     fd00:1122:3344:1::1  
    internal_dns      a729999a-6e45-46ca-b51e-0bbb5490387a   artifact: version 1.0.0     in service     fd00:1122:3344:1::1  
    internal_ntp      62620961-fc4a-481e-968b-f5acbac0dc63   artifact: version 0.0.1     expunged ✓     fd00:1122:3344:102::3
    internal_ntp      c74e3068-8b20-4a62-953b-dab703a442db   artifact: version 1.0.0     in service     fd00:1122:3344:102::b
    nexus             466a9f29-62bf-4e63-924a-b9efdb86afec   artifact: version 0.0.1     in service     fd00:1122:3344:102::4
*   crucible          e2fdefe7-95b2-4fd2-ae37-56929a06d58c   - artifact: version 0.0.1   in service     fd00:1122:3344:102::9
     └─                                                      + artifact: version 1.0.0                                       


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # The previous plan updated the last non-Nexus zone on this sled. Nexus comes
> # after everything else, so the next step should update the first zone on the
> # next sled.
> sled-set 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron-config latest
set sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron config from latest blueprint (c0d81ea6-909c-4efb-964e-beff67f6da0d)

> inventory-generate
generated inventory collection b460bcc7-664d-4dff-92fb-f250def5537c from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipped noop image source check on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 60b55d33-5fec-4277-9864-935197eaead7 based on parent blueprint c0d81ea6-909c-4efb-964e-beff67f6da0d
blueprint source: planner with report:
planning report:
* 1 out-of-date zone updated in-place:
  * sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, zone 058fd5f9-60a8-4e11-9302-15172782e17d (crucible)
* 16 remaining out-of-date zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint c0d81ea6-909c-4efb-964e-beff67f6da0d
to:   blueprint 60b55d33-5fec-4277-9864-935197eaead7

 MODIFIED SLEDS:

  sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 (active, config generation 5 -> 6):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-073979dd-3248-44a5-9fa1-cc72a140d682   in service 
    fake-vendor   fake-model   serial-c6d33b64-fb96-4129-bab1-7878a06a5f9b   in service 
    fake-vendor   fake-model   serial-e4d937e1-6ddc-4eca-bb08-c1f73791e608   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crucible                                                              335e1dc3-b610-48dd-90bb-9ca5cce1a6d0   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crucible                                                              d5fef28b-4ee8-4443-8c06-7e872c2502f3   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crucible                                                              6477f019-088c-43cf-8508-aa93f868830f   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    02c56a30-7d97-406d-bd34-1eb437fd517d   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    4d7e3e8e-06bd-414c-a468-779e056a9b75   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone                                                            4617d206-4330-4dfa-b9f3-f63a3db834f9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone                                                            4f60b534-eaa3-40a1-b60f-bfdf147af478   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone                                                            ad41be71-6c15-4428-b510-20ceacde4fa6   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone/oxz_crucible_058fd5f9-60a8-4e11-9302-15172782e17d          55a2a61a-1471-49b2-a6d0-b191ed94e057   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_5199c033-4cf9-4ab6-8ae7-566bd7606363          90b46084-4238-45ba-9e26-d3f2623e640e   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_crucible_dfac80b4-a887-430a-ae87-a4e065dba787          bcdc7bf3-bbae-4e7f-81b2-4d94c8f752a4   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_ba4994a8-23f9-4b1a-a84f-a08d74591389   50b029e3-96aa-41e5-bf39-023193a4355e   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_803bfb63-c246-41db-b0da-d3b87ddfc63d      ea8a11bf-a884-4c4f-8df0-3ef9b7aacf43   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_427ec88f-f467-42fa-9bbb-66a91a36103c      7b4ce6bf-95bb-42fe-a4a0-dff31211ab88   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_0c71b3b2-6ceb-4e8f-b020-b08675e83038             832fd140-d467-4bad-b5e9-63171634087c   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_6444f8a5-6465-4f0b-a549-1993c113569c               42430c80-7836-4191-a4f6-bcee749010fe   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/debug                                                           248c6c10-1ac6-45de-bb55-ede36ca56bbd   in service    100 GiB   none          gzip-9     
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/debug                                                           686c19cf-a0d7-45f6-866f-c564612b2664   in service    100 GiB   none          gzip-9     
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/debug                                                           1bca7f71-5e42-4749-91ec-fa40793a3a9a   in service    100 GiB   none          gzip-9     
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/local_storage                                                   cdf3684f-a6cf-4449-b9ec-e696b2c663e2   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/local_storage                                                   3ac089c9-9dec-465b-863a-188e80d71fb4   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/local_storage                                                   43931274-7fe8-4077-825d-dff2bc8efa58   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/local_storage_unencrypted                                             793ac181-1b01-403c-850d-7f5c54bda6c9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/local_storage_unencrypted                                             a4c3032e-21fa-4d4a-b040-a7e3c572cf3c   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/local_storage_unencrypted                                             4847a96e-a267-4ae7-aa3d-805c1e77f81e   in service    none      none          off        


    omicron zones:
    ------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source                disposition   underlay IP          
    ------------------------------------------------------------------------------------------------------------------------
    crucible          5199c033-4cf9-4ab6-8ae7-566bd7606363   artifact: version 0.0.1     in service    fd00:1122:3344:101::7
    crucible          dfac80b4-a887-430a-ae87-a4e065dba787   artifact: version 0.0.1     in service    fd00:1122:3344:101::8
    crucible_pantry   ba4994a8-23f9-4b1a-a84f-a08d74591389   artifact: version 0.0.1     in service    fd00:1122:3344:101::6
    external_dns      803bfb63-c246-41db-b0da-d3b87ddfc63d   artifact: version 0.0.1     in service    fd00:1122:3344:101::5
    internal_dns      427ec88f-f467-42fa-9bbb-66a91a36103c   artifact: version 0.0.1     in service    fd00:1122:3344:2::1  
    internal_ntp      6444f8a5-6465-4f0b-a549-1993c113569c   artifact: version 0.0.1     in service    fd00:1122:3344:101::3
    nexus             0c71b3b2-6ceb-4e8f-b020-b08675e83038   artifact: version 0.0.1     in service    fd00:1122:3344:101::4
*   crucible          058fd5f9-60a8-4e11-9302-15172782e17d   - artifact: version 0.0.1   in service    fd00:1122:3344:101::9
     └─                                                      + artifact: version 1.0.0                                      


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # Step through updates of all the non-Nexus zones on this sled.
> sled-set 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron-config latest
set sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron config from latest blueprint (60b55d33-5fec-4277-9864-935197eaead7)

> inventory-generate
generated inventory collection f8212fb6-115e-4568-a05c-b241e2e8ffb9 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipped noop image source check on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint aa13f40f-41ff-4b68-bee1-df2e1f805544 based on parent blueprint 60b55d33-5fec-4277-9864-935197eaead7
blueprint source: planner with report:
planning report:
* 1 out-of-date zone expunged:
  * sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, zone 427ec88f-f467-42fa-9bbb-66a91a36103c (internal_dns)
* 15 remaining out-of-date zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 60b55d33-5fec-4277-9864-935197eaead7
to:   blueprint aa13f40f-41ff-4b68-bee1-df2e1f805544

 MODIFIED SLEDS:

  sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 (active, config generation 6 -> 7):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-073979dd-3248-44a5-9fa1-cc72a140d682   in service 
    fake-vendor   fake-model   serial-c6d33b64-fb96-4129-bab1-7878a06a5f9b   in service 
    fake-vendor   fake-model   serial-e4d937e1-6ddc-4eca-bb08-c1f73791e608   in service 


    datasets:
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition    quota     reservation   compression
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crucible                                                              335e1dc3-b610-48dd-90bb-9ca5cce1a6d0   in service     none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crucible                                                              d5fef28b-4ee8-4443-8c06-7e872c2502f3   in service     none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crucible                                                              6477f019-088c-43cf-8508-aa93f868830f   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    02c56a30-7d97-406d-bd34-1eb437fd517d   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone                                                            4617d206-4330-4dfa-b9f3-f63a3db834f9   in service     none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone                                                            4f60b534-eaa3-40a1-b60f-bfdf147af478   in service     none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone                                                            ad41be71-6c15-4428-b510-20ceacde4fa6   in service     none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone/oxz_crucible_058fd5f9-60a8-4e11-9302-15172782e17d          55a2a61a-1471-49b2-a6d0-b191ed94e057   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_5199c033-4cf9-4ab6-8ae7-566bd7606363          90b46084-4238-45ba-9e26-d3f2623e640e   in service     none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_crucible_dfac80b4-a887-430a-ae87-a4e065dba787          bcdc7bf3-bbae-4e7f-81b2-4d94c8f752a4   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_ba4994a8-23f9-4b1a-a84f-a08d74591389   50b029e3-96aa-41e5-bf39-023193a4355e   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_803bfb63-c246-41db-b0da-d3b87ddfc63d      ea8a11bf-a884-4c4f-8df0-3ef9b7aacf43   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_0c71b3b2-6ceb-4e8f-b020-b08675e83038             832fd140-d467-4bad-b5e9-63171634087c   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_6444f8a5-6465-4f0b-a549-1993c113569c               42430c80-7836-4191-a4f6-bcee749010fe   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/debug                                                           248c6c10-1ac6-45de-bb55-ede36ca56bbd   in service     100 GiB   none          gzip-9     
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/debug                                                           686c19cf-a0d7-45f6-866f-c564612b2664   in service     100 GiB   none          gzip-9     
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/debug                                                           1bca7f71-5e42-4749-91ec-fa40793a3a9a   in service     100 GiB   none          gzip-9     
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/local_storage                                                   cdf3684f-a6cf-4449-b9ec-e696b2c663e2   in service     none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/local_storage                                                   3ac089c9-9dec-465b-863a-188e80d71fb4   in service     none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/local_storage                                                   43931274-7fe8-4077-825d-dff2bc8efa58   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/local_storage_unencrypted                                             793ac181-1b01-403c-850d-7f5c54bda6c9   in service     none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/local_storage_unencrypted                                             a4c3032e-21fa-4d4a-b040-a7e3c572cf3c   in service     none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/local_storage_unencrypted                                             4847a96e-a267-4ae7-aa3d-805c1e77f81e   in service     none      none          off        
*   oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    4d7e3e8e-06bd-414c-a468-779e056a9b75   - in service   none      none          off        
     └─                                                                                                                                                   + expunged                                        
*   oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_427ec88f-f467-42fa-9bbb-66a91a36103c      7b4ce6bf-95bb-42fe-a4a0-dff31211ab88   - in service   none      none          off        
     └─                                                                                                                                                   + expunged                                        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    crucible          058fd5f9-60a8-4e11-9302-15172782e17d   artifact: version 1.0.0   in service       fd00:1122:3344:101::9
    crucible          5199c033-4cf9-4ab6-8ae7-566bd7606363   artifact: version 0.0.1   in service       fd00:1122:3344:101::7
    crucible          dfac80b4-a887-430a-ae87-a4e065dba787   artifact: version 0.0.1   in service       fd00:1122:3344:101::8
    crucible_pantry   ba4994a8-23f9-4b1a-a84f-a08d74591389   artifact: version 0.0.1   in service       fd00:1122:3344:101::6
    external_dns      803bfb63-c246-41db-b0da-d3b87ddfc63d   artifact: version 0.0.1   in service       fd00:1122:3344:101::5
    internal_ntp      6444f8a5-6465-4f0b-a549-1993c113569c   artifact: version 0.0.1   in service       fd00:1122:3344:101::3
    nexus             0c71b3b2-6ceb-4e8f-b020-b08675e83038   artifact: version 0.0.1   in service       fd00:1122:3344:101::4
*   internal_dns      427ec88f-f467-42fa-9bbb-66a91a36103c   artifact: version 0.0.1   - in service     fd00:1122:3344:2::1  
     └─                                                                                + expunged ⏳                          


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
* DNS zone: "control-plane.oxide.internal": 
-   name: 427ec88f-f467-42fa-9bbb-66a91a36103c.host          (records: 1)
-       AAAA fd00:1122:3344:2::1
*   name: @                                                  (records: 3 -> 2)
-       NS   ns1.control-plane.oxide.internal
-       NS   ns2.control-plane.oxide.internal
-       NS   ns3.control-plane.oxide.internal
+       NS   ns1.control-plane.oxide.internal
+       NS   ns2.control-plane.oxide.internal
*   name: _nameservice._tcp                                  (records: 3 -> 2)
-       SRV  port  5353 427ec88f-f467-42fa-9bbb-66a91a36103c.host.control-plane.oxide.internal
-       SRV  port  5353 a729999a-6e45-46ca-b51e-0bbb5490387a.host.control-plane.oxide.internal
-       SRV  port  5353 ea5b4030-b52f-44b2-8d70-45f15f987d01.host.control-plane.oxide.internal
+       SRV  port  5353 a729999a-6e45-46ca-b51e-0bbb5490387a.host.control-plane.oxide.internal
+       SRV  port  5353 ea5b4030-b52f-44b2-8d70-45f15f987d01.host.control-plane.oxide.internal
*   name: ns2                                                (records: 1 -> 1)
-       AAAA fd00:1122:3344:2::1
+       AAAA fd00:1122:3344:3::1
-   name: ns3                                                (records: 1)
-       AAAA fd00:1122:3344:3::1
    unchanged names: 47 (records: 59)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> sled-set 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron-config latest
set sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron config from latest blueprint (aa13f40f-41ff-4b68-bee1-df2e1f805544)

> inventory-generate
generated inventory collection f7602eed-bc12-42db-8eec-6f98a05d9796 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 7, num_already_artifact: 7, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipped noop image source check on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 316ccd9e-5c53-46c3-a2e9-20c3867b7111 based on parent blueprint aa13f40f-41ff-4b68-bee1-df2e1f805544
blueprint source: planner with report:
planning report:
* discretionary zones placed:
  * internal_dns zone on sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 from source artifact: version 1.0.0
* zone updates waiting on discretionary zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint aa13f40f-41ff-4b68-bee1-df2e1f805544
to:   blueprint 316ccd9e-5c53-46c3-a2e9-20c3867b7111

 MODIFIED SLEDS:

  sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 (active, config generation 7 -> 8):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-073979dd-3248-44a5-9fa1-cc72a140d682   in service 
    fake-vendor   fake-model   serial-c6d33b64-fb96-4129-bab1-7878a06a5f9b   in service 
    fake-vendor   fake-model   serial-e4d937e1-6ddc-4eca-bb08-c1f73791e608   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crucible                                                              335e1dc3-b610-48dd-90bb-9ca5cce1a6d0   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crucible                                                              d5fef28b-4ee8-4443-8c06-7e872c2502f3   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crucible                                                              6477f019-088c-43cf-8508-aa93f868830f   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    02c56a30-7d97-406d-bd34-1eb437fd517d   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    4d7e3e8e-06bd-414c-a468-779e056a9b75   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone                                                            4617d206-4330-4dfa-b9f3-f63a3db834f9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone                                                            4f60b534-eaa3-40a1-b60f-bfdf147af478   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone                                                            ad41be71-6c15-4428-b510-20ceacde4fa6   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone/oxz_crucible_058fd5f9-60a8-4e11-9302-15172782e17d          55a2a61a-1471-49b2-a6d0-b191ed94e057   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_5199c033-4cf9-4ab6-8ae7-566bd7606363          90b46084-4238-45ba-9e26-d3f2623e640e   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_crucible_dfac80b4-a887-430a-ae87-a4e065dba787          bcdc7bf3-bbae-4e7f-81b2-4d94c8f752a4   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_ba4994a8-23f9-4b1a-a84f-a08d74591389   50b029e3-96aa-41e5-bf39-023193a4355e   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_803bfb63-c246-41db-b0da-d3b87ddfc63d      ea8a11bf-a884-4c4f-8df0-3ef9b7aacf43   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_427ec88f-f467-42fa-9bbb-66a91a36103c      7b4ce6bf-95bb-42fe-a4a0-dff31211ab88   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_0c71b3b2-6ceb-4e8f-b020-b08675e83038             832fd140-d467-4bad-b5e9-63171634087c   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_6444f8a5-6465-4f0b-a549-1993c113569c               42430c80-7836-4191-a4f6-bcee749010fe   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/debug                                                           248c6c10-1ac6-45de-bb55-ede36ca56bbd   in service    100 GiB   none          gzip-9     
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/debug                                                           686c19cf-a0d7-45f6-866f-c564612b2664   in service    100 GiB   none          gzip-9     
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/debug                                                           1bca7f71-5e42-4749-91ec-fa40793a3a9a   in service    100 GiB   none          gzip-9     
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/local_storage                                                   cdf3684f-a6cf-4449-b9ec-e696b2c663e2   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/local_storage                                                   3ac089c9-9dec-465b-863a-188e80d71fb4   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/local_storage                                                   43931274-7fe8-4077-825d-dff2bc8efa58   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/local_storage_unencrypted                                             793ac181-1b01-403c-850d-7f5c54bda6c9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/local_storage_unencrypted                                             a4c3032e-21fa-4d4a-b040-a7e3c572cf3c   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/local_storage_unencrypted                                             4847a96e-a267-4ae7-aa3d-805c1e77f81e   in service    none      none          off        
+   oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    fbd8f5eb-baa1-4e8f-9124-a48e5341b41f   in service    none      none          off        
+   oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_cc6fdaf4-0195-4cef-950d-7bacd7059787      5d6116c2-ade3-4246-8d02-5591d2622c10   in service    none      none          off        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    crucible          058fd5f9-60a8-4e11-9302-15172782e17d   artifact: version 1.0.0   in service       fd00:1122:3344:101::9
    crucible          5199c033-4cf9-4ab6-8ae7-566bd7606363   artifact: version 0.0.1   in service       fd00:1122:3344:101::7
    crucible          dfac80b4-a887-430a-ae87-a4e065dba787   artifact: version 0.0.1   in service       fd00:1122:3344:101::8
    crucible_pantry   ba4994a8-23f9-4b1a-a84f-a08d74591389   artifact: version 0.0.1   in service       fd00:1122:3344:101::6
    external_dns      803bfb63-c246-41db-b0da-d3b87ddfc63d   artifact: version 0.0.1   in service       fd00:1122:3344:101::5
    internal_ntp      6444f8a5-6465-4f0b-a549-1993c113569c   artifact: version 0.0.1   in service       fd00:1122:3344:101::3
    nexus             0c71b3b2-6ceb-4e8f-b020-b08675e83038   artifact: version 0.0.1   in service       fd00:1122:3344:101::4
*   internal_dns      427ec88f-f467-42fa-9bbb-66a91a36103c   artifact: version 0.0.1   - expunged ⏳     fd00:1122:3344:2::1  
     └─                                                                                + expunged ✓                          
+   internal_dns      cc6fdaf4-0195-4cef-950d-7bacd7059787   artifact: version 1.0.0   in service       fd00:1122:3344:2::1  


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
* DNS zone: "control-plane.oxide.internal": 
*   name: @                                                  (records: 2 -> 3)
-       NS   ns1.control-plane.oxide.internal
-       NS   ns2.control-plane.oxide.internal
+       NS   ns1.control-plane.oxide.internal
+       NS   ns2.control-plane.oxide.internal
+       NS   ns3.control-plane.oxide.internal
*   name: _nameservice._tcp                                  (records: 2 -> 3)
-       SRV  port  5353 a729999a-6e45-46ca-b51e-0bbb5490387a.host.control-plane.oxide.internal
-       SRV  port  5353 ea5b4030-b52f-44b2-8d70-45f15f987d01.host.control-plane.oxide.internal
+       SRV  port  5353 a729999a-6e45-46ca-b51e-0bbb5490387a.host.control-plane.oxide.internal
+       SRV  port  5353 cc6fdaf4-0195-4cef-950d-7bacd7059787.host.control-plane.oxide.internal
+       SRV  port  5353 ea5b4030-b52f-44b2-8d70-45f15f987d01.host.control-plane.oxide.internal
+   name: cc6fdaf4-0195-4cef-950d-7bacd7059787.host          (records: 1)
+       AAAA fd00:1122:3344:2::1
*   name: ns2                                                (records: 1 -> 1)
-       AAAA fd00:1122:3344:3::1
+       AAAA fd00:1122:3344:2::1
+   name: ns3                                                (records: 1)
+       AAAA fd00:1122:3344:3::1
    unchanged names: 47 (records: 59)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> sled-set 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron-config latest
set sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron config from latest blueprint (316ccd9e-5c53-46c3-a2e9-20c3867b7111)

> inventory-generate
generated inventory collection af824d9a-296d-4a2f-b704-c985c7470a1a from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipped noop image source check on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 02078c95-3d58-4b7b-a03f-9b160361c50a based on parent blueprint 316ccd9e-5c53-46c3-a2e9-20c3867b7111
blueprint source: planner with report:
planning report:
* 1 out-of-date zone updated in-place:
  * sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, zone 5199c033-4cf9-4ab6-8ae7-566bd7606363 (crucible)
* 14 remaining out-of-date zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 316ccd9e-5c53-46c3-a2e9-20c3867b7111
to:   blueprint 02078c95-3d58-4b7b-a03f-9b160361c50a

 MODIFIED SLEDS:

  sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 (active, config generation 8 -> 9):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-073979dd-3248-44a5-9fa1-cc72a140d682   in service 
    fake-vendor   fake-model   serial-c6d33b64-fb96-4129-bab1-7878a06a5f9b   in service 
    fake-vendor   fake-model   serial-e4d937e1-6ddc-4eca-bb08-c1f73791e608   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crucible                                                              335e1dc3-b610-48dd-90bb-9ca5cce1a6d0   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crucible                                                              d5fef28b-4ee8-4443-8c06-7e872c2502f3   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crucible                                                              6477f019-088c-43cf-8508-aa93f868830f   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    02c56a30-7d97-406d-bd34-1eb437fd517d   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    fbd8f5eb-baa1-4e8f-9124-a48e5341b41f   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    4d7e3e8e-06bd-414c-a468-779e056a9b75   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone                                                            4617d206-4330-4dfa-b9f3-f63a3db834f9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone                                                            4f60b534-eaa3-40a1-b60f-bfdf147af478   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone                                                            ad41be71-6c15-4428-b510-20ceacde4fa6   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone/oxz_crucible_058fd5f9-60a8-4e11-9302-15172782e17d          55a2a61a-1471-49b2-a6d0-b191ed94e057   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_5199c033-4cf9-4ab6-8ae7-566bd7606363          90b46084-4238-45ba-9e26-d3f2623e640e   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_crucible_dfac80b4-a887-430a-ae87-a4e065dba787          bcdc7bf3-bbae-4e7f-81b2-4d94c8f752a4   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_ba4994a8-23f9-4b1a-a84f-a08d74591389   50b029e3-96aa-41e5-bf39-023193a4355e   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_803bfb63-c246-41db-b0da-d3b87ddfc63d      ea8a11bf-a884-4c4f-8df0-3ef9b7aacf43   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_427ec88f-f467-42fa-9bbb-66a91a36103c      7b4ce6bf-95bb-42fe-a4a0-dff31211ab88   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_cc6fdaf4-0195-4cef-950d-7bacd7059787      5d6116c2-ade3-4246-8d02-5591d2622c10   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_0c71b3b2-6ceb-4e8f-b020-b08675e83038             832fd140-d467-4bad-b5e9-63171634087c   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_6444f8a5-6465-4f0b-a549-1993c113569c               42430c80-7836-4191-a4f6-bcee749010fe   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/debug                                                           248c6c10-1ac6-45de-bb55-ede36ca56bbd   in service    100 GiB   none          gzip-9     
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/debug                                                           686c19cf-a0d7-45f6-866f-c564612b2664   in service    100 GiB   none          gzip-9     
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/debug                                                           1bca7f71-5e42-4749-91ec-fa40793a3a9a   in service    100 GiB   none          gzip-9     
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/local_storage                                                   cdf3684f-a6cf-4449-b9ec-e696b2c663e2   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/local_storage                                                   3ac089c9-9dec-465b-863a-188e80d71fb4   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/local_storage                                                   43931274-7fe8-4077-825d-dff2bc8efa58   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/local_storage_unencrypted                                             793ac181-1b01-403c-850d-7f5c54bda6c9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/local_storage_unencrypted                                             a4c3032e-21fa-4d4a-b040-a7e3c572cf3c   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/local_storage_unencrypted                                             4847a96e-a267-4ae7-aa3d-805c1e77f81e   in service    none      none          off        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source                disposition    underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    crucible          058fd5f9-60a8-4e11-9302-15172782e17d   artifact: version 1.0.0     in service     fd00:1122:3344:101::9
    crucible          dfac80b4-a887-430a-ae87-a4e065dba787   artifact: version 0.0.1     in service     fd00:1122:3344:101::8
    crucible_pantry   ba4994a8-23f9-4b1a-a84f-a08d74591389   artifact: version 0.0.1     in service     fd00:1122:3344:101::6
    external_dns      803bfb63-c246-41db-b0da-d3b87ddfc63d   artifact: version 0.0.1     in service     fd00:1122:3344:101::5
    internal_dns      427ec88f-f467-42fa-9bbb-66a91a36103c   artifact: version 0.0.1     expunged ✓     fd00:1122:3344:2::1  
    internal_dns      cc6fdaf4-0195-4cef-950d-7bacd7059787   artifact: version 1.0.0     in service     fd00:1122:3344:2::1  
    internal_ntp      6444f8a5-6465-4f0b-a549-1993c113569c   artifact: version 0.0.1     in service     fd00:1122:3344:101::3
    nexus             0c71b3b2-6ceb-4e8f-b020-b08675e83038   artifact: version 0.0.1     in service     fd00:1122:3344:101::4
*   crucible          5199c033-4cf9-4ab6-8ae7-566bd7606363   - artifact: version 0.0.1   in service     fd00:1122:3344:101::7
     └─                                                      + artifact: version 1.0.0                                       


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> sled-set 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron-config latest
set sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron config from latest blueprint (02078c95-3d58-4b7b-a03f-9b160361c50a)

> inventory-generate
generated inventory collection 2d5a41c5-bf7b-464c-a4b7-b14ab35982c4 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipped noop image source check on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint e7a01ffc-6b0e-408b-917b-b1efe18b3110 based on parent blueprint 02078c95-3d58-4b7b-a03f-9b160361c50a
blueprint source: planner with report:
planning report:
* 1 out-of-date zone expunged:
  * sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, zone 6444f8a5-6465-4f0b-a549-1993c113569c (internal_ntp)
* 13 remaining out-of-date zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 02078c95-3d58-4b7b-a03f-9b160361c50a
to:   blueprint e7a01ffc-6b0e-408b-917b-b1efe18b3110

 MODIFIED SLEDS:

  sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 (active, config generation 9 -> 10):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-073979dd-3248-44a5-9fa1-cc72a140d682   in service 
    fake-vendor   fake-model   serial-c6d33b64-fb96-4129-bab1-7878a06a5f9b   in service 
    fake-vendor   fake-model   serial-e4d937e1-6ddc-4eca-bb08-c1f73791e608   in service 


    datasets:
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition    quota     reservation   compression
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crucible                                                              335e1dc3-b610-48dd-90bb-9ca5cce1a6d0   in service     none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crucible                                                              d5fef28b-4ee8-4443-8c06-7e872c2502f3   in service     none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crucible                                                              6477f019-088c-43cf-8508-aa93f868830f   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    02c56a30-7d97-406d-bd34-1eb437fd517d   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    fbd8f5eb-baa1-4e8f-9124-a48e5341b41f   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    4d7e3e8e-06bd-414c-a468-779e056a9b75   expunged       none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone                                                            4617d206-4330-4dfa-b9f3-f63a3db834f9   in service     none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone                                                            4f60b534-eaa3-40a1-b60f-bfdf147af478   in service     none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone                                                            ad41be71-6c15-4428-b510-20ceacde4fa6   in service     none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone/oxz_crucible_058fd5f9-60a8-4e11-9302-15172782e17d          55a2a61a-1471-49b2-a6d0-b191ed94e057   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_5199c033-4cf9-4ab6-8ae7-566bd7606363          90b46084-4238-45ba-9e26-d3f2623e640e   in service     none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_crucible_dfac80b4-a887-430a-ae87-a4e065dba787          bcdc7bf3-bbae-4e7f-81b2-4d94c8f752a4   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_ba4994a8-23f9-4b1a-a84f-a08d74591389   50b029e3-96aa-41e5-bf39-023193a4355e   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_803bfb63-c246-41db-b0da-d3b87ddfc63d      ea8a11bf-a884-4c4f-8df0-3ef9b7aacf43   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_427ec88f-f467-42fa-9bbb-66a91a36103c      7b4ce6bf-95bb-42fe-a4a0-dff31211ab88   expunged       none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_cc6fdaf4-0195-4cef-950d-7bacd7059787      5d6116c2-ade3-4246-8d02-5591d2622c10   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_0c71b3b2-6ceb-4e8f-b020-b08675e83038             832fd140-d467-4bad-b5e9-63171634087c   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/debug                                                           248c6c10-1ac6-45de-bb55-ede36ca56bbd   in service     100 GiB   none          gzip-9     
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/debug                                                           686c19cf-a0d7-45f6-866f-c564612b2664   in service     100 GiB   none          gzip-9     
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/debug                                                           1bca7f71-5e42-4749-91ec-fa40793a3a9a   in service     100 GiB   none          gzip-9     
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/local_storage                                                   cdf3684f-a6cf-4449-b9ec-e696b2c663e2   in service     none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/local_storage                                                   3ac089c9-9dec-465b-863a-188e80d71fb4   in service     none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/local_storage                                                   43931274-7fe8-4077-825d-dff2bc8efa58   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/local_storage_unencrypted                                             793ac181-1b01-403c-850d-7f5c54bda6c9   in service     none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/local_storage_unencrypted                                             a4c3032e-21fa-4d4a-b040-a7e3c572cf3c   in service     none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/local_storage_unencrypted                                             4847a96e-a267-4ae7-aa3d-805c1e77f81e   in service     none      none          off        
*   oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_6444f8a5-6465-4f0b-a549-1993c113569c               42430c80-7836-4191-a4f6-bcee749010fe   - in service   none      none          off        
     └─                                                                                                                                                   + expunged                                        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    crucible          058fd5f9-60a8-4e11-9302-15172782e17d   artifact: version 1.0.0   in service       fd00:1122:3344:101::9
    crucible          5199c033-4cf9-4ab6-8ae7-566bd7606363   artifact: version 1.0.0   in service       fd00:1122:3344:101::7
    crucible          dfac80b4-a887-430a-ae87-a4e065dba787   artifact: version 0.0.1   in service       fd00:1122:3344:101::8
    crucible_pantry   ba4994a8-23f9-4b1a-a84f-a08d74591389   artifact: version 0.0.1   in service       fd00:1122:3344:101::6
    external_dns      803bfb63-c246-41db-b0da-d3b87ddfc63d   artifact: version 0.0.1   in service       fd00:1122:3344:101::5
    internal_dns      427ec88f-f467-42fa-9bbb-66a91a36103c   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:2::1  
    internal_dns      cc6fdaf4-0195-4cef-950d-7bacd7059787   artifact: version 1.0.0   in service       fd00:1122:3344:2::1  
    nexus             0c71b3b2-6ceb-4e8f-b020-b08675e83038   artifact: version 0.0.1   in service       fd00:1122:3344:101::4
*   internal_ntp      6444f8a5-6465-4f0b-a549-1993c113569c   artifact: version 0.0.1   - in service     fd00:1122:3344:101::3
     └─                                                                                + expunged ⏳                          


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
* DNS zone: "control-plane.oxide.internal": 
-   name: 6444f8a5-6465-4f0b-a549-1993c113569c.host          (records: 1)
-       AAAA fd00:1122:3344:101::3
*   name: _internal-ntp._tcp                                 (records: 3 -> 2)
-       SRV  port   123 6444f8a5-6465-4f0b-a549-1993c113569c.host.control-plane.oxide.internal
-       SRV  port   123 c74e3068-8b20-4a62-953b-dab703a442db.host.control-plane.oxide.internal
-       SRV  port   123 f10a4fb9-759f-4a65-b25e-5794ad2d07d8.host.control-plane.oxide.internal
+       SRV  port   123 c74e3068-8b20-4a62-953b-dab703a442db.host.control-plane.oxide.internal
+       SRV  port   123 f10a4fb9-759f-4a65-b25e-5794ad2d07d8.host.control-plane.oxide.internal
    unchanged names: 50 (records: 64)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> sled-set 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron-config latest
set sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron config from latest blueprint (e7a01ffc-6b0e-408b-917b-b1efe18b3110)

> inventory-generate
generated inventory collection 94c793da-83b2-4fdf-b085-d7ef476bf204 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 7, num_already_artifact: 7, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipped noop image source check on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
INFO some zones not yet up-to-date, zones_currently_updating: [ZonePropagationIncomplete { zone_id: a690b03d-c29b-471d-ba2b-6d8de82299b4 (omicron_zone), zone_kind: InternalNtp, reason: MissingInInventory { bp_image_source: Artifact { version: Available { version: ArtifactVersion("1.0.0") }, hash: ArtifactHash(HexArray(2c7a661d288567335a1cabbbb96ec43c648bdfa1323b9c7c4e8de7ff23edeed0)) } } }]
generated blueprint 880e2ffc-8187-4275-a2f3-1b36aa2f4482 based on parent blueprint e7a01ffc-6b0e-408b-917b-b1efe18b3110
blueprint source: planner with report:
planning report:
* waiting for NTP zones to appear in inventory on sleds: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6
* sleds getting NTP zones and which have other services already, making them eligible for discretionary zones: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6
* missing NTP zone on sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6
* zone updates waiting on zone propagation to inventory
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint e7a01ffc-6b0e-408b-917b-b1efe18b3110
to:   blueprint 880e2ffc-8187-4275-a2f3-1b36aa2f4482

 MODIFIED SLEDS:

  sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 (active, config generation 10 -> 11):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-073979dd-3248-44a5-9fa1-cc72a140d682   in service 
    fake-vendor   fake-model   serial-c6d33b64-fb96-4129-bab1-7878a06a5f9b   in service 
    fake-vendor   fake-model   serial-e4d937e1-6ddc-4eca-bb08-c1f73791e608   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crucible                                                              335e1dc3-b610-48dd-90bb-9ca5cce1a6d0   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crucible                                                              d5fef28b-4ee8-4443-8c06-7e872c2502f3   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crucible                                                              6477f019-088c-43cf-8508-aa93f868830f   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    02c56a30-7d97-406d-bd34-1eb437fd517d   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    fbd8f5eb-baa1-4e8f-9124-a48e5341b41f   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    4d7e3e8e-06bd-414c-a468-779e056a9b75   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone                                                            4617d206-4330-4dfa-b9f3-f63a3db834f9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone                                                            4f60b534-eaa3-40a1-b60f-bfdf147af478   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone                                                            ad41be71-6c15-4428-b510-20ceacde4fa6   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone/oxz_crucible_058fd5f9-60a8-4e11-9302-15172782e17d          55a2a61a-1471-49b2-a6d0-b191ed94e057   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_5199c033-4cf9-4ab6-8ae7-566bd7606363          90b46084-4238-45ba-9e26-d3f2623e640e   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_crucible_dfac80b4-a887-430a-ae87-a4e065dba787          bcdc7bf3-bbae-4e7f-81b2-4d94c8f752a4   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_ba4994a8-23f9-4b1a-a84f-a08d74591389   50b029e3-96aa-41e5-bf39-023193a4355e   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_803bfb63-c246-41db-b0da-d3b87ddfc63d      ea8a11bf-a884-4c4f-8df0-3ef9b7aacf43   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_427ec88f-f467-42fa-9bbb-66a91a36103c      7b4ce6bf-95bb-42fe-a4a0-dff31211ab88   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_cc6fdaf4-0195-4cef-950d-7bacd7059787      5d6116c2-ade3-4246-8d02-5591d2622c10   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_0c71b3b2-6ceb-4e8f-b020-b08675e83038             832fd140-d467-4bad-b5e9-63171634087c   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_6444f8a5-6465-4f0b-a549-1993c113569c               42430c80-7836-4191-a4f6-bcee749010fe   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/debug                                                           248c6c10-1ac6-45de-bb55-ede36ca56bbd   in service    100 GiB   none          gzip-9     
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/debug                                                           686c19cf-a0d7-45f6-866f-c564612b2664   in service    100 GiB   none          gzip-9     
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/debug                                                           1bca7f71-5e42-4749-91ec-fa40793a3a9a   in service    100 GiB   none          gzip-9     
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/local_storage                                                   cdf3684f-a6cf-4449-b9ec-e696b2c663e2   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/local_storage                                                   3ac089c9-9dec-465b-863a-188e80d71fb4   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/local_storage                                                   43931274-7fe8-4077-825d-dff2bc8efa58   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/local_storage_unencrypted                                             793ac181-1b01-403c-850d-7f5c54bda6c9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/local_storage_unencrypted                                             a4c3032e-21fa-4d4a-b040-a7e3c572cf3c   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/local_storage_unencrypted                                             4847a96e-a267-4ae7-aa3d-805c1e77f81e   in service    none      none          off        
+   oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_a690b03d-c29b-471d-ba2b-6d8de82299b4               b72697f0-0058-4c7b-b647-dab4c8b1715d   in service    none      none          off        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    crucible          058fd5f9-60a8-4e11-9302-15172782e17d   artifact: version 1.0.0   in service       fd00:1122:3344:101::9
    crucible          5199c033-4cf9-4ab6-8ae7-566bd7606363   artifact: version 1.0.0   in service       fd00:1122:3344:101::7
    crucible          dfac80b4-a887-430a-ae87-a4e065dba787   artifact: version 0.0.1   in service       fd00:1122:3344:101::8
    crucible_pantry   ba4994a8-23f9-4b1a-a84f-a08d74591389   artifact: version 0.0.1   in service       fd00:1122:3344:101::6
    external_dns      803bfb63-c246-41db-b0da-d3b87ddfc63d   artifact: version 0.0.1   in service       fd00:1122:3344:101::5
    internal_dns      427ec88f-f467-42fa-9bbb-66a91a36103c   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:2::1  
    internal_dns      cc6fdaf4-0195-4cef-950d-7bacd7059787   artifact: version 1.0.0   in service       fd00:1122:3344:2::1  
    nexus             0c71b3b2-6ceb-4e8f-b020-b08675e83038   artifact: version 0.0.1   in service       fd00:1122:3344:101::4
*   internal_ntp      6444f8a5-6465-4f0b-a549-1993c113569c   artifact: version 0.0.1   - expunged ⏳     fd00:1122:3344:101::3
     └─                                                                                + expunged ✓                          
+   internal_ntp      a690b03d-c29b-471d-ba2b-6d8de82299b4   artifact: version 1.0.0   in service       fd00:1122:3344:101::a


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
* DNS zone: "control-plane.oxide.internal": 
*   name: _internal-ntp._tcp                                 (records: 2 -> 3)
-       SRV  port   123 c74e3068-8b20-4a62-953b-dab703a442db.host.control-plane.oxide.internal
-       SRV  port   123 f10a4fb9-759f-4a65-b25e-5794ad2d07d8.host.control-plane.oxide.internal
+       SRV  port   123 a690b03d-c29b-471d-ba2b-6d8de82299b4.host.control-plane.oxide.internal
+       SRV  port   123 c74e3068-8b20-4a62-953b-dab703a442db.host.control-plane.oxide.internal
+       SRV  port   123 f10a4fb9-759f-4a65-b25e-5794ad2d07d8.host.control-plane.oxide.internal
+   name: a690b03d-c29b-471d-ba2b-6d8de82299b4.host          (records: 1)
+       AAAA fd00:1122:3344:101::a
    unchanged names: 50 (records: 64)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> sled-set 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron-config latest
set sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron config from latest blueprint (880e2ffc-8187-4275-a2f3-1b36aa2f4482)

> inventory-generate
generated inventory collection 388a8c73-4ec0-4a23-9f82-225e652d8f37 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipped noop image source check on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint c4a20bcb-1a71-4e88-97b4-36d16f55daec based on parent blueprint 880e2ffc-8187-4275-a2f3-1b36aa2f4482
blueprint source: planner with report:
planning report:
* 1 out-of-date zone expunged:
  * sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, zone 803bfb63-c246-41db-b0da-d3b87ddfc63d (external_dns)
* 12 remaining out-of-date zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 880e2ffc-8187-4275-a2f3-1b36aa2f4482
to:   blueprint c4a20bcb-1a71-4e88-97b4-36d16f55daec

 MODIFIED SLEDS:

  sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 (active, config generation 11 -> 12):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-073979dd-3248-44a5-9fa1-cc72a140d682   in service 
    fake-vendor   fake-model   serial-c6d33b64-fb96-4129-bab1-7878a06a5f9b   in service 
    fake-vendor   fake-model   serial-e4d937e1-6ddc-4eca-bb08-c1f73791e608   in service 


    datasets:
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition    quota     reservation   compression
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crucible                                                              335e1dc3-b610-48dd-90bb-9ca5cce1a6d0   in service     none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crucible                                                              d5fef28b-4ee8-4443-8c06-7e872c2502f3   in service     none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crucible                                                              6477f019-088c-43cf-8508-aa93f868830f   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    4d7e3e8e-06bd-414c-a468-779e056a9b75   expunged       none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    fbd8f5eb-baa1-4e8f-9124-a48e5341b41f   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone                                                            4617d206-4330-4dfa-b9f3-f63a3db834f9   in service     none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone                                                            4f60b534-eaa3-40a1-b60f-bfdf147af478   in service     none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone                                                            ad41be71-6c15-4428-b510-20ceacde4fa6   in service     none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone/oxz_crucible_058fd5f9-60a8-4e11-9302-15172782e17d          55a2a61a-1471-49b2-a6d0-b191ed94e057   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_5199c033-4cf9-4ab6-8ae7-566bd7606363          90b46084-4238-45ba-9e26-d3f2623e640e   in service     none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_crucible_dfac80b4-a887-430a-ae87-a4e065dba787          bcdc7bf3-bbae-4e7f-81b2-4d94c8f752a4   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_ba4994a8-23f9-4b1a-a84f-a08d74591389   50b029e3-96aa-41e5-bf39-023193a4355e   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_427ec88f-f467-42fa-9bbb-66a91a36103c      7b4ce6bf-95bb-42fe-a4a0-dff31211ab88   expunged       none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_cc6fdaf4-0195-4cef-950d-7bacd7059787      5d6116c2-ade3-4246-8d02-5591d2622c10   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_0c71b3b2-6ceb-4e8f-b020-b08675e83038             832fd140-d467-4bad-b5e9-63171634087c   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_6444f8a5-6465-4f0b-a549-1993c113569c               42430c80-7836-4191-a4f6-bcee749010fe   expunged       none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_a690b03d-c29b-471d-ba2b-6d8de82299b4               b72697f0-0058-4c7b-b647-dab4c8b1715d   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/debug                                                           248c6c10-1ac6-45de-bb55-ede36ca56bbd   in service     100 GiB   none          gzip-9     
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/debug                                                           686c19cf-a0d7-45f6-866f-c564612b2664   in service     100 GiB   none          gzip-9     
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/debug                                                           1bca7f71-5e42-4749-91ec-fa40793a3a9a   in service     100 GiB   none          gzip-9     
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/local_storage                                                   cdf3684f-a6cf-4449-b9ec-e696b2c663e2   in service     none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/local_storage                                                   3ac089c9-9dec-465b-863a-188e80d71fb4   in service     none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/local_storage                                                   43931274-7fe8-4077-825d-dff2bc8efa58   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/local_storage_unencrypted                                             793ac181-1b01-403c-850d-7f5c54bda6c9   in service     none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/local_storage_unencrypted                                             a4c3032e-21fa-4d4a-b040-a7e3c572cf3c   in service     none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/local_storage_unencrypted                                             4847a96e-a267-4ae7-aa3d-805c1e77f81e   in service     none      none          off        
*   oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    02c56a30-7d97-406d-bd34-1eb437fd517d   - in service   none      none          off        
     └─                                                                                                                                                   + expunged                                        
*   oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_803bfb63-c246-41db-b0da-d3b87ddfc63d      ea8a11bf-a884-4c4f-8df0-3ef9b7aacf43   - in service   none      none          off        
     └─                                                                                                                                                   + expunged                                        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    crucible          058fd5f9-60a8-4e11-9302-15172782e17d   artifact: version 1.0.0   in service       fd00:1122:3344:101::9
    crucible          5199c033-4cf9-4ab6-8ae7-566bd7606363   artifact: version 1.0.0   in service       fd00:1122:3344:101::7
    crucible          dfac80b4-a887-430a-ae87-a4e065dba787   artifact: version 0.0.1   in service       fd00:1122:3344:101::8
    crucible_pantry   ba4994a8-23f9-4b1a-a84f-a08d74591389   artifact: version 0.0.1   in service       fd00:1122:3344:101::6
    internal_dns      427ec88f-f467-42fa-9bbb-66a91a36103c   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:2::1  
    internal_dns      cc6fdaf4-0195-4cef-950d-7bacd7059787   artifact: version 1.0.0   in service       fd00:1122:3344:2::1  
    internal_ntp      6444f8a5-6465-4f0b-a549-1993c113569c   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:101::3
    internal_ntp      a690b03d-c29b-471d-ba2b-6d8de82299b4   artifact: version 1.0.0   in service       fd00:1122:3344:101::a
    nexus             0c71b3b2-6ceb-4e8f-b020-b08675e83038   artifact: version 0.0.1   in service       fd00:1122:3344:101::4
*   external_dns      803bfb63-c246-41db-b0da-d3b87ddfc63d   artifact: version 0.0.1   - in service     fd00:1122:3344:101::5
     └─                                                                                + expunged ⏳                          


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
* DNS zone: "control-plane.oxide.internal": 
-   name: 803bfb63-c246-41db-b0da-d3b87ddfc63d.host          (records: 1)
-       AAAA fd00:1122:3344:101::5
*   name: _external-dns._tcp                                 (records: 3 -> 2)
-       SRV  port  5353 803bfb63-c246-41db-b0da-d3b87ddfc63d.host.control-plane.oxide.internal
-       SRV  port  5353 c821c39d-2b2c-4c55-8874-ac12315ba1e4.host.control-plane.oxide.internal
-       SRV  port  5353 f6ec9c67-946a-4da3-98d5-581f72ce8bf0.host.control-plane.oxide.internal
+       SRV  port  5353 c821c39d-2b2c-4c55-8874-ac12315ba1e4.host.control-plane.oxide.internal
+       SRV  port  5353 f6ec9c67-946a-4da3-98d5-581f72ce8bf0.host.control-plane.oxide.internal
    unchanged names: 50 (records: 64)

external DNS:
* DNS zone: "oxide.example": 
*   name: @                                                  (records: 3 -> 2)
-       NS   ns1.oxide.example
-       NS   ns2.oxide.example
-       NS   ns3.oxide.example
+       NS   ns1.oxide.example
+       NS   ns2.oxide.example
*   name: ns2                                                (records: 1 -> 1)
-       A    198.51.100.2
+       A    198.51.100.3
-   name: ns3                                                (records: 1)
-       A    198.51.100.3
    unchanged names: 2 (records: 4)




> sled-set 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron-config latest
set sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron config from latest blueprint (c4a20bcb-1a71-4e88-97b4-36d16f55daec)

> inventory-generate
generated inventory collection 2d608b8f-bf88-4707-ac27-6be62f3d5146 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 7, num_already_artifact: 7, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipped noop image source check on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint a2c6496d-98fc-444d-aa36-99508aa72367 based on parent blueprint c4a20bcb-1a71-4e88-97b4-36d16f55daec
blueprint source: planner with report:
planning report:
* discretionary zones placed:
  * external_dns zone on sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 from source artifact: version 1.0.0
* zone updates waiting on discretionary zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint c4a20bcb-1a71-4e88-97b4-36d16f55daec
to:   blueprint a2c6496d-98fc-444d-aa36-99508aa72367

 MODIFIED SLEDS:

  sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 (active, config generation 12 -> 13):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-073979dd-3248-44a5-9fa1-cc72a140d682   in service 
    fake-vendor   fake-model   serial-c6d33b64-fb96-4129-bab1-7878a06a5f9b   in service 
    fake-vendor   fake-model   serial-e4d937e1-6ddc-4eca-bb08-c1f73791e608   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crucible                                                              335e1dc3-b610-48dd-90bb-9ca5cce1a6d0   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crucible                                                              d5fef28b-4ee8-4443-8c06-7e872c2502f3   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crucible                                                              6477f019-088c-43cf-8508-aa93f868830f   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    02c56a30-7d97-406d-bd34-1eb437fd517d   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    fbd8f5eb-baa1-4e8f-9124-a48e5341b41f   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    4d7e3e8e-06bd-414c-a468-779e056a9b75   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone                                                            4617d206-4330-4dfa-b9f3-f63a3db834f9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone                                                            4f60b534-eaa3-40a1-b60f-bfdf147af478   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone                                                            ad41be71-6c15-4428-b510-20ceacde4fa6   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone/oxz_crucible_058fd5f9-60a8-4e11-9302-15172782e17d          55a2a61a-1471-49b2-a6d0-b191ed94e057   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_5199c033-4cf9-4ab6-8ae7-566bd7606363          90b46084-4238-45ba-9e26-d3f2623e640e   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_crucible_dfac80b4-a887-430a-ae87-a4e065dba787          bcdc7bf3-bbae-4e7f-81b2-4d94c8f752a4   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_ba4994a8-23f9-4b1a-a84f-a08d74591389   50b029e3-96aa-41e5-bf39-023193a4355e   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_803bfb63-c246-41db-b0da-d3b87ddfc63d      ea8a11bf-a884-4c4f-8df0-3ef9b7aacf43   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_427ec88f-f467-42fa-9bbb-66a91a36103c      7b4ce6bf-95bb-42fe-a4a0-dff31211ab88   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_cc6fdaf4-0195-4cef-950d-7bacd7059787      5d6116c2-ade3-4246-8d02-5591d2622c10   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_0c71b3b2-6ceb-4e8f-b020-b08675e83038             832fd140-d467-4bad-b5e9-63171634087c   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_6444f8a5-6465-4f0b-a549-1993c113569c               42430c80-7836-4191-a4f6-bcee749010fe   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_a690b03d-c29b-471d-ba2b-6d8de82299b4               b72697f0-0058-4c7b-b647-dab4c8b1715d   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/debug                                                           248c6c10-1ac6-45de-bb55-ede36ca56bbd   in service    100 GiB   none          gzip-9     
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/debug                                                           686c19cf-a0d7-45f6-866f-c564612b2664   in service    100 GiB   none          gzip-9     
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/debug                                                           1bca7f71-5e42-4749-91ec-fa40793a3a9a   in service    100 GiB   none          gzip-9     
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/local_storage                                                   cdf3684f-a6cf-4449-b9ec-e696b2c663e2   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/local_storage                                                   3ac089c9-9dec-465b-863a-188e80d71fb4   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/local_storage                                                   43931274-7fe8-4077-825d-dff2bc8efa58   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/local_storage_unencrypted                                             793ac181-1b01-403c-850d-7f5c54bda6c9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/local_storage_unencrypted                                             a4c3032e-21fa-4d4a-b040-a7e3c572cf3c   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/local_storage_unencrypted                                             4847a96e-a267-4ae7-aa3d-805c1e77f81e   in service    none      none          off        
+   oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    162a2b3f-5fce-4d91-8353-2e3479184b10   in service    none      none          off        
+   oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_4b2a2238-6721-4e83-ad61-c4611712ca74      70815b76-b7a0-4286-8987-795d539912ba   in service    none      none          off        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    crucible          058fd5f9-60a8-4e11-9302-15172782e17d   artifact: version 1.0.0   in service       fd00:1122:3344:101::9
    crucible          5199c033-4cf9-4ab6-8ae7-566bd7606363   artifact: version 1.0.0   in service       fd00:1122:3344:101::7
    crucible          dfac80b4-a887-430a-ae87-a4e065dba787   artifact: version 0.0.1   in service       fd00:1122:3344:101::8
    crucible_pantry   ba4994a8-23f9-4b1a-a84f-a08d74591389   artifact: version 0.0.1   in service       fd00:1122:3344:101::6
    internal_dns      427ec88f-f467-42fa-9bbb-66a91a36103c   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:2::1  
    internal_dns      cc6fdaf4-0195-4cef-950d-7bacd7059787   artifact: version 1.0.0   in service       fd00:1122:3344:2::1  
    internal_ntp      6444f8a5-6465-4f0b-a549-1993c113569c   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:101::3
    internal_ntp      a690b03d-c29b-471d-ba2b-6d8de82299b4   artifact: version 1.0.0   in service       fd00:1122:3344:101::a
    nexus             0c71b3b2-6ceb-4e8f-b020-b08675e83038   artifact: version 0.0.1   in service       fd00:1122:3344:101::4
*   external_dns      803bfb63-c246-41db-b0da-d3b87ddfc63d   artifact: version 0.0.1   - expunged ⏳     fd00:1122:3344:101::5
     └─                                                                                + expunged ✓                          
+   external_dns      4b2a2238-6721-4e83-ad61-c4611712ca74   artifact: version 1.0.0   in service       fd00:1122:3344:101::b


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
* DNS zone: "control-plane.oxide.internal": 
+   name: 4b2a2238-6721-4e83-ad61-c4611712ca74.host          (records: 1)
+       AAAA fd00:1122:3344:101::b
*   name: _external-dns._tcp                                 (records: 2 -> 3)
-       SRV  port  5353 c821c39d-2b2c-4c55-8874-ac12315ba1e4.host.control-plane.oxide.internal
-       SRV  port  5353 f6ec9c67-946a-4da3-98d5-581f72ce8bf0.host.control-plane.oxide.internal
+       SRV  port  5353 4b2a2238-6721-4e83-ad61-c4611712ca74.host.control-plane.oxide.internal
+       SRV  port  5353 c821c39d-2b2c-4c55-8874-ac12315ba1e4.host.control-plane.oxide.internal
+       SRV  port  5353 f6ec9c67-946a-4da3-98d5-581f72ce8bf0.host.control-plane.oxide.internal
    unchanged names: 50 (records: 64)

external DNS:
* DNS zone: "oxide.example": 
*   name: @                                                  (records: 2 -> 3)
-       NS   ns1.oxide.example
-       NS   ns2.oxide.example
+       NS   ns1.oxide.example
+       NS   ns2.oxide.example
+       NS   ns3.oxide.example
*   name: ns2                                                (records: 1 -> 1)
-       A    198.51.100.3
+       A    198.51.100.2
+   name: ns3                                                (records: 1)
+       A    198.51.100.3
    unchanged names: 2 (records: 4)




> sled-set 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron-config latest
set sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron config from latest blueprint (a2c6496d-98fc-444d-aa36-99508aa72367)

> inventory-generate
generated inventory collection 21e24074-fdd0-438e-a4e7-11665b7071bb from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipped noop image source check on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 6ed56354-5941-40d1-a06c-b0e940701d52 based on parent blueprint a2c6496d-98fc-444d-aa36-99508aa72367
blueprint source: planner with report:
planning report:
* 1 out-of-date zone expunged:
  * sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, zone ba4994a8-23f9-4b1a-a84f-a08d74591389 (crucible_pantry)
* 11 remaining out-of-date zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint a2c6496d-98fc-444d-aa36-99508aa72367
to:   blueprint 6ed56354-5941-40d1-a06c-b0e940701d52

 MODIFIED SLEDS:

  sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 (active, config generation 13 -> 14):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-073979dd-3248-44a5-9fa1-cc72a140d682   in service 
    fake-vendor   fake-model   serial-c6d33b64-fb96-4129-bab1-7878a06a5f9b   in service 
    fake-vendor   fake-model   serial-e4d937e1-6ddc-4eca-bb08-c1f73791e608   in service 


    datasets:
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition    quota     reservation   compression
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crucible                                                              335e1dc3-b610-48dd-90bb-9ca5cce1a6d0   in service     none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crucible                                                              d5fef28b-4ee8-4443-8c06-7e872c2502f3   in service     none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crucible                                                              6477f019-088c-43cf-8508-aa93f868830f   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    02c56a30-7d97-406d-bd34-1eb437fd517d   expunged       none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    162a2b3f-5fce-4d91-8353-2e3479184b10   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    fbd8f5eb-baa1-4e8f-9124-a48e5341b41f   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    4d7e3e8e-06bd-414c-a468-779e056a9b75   expunged       none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone                                                            4617d206-4330-4dfa-b9f3-f63a3db834f9   in service     none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone                                                            4f60b534-eaa3-40a1-b60f-bfdf147af478   in service     none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone                                                            ad41be71-6c15-4428-b510-20ceacde4fa6   in service     none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone/oxz_crucible_058fd5f9-60a8-4e11-9302-15172782e17d          55a2a61a-1471-49b2-a6d0-b191ed94e057   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_5199c033-4cf9-4ab6-8ae7-566bd7606363          90b46084-4238-45ba-9e26-d3f2623e640e   in service     none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_crucible_dfac80b4-a887-430a-ae87-a4e065dba787          bcdc7bf3-bbae-4e7f-81b2-4d94c8f752a4   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_4b2a2238-6721-4e83-ad61-c4611712ca74      70815b76-b7a0-4286-8987-795d539912ba   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_803bfb63-c246-41db-b0da-d3b87ddfc63d      ea8a11bf-a884-4c4f-8df0-3ef9b7aacf43   expunged       none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_427ec88f-f467-42fa-9bbb-66a91a36103c      7b4ce6bf-95bb-42fe-a4a0-dff31211ab88   expunged       none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_cc6fdaf4-0195-4cef-950d-7bacd7059787      5d6116c2-ade3-4246-8d02-5591d2622c10   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_0c71b3b2-6ceb-4e8f-b020-b08675e83038             832fd140-d467-4bad-b5e9-63171634087c   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_6444f8a5-6465-4f0b-a549-1993c113569c               42430c80-7836-4191-a4f6-bcee749010fe   expunged       none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_a690b03d-c29b-471d-ba2b-6d8de82299b4               b72697f0-0058-4c7b-b647-dab4c8b1715d   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/debug                                                           248c6c10-1ac6-45de-bb55-ede36ca56bbd   in service     100 GiB   none          gzip-9     
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/debug                                                           686c19cf-a0d7-45f6-866f-c564612b2664   in service     100 GiB   none          gzip-9     
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/debug                                                           1bca7f71-5e42-4749-91ec-fa40793a3a9a   in service     100 GiB   none          gzip-9     
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/local_storage                                                   cdf3684f-a6cf-4449-b9ec-e696b2c663e2   in service     none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/local_storage                                                   3ac089c9-9dec-465b-863a-188e80d71fb4   in service     none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/local_storage                                                   43931274-7fe8-4077-825d-dff2bc8efa58   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/local_storage_unencrypted                                             793ac181-1b01-403c-850d-7f5c54bda6c9   in service     none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/local_storage_unencrypted                                             a4c3032e-21fa-4d4a-b040-a7e3c572cf3c   in service     none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/local_storage_unencrypted                                             4847a96e-a267-4ae7-aa3d-805c1e77f81e   in service     none      none          off        
*   oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_ba4994a8-23f9-4b1a-a84f-a08d74591389   50b029e3-96aa-41e5-bf39-023193a4355e   - in service   none      none          off        
     └─                                                                                                                                                   + expunged                                        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    crucible          058fd5f9-60a8-4e11-9302-15172782e17d   artifact: version 1.0.0   in service       fd00:1122:3344:101::9
    crucible          5199c033-4cf9-4ab6-8ae7-566bd7606363   artifact: version 1.0.0   in service       fd00:1122:3344:101::7
    crucible          dfac80b4-a887-430a-ae87-a4e065dba787   artifact: version 0.0.1   in service       fd00:1122:3344:101::8
    external_dns      4b2a2238-6721-4e83-ad61-c4611712ca74   artifact: version 1.0.0   in service       fd00:1122:3344:101::b
    external_dns      803bfb63-c246-41db-b0da-d3b87ddfc63d   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:101::5
    internal_dns      427ec88f-f467-42fa-9bbb-66a91a36103c   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:2::1  
    internal_dns      cc6fdaf4-0195-4cef-950d-7bacd7059787   artifact: version 1.0.0   in service       fd00:1122:3344:2::1  
    internal_ntp      6444f8a5-6465-4f0b-a549-1993c113569c   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:101::3
    internal_ntp      a690b03d-c29b-471d-ba2b-6d8de82299b4   artifact: version 1.0.0   in service       fd00:1122:3344:101::a
    nexus             0c71b3b2-6ceb-4e8f-b020-b08675e83038   artifact: version 0.0.1   in service       fd00:1122:3344:101::4
*   crucible_pantry   ba4994a8-23f9-4b1a-a84f-a08d74591389   artifact: version 0.0.1   - in service     fd00:1122:3344:101::6
     └─                                                                                + expunged ⏳                          


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
* DNS zone: "control-plane.oxide.internal": 
*   name: _crucible-pantry._tcp                              (records: 3 -> 2)
-       SRV  port 17000 75b220ba-a0f4-4872-8202-dc7c87f062d0.host.control-plane.oxide.internal
-       SRV  port 17000 ba4994a8-23f9-4b1a-a84f-a08d74591389.host.control-plane.oxide.internal
-       SRV  port 17000 c484718d-c38b-42d5-8171-743e0fd5e5b7.host.control-plane.oxide.internal
+       SRV  port 17000 75b220ba-a0f4-4872-8202-dc7c87f062d0.host.control-plane.oxide.internal
+       SRV  port 17000 c484718d-c38b-42d5-8171-743e0fd5e5b7.host.control-plane.oxide.internal
-   name: ba4994a8-23f9-4b1a-a84f-a08d74591389.host          (records: 1)
-       AAAA fd00:1122:3344:101::6
    unchanged names: 50 (records: 64)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> sled-set 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron-config latest
set sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron config from latest blueprint (6ed56354-5941-40d1-a06c-b0e940701d52)

> inventory-generate
generated inventory collection ed8ea2c4-4271-407e-9c84-54129418d171 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 7, num_already_artifact: 7, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipped noop image source check on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 9078c4ba-3a73-4b3f-ac2c-acb501f89cb2 based on parent blueprint 6ed56354-5941-40d1-a06c-b0e940701d52
blueprint source: planner with report:
planning report:
* discretionary zones placed:
  * crucible_pantry zone on sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 from source artifact: version 1.0.0
* zone updates waiting on discretionary zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 6ed56354-5941-40d1-a06c-b0e940701d52
to:   blueprint 9078c4ba-3a73-4b3f-ac2c-acb501f89cb2

 MODIFIED SLEDS:

  sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 (active, config generation 14 -> 15):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-073979dd-3248-44a5-9fa1-cc72a140d682   in service 
    fake-vendor   fake-model   serial-c6d33b64-fb96-4129-bab1-7878a06a5f9b   in service 
    fake-vendor   fake-model   serial-e4d937e1-6ddc-4eca-bb08-c1f73791e608   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crucible                                                              335e1dc3-b610-48dd-90bb-9ca5cce1a6d0   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crucible                                                              d5fef28b-4ee8-4443-8c06-7e872c2502f3   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crucible                                                              6477f019-088c-43cf-8508-aa93f868830f   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    02c56a30-7d97-406d-bd34-1eb437fd517d   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    162a2b3f-5fce-4d91-8353-2e3479184b10   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    fbd8f5eb-baa1-4e8f-9124-a48e5341b41f   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    4d7e3e8e-06bd-414c-a468-779e056a9b75   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone                                                            4617d206-4330-4dfa-b9f3-f63a3db834f9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone                                                            4f60b534-eaa3-40a1-b60f-bfdf147af478   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone                                                            ad41be71-6c15-4428-b510-20ceacde4fa6   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone/oxz_crucible_058fd5f9-60a8-4e11-9302-15172782e17d          55a2a61a-1471-49b2-a6d0-b191ed94e057   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_5199c033-4cf9-4ab6-8ae7-566bd7606363          90b46084-4238-45ba-9e26-d3f2623e640e   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_crucible_dfac80b4-a887-430a-ae87-a4e065dba787          bcdc7bf3-bbae-4e7f-81b2-4d94c8f752a4   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_ba4994a8-23f9-4b1a-a84f-a08d74591389   50b029e3-96aa-41e5-bf39-023193a4355e   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_4b2a2238-6721-4e83-ad61-c4611712ca74      70815b76-b7a0-4286-8987-795d539912ba   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_803bfb63-c246-41db-b0da-d3b87ddfc63d      ea8a11bf-a884-4c4f-8df0-3ef9b7aacf43   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_427ec88f-f467-42fa-9bbb-66a91a36103c      7b4ce6bf-95bb-42fe-a4a0-dff31211ab88   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_cc6fdaf4-0195-4cef-950d-7bacd7059787      5d6116c2-ade3-4246-8d02-5591d2622c10   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_0c71b3b2-6ceb-4e8f-b020-b08675e83038             832fd140-d467-4bad-b5e9-63171634087c   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_6444f8a5-6465-4f0b-a549-1993c113569c               42430c80-7836-4191-a4f6-bcee749010fe   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_a690b03d-c29b-471d-ba2b-6d8de82299b4               b72697f0-0058-4c7b-b647-dab4c8b1715d   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/debug                                                           248c6c10-1ac6-45de-bb55-ede36ca56bbd   in service    100 GiB   none          gzip-9     
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/debug                                                           686c19cf-a0d7-45f6-866f-c564612b2664   in service    100 GiB   none          gzip-9     
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/debug                                                           1bca7f71-5e42-4749-91ec-fa40793a3a9a   in service    100 GiB   none          gzip-9     
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/local_storage                                                   cdf3684f-a6cf-4449-b9ec-e696b2c663e2   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/local_storage                                                   3ac089c9-9dec-465b-863a-188e80d71fb4   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/local_storage                                                   43931274-7fe8-4077-825d-dff2bc8efa58   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/local_storage_unencrypted                                             793ac181-1b01-403c-850d-7f5c54bda6c9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/local_storage_unencrypted                                             a4c3032e-21fa-4d4a-b040-a7e3c572cf3c   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/local_storage_unencrypted                                             4847a96e-a267-4ae7-aa3d-805c1e77f81e   in service    none      none          off        
+   oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_637cd92b-79c8-459a-a1a7-98abde49bdbc   4fecda40-5cf6-4bc4-9bfc-5a9ddc85438a   in service    none      none          off        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    crucible          058fd5f9-60a8-4e11-9302-15172782e17d   artifact: version 1.0.0   in service       fd00:1122:3344:101::9
    crucible          5199c033-4cf9-4ab6-8ae7-566bd7606363   artifact: version 1.0.0   in service       fd00:1122:3344:101::7
    crucible          dfac80b4-a887-430a-ae87-a4e065dba787   artifact: version 0.0.1   in service       fd00:1122:3344:101::8
    external_dns      4b2a2238-6721-4e83-ad61-c4611712ca74   artifact: version 1.0.0   in service       fd00:1122:3344:101::b
    external_dns      803bfb63-c246-41db-b0da-d3b87ddfc63d   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:101::5
    internal_dns      427ec88f-f467-42fa-9bbb-66a91a36103c   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:2::1  
    internal_dns      cc6fdaf4-0195-4cef-950d-7bacd7059787   artifact: version 1.0.0   in service       fd00:1122:3344:2::1  
    internal_ntp      6444f8a5-6465-4f0b-a549-1993c113569c   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:101::3
    internal_ntp      a690b03d-c29b-471d-ba2b-6d8de82299b4   artifact: version 1.0.0   in service       fd00:1122:3344:101::a
    nexus             0c71b3b2-6ceb-4e8f-b020-b08675e83038   artifact: version 0.0.1   in service       fd00:1122:3344:101::4
*   crucible_pantry   ba4994a8-23f9-4b1a-a84f-a08d74591389   artifact: version 0.0.1   - expunged ⏳     fd00:1122:3344:101::6
     └─                                                                                + expunged ✓                          
+   crucible_pantry   637cd92b-79c8-459a-a1a7-98abde49bdbc   artifact: version 1.0.0   in service       fd00:1122:3344:101::c


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
* DNS zone: "control-plane.oxide.internal": 
+   name: 637cd92b-79c8-459a-a1a7-98abde49bdbc.host          (records: 1)
+       AAAA fd00:1122:3344:101::c
*   name: _crucible-pantry._tcp                              (records: 2 -> 3)
-       SRV  port 17000 75b220ba-a0f4-4872-8202-dc7c87f062d0.host.control-plane.oxide.internal
-       SRV  port 17000 c484718d-c38b-42d5-8171-743e0fd5e5b7.host.control-plane.oxide.internal
+       SRV  port 17000 637cd92b-79c8-459a-a1a7-98abde49bdbc.host.control-plane.oxide.internal
+       SRV  port 17000 75b220ba-a0f4-4872-8202-dc7c87f062d0.host.control-plane.oxide.internal
+       SRV  port 17000 c484718d-c38b-42d5-8171-743e0fd5e5b7.host.control-plane.oxide.internal
    unchanged names: 50 (records: 64)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> sled-set 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron-config latest
set sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron config from latest blueprint (9078c4ba-3a73-4b3f-ac2c-acb501f89cb2)

> inventory-generate
generated inventory collection 336dbc73-f973-4962-a210-3c9d424bd6a3 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipped noop image source check on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 8763abc1-8a42-4932-b5a7-33109e0e0152 based on parent blueprint 9078c4ba-3a73-4b3f-ac2c-acb501f89cb2
blueprint source: planner with report:
planning report:
* 1 out-of-date zone updated in-place:
  * sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, zone dfac80b4-a887-430a-ae87-a4e065dba787 (crucible)
* 10 remaining out-of-date zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 9078c4ba-3a73-4b3f-ac2c-acb501f89cb2
to:   blueprint 8763abc1-8a42-4932-b5a7-33109e0e0152

 MODIFIED SLEDS:

  sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 (active, config generation 15 -> 16):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-073979dd-3248-44a5-9fa1-cc72a140d682   in service 
    fake-vendor   fake-model   serial-c6d33b64-fb96-4129-bab1-7878a06a5f9b   in service 
    fake-vendor   fake-model   serial-e4d937e1-6ddc-4eca-bb08-c1f73791e608   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crucible                                                              335e1dc3-b610-48dd-90bb-9ca5cce1a6d0   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crucible                                                              d5fef28b-4ee8-4443-8c06-7e872c2502f3   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crucible                                                              6477f019-088c-43cf-8508-aa93f868830f   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    02c56a30-7d97-406d-bd34-1eb437fd517d   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    162a2b3f-5fce-4d91-8353-2e3479184b10   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    fbd8f5eb-baa1-4e8f-9124-a48e5341b41f   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    4d7e3e8e-06bd-414c-a468-779e056a9b75   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone                                                            4617d206-4330-4dfa-b9f3-f63a3db834f9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone                                                            4f60b534-eaa3-40a1-b60f-bfdf147af478   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone                                                            ad41be71-6c15-4428-b510-20ceacde4fa6   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone/oxz_crucible_058fd5f9-60a8-4e11-9302-15172782e17d          55a2a61a-1471-49b2-a6d0-b191ed94e057   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_5199c033-4cf9-4ab6-8ae7-566bd7606363          90b46084-4238-45ba-9e26-d3f2623e640e   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_crucible_dfac80b4-a887-430a-ae87-a4e065dba787          bcdc7bf3-bbae-4e7f-81b2-4d94c8f752a4   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_637cd92b-79c8-459a-a1a7-98abde49bdbc   4fecda40-5cf6-4bc4-9bfc-5a9ddc85438a   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_ba4994a8-23f9-4b1a-a84f-a08d74591389   50b029e3-96aa-41e5-bf39-023193a4355e   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_4b2a2238-6721-4e83-ad61-c4611712ca74      70815b76-b7a0-4286-8987-795d539912ba   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_803bfb63-c246-41db-b0da-d3b87ddfc63d      ea8a11bf-a884-4c4f-8df0-3ef9b7aacf43   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_427ec88f-f467-42fa-9bbb-66a91a36103c      7b4ce6bf-95bb-42fe-a4a0-dff31211ab88   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_cc6fdaf4-0195-4cef-950d-7bacd7059787      5d6116c2-ade3-4246-8d02-5591d2622c10   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_0c71b3b2-6ceb-4e8f-b020-b08675e83038             832fd140-d467-4bad-b5e9-63171634087c   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_6444f8a5-6465-4f0b-a549-1993c113569c               42430c80-7836-4191-a4f6-bcee749010fe   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_a690b03d-c29b-471d-ba2b-6d8de82299b4               b72697f0-0058-4c7b-b647-dab4c8b1715d   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/debug                                                           248c6c10-1ac6-45de-bb55-ede36ca56bbd   in service    100 GiB   none          gzip-9     
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/debug                                                           686c19cf-a0d7-45f6-866f-c564612b2664   in service    100 GiB   none          gzip-9     
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/debug                                                           1bca7f71-5e42-4749-91ec-fa40793a3a9a   in service    100 GiB   none          gzip-9     
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/local_storage                                                   cdf3684f-a6cf-4449-b9ec-e696b2c663e2   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/local_storage                                                   3ac089c9-9dec-465b-863a-188e80d71fb4   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/local_storage                                                   43931274-7fe8-4077-825d-dff2bc8efa58   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/local_storage_unencrypted                                             793ac181-1b01-403c-850d-7f5c54bda6c9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/local_storage_unencrypted                                             a4c3032e-21fa-4d4a-b040-a7e3c572cf3c   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/local_storage_unencrypted                                             4847a96e-a267-4ae7-aa3d-805c1e77f81e   in service    none      none          off        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source                disposition    underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    crucible          058fd5f9-60a8-4e11-9302-15172782e17d   artifact: version 1.0.0     in service     fd00:1122:3344:101::9
    crucible          5199c033-4cf9-4ab6-8ae7-566bd7606363   artifact: version 1.0.0     in service     fd00:1122:3344:101::7
    crucible_pantry   637cd92b-79c8-459a-a1a7-98abde49bdbc   artifact: version 1.0.0     in service     fd00:1122:3344:101::c
    crucible_pantry   ba4994a8-23f9-4b1a-a84f-a08d74591389   artifact: version 0.0.1     expunged ✓     fd00:1122:3344:101::6
    external_dns      4b2a2238-6721-4e83-ad61-c4611712ca74   artifact: version 1.0.0     in service     fd00:1122:3344:101::b
    external_dns      803bfb63-c246-41db-b0da-d3b87ddfc63d   artifact: version 0.0.1     expunged ✓     fd00:1122:3344:101::5
    internal_dns      427ec88f-f467-42fa-9bbb-66a91a36103c   artifact: version 0.0.1     expunged ✓     fd00:1122:3344:2::1  
    internal_dns      cc6fdaf4-0195-4cef-950d-7bacd7059787   artifact: version 1.0.0     in service     fd00:1122:3344:2::1  
    internal_ntp      6444f8a5-6465-4f0b-a549-1993c113569c   artifact: version 0.0.1     expunged ✓     fd00:1122:3344:101::3
    internal_ntp      a690b03d-c29b-471d-ba2b-6d8de82299b4   artifact: version 1.0.0     in service     fd00:1122:3344:101::a
    nexus             0c71b3b2-6ceb-4e8f-b020-b08675e83038   artifact: version 0.0.1     in service     fd00:1122:3344:101::4
*   crucible          dfac80b4-a887-430a-ae87-a4e065dba787   - artifact: version 0.0.1   in service     fd00:1122:3344:101::8
     └─                                                      + artifact: version 1.0.0                                       


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # The previous plan updated the last non-Nexus zone on this sled. Nexus comes
> # after everything else, so the next step should update the first zone on the
> # next sled.
> sled-set 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron-config latest
set sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron config from latest blueprint (8763abc1-8a42-4932-b5a7-33109e0e0152)

> inventory-generate
generated inventory collection 897721fc-b087-41be-a566-809d59c8aeea from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipped noop image source check on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, reason: inventory stale: inventory reported generation (4) that is older than the generation in the parent blueprint (5)
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 2b89e0d7-f15b-4474-8ac4-85959ed1bc88 based on parent blueprint 8763abc1-8a42-4932-b5a7-33109e0e0152
blueprint source: planner with report:
planning report:
* 1 out-of-date zone updated in-place:
  * sled d81c6a84-79b8-4958-ae41-ea46c9b19763, zone 694bd14f-cb24-4be4-bb19-876e79cda2c8 (crucible)
* 9 remaining out-of-date zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 8763abc1-8a42-4932-b5a7-33109e0e0152
to:   blueprint 2b89e0d7-f15b-4474-8ac4-85959ed1bc88

 MODIFIED SLEDS:

  sled d81c6a84-79b8-4958-ae41-ea46c9b19763 (active, config generation 5 -> 6):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-18b20749-0748-4105-bb10-7b13cfc776e2   in service 
    fake-vendor   fake-model   serial-30c16fe4-4229-49d0-ab01-3138f2c7dff2   in service 
    fake-vendor   fake-model   serial-4930954e-9ac7-4453-b63f-5ab97c389a99   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crucible                                                              ba9311dd-89ac-47db-a5e8-d64e8a5fcf70   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crucible                                                              3c2cb304-a466-4ab5-8597-5db8172e2388   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crucible                                                              41107868-c6cc-4ec4-9159-aed688c3ceaf   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/external_dns                                                    429da94b-19f7-48bd-98e9-47842863ba7b   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    3443a368-199e-4d26-b59f-3f2bbd507761   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone                                                            45cd9687-20be-4247-b62a-dfdacf324929   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone                                                            252ac39f-b9e2-4697-8c07-3a833115d704   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone                                                            1cb0a47a-59ac-4892-8e92-cf87b4290f96   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone/oxz_crucible_694bd14f-cb24-4be4-bb19-876e79cda2c8          543fc3b8-08eb-4e5e-9e05-cf7a91732d5d   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone/oxz_crucible_7c252b64-c5af-4ec1-989e-9a03f3b0f111          3d9537b8-05be-4b1b-a051-f47becf8ec75   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_f55647d4-5500-4ad3-893a-df45bd50d622          c895e8d5-1434-4ecf-8d46-9bf1ecc8cbc9   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_75b220ba-a0f4-4872-8202-dc7c87f062d0   a50cd13a-5749-4e79-bb8b-19229500a8b3   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_external_dns_f6ec9c67-946a-4da3-98d5-581f72ce8bf0      6f04dd20-5e2c-4fa8-8430-a886470ed140   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_ea5b4030-b52f-44b2-8d70-45f15f987d01      7ea73f80-c4e0-450a-92dc-8397ce2af14f   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_nexus_3eeb8d49-eb1a-43f8-bb64-c2338421c2c6             50ea8c15-c4c0-4403-a490-d14b3405dfc2   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f10a4fb9-759f-4a65-b25e-5794ad2d07d8               54bbadaf-ec04-41a2-a62f-f5ac5bf321be   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/debug                                                           7a6a2058-ea78-49de-9730-cce5e28b4cfb   in service    100 GiB   none          gzip-9     
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/debug                                                           21fd4f3a-ec31-469b-87b1-087c343a2422   in service    100 GiB   none          gzip-9     
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/debug                                                           b1deff4b-51df-4a37-9043-afbd7c70a1cb   in service    100 GiB   none          gzip-9     
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/local_storage                                                   41071985-1dfd-4ce5-8bc2-897161a8bce4   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/local_storage                                                   c65a9c1c-36dc-4ddb-8aac-ec3be8dbb209   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/local_storage                                                   090bd88d-0a43-4040-a832-b13ae721f74f   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/local_storage_unencrypted                                             e009d8b8-4695-4322-b53f-f03f2744aef7   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/local_storage_unencrypted                                             4da74a5b-6911-4cca-b624-b90c65530117   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/local_storage_unencrypted                                             96ae8389-3027-4260-9374-e0f6ce851de2   in service    none      none          off        


    omicron zones:
    ------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source                disposition   underlay IP          
    ------------------------------------------------------------------------------------------------------------------------
    crucible          7c252b64-c5af-4ec1-989e-9a03f3b0f111   artifact: version 0.0.1     in service    fd00:1122:3344:103::9
    crucible          f55647d4-5500-4ad3-893a-df45bd50d622   artifact: version 0.0.1     in service    fd00:1122:3344:103::7
    crucible_pantry   75b220ba-a0f4-4872-8202-dc7c87f062d0   artifact: version 0.0.1     in service    fd00:1122:3344:103::6
    external_dns      f6ec9c67-946a-4da3-98d5-581f72ce8bf0   artifact: version 0.0.1     in service    fd00:1122:3344:103::5
    internal_dns      ea5b4030-b52f-44b2-8d70-45f15f987d01   artifact: version 0.0.1     in service    fd00:1122:3344:3::1  
    internal_ntp      f10a4fb9-759f-4a65-b25e-5794ad2d07d8   artifact: version 0.0.1     in service    fd00:1122:3344:103::3
    nexus             3eeb8d49-eb1a-43f8-bb64-c2338421c2c6   artifact: version 0.0.1     in service    fd00:1122:3344:103::4
*   crucible          694bd14f-cb24-4be4-bb19-876e79cda2c8   - artifact: version 0.0.1   in service    fd00:1122:3344:103::8
     └─                                                      + artifact: version 1.0.0                                      


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # Step through updates of all the non-Nexus zones on this sled.
> sled-set d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron-config latest
set sled d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron config from latest blueprint (2b89e0d7-f15b-4474-8ac4-85959ed1bc88)

> inventory-generate
generated inventory collection 5d0b9686-48df-4642-a39c-e2dea04d5330 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 7f6b7297-c2bc-4f67-b3c0-c8e555ebbdc4 based on parent blueprint 2b89e0d7-f15b-4474-8ac4-85959ed1bc88
blueprint source: planner with report:
planning report:
* 1 out-of-date zone expunged:
  * sled d81c6a84-79b8-4958-ae41-ea46c9b19763, zone 75b220ba-a0f4-4872-8202-dc7c87f062d0 (crucible_pantry)
* 8 remaining out-of-date zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 2b89e0d7-f15b-4474-8ac4-85959ed1bc88
to:   blueprint 7f6b7297-c2bc-4f67-b3c0-c8e555ebbdc4

 MODIFIED SLEDS:

  sled d81c6a84-79b8-4958-ae41-ea46c9b19763 (active, config generation 6 -> 7):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-18b20749-0748-4105-bb10-7b13cfc776e2   in service 
    fake-vendor   fake-model   serial-30c16fe4-4229-49d0-ab01-3138f2c7dff2   in service 
    fake-vendor   fake-model   serial-4930954e-9ac7-4453-b63f-5ab97c389a99   in service 


    datasets:
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition    quota     reservation   compression
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crucible                                                              ba9311dd-89ac-47db-a5e8-d64e8a5fcf70   in service     none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crucible                                                              3c2cb304-a466-4ab5-8597-5db8172e2388   in service     none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crucible                                                              41107868-c6cc-4ec4-9159-aed688c3ceaf   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/external_dns                                                    429da94b-19f7-48bd-98e9-47842863ba7b   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    3443a368-199e-4d26-b59f-3f2bbd507761   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone                                                            45cd9687-20be-4247-b62a-dfdacf324929   in service     none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone                                                            252ac39f-b9e2-4697-8c07-3a833115d704   in service     none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone                                                            1cb0a47a-59ac-4892-8e92-cf87b4290f96   in service     none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone/oxz_crucible_694bd14f-cb24-4be4-bb19-876e79cda2c8          543fc3b8-08eb-4e5e-9e05-cf7a91732d5d   in service     none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone/oxz_crucible_7c252b64-c5af-4ec1-989e-9a03f3b0f111          3d9537b8-05be-4b1b-a051-f47becf8ec75   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_f55647d4-5500-4ad3-893a-df45bd50d622          c895e8d5-1434-4ecf-8d46-9bf1ecc8cbc9   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_external_dns_f6ec9c67-946a-4da3-98d5-581f72ce8bf0      6f04dd20-5e2c-4fa8-8430-a886470ed140   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_ea5b4030-b52f-44b2-8d70-45f15f987d01      7ea73f80-c4e0-450a-92dc-8397ce2af14f   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_nexus_3eeb8d49-eb1a-43f8-bb64-c2338421c2c6             50ea8c15-c4c0-4403-a490-d14b3405dfc2   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f10a4fb9-759f-4a65-b25e-5794ad2d07d8               54bbadaf-ec04-41a2-a62f-f5ac5bf321be   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/debug                                                           7a6a2058-ea78-49de-9730-cce5e28b4cfb   in service     100 GiB   none          gzip-9     
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/debug                                                           21fd4f3a-ec31-469b-87b1-087c343a2422   in service     100 GiB   none          gzip-9     
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/debug                                                           b1deff4b-51df-4a37-9043-afbd7c70a1cb   in service     100 GiB   none          gzip-9     
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/local_storage                                                   41071985-1dfd-4ce5-8bc2-897161a8bce4   in service     none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/local_storage                                                   c65a9c1c-36dc-4ddb-8aac-ec3be8dbb209   in service     none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/local_storage                                                   090bd88d-0a43-4040-a832-b13ae721f74f   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/local_storage_unencrypted                                             e009d8b8-4695-4322-b53f-f03f2744aef7   in service     none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/local_storage_unencrypted                                             4da74a5b-6911-4cca-b624-b90c65530117   in service     none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/local_storage_unencrypted                                             96ae8389-3027-4260-9374-e0f6ce851de2   in service     none      none          off        
*   oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_75b220ba-a0f4-4872-8202-dc7c87f062d0   a50cd13a-5749-4e79-bb8b-19229500a8b3   - in service   none      none          off        
     └─                                                                                                                                                   + expunged                                        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    crucible          694bd14f-cb24-4be4-bb19-876e79cda2c8   artifact: version 1.0.0   in service       fd00:1122:3344:103::8
    crucible          7c252b64-c5af-4ec1-989e-9a03f3b0f111   artifact: version 0.0.1   in service       fd00:1122:3344:103::9
    crucible          f55647d4-5500-4ad3-893a-df45bd50d622   artifact: version 0.0.1   in service       fd00:1122:3344:103::7
    external_dns      f6ec9c67-946a-4da3-98d5-581f72ce8bf0   artifact: version 0.0.1   in service       fd00:1122:3344:103::5
    internal_dns      ea5b4030-b52f-44b2-8d70-45f15f987d01   artifact: version 0.0.1   in service       fd00:1122:3344:3::1  
    internal_ntp      f10a4fb9-759f-4a65-b25e-5794ad2d07d8   artifact: version 0.0.1   in service       fd00:1122:3344:103::3
    nexus             3eeb8d49-eb1a-43f8-bb64-c2338421c2c6   artifact: version 0.0.1   in service       fd00:1122:3344:103::4
*   crucible_pantry   75b220ba-a0f4-4872-8202-dc7c87f062d0   artifact: version 0.0.1   - in service     fd00:1122:3344:103::6
     └─                                                                                + expunged ⏳                          


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
* DNS zone: "control-plane.oxide.internal": 
-   name: 75b220ba-a0f4-4872-8202-dc7c87f062d0.host          (records: 1)
-       AAAA fd00:1122:3344:103::6
*   name: _crucible-pantry._tcp                              (records: 3 -> 2)
-       SRV  port 17000 637cd92b-79c8-459a-a1a7-98abde49bdbc.host.control-plane.oxide.internal
-       SRV  port 17000 75b220ba-a0f4-4872-8202-dc7c87f062d0.host.control-plane.oxide.internal
-       SRV  port 17000 c484718d-c38b-42d5-8171-743e0fd5e5b7.host.control-plane.oxide.internal
+       SRV  port 17000 637cd92b-79c8-459a-a1a7-98abde49bdbc.host.control-plane.oxide.internal
+       SRV  port 17000 c484718d-c38b-42d5-8171-743e0fd5e5b7.host.control-plane.oxide.internal
    unchanged names: 50 (records: 64)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> sled-set d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron-config latest
set sled d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron config from latest blueprint (7f6b7297-c2bc-4f67-b3c0-c8e555ebbdc4)

> inventory-generate
generated inventory collection 90f0f757-fd33-4744-abee-36616a645b87 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 7, num_already_artifact: 7, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 59630e63-c953-4807-9e84-9e750a79f68e based on parent blueprint 7f6b7297-c2bc-4f67-b3c0-c8e555ebbdc4
blueprint source: planner with report:
planning report:
* discretionary zones placed:
  * crucible_pantry zone on sled d81c6a84-79b8-4958-ae41-ea46c9b19763 from source artifact: version 1.0.0
* zone updates waiting on discretionary zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 7f6b7297-c2bc-4f67-b3c0-c8e555ebbdc4
to:   blueprint 59630e63-c953-4807-9e84-9e750a79f68e

 MODIFIED SLEDS:

  sled d81c6a84-79b8-4958-ae41-ea46c9b19763 (active, config generation 7 -> 8):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-18b20749-0748-4105-bb10-7b13cfc776e2   in service 
    fake-vendor   fake-model   serial-30c16fe4-4229-49d0-ab01-3138f2c7dff2   in service 
    fake-vendor   fake-model   serial-4930954e-9ac7-4453-b63f-5ab97c389a99   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crucible                                                              ba9311dd-89ac-47db-a5e8-d64e8a5fcf70   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crucible                                                              3c2cb304-a466-4ab5-8597-5db8172e2388   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crucible                                                              41107868-c6cc-4ec4-9159-aed688c3ceaf   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/external_dns                                                    429da94b-19f7-48bd-98e9-47842863ba7b   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    3443a368-199e-4d26-b59f-3f2bbd507761   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone                                                            45cd9687-20be-4247-b62a-dfdacf324929   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone                                                            252ac39f-b9e2-4697-8c07-3a833115d704   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone                                                            1cb0a47a-59ac-4892-8e92-cf87b4290f96   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone/oxz_crucible_694bd14f-cb24-4be4-bb19-876e79cda2c8          543fc3b8-08eb-4e5e-9e05-cf7a91732d5d   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone/oxz_crucible_7c252b64-c5af-4ec1-989e-9a03f3b0f111          3d9537b8-05be-4b1b-a051-f47becf8ec75   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_f55647d4-5500-4ad3-893a-df45bd50d622          c895e8d5-1434-4ecf-8d46-9bf1ecc8cbc9   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_75b220ba-a0f4-4872-8202-dc7c87f062d0   a50cd13a-5749-4e79-bb8b-19229500a8b3   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_external_dns_f6ec9c67-946a-4da3-98d5-581f72ce8bf0      6f04dd20-5e2c-4fa8-8430-a886470ed140   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_ea5b4030-b52f-44b2-8d70-45f15f987d01      7ea73f80-c4e0-450a-92dc-8397ce2af14f   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_nexus_3eeb8d49-eb1a-43f8-bb64-c2338421c2c6             50ea8c15-c4c0-4403-a490-d14b3405dfc2   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f10a4fb9-759f-4a65-b25e-5794ad2d07d8               54bbadaf-ec04-41a2-a62f-f5ac5bf321be   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/debug                                                           7a6a2058-ea78-49de-9730-cce5e28b4cfb   in service    100 GiB   none          gzip-9     
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/debug                                                           21fd4f3a-ec31-469b-87b1-087c343a2422   in service    100 GiB   none          gzip-9     
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/debug                                                           b1deff4b-51df-4a37-9043-afbd7c70a1cb   in service    100 GiB   none          gzip-9     
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/local_storage                                                   41071985-1dfd-4ce5-8bc2-897161a8bce4   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/local_storage                                                   c65a9c1c-36dc-4ddb-8aac-ec3be8dbb209   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/local_storage                                                   090bd88d-0a43-4040-a832-b13ae721f74f   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/local_storage_unencrypted                                             e009d8b8-4695-4322-b53f-f03f2744aef7   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/local_storage_unencrypted                                             4da74a5b-6911-4cca-b624-b90c65530117   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/local_storage_unencrypted                                             96ae8389-3027-4260-9374-e0f6ce851de2   in service    none      none          off        
+   oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_7fbd0103-d7f8-48a5-b95e-29bf812cac1f   49336223-f6df-4fe7-bd9f-95123c5622a9   in service    none      none          off        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    crucible          694bd14f-cb24-4be4-bb19-876e79cda2c8   artifact: version 1.0.0   in service       fd00:1122:3344:103::8
    crucible          7c252b64-c5af-4ec1-989e-9a03f3b0f111   artifact: version 0.0.1   in service       fd00:1122:3344:103::9
    crucible          f55647d4-5500-4ad3-893a-df45bd50d622   artifact: version 0.0.1   in service       fd00:1122:3344:103::7
    external_dns      f6ec9c67-946a-4da3-98d5-581f72ce8bf0   artifact: version 0.0.1   in service       fd00:1122:3344:103::5
    internal_dns      ea5b4030-b52f-44b2-8d70-45f15f987d01   artifact: version 0.0.1   in service       fd00:1122:3344:3::1  
    internal_ntp      f10a4fb9-759f-4a65-b25e-5794ad2d07d8   artifact: version 0.0.1   in service       fd00:1122:3344:103::3
    nexus             3eeb8d49-eb1a-43f8-bb64-c2338421c2c6   artifact: version 0.0.1   in service       fd00:1122:3344:103::4
*   crucible_pantry   75b220ba-a0f4-4872-8202-dc7c87f062d0   artifact: version 0.0.1   - expunged ⏳     fd00:1122:3344:103::6
     └─                                                                                + expunged ✓                          
+   crucible_pantry   7fbd0103-d7f8-48a5-b95e-29bf812cac1f   artifact: version 1.0.0   in service       fd00:1122:3344:103::a


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
* DNS zone: "control-plane.oxide.internal": 
+   name: 7fbd0103-d7f8-48a5-b95e-29bf812cac1f.host          (records: 1)
+       AAAA fd00:1122:3344:103::a
*   name: _crucible-pantry._tcp                              (records: 2 -> 3)
-       SRV  port 17000 637cd92b-79c8-459a-a1a7-98abde49bdbc.host.control-plane.oxide.internal
-       SRV  port 17000 c484718d-c38b-42d5-8171-743e0fd5e5b7.host.control-plane.oxide.internal
+       SRV  port 17000 637cd92b-79c8-459a-a1a7-98abde49bdbc.host.control-plane.oxide.internal
+       SRV  port 17000 7fbd0103-d7f8-48a5-b95e-29bf812cac1f.host.control-plane.oxide.internal
+       SRV  port 17000 c484718d-c38b-42d5-8171-743e0fd5e5b7.host.control-plane.oxide.internal
    unchanged names: 50 (records: 64)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> sled-set d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron-config latest
set sled d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron config from latest blueprint (59630e63-c953-4807-9e84-9e750a79f68e)

> inventory-generate
generated inventory collection ee9bc64a-70f7-4d81-b39d-a709754ce118 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint e93650dc-b5ba-4ec7-8550-9171c1ada194 based on parent blueprint 59630e63-c953-4807-9e84-9e750a79f68e
blueprint source: planner with report:
planning report:
* 1 out-of-date zone updated in-place:
  * sled d81c6a84-79b8-4958-ae41-ea46c9b19763, zone 7c252b64-c5af-4ec1-989e-9a03f3b0f111 (crucible)
* 7 remaining out-of-date zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 59630e63-c953-4807-9e84-9e750a79f68e
to:   blueprint e93650dc-b5ba-4ec7-8550-9171c1ada194

 MODIFIED SLEDS:

  sled d81c6a84-79b8-4958-ae41-ea46c9b19763 (active, config generation 8 -> 9):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-18b20749-0748-4105-bb10-7b13cfc776e2   in service 
    fake-vendor   fake-model   serial-30c16fe4-4229-49d0-ab01-3138f2c7dff2   in service 
    fake-vendor   fake-model   serial-4930954e-9ac7-4453-b63f-5ab97c389a99   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crucible                                                              ba9311dd-89ac-47db-a5e8-d64e8a5fcf70   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crucible                                                              3c2cb304-a466-4ab5-8597-5db8172e2388   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crucible                                                              41107868-c6cc-4ec4-9159-aed688c3ceaf   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/external_dns                                                    429da94b-19f7-48bd-98e9-47842863ba7b   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    3443a368-199e-4d26-b59f-3f2bbd507761   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone                                                            45cd9687-20be-4247-b62a-dfdacf324929   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone                                                            252ac39f-b9e2-4697-8c07-3a833115d704   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone                                                            1cb0a47a-59ac-4892-8e92-cf87b4290f96   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone/oxz_crucible_694bd14f-cb24-4be4-bb19-876e79cda2c8          543fc3b8-08eb-4e5e-9e05-cf7a91732d5d   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone/oxz_crucible_7c252b64-c5af-4ec1-989e-9a03f3b0f111          3d9537b8-05be-4b1b-a051-f47becf8ec75   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_f55647d4-5500-4ad3-893a-df45bd50d622          c895e8d5-1434-4ecf-8d46-9bf1ecc8cbc9   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_75b220ba-a0f4-4872-8202-dc7c87f062d0   a50cd13a-5749-4e79-bb8b-19229500a8b3   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_7fbd0103-d7f8-48a5-b95e-29bf812cac1f   49336223-f6df-4fe7-bd9f-95123c5622a9   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_external_dns_f6ec9c67-946a-4da3-98d5-581f72ce8bf0      6f04dd20-5e2c-4fa8-8430-a886470ed140   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_ea5b4030-b52f-44b2-8d70-45f15f987d01      7ea73f80-c4e0-450a-92dc-8397ce2af14f   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_nexus_3eeb8d49-eb1a-43f8-bb64-c2338421c2c6             50ea8c15-c4c0-4403-a490-d14b3405dfc2   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f10a4fb9-759f-4a65-b25e-5794ad2d07d8               54bbadaf-ec04-41a2-a62f-f5ac5bf321be   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/debug                                                           7a6a2058-ea78-49de-9730-cce5e28b4cfb   in service    100 GiB   none          gzip-9     
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/debug                                                           21fd4f3a-ec31-469b-87b1-087c343a2422   in service    100 GiB   none          gzip-9     
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/debug                                                           b1deff4b-51df-4a37-9043-afbd7c70a1cb   in service    100 GiB   none          gzip-9     
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/local_storage                                                   41071985-1dfd-4ce5-8bc2-897161a8bce4   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/local_storage                                                   c65a9c1c-36dc-4ddb-8aac-ec3be8dbb209   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/local_storage                                                   090bd88d-0a43-4040-a832-b13ae721f74f   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/local_storage_unencrypted                                             e009d8b8-4695-4322-b53f-f03f2744aef7   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/local_storage_unencrypted                                             4da74a5b-6911-4cca-b624-b90c65530117   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/local_storage_unencrypted                                             96ae8389-3027-4260-9374-e0f6ce851de2   in service    none      none          off        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source                disposition    underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    crucible          694bd14f-cb24-4be4-bb19-876e79cda2c8   artifact: version 1.0.0     in service     fd00:1122:3344:103::8
    crucible          f55647d4-5500-4ad3-893a-df45bd50d622   artifact: version 0.0.1     in service     fd00:1122:3344:103::7
    crucible_pantry   75b220ba-a0f4-4872-8202-dc7c87f062d0   artifact: version 0.0.1     expunged ✓     fd00:1122:3344:103::6
    crucible_pantry   7fbd0103-d7f8-48a5-b95e-29bf812cac1f   artifact: version 1.0.0     in service     fd00:1122:3344:103::a
    external_dns      f6ec9c67-946a-4da3-98d5-581f72ce8bf0   artifact: version 0.0.1     in service     fd00:1122:3344:103::5
    internal_dns      ea5b4030-b52f-44b2-8d70-45f15f987d01   artifact: version 0.0.1     in service     fd00:1122:3344:3::1  
    internal_ntp      f10a4fb9-759f-4a65-b25e-5794ad2d07d8   artifact: version 0.0.1     in service     fd00:1122:3344:103::3
    nexus             3eeb8d49-eb1a-43f8-bb64-c2338421c2c6   artifact: version 0.0.1     in service     fd00:1122:3344:103::4
*   crucible          7c252b64-c5af-4ec1-989e-9a03f3b0f111   - artifact: version 0.0.1   in service     fd00:1122:3344:103::9
     └─                                                      + artifact: version 1.0.0                                       


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> sled-set d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron-config latest
set sled d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron config from latest blueprint (e93650dc-b5ba-4ec7-8550-9171c1ada194)

> inventory-generate
generated inventory collection 3dc9d8c8-8f50-4d6e-9396-97058d1d2722 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 90650737-8142-47a6-9a48-a10efc487e57 based on parent blueprint e93650dc-b5ba-4ec7-8550-9171c1ada194
blueprint source: planner with report:
planning report:
* 1 out-of-date zone expunged:
  * sled d81c6a84-79b8-4958-ae41-ea46c9b19763, zone ea5b4030-b52f-44b2-8d70-45f15f987d01 (internal_dns)
* 6 remaining out-of-date zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint e93650dc-b5ba-4ec7-8550-9171c1ada194
to:   blueprint 90650737-8142-47a6-9a48-a10efc487e57

 MODIFIED SLEDS:

  sled d81c6a84-79b8-4958-ae41-ea46c9b19763 (active, config generation 9 -> 10):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-18b20749-0748-4105-bb10-7b13cfc776e2   in service 
    fake-vendor   fake-model   serial-30c16fe4-4229-49d0-ab01-3138f2c7dff2   in service 
    fake-vendor   fake-model   serial-4930954e-9ac7-4453-b63f-5ab97c389a99   in service 


    datasets:
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition    quota     reservation   compression
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crucible                                                              ba9311dd-89ac-47db-a5e8-d64e8a5fcf70   in service     none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crucible                                                              3c2cb304-a466-4ab5-8597-5db8172e2388   in service     none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crucible                                                              41107868-c6cc-4ec4-9159-aed688c3ceaf   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/external_dns                                                    429da94b-19f7-48bd-98e9-47842863ba7b   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone                                                            45cd9687-20be-4247-b62a-dfdacf324929   in service     none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone                                                            252ac39f-b9e2-4697-8c07-3a833115d704   in service     none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone                                                            1cb0a47a-59ac-4892-8e92-cf87b4290f96   in service     none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone/oxz_crucible_694bd14f-cb24-4be4-bb19-876e79cda2c8          543fc3b8-08eb-4e5e-9e05-cf7a91732d5d   in service     none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone/oxz_crucible_7c252b64-c5af-4ec1-989e-9a03f3b0f111          3d9537b8-05be-4b1b-a051-f47becf8ec75   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_f55647d4-5500-4ad3-893a-df45bd50d622          c895e8d5-1434-4ecf-8d46-9bf1ecc8cbc9   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_75b220ba-a0f4-4872-8202-dc7c87f062d0   a50cd13a-5749-4e79-bb8b-19229500a8b3   expunged       none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_7fbd0103-d7f8-48a5-b95e-29bf812cac1f   49336223-f6df-4fe7-bd9f-95123c5622a9   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_external_dns_f6ec9c67-946a-4da3-98d5-581f72ce8bf0      6f04dd20-5e2c-4fa8-8430-a886470ed140   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_nexus_3eeb8d49-eb1a-43f8-bb64-c2338421c2c6             50ea8c15-c4c0-4403-a490-d14b3405dfc2   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f10a4fb9-759f-4a65-b25e-5794ad2d07d8               54bbadaf-ec04-41a2-a62f-f5ac5bf321be   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/debug                                                           7a6a2058-ea78-49de-9730-cce5e28b4cfb   in service     100 GiB   none          gzip-9     
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/debug                                                           21fd4f3a-ec31-469b-87b1-087c343a2422   in service     100 GiB   none          gzip-9     
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/debug                                                           b1deff4b-51df-4a37-9043-afbd7c70a1cb   in service     100 GiB   none          gzip-9     
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/local_storage                                                   41071985-1dfd-4ce5-8bc2-897161a8bce4   in service     none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/local_storage                                                   c65a9c1c-36dc-4ddb-8aac-ec3be8dbb209   in service     none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/local_storage                                                   090bd88d-0a43-4040-a832-b13ae721f74f   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/local_storage_unencrypted                                             e009d8b8-4695-4322-b53f-f03f2744aef7   in service     none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/local_storage_unencrypted                                             4da74a5b-6911-4cca-b624-b90c65530117   in service     none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/local_storage_unencrypted                                             96ae8389-3027-4260-9374-e0f6ce851de2   in service     none      none          off        
*   oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    3443a368-199e-4d26-b59f-3f2bbd507761   - in service   none      none          off        
     └─                                                                                                                                                   + expunged                                        
*   oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_ea5b4030-b52f-44b2-8d70-45f15f987d01      7ea73f80-c4e0-450a-92dc-8397ce2af14f   - in service   none      none          off        
     └─                                                                                                                                                   + expunged                                        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    crucible          694bd14f-cb24-4be4-bb19-876e79cda2c8   artifact: version 1.0.0   in service       fd00:1122:3344:103::8
    crucible          7c252b64-c5af-4ec1-989e-9a03f3b0f111   artifact: version 1.0.0   in service       fd00:1122:3344:103::9
    crucible          f55647d4-5500-4ad3-893a-df45bd50d622   artifact: version 0.0.1   in service       fd00:1122:3344:103::7
    crucible_pantry   75b220ba-a0f4-4872-8202-dc7c87f062d0   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:103::6
    crucible_pantry   7fbd0103-d7f8-48a5-b95e-29bf812cac1f   artifact: version 1.0.0   in service       fd00:1122:3344:103::a
    external_dns      f6ec9c67-946a-4da3-98d5-581f72ce8bf0   artifact: version 0.0.1   in service       fd00:1122:3344:103::5
    internal_ntp      f10a4fb9-759f-4a65-b25e-5794ad2d07d8   artifact: version 0.0.1   in service       fd00:1122:3344:103::3
    nexus             3eeb8d49-eb1a-43f8-bb64-c2338421c2c6   artifact: version 0.0.1   in service       fd00:1122:3344:103::4
*   internal_dns      ea5b4030-b52f-44b2-8d70-45f15f987d01   artifact: version 0.0.1   - in service     fd00:1122:3344:3::1  
     └─                                                                                + expunged ⏳                          


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
* DNS zone: "control-plane.oxide.internal": 
*   name: @                                                  (records: 3 -> 2)
-       NS   ns1.control-plane.oxide.internal
-       NS   ns2.control-plane.oxide.internal
-       NS   ns3.control-plane.oxide.internal
+       NS   ns1.control-plane.oxide.internal
+       NS   ns2.control-plane.oxide.internal
*   name: _nameservice._tcp                                  (records: 3 -> 2)
-       SRV  port  5353 a729999a-6e45-46ca-b51e-0bbb5490387a.host.control-plane.oxide.internal
-       SRV  port  5353 cc6fdaf4-0195-4cef-950d-7bacd7059787.host.control-plane.oxide.internal
-       SRV  port  5353 ea5b4030-b52f-44b2-8d70-45f15f987d01.host.control-plane.oxide.internal
+       SRV  port  5353 a729999a-6e45-46ca-b51e-0bbb5490387a.host.control-plane.oxide.internal
+       SRV  port  5353 cc6fdaf4-0195-4cef-950d-7bacd7059787.host.control-plane.oxide.internal
-   name: ea5b4030-b52f-44b2-8d70-45f15f987d01.host          (records: 1)
-       AAAA fd00:1122:3344:3::1
-   name: ns3                                                (records: 1)
-       AAAA fd00:1122:3344:3::1
    unchanged names: 48 (records: 60)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> sled-set d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron-config latest
set sled d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron config from latest blueprint (90650737-8142-47a6-9a48-a10efc487e57)

> inventory-generate
generated inventory collection a4dab274-0fff-47fa-bc22-b98d11ec54d2 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 7, num_already_artifact: 7, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 2182613d-dc9f-41eb-9c6a-d33801849caa based on parent blueprint 90650737-8142-47a6-9a48-a10efc487e57
blueprint source: planner with report:
planning report:
* discretionary zones placed:
  * internal_dns zone on sled d81c6a84-79b8-4958-ae41-ea46c9b19763 from source artifact: version 1.0.0
* zone updates waiting on discretionary zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 90650737-8142-47a6-9a48-a10efc487e57
to:   blueprint 2182613d-dc9f-41eb-9c6a-d33801849caa

 MODIFIED SLEDS:

  sled d81c6a84-79b8-4958-ae41-ea46c9b19763 (active, config generation 10 -> 11):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-18b20749-0748-4105-bb10-7b13cfc776e2   in service 
    fake-vendor   fake-model   serial-30c16fe4-4229-49d0-ab01-3138f2c7dff2   in service 
    fake-vendor   fake-model   serial-4930954e-9ac7-4453-b63f-5ab97c389a99   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crucible                                                              ba9311dd-89ac-47db-a5e8-d64e8a5fcf70   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crucible                                                              3c2cb304-a466-4ab5-8597-5db8172e2388   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crucible                                                              41107868-c6cc-4ec4-9159-aed688c3ceaf   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/external_dns                                                    429da94b-19f7-48bd-98e9-47842863ba7b   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    3443a368-199e-4d26-b59f-3f2bbd507761   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone                                                            45cd9687-20be-4247-b62a-dfdacf324929   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone                                                            252ac39f-b9e2-4697-8c07-3a833115d704   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone                                                            1cb0a47a-59ac-4892-8e92-cf87b4290f96   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone/oxz_crucible_694bd14f-cb24-4be4-bb19-876e79cda2c8          543fc3b8-08eb-4e5e-9e05-cf7a91732d5d   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone/oxz_crucible_7c252b64-c5af-4ec1-989e-9a03f3b0f111          3d9537b8-05be-4b1b-a051-f47becf8ec75   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_f55647d4-5500-4ad3-893a-df45bd50d622          c895e8d5-1434-4ecf-8d46-9bf1ecc8cbc9   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_75b220ba-a0f4-4872-8202-dc7c87f062d0   a50cd13a-5749-4e79-bb8b-19229500a8b3   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_7fbd0103-d7f8-48a5-b95e-29bf812cac1f   49336223-f6df-4fe7-bd9f-95123c5622a9   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_external_dns_f6ec9c67-946a-4da3-98d5-581f72ce8bf0      6f04dd20-5e2c-4fa8-8430-a886470ed140   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_ea5b4030-b52f-44b2-8d70-45f15f987d01      7ea73f80-c4e0-450a-92dc-8397ce2af14f   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_nexus_3eeb8d49-eb1a-43f8-bb64-c2338421c2c6             50ea8c15-c4c0-4403-a490-d14b3405dfc2   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f10a4fb9-759f-4a65-b25e-5794ad2d07d8               54bbadaf-ec04-41a2-a62f-f5ac5bf321be   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/debug                                                           7a6a2058-ea78-49de-9730-cce5e28b4cfb   in service    100 GiB   none          gzip-9     
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/debug                                                           21fd4f3a-ec31-469b-87b1-087c343a2422   in service    100 GiB   none          gzip-9     
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/debug                                                           b1deff4b-51df-4a37-9043-afbd7c70a1cb   in service    100 GiB   none          gzip-9     
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/local_storage                                                   41071985-1dfd-4ce5-8bc2-897161a8bce4   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/local_storage                                                   c65a9c1c-36dc-4ddb-8aac-ec3be8dbb209   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/local_storage                                                   090bd88d-0a43-4040-a832-b13ae721f74f   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/local_storage_unencrypted                                             e009d8b8-4695-4322-b53f-f03f2744aef7   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/local_storage_unencrypted                                             4da74a5b-6911-4cca-b624-b90c65530117   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/local_storage_unencrypted                                             96ae8389-3027-4260-9374-e0f6ce851de2   in service    none      none          off        
+   oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    c2782fb5-af50-401f-92eb-dc0937e2cae2   in service    none      none          off        
+   oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_b5edcb10-9ba0-4fd7-9583-1617e5b4b452      1d6eef5e-daab-470c-9aa3-2c92894468ff   in service    none      none          off        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    crucible          694bd14f-cb24-4be4-bb19-876e79cda2c8   artifact: version 1.0.0   in service       fd00:1122:3344:103::8
    crucible          7c252b64-c5af-4ec1-989e-9a03f3b0f111   artifact: version 1.0.0   in service       fd00:1122:3344:103::9
    crucible          f55647d4-5500-4ad3-893a-df45bd50d622   artifact: version 0.0.1   in service       fd00:1122:3344:103::7
    crucible_pantry   75b220ba-a0f4-4872-8202-dc7c87f062d0   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:103::6
    crucible_pantry   7fbd0103-d7f8-48a5-b95e-29bf812cac1f   artifact: version 1.0.0   in service       fd00:1122:3344:103::a
    external_dns      f6ec9c67-946a-4da3-98d5-581f72ce8bf0   artifact: version 0.0.1   in service       fd00:1122:3344:103::5
    internal_ntp      f10a4fb9-759f-4a65-b25e-5794ad2d07d8   artifact: version 0.0.1   in service       fd00:1122:3344:103::3
    nexus             3eeb8d49-eb1a-43f8-bb64-c2338421c2c6   artifact: version 0.0.1   in service       fd00:1122:3344:103::4
*   internal_dns      ea5b4030-b52f-44b2-8d70-45f15f987d01   artifact: version 0.0.1   - expunged ⏳     fd00:1122:3344:3::1  
     └─                                                                                + expunged ✓                          
+   internal_dns      b5edcb10-9ba0-4fd7-9583-1617e5b4b452   artifact: version 1.0.0   in service       fd00:1122:3344:3::1  


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
* DNS zone: "control-plane.oxide.internal": 
*   name: @                                                  (records: 2 -> 3)
-       NS   ns1.control-plane.oxide.internal
-       NS   ns2.control-plane.oxide.internal
+       NS   ns1.control-plane.oxide.internal
+       NS   ns2.control-plane.oxide.internal
+       NS   ns3.control-plane.oxide.internal
*   name: _nameservice._tcp                                  (records: 2 -> 3)
-       SRV  port  5353 a729999a-6e45-46ca-b51e-0bbb5490387a.host.control-plane.oxide.internal
-       SRV  port  5353 cc6fdaf4-0195-4cef-950d-7bacd7059787.host.control-plane.oxide.internal
+       SRV  port  5353 a729999a-6e45-46ca-b51e-0bbb5490387a.host.control-plane.oxide.internal
+       SRV  port  5353 b5edcb10-9ba0-4fd7-9583-1617e5b4b452.host.control-plane.oxide.internal
+       SRV  port  5353 cc6fdaf4-0195-4cef-950d-7bacd7059787.host.control-plane.oxide.internal
+   name: b5edcb10-9ba0-4fd7-9583-1617e5b4b452.host          (records: 1)
+       AAAA fd00:1122:3344:3::1
+   name: ns3                                                (records: 1)
+       AAAA fd00:1122:3344:3::1
    unchanged names: 48 (records: 60)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> sled-set d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron-config latest
set sled d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron config from latest blueprint (2182613d-dc9f-41eb-9c6a-d33801849caa)

> inventory-generate
generated inventory collection d483be68-4bf3-4133-aed1-661cba8e1194 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint e8b088a8-7da0-480b-a2dc-75ffef068ece based on parent blueprint 2182613d-dc9f-41eb-9c6a-d33801849caa
blueprint source: planner with report:
planning report:
* 1 out-of-date zone expunged:
  * sled d81c6a84-79b8-4958-ae41-ea46c9b19763, zone f10a4fb9-759f-4a65-b25e-5794ad2d07d8 (internal_ntp)
* 5 remaining out-of-date zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 2182613d-dc9f-41eb-9c6a-d33801849caa
to:   blueprint e8b088a8-7da0-480b-a2dc-75ffef068ece

 MODIFIED SLEDS:

  sled d81c6a84-79b8-4958-ae41-ea46c9b19763 (active, config generation 11 -> 12):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-18b20749-0748-4105-bb10-7b13cfc776e2   in service 
    fake-vendor   fake-model   serial-30c16fe4-4229-49d0-ab01-3138f2c7dff2   in service 
    fake-vendor   fake-model   serial-4930954e-9ac7-4453-b63f-5ab97c389a99   in service 


    datasets:
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition    quota     reservation   compression
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crucible                                                              ba9311dd-89ac-47db-a5e8-d64e8a5fcf70   in service     none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crucible                                                              3c2cb304-a466-4ab5-8597-5db8172e2388   in service     none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crucible                                                              41107868-c6cc-4ec4-9159-aed688c3ceaf   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/external_dns                                                    429da94b-19f7-48bd-98e9-47842863ba7b   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    c2782fb5-af50-401f-92eb-dc0937e2cae2   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    3443a368-199e-4d26-b59f-3f2bbd507761   expunged       none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone                                                            45cd9687-20be-4247-b62a-dfdacf324929   in service     none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone                                                            252ac39f-b9e2-4697-8c07-3a833115d704   in service     none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone                                                            1cb0a47a-59ac-4892-8e92-cf87b4290f96   in service     none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone/oxz_crucible_694bd14f-cb24-4be4-bb19-876e79cda2c8          543fc3b8-08eb-4e5e-9e05-cf7a91732d5d   in service     none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone/oxz_crucible_7c252b64-c5af-4ec1-989e-9a03f3b0f111          3d9537b8-05be-4b1b-a051-f47becf8ec75   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_f55647d4-5500-4ad3-893a-df45bd50d622          c895e8d5-1434-4ecf-8d46-9bf1ecc8cbc9   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_75b220ba-a0f4-4872-8202-dc7c87f062d0   a50cd13a-5749-4e79-bb8b-19229500a8b3   expunged       none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_7fbd0103-d7f8-48a5-b95e-29bf812cac1f   49336223-f6df-4fe7-bd9f-95123c5622a9   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_external_dns_f6ec9c67-946a-4da3-98d5-581f72ce8bf0      6f04dd20-5e2c-4fa8-8430-a886470ed140   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_b5edcb10-9ba0-4fd7-9583-1617e5b4b452      1d6eef5e-daab-470c-9aa3-2c92894468ff   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_ea5b4030-b52f-44b2-8d70-45f15f987d01      7ea73f80-c4e0-450a-92dc-8397ce2af14f   expunged       none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_nexus_3eeb8d49-eb1a-43f8-bb64-c2338421c2c6             50ea8c15-c4c0-4403-a490-d14b3405dfc2   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/debug                                                           7a6a2058-ea78-49de-9730-cce5e28b4cfb   in service     100 GiB   none          gzip-9     
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/debug                                                           21fd4f3a-ec31-469b-87b1-087c343a2422   in service     100 GiB   none          gzip-9     
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/debug                                                           b1deff4b-51df-4a37-9043-afbd7c70a1cb   in service     100 GiB   none          gzip-9     
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/local_storage                                                   41071985-1dfd-4ce5-8bc2-897161a8bce4   in service     none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/local_storage                                                   c65a9c1c-36dc-4ddb-8aac-ec3be8dbb209   in service     none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/local_storage                                                   090bd88d-0a43-4040-a832-b13ae721f74f   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/local_storage_unencrypted                                             e009d8b8-4695-4322-b53f-f03f2744aef7   in service     none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/local_storage_unencrypted                                             4da74a5b-6911-4cca-b624-b90c65530117   in service     none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/local_storage_unencrypted                                             96ae8389-3027-4260-9374-e0f6ce851de2   in service     none      none          off        
*   oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f10a4fb9-759f-4a65-b25e-5794ad2d07d8               54bbadaf-ec04-41a2-a62f-f5ac5bf321be   - in service   none      none          off        
     └─                                                                                                                                                   + expunged                                        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    crucible          694bd14f-cb24-4be4-bb19-876e79cda2c8   artifact: version 1.0.0   in service       fd00:1122:3344:103::8
    crucible          7c252b64-c5af-4ec1-989e-9a03f3b0f111   artifact: version 1.0.0   in service       fd00:1122:3344:103::9
    crucible          f55647d4-5500-4ad3-893a-df45bd50d622   artifact: version 0.0.1   in service       fd00:1122:3344:103::7
    crucible_pantry   75b220ba-a0f4-4872-8202-dc7c87f062d0   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:103::6
    crucible_pantry   7fbd0103-d7f8-48a5-b95e-29bf812cac1f   artifact: version 1.0.0   in service       fd00:1122:3344:103::a
    external_dns      f6ec9c67-946a-4da3-98d5-581f72ce8bf0   artifact: version 0.0.1   in service       fd00:1122:3344:103::5
    internal_dns      b5edcb10-9ba0-4fd7-9583-1617e5b4b452   artifact: version 1.0.0   in service       fd00:1122:3344:3::1  
    internal_dns      ea5b4030-b52f-44b2-8d70-45f15f987d01   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:3::1  
    nexus             3eeb8d49-eb1a-43f8-bb64-c2338421c2c6   artifact: version 0.0.1   in service       fd00:1122:3344:103::4
*   internal_ntp      f10a4fb9-759f-4a65-b25e-5794ad2d07d8   artifact: version 0.0.1   - in service     fd00:1122:3344:103::3
     └─                                                                                + expunged ⏳                          


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
* DNS zone: "control-plane.oxide.internal": 
*   name: _internal-ntp._tcp                                 (records: 3 -> 2)
-       SRV  port   123 a690b03d-c29b-471d-ba2b-6d8de82299b4.host.control-plane.oxide.internal
-       SRV  port   123 c74e3068-8b20-4a62-953b-dab703a442db.host.control-plane.oxide.internal
-       SRV  port   123 f10a4fb9-759f-4a65-b25e-5794ad2d07d8.host.control-plane.oxide.internal
+       SRV  port   123 a690b03d-c29b-471d-ba2b-6d8de82299b4.host.control-plane.oxide.internal
+       SRV  port   123 c74e3068-8b20-4a62-953b-dab703a442db.host.control-plane.oxide.internal
-   name: f10a4fb9-759f-4a65-b25e-5794ad2d07d8.host          (records: 1)
-       AAAA fd00:1122:3344:103::3
    unchanged names: 50 (records: 64)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> sled-set d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron-config latest
set sled d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron config from latest blueprint (e8b088a8-7da0-480b-a2dc-75ffef068ece)

> inventory-generate
generated inventory collection 74b742c1-01da-4461-a011-785e2e11a5b2 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 7, num_already_artifact: 7, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
INFO some zones not yet up-to-date, zones_currently_updating: [ZonePropagationIncomplete { zone_id: f4d7ec7b-5e5c-4c90-97f2-2ac9d4588a01 (omicron_zone), zone_kind: InternalNtp, reason: MissingInInventory { bp_image_source: Artifact { version: Available { version: ArtifactVersion("1.0.0") }, hash: ArtifactHash(HexArray(2c7a661d288567335a1cabbbb96ec43c648bdfa1323b9c7c4e8de7ff23edeed0)) } } }]
generated blueprint 810ea95a-4730-43dd-867e-1984aeb9d873 based on parent blueprint e8b088a8-7da0-480b-a2dc-75ffef068ece
blueprint source: planner with report:
planning report:
* waiting for NTP zones to appear in inventory on sleds: d81c6a84-79b8-4958-ae41-ea46c9b19763
* sleds getting NTP zones and which have other services already, making them eligible for discretionary zones: d81c6a84-79b8-4958-ae41-ea46c9b19763
* missing NTP zone on sled d81c6a84-79b8-4958-ae41-ea46c9b19763
* zone updates waiting on zone propagation to inventory
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint e8b088a8-7da0-480b-a2dc-75ffef068ece
to:   blueprint 810ea95a-4730-43dd-867e-1984aeb9d873

 MODIFIED SLEDS:

  sled d81c6a84-79b8-4958-ae41-ea46c9b19763 (active, config generation 12 -> 13):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-18b20749-0748-4105-bb10-7b13cfc776e2   in service 
    fake-vendor   fake-model   serial-30c16fe4-4229-49d0-ab01-3138f2c7dff2   in service 
    fake-vendor   fake-model   serial-4930954e-9ac7-4453-b63f-5ab97c389a99   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crucible                                                              ba9311dd-89ac-47db-a5e8-d64e8a5fcf70   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crucible                                                              3c2cb304-a466-4ab5-8597-5db8172e2388   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crucible                                                              41107868-c6cc-4ec4-9159-aed688c3ceaf   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/external_dns                                                    429da94b-19f7-48bd-98e9-47842863ba7b   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    c2782fb5-af50-401f-92eb-dc0937e2cae2   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    3443a368-199e-4d26-b59f-3f2bbd507761   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone                                                            45cd9687-20be-4247-b62a-dfdacf324929   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone                                                            252ac39f-b9e2-4697-8c07-3a833115d704   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone                                                            1cb0a47a-59ac-4892-8e92-cf87b4290f96   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone/oxz_crucible_694bd14f-cb24-4be4-bb19-876e79cda2c8          543fc3b8-08eb-4e5e-9e05-cf7a91732d5d   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone/oxz_crucible_7c252b64-c5af-4ec1-989e-9a03f3b0f111          3d9537b8-05be-4b1b-a051-f47becf8ec75   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_f55647d4-5500-4ad3-893a-df45bd50d622          c895e8d5-1434-4ecf-8d46-9bf1ecc8cbc9   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_75b220ba-a0f4-4872-8202-dc7c87f062d0   a50cd13a-5749-4e79-bb8b-19229500a8b3   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_7fbd0103-d7f8-48a5-b95e-29bf812cac1f   49336223-f6df-4fe7-bd9f-95123c5622a9   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_external_dns_f6ec9c67-946a-4da3-98d5-581f72ce8bf0      6f04dd20-5e2c-4fa8-8430-a886470ed140   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_b5edcb10-9ba0-4fd7-9583-1617e5b4b452      1d6eef5e-daab-470c-9aa3-2c92894468ff   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_ea5b4030-b52f-44b2-8d70-45f15f987d01      7ea73f80-c4e0-450a-92dc-8397ce2af14f   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_nexus_3eeb8d49-eb1a-43f8-bb64-c2338421c2c6             50ea8c15-c4c0-4403-a490-d14b3405dfc2   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f10a4fb9-759f-4a65-b25e-5794ad2d07d8               54bbadaf-ec04-41a2-a62f-f5ac5bf321be   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/debug                                                           7a6a2058-ea78-49de-9730-cce5e28b4cfb   in service    100 GiB   none          gzip-9     
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/debug                                                           21fd4f3a-ec31-469b-87b1-087c343a2422   in service    100 GiB   none          gzip-9     
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/debug                                                           b1deff4b-51df-4a37-9043-afbd7c70a1cb   in service    100 GiB   none          gzip-9     
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/local_storage                                                   41071985-1dfd-4ce5-8bc2-897161a8bce4   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/local_storage                                                   c65a9c1c-36dc-4ddb-8aac-ec3be8dbb209   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/local_storage                                                   090bd88d-0a43-4040-a832-b13ae721f74f   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/local_storage_unencrypted                                             e009d8b8-4695-4322-b53f-f03f2744aef7   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/local_storage_unencrypted                                             4da74a5b-6911-4cca-b624-b90c65530117   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/local_storage_unencrypted                                             96ae8389-3027-4260-9374-e0f6ce851de2   in service    none      none          off        
+   oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f4d7ec7b-5e5c-4c90-97f2-2ac9d4588a01               b24bee8e-82a0-4b4d-a57c-77a1010f3e38   in service    none      none          off        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    crucible          694bd14f-cb24-4be4-bb19-876e79cda2c8   artifact: version 1.0.0   in service       fd00:1122:3344:103::8
    crucible          7c252b64-c5af-4ec1-989e-9a03f3b0f111   artifact: version 1.0.0   in service       fd00:1122:3344:103::9
    crucible          f55647d4-5500-4ad3-893a-df45bd50d622   artifact: version 0.0.1   in service       fd00:1122:3344:103::7
    crucible_pantry   75b220ba-a0f4-4872-8202-dc7c87f062d0   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:103::6
    crucible_pantry   7fbd0103-d7f8-48a5-b95e-29bf812cac1f   artifact: version 1.0.0   in service       fd00:1122:3344:103::a
    external_dns      f6ec9c67-946a-4da3-98d5-581f72ce8bf0   artifact: version 0.0.1   in service       fd00:1122:3344:103::5
    internal_dns      b5edcb10-9ba0-4fd7-9583-1617e5b4b452   artifact: version 1.0.0   in service       fd00:1122:3344:3::1  
    internal_dns      ea5b4030-b52f-44b2-8d70-45f15f987d01   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:3::1  
    nexus             3eeb8d49-eb1a-43f8-bb64-c2338421c2c6   artifact: version 0.0.1   in service       fd00:1122:3344:103::4
*   internal_ntp      f10a4fb9-759f-4a65-b25e-5794ad2d07d8   artifact: version 0.0.1   - expunged ⏳     fd00:1122:3344:103::3
     └─                                                                                + expunged ✓                          
+   internal_ntp      f4d7ec7b-5e5c-4c90-97f2-2ac9d4588a01   artifact: version 1.0.0   in service       fd00:1122:3344:103::b


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
* DNS zone: "control-plane.oxide.internal": 
*   name: _internal-ntp._tcp                                 (records: 2 -> 3)
-       SRV  port   123 a690b03d-c29b-471d-ba2b-6d8de82299b4.host.control-plane.oxide.internal
-       SRV  port   123 c74e3068-8b20-4a62-953b-dab703a442db.host.control-plane.oxide.internal
+       SRV  port   123 a690b03d-c29b-471d-ba2b-6d8de82299b4.host.control-plane.oxide.internal
+       SRV  port   123 c74e3068-8b20-4a62-953b-dab703a442db.host.control-plane.oxide.internal
+       SRV  port   123 f4d7ec7b-5e5c-4c90-97f2-2ac9d4588a01.host.control-plane.oxide.internal
+   name: f4d7ec7b-5e5c-4c90-97f2-2ac9d4588a01.host          (records: 1)
+       AAAA fd00:1122:3344:103::b
    unchanged names: 50 (records: 64)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> sled-set d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron-config latest
set sled d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron config from latest blueprint (810ea95a-4730-43dd-867e-1984aeb9d873)

> inventory-generate
generated inventory collection 78486156-ea1a-42a2-adc3-658ccd94ccd1 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 67c074ef-c52e-4ff1-851a-598c04dc2c8d based on parent blueprint 810ea95a-4730-43dd-867e-1984aeb9d873
blueprint source: planner with report:
planning report:
* 1 out-of-date zone updated in-place:
  * sled d81c6a84-79b8-4958-ae41-ea46c9b19763, zone f55647d4-5500-4ad3-893a-df45bd50d622 (crucible)
* 4 remaining out-of-date zones
* waiting to update top-level nexus_generation: some non-Nexus zone are not yet updated



> blueprint-diff latest
from: blueprint 810ea95a-4730-43dd-867e-1984aeb9d873
to:   blueprint 67c074ef-c52e-4ff1-851a-598c04dc2c8d

 MODIFIED SLEDS:

  sled d81c6a84-79b8-4958-ae41-ea46c9b19763 (active, config generation 13 -> 14):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-18b20749-0748-4105-bb10-7b13cfc776e2   in service 
    fake-vendor   fake-model   serial-30c16fe4-4229-49d0-ab01-3138f2c7dff2   in service 
    fake-vendor   fake-model   serial-4930954e-9ac7-4453-b63f-5ab97c389a99   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crucible                                                              ba9311dd-89ac-47db-a5e8-d64e8a5fcf70   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crucible                                                              3c2cb304-a466-4ab5-8597-5db8172e2388   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crucible                                                              41107868-c6cc-4ec4-9159-aed688c3ceaf   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/external_dns                                                    429da94b-19f7-48bd-98e9-47842863ba7b   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    c2782fb5-af50-401f-92eb-dc0937e2cae2   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    3443a368-199e-4d26-b59f-3f2bbd507761   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone                                                            45cd9687-20be-4247-b62a-dfdacf324929   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone                                                            252ac39f-b9e2-4697-8c07-3a833115d704   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone                                                            1cb0a47a-59ac-4892-8e92-cf87b4290f96   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone/oxz_crucible_694bd14f-cb24-4be4-bb19-876e79cda2c8          543fc3b8-08eb-4e5e-9e05-cf7a91732d5d   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone/oxz_crucible_7c252b64-c5af-4ec1-989e-9a03f3b0f111          3d9537b8-05be-4b1b-a051-f47becf8ec75   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_f55647d4-5500-4ad3-893a-df45bd50d622          c895e8d5-1434-4ecf-8d46-9bf1ecc8cbc9   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_75b220ba-a0f4-4872-8202-dc7c87f062d0   a50cd13a-5749-4e79-bb8b-19229500a8b3   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_7fbd0103-d7f8-48a5-b95e-29bf812cac1f   49336223-f6df-4fe7-bd9f-95123c5622a9   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_external_dns_f6ec9c67-946a-4da3-98d5-581f72ce8bf0      6f04dd20-5e2c-4fa8-8430-a886470ed140   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_b5edcb10-9ba0-4fd7-9583-1617e5b4b452      1d6eef5e-daab-470c-9aa3-2c92894468ff   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_ea5b4030-b52f-44b2-8d70-45f15f987d01      7ea73f80-c4e0-450a-92dc-8397ce2af14f   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_nexus_3eeb8d49-eb1a-43f8-bb64-c2338421c2c6             50ea8c15-c4c0-4403-a490-d14b3405dfc2   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f10a4fb9-759f-4a65-b25e-5794ad2d07d8               54bbadaf-ec04-41a2-a62f-f5ac5bf321be   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f4d7ec7b-5e5c-4c90-97f2-2ac9d4588a01               b24bee8e-82a0-4b4d-a57c-77a1010f3e38   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/debug                                                           7a6a2058-ea78-49de-9730-cce5e28b4cfb   in service    100 GiB   none          gzip-9     
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/debug                                                           21fd4f3a-ec31-469b-87b1-087c343a2422   in service    100 GiB   none          gzip-9     
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/debug                                                           b1deff4b-51df-4a37-9043-afbd7c70a1cb   in service    100 GiB   none          gzip-9     
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/local_storage                                                   41071985-1dfd-4ce5-8bc2-897161a8bce4   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/local_storage                                                   c65a9c1c-36dc-4ddb-8aac-ec3be8dbb209   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/local_storage                                                   090bd88d-0a43-4040-a832-b13ae721f74f   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/local_storage_unencrypted                                             e009d8b8-4695-4322-b53f-f03f2744aef7   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/local_storage_unencrypted                                             4da74a5b-6911-4cca-b624-b90c65530117   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/local_storage_unencrypted                                             96ae8389-3027-4260-9374-e0f6ce851de2   in service    none      none          off        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source                disposition    underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    crucible          694bd14f-cb24-4be4-bb19-876e79cda2c8   artifact: version 1.0.0     in service     fd00:1122:3344:103::8
    crucible          7c252b64-c5af-4ec1-989e-9a03f3b0f111   artifact: version 1.0.0     in service     fd00:1122:3344:103::9
    crucible_pantry   75b220ba-a0f4-4872-8202-dc7c87f062d0   artifact: version 0.0.1     expunged ✓     fd00:1122:3344:103::6
    crucible_pantry   7fbd0103-d7f8-48a5-b95e-29bf812cac1f   artifact: version 1.0.0     in service     fd00:1122:3344:103::a
    external_dns      f6ec9c67-946a-4da3-98d5-581f72ce8bf0   artifact: version 0.0.1     in service     fd00:1122:3344:103::5
    internal_dns      b5edcb10-9ba0-4fd7-9583-1617e5b4b452   artifact: version 1.0.0     in service     fd00:1122:3344:3::1  
    internal_dns      ea5b4030-b52f-44b2-8d70-45f15f987d01   artifact: version 0.0.1     expunged ✓     fd00:1122:3344:3::1  
    internal_ntp      f10a4fb9-759f-4a65-b25e-5794ad2d07d8   artifact: version 0.0.1     expunged ✓     fd00:1122:3344:103::3
    internal_ntp      f4d7ec7b-5e5c-4c90-97f2-2ac9d4588a01   artifact: version 1.0.0     in service     fd00:1122:3344:103::b
    nexus             3eeb8d49-eb1a-43f8-bb64-c2338421c2c6   artifact: version 0.0.1     in service     fd00:1122:3344:103::4
*   crucible          f55647d4-5500-4ad3-893a-df45bd50d622   - artifact: version 0.0.1   in service     fd00:1122:3344:103::7
     └─                                                      + artifact: version 1.0.0                                       


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> sled-set d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron-config latest
set sled d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron config from latest blueprint (67c074ef-c52e-4ff1-851a-598c04dc2c8d)

> inventory-generate
generated inventory collection 0f80a0f2-360f-4c64-9c35-3dc067dd2620 from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 0a8d2f87-1d3e-4296-ba07-108940a7a57e based on parent blueprint 67c074ef-c52e-4ff1-851a-598c04dc2c8d
blueprint source: planner with report:
planning report:
* 1 out-of-date zone expunged:
  * sled d81c6a84-79b8-4958-ae41-ea46c9b19763, zone f6ec9c67-946a-4da3-98d5-581f72ce8bf0 (external_dns)
* 3 remaining out-of-date zones
* waiting to update top-level nexus_generation: new Nexus zones have not been planned yet



> blueprint-diff latest
from: blueprint 67c074ef-c52e-4ff1-851a-598c04dc2c8d
to:   blueprint 0a8d2f87-1d3e-4296-ba07-108940a7a57e

 MODIFIED SLEDS:

  sled d81c6a84-79b8-4958-ae41-ea46c9b19763 (active, config generation 14 -> 15):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-18b20749-0748-4105-bb10-7b13cfc776e2   in service 
    fake-vendor   fake-model   serial-30c16fe4-4229-49d0-ab01-3138f2c7dff2   in service 
    fake-vendor   fake-model   serial-4930954e-9ac7-4453-b63f-5ab97c389a99   in service 


    datasets:
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition    quota     reservation   compression
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crucible                                                              ba9311dd-89ac-47db-a5e8-d64e8a5fcf70   in service     none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crucible                                                              3c2cb304-a466-4ab5-8597-5db8172e2388   in service     none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crucible                                                              41107868-c6cc-4ec4-9159-aed688c3ceaf   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    3443a368-199e-4d26-b59f-3f2bbd507761   expunged       none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    c2782fb5-af50-401f-92eb-dc0937e2cae2   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone                                                            45cd9687-20be-4247-b62a-dfdacf324929   in service     none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone                                                            252ac39f-b9e2-4697-8c07-3a833115d704   in service     none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone                                                            1cb0a47a-59ac-4892-8e92-cf87b4290f96   in service     none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone/oxz_crucible_694bd14f-cb24-4be4-bb19-876e79cda2c8          543fc3b8-08eb-4e5e-9e05-cf7a91732d5d   in service     none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone/oxz_crucible_7c252b64-c5af-4ec1-989e-9a03f3b0f111          3d9537b8-05be-4b1b-a051-f47becf8ec75   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_f55647d4-5500-4ad3-893a-df45bd50d622          c895e8d5-1434-4ecf-8d46-9bf1ecc8cbc9   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_75b220ba-a0f4-4872-8202-dc7c87f062d0   a50cd13a-5749-4e79-bb8b-19229500a8b3   expunged       none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_7fbd0103-d7f8-48a5-b95e-29bf812cac1f   49336223-f6df-4fe7-bd9f-95123c5622a9   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_b5edcb10-9ba0-4fd7-9583-1617e5b4b452      1d6eef5e-daab-470c-9aa3-2c92894468ff   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_ea5b4030-b52f-44b2-8d70-45f15f987d01      7ea73f80-c4e0-450a-92dc-8397ce2af14f   expunged       none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_nexus_3eeb8d49-eb1a-43f8-bb64-c2338421c2c6             50ea8c15-c4c0-4403-a490-d14b3405dfc2   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f10a4fb9-759f-4a65-b25e-5794ad2d07d8               54bbadaf-ec04-41a2-a62f-f5ac5bf321be   expunged       none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f4d7ec7b-5e5c-4c90-97f2-2ac9d4588a01               b24bee8e-82a0-4b4d-a57c-77a1010f3e38   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/debug                                                           7a6a2058-ea78-49de-9730-cce5e28b4cfb   in service     100 GiB   none          gzip-9     
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/debug                                                           21fd4f3a-ec31-469b-87b1-087c343a2422   in service     100 GiB   none          gzip-9     
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/debug                                                           b1deff4b-51df-4a37-9043-afbd7c70a1cb   in service     100 GiB   none          gzip-9     
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/local_storage                                                   41071985-1dfd-4ce5-8bc2-897161a8bce4   in service     none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/local_storage                                                   c65a9c1c-36dc-4ddb-8aac-ec3be8dbb209   in service     none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/local_storage                                                   090bd88d-0a43-4040-a832-b13ae721f74f   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/local_storage_unencrypted                                             e009d8b8-4695-4322-b53f-f03f2744aef7   in service     none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/local_storage_unencrypted                                             4da74a5b-6911-4cca-b624-b90c65530117   in service     none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/local_storage_unencrypted                                             96ae8389-3027-4260-9374-e0f6ce851de2   in service     none      none          off        
*   oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/external_dns                                                    429da94b-19f7-48bd-98e9-47842863ba7b   - in service   none      none          off        
     └─                                                                                                                                                   + expunged                                        
*   oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_external_dns_f6ec9c67-946a-4da3-98d5-581f72ce8bf0      6f04dd20-5e2c-4fa8-8430-a886470ed140   - in service   none      none          off        
     └─                                                                                                                                                   + expunged                                        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    crucible          694bd14f-cb24-4be4-bb19-876e79cda2c8   artifact: version 1.0.0   in service       fd00:1122:3344:103::8
    crucible          7c252b64-c5af-4ec1-989e-9a03f3b0f111   artifact: version 1.0.0   in service       fd00:1122:3344:103::9
    crucible          f55647d4-5500-4ad3-893a-df45bd50d622   artifact: version 1.0.0   in service       fd00:1122:3344:103::7
    crucible_pantry   75b220ba-a0f4-4872-8202-dc7c87f062d0   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:103::6
    crucible_pantry   7fbd0103-d7f8-48a5-b95e-29bf812cac1f   artifact: version 1.0.0   in service       fd00:1122:3344:103::a
    internal_dns      b5edcb10-9ba0-4fd7-9583-1617e5b4b452   artifact: version 1.0.0   in service       fd00:1122:3344:3::1  
    internal_dns      ea5b4030-b52f-44b2-8d70-45f15f987d01   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:3::1  
    internal_ntp      f10a4fb9-759f-4a65-b25e-5794ad2d07d8   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:103::3
    internal_ntp      f4d7ec7b-5e5c-4c90-97f2-2ac9d4588a01   artifact: version 1.0.0   in service       fd00:1122:3344:103::b
    nexus             3eeb8d49-eb1a-43f8-bb64-c2338421c2c6   artifact: version 0.0.1   in service       fd00:1122:3344:103::4
*   external_dns      f6ec9c67-946a-4da3-98d5-581f72ce8bf0   artifact: version 0.0.1   - in service     fd00:1122:3344:103::5
     └─                                                                                + expunged ⏳                          


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
* DNS zone: "control-plane.oxide.internal": 
*   name: _external-dns._tcp                                 (records: 3 -> 2)
-       SRV  port  5353 4b2a2238-6721-4e83-ad61-c4611712ca74.host.control-plane.oxide.internal
-       SRV  port  5353 c821c39d-2b2c-4c55-8874-ac12315ba1e4.host.control-plane.oxide.internal
-       SRV  port  5353 f6ec9c67-946a-4da3-98d5-581f72ce8bf0.host.control-plane.oxide.internal
+       SRV  port  5353 4b2a2238-6721-4e83-ad61-c4611712ca74.host.control-plane.oxide.internal
+       SRV  port  5353 c821c39d-2b2c-4c55-8874-ac12315ba1e4.host.control-plane.oxide.internal
-   name: f6ec9c67-946a-4da3-98d5-581f72ce8bf0.host          (records: 1)
-       AAAA fd00:1122:3344:103::5
    unchanged names: 50 (records: 64)

external DNS:
* DNS zone: "oxide.example": 
*   name: @                                                  (records: 3 -> 2)
-       NS   ns1.oxide.example
-       NS   ns2.oxide.example
-       NS   ns3.oxide.example
+       NS   ns1.oxide.example
+       NS   ns2.oxide.example
-   name: ns3                                                (records: 1)
-       A    198.51.100.3
    unchanged names: 3 (records: 5)




> sled-set d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron-config latest
set sled d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron config from latest blueprint (0a8d2f87-1d3e-4296-ba07-108940a7a57e)

> inventory-generate
generated inventory collection c0548a65-0ee4-4876-a5e0-3384187c88cc from configured sleds

> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 7, num_already_artifact: 7, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint d69e1109-06be-4469-8876-4292dc7885d7 based on parent blueprint 0a8d2f87-1d3e-4296-ba07-108940a7a57e
blueprint source: planner with report:
planning report:
* discretionary zones placed:
  * external_dns zone on sled d81c6a84-79b8-4958-ae41-ea46c9b19763 from source artifact: version 1.0.0
* zone updates waiting on discretionary zones
* waiting to update top-level nexus_generation: new Nexus zones have not been planned yet



> blueprint-diff latest
from: blueprint 0a8d2f87-1d3e-4296-ba07-108940a7a57e
to:   blueprint d69e1109-06be-4469-8876-4292dc7885d7

 MODIFIED SLEDS:

  sled d81c6a84-79b8-4958-ae41-ea46c9b19763 (active, config generation 15 -> 16):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-18b20749-0748-4105-bb10-7b13cfc776e2   in service 
    fake-vendor   fake-model   serial-30c16fe4-4229-49d0-ab01-3138f2c7dff2   in service 
    fake-vendor   fake-model   serial-4930954e-9ac7-4453-b63f-5ab97c389a99   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crucible                                                              ba9311dd-89ac-47db-a5e8-d64e8a5fcf70   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crucible                                                              3c2cb304-a466-4ab5-8597-5db8172e2388   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crucible                                                              41107868-c6cc-4ec4-9159-aed688c3ceaf   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/external_dns                                                    429da94b-19f7-48bd-98e9-47842863ba7b   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    c2782fb5-af50-401f-92eb-dc0937e2cae2   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    3443a368-199e-4d26-b59f-3f2bbd507761   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone                                                            45cd9687-20be-4247-b62a-dfdacf324929   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone                                                            252ac39f-b9e2-4697-8c07-3a833115d704   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone                                                            1cb0a47a-59ac-4892-8e92-cf87b4290f96   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone/oxz_crucible_694bd14f-cb24-4be4-bb19-876e79cda2c8          543fc3b8-08eb-4e5e-9e05-cf7a91732d5d   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone/oxz_crucible_7c252b64-c5af-4ec1-989e-9a03f3b0f111          3d9537b8-05be-4b1b-a051-f47becf8ec75   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_f55647d4-5500-4ad3-893a-df45bd50d622          c895e8d5-1434-4ecf-8d46-9bf1ecc8cbc9   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_75b220ba-a0f4-4872-8202-dc7c87f062d0   a50cd13a-5749-4e79-bb8b-19229500a8b3   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_7fbd0103-d7f8-48a5-b95e-29bf812cac1f   49336223-f6df-4fe7-bd9f-95123c5622a9   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_external_dns_f6ec9c67-946a-4da3-98d5-581f72ce8bf0      6f04dd20-5e2c-4fa8-8430-a886470ed140   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_b5edcb10-9ba0-4fd7-9583-1617e5b4b452      1d6eef5e-daab-470c-9aa3-2c92894468ff   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_ea5b4030-b52f-44b2-8d70-45f15f987d01      7ea73f80-c4e0-450a-92dc-8397ce2af14f   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_nexus_3eeb8d49-eb1a-43f8-bb64-c2338421c2c6             50ea8c15-c4c0-4403-a490-d14b3405dfc2   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f10a4fb9-759f-4a65-b25e-5794ad2d07d8               54bbadaf-ec04-41a2-a62f-f5ac5bf321be   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f4d7ec7b-5e5c-4c90-97f2-2ac9d4588a01               b24bee8e-82a0-4b4d-a57c-77a1010f3e38   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/debug                                                           7a6a2058-ea78-49de-9730-cce5e28b4cfb   in service    100 GiB   none          gzip-9     
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/debug                                                           21fd4f3a-ec31-469b-87b1-087c343a2422   in service    100 GiB   none          gzip-9     
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/debug                                                           b1deff4b-51df-4a37-9043-afbd7c70a1cb   in service    100 GiB   none          gzip-9     
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/local_storage                                                   41071985-1dfd-4ce5-8bc2-897161a8bce4   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/local_storage                                                   c65a9c1c-36dc-4ddb-8aac-ec3be8dbb209   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/local_storage                                                   090bd88d-0a43-4040-a832-b13ae721f74f   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/local_storage_unencrypted                                             e009d8b8-4695-4322-b53f-f03f2744aef7   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/local_storage_unencrypted                                             4da74a5b-6911-4cca-b624-b90c65530117   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/local_storage_unencrypted                                             96ae8389-3027-4260-9374-e0f6ce851de2   in service    none      none          off        
+   oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/external_dns                                                    6f2feeac-a819-447d-9331-64f19d1507ed   in service    none      none          off        
+   oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_external_dns_90dbd6f3-9bcb-4a62-ad85-d61f5b3a36ad      ecb27354-877c-4a24-8982-1298a222ca1c   in service    none      none          off        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    crucible          694bd14f-cb24-4be4-bb19-876e79cda2c8   artifact: version 1.0.0   in service       fd00:1122:3344:103::8
    crucible          7c252b64-c5af-4ec1-989e-9a03f3b0f111   artifact: version 1.0.0   in service       fd00:1122:3344:103::9
    crucible          f55647d4-5500-4ad3-893a-df45bd50d622   artifact: version 1.0.0   in service       fd00:1122:3344:103::7
    crucible_pantry   75b220ba-a0f4-4872-8202-dc7c87f062d0   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:103::6
    crucible_pantry   7fbd0103-d7f8-48a5-b95e-29bf812cac1f   artifact: version 1.0.0   in service       fd00:1122:3344:103::a
    internal_dns      b5edcb10-9ba0-4fd7-9583-1617e5b4b452   artifact: version 1.0.0   in service       fd00:1122:3344:3::1  
    internal_dns      ea5b4030-b52f-44b2-8d70-45f15f987d01   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:3::1  
    internal_ntp      f10a4fb9-759f-4a65-b25e-5794ad2d07d8   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:103::3
    internal_ntp      f4d7ec7b-5e5c-4c90-97f2-2ac9d4588a01   artifact: version 1.0.0   in service       fd00:1122:3344:103::b
    nexus             3eeb8d49-eb1a-43f8-bb64-c2338421c2c6   artifact: version 0.0.1   in service       fd00:1122:3344:103::4
*   external_dns      f6ec9c67-946a-4da3-98d5-581f72ce8bf0   artifact: version 0.0.1   - expunged ⏳     fd00:1122:3344:103::5
     └─                                                                                + expunged ✓                          
+   external_dns      90dbd6f3-9bcb-4a62-ad85-d61f5b3a36ad   artifact: version 1.0.0   in service       fd00:1122:3344:103::c


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
* DNS zone: "control-plane.oxide.internal": 
+   name: 90dbd6f3-9bcb-4a62-ad85-d61f5b3a36ad.host          (records: 1)
+       AAAA fd00:1122:3344:103::c
*   name: _external-dns._tcp                                 (records: 2 -> 3)
-       SRV  port  5353 4b2a2238-6721-4e83-ad61-c4611712ca74.host.control-plane.oxide.internal
-       SRV  port  5353 c821c39d-2b2c-4c55-8874-ac12315ba1e4.host.control-plane.oxide.internal
+       SRV  port  5353 4b2a2238-6721-4e83-ad61-c4611712ca74.host.control-plane.oxide.internal
+       SRV  port  5353 90dbd6f3-9bcb-4a62-ad85-d61f5b3a36ad.host.control-plane.oxide.internal
+       SRV  port  5353 c821c39d-2b2c-4c55-8874-ac12315ba1e4.host.control-plane.oxide.internal
    unchanged names: 50 (records: 64)

external DNS:
* DNS zone: "oxide.example": 
*   name: @                                                  (records: 2 -> 3)
-       NS   ns1.oxide.example
-       NS   ns2.oxide.example
+       NS   ns1.oxide.example
+       NS   ns2.oxide.example
+       NS   ns3.oxide.example
+   name: ns3                                                (records: 1)
+       A    198.51.100.3
    unchanged names: 3 (records: 5)




> sled-set d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron-config latest
set sled d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron config from latest blueprint (d69e1109-06be-4469-8876-4292dc7885d7)

> inventory-generate
generated inventory collection 7349431d-718a-4353-a1ee-357ce2aeeb28 from configured sleds


> # Start the Nexus handoff process: A planning step here should place three new
> # Nexus zones, each running from the new TUF repo artifact.
> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 12f19448-6a10-4b4b-ae19-a8c94a566097 based on parent blueprint d69e1109-06be-4469-8876-4292dc7885d7
blueprint source: planner with report:
planning report:
* discretionary zones placed:
  * nexus zone on sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c from source artifact: version 1.0.0
  * nexus zone on sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 from source artifact: version 1.0.0
  * nexus zone on sled d81c6a84-79b8-4958-ae41-ea46c9b19763 from source artifact: version 1.0.0
* zone updates waiting on discretionary zones
* waiting to update top-level nexus_generation: new Nexus zones do not have database records yet



> blueprint-diff latest
from: blueprint d69e1109-06be-4469-8876-4292dc7885d7
to:   blueprint 12f19448-6a10-4b4b-ae19-a8c94a566097

 MODIFIED SLEDS:

  sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c (active, config generation 17 -> 18):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-727522a7-934f-494d-b5b3-160968e74463   in service 
    fake-vendor   fake-model   serial-72c59873-31ff-4e36-8d76-ff834009349a   in service 
    fake-vendor   fake-model   serial-b5fd5bc1-099e-4e77-8028-a9793c11f43b   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_727522a7-934f-494d-b5b3-160968e74463/crucible                                                              feecfda1-9966-43d4-aaef-440b77f0b26d   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crucible                                                              956966b9-8201-437b-81ba-3c8ad2032080   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crucible                                                              4b0b09bf-94b7-45bf-a6b3-d46af53ae44a   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/clickhouse                                                      5ae11c7e-08fa-4d78-a4ea-14b4a9a10241   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    3e0d6188-c503-49cf-a441-fa7df40ceb43   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    5c01fdbd-ff37-44b4-a17b-6d625e6fa48d   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    a2e6e726-7cf1-432d-9ca7-b7cde2f1f742   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    b8f2a09f-8bd2-4418-872b-a4457a3f958c   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone                                                            4829f422-aa31-41a8-ab73-95684ff1ef48   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone                                                            3b66453b-7148-4c1b-84a9-499e43290ab4   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone                                                            841d5648-05f0-47b0-b446-92f6b60fe9a6   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_clickhouse_353b3b65-20f7-48c3-88f7-495bd5d31545        49f8fbb6-5bac-4609-907f-6e3dfc206059   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone/oxz_crucible_86a22a56-0168-453d-9df1-cb2a7c64b5d3          6e218d0a-13fd-4f70-884e-47e960fa8bb8   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_bd354eef-d8a6-4165-9124-283fb5e46d77          9073fb6b-f973-4bbd-b7cc-ba1abf6cb238   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone/oxz_crucible_e2fdefe7-95b2-4fd2-ae37-56929a06d58c          0582030b-aab6-4d0e-b1d2-64562ee712cd   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_ad6a3a03-8d0f-4504-99a4-cbf73d69b973   1640adb6-70bf-44cf-b05c-bff6dd300cf3   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_c484718d-c38b-42d5-8171-743e0fd5e5b7   e9d249aa-4d3a-49c6-8d94-52fef693f8b9   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_6c3ae381-04f7-41ea-b0ac-74db387dbc3a      78f34ce7-42f1-41da-995f-318f32054ad2   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_c821c39d-2b2c-4c55-8874-ac12315ba1e4      a21812e1-1b80-4faa-9f2b-51189e0f6999   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_99e2f30b-3174-40bf-a78a-90da8abba8ca      2f204c50-a327-479c-8852-f53ec7a19c1f   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_a729999a-6e45-46ca-b51e-0bbb5490387a      eece684d-17ae-4aae-93b3-6928f26722c2   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_nexus_466a9f29-62bf-4e63-924a-b9efdb86afec             8e0bd2bd-23b7-4bc6-9e73-c4d4ebc0bc8c   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_62620961-fc4a-481e-968b-f5acbac0dc63               8c4fa711-1d5d-4e93-85f0-d17bff47b063   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_c74e3068-8b20-4a62-953b-dab703a442db               5b087884-f80b-4a4f-a672-6e088753933e   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/debug                                                           93957ca0-9ed1-4e7b-8c34-2ce07a69541c   in service    100 GiB   none          gzip-9     
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/debug                                                           318fae85-abcb-4259-b1b6-ac96d193f7b7   in service    100 GiB   none          gzip-9     
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/debug                                                           b46de15d-33e7-4cd0-aa7c-e7be2a61e71b   in service    100 GiB   none          gzip-9     
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/local_storage                                                   2db6b7c1-0f46-4ced-a3ad-48872793360e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/local_storage                                                   09b9cc9b-3426-470b-a7bc-538f82dede03   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/local_storage                                                   c31623de-c19b-4615-9f1d-5e1daa5d3bda   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/local_storage_unencrypted                                             775f9207-c42d-4af2-9186-27ffef67735e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/local_storage_unencrypted                                             3560dd69-3b23-4c69-807d-d673104cfc68   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/local_storage_unencrypted                                             2ad1875a-92ac-472f-8c26-593309f0e4da   in service    none      none          off        
+   oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone/oxz_nexus_1e2010ea-5755-425c-beca-2a78fec27ecf             71228bc8-80b4-4ca3-8075-403f970c25f7   in service    none      none          off        


    omicron zones:
    -----------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition    underlay IP          
    -----------------------------------------------------------------------------------------------------------------------
    clickhouse        353b3b65-20f7-48c3-88f7-495bd5d31545   artifact: version 1.0.0   in service     fd00:1122:3344:102::5
    crucible          86a22a56-0168-453d-9df1-cb2a7c64b5d3   artifact: version 1.0.0   in service     fd00:1122:3344:102::a
    crucible          bd354eef-d8a6-4165-9124-283fb5e46d77   artifact: version 1.0.0   in service     fd00:1122:3344:102::8
    crucible          e2fdefe7-95b2-4fd2-ae37-56929a06d58c   artifact: version 1.0.0   in service     fd00:1122:3344:102::9
    crucible_pantry   ad6a3a03-8d0f-4504-99a4-cbf73d69b973   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:102::7
    crucible_pantry   c484718d-c38b-42d5-8171-743e0fd5e5b7   artifact: version 1.0.0   in service     fd00:1122:3344:102::d
    external_dns      6c3ae381-04f7-41ea-b0ac-74db387dbc3a   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:102::6
    external_dns      c821c39d-2b2c-4c55-8874-ac12315ba1e4   artifact: version 1.0.0   in service     fd00:1122:3344:102::c
    internal_dns      99e2f30b-3174-40bf-a78a-90da8abba8ca   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:1::1  
    internal_dns      a729999a-6e45-46ca-b51e-0bbb5490387a   artifact: version 1.0.0   in service     fd00:1122:3344:1::1  
    internal_ntp      62620961-fc4a-481e-968b-f5acbac0dc63   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:102::3
    internal_ntp      c74e3068-8b20-4a62-953b-dab703a442db   artifact: version 1.0.0   in service     fd00:1122:3344:102::b
    nexus             466a9f29-62bf-4e63-924a-b9efdb86afec   artifact: version 0.0.1   in service     fd00:1122:3344:102::4
+   nexus             1e2010ea-5755-425c-beca-2a78fec27ecf   artifact: version 1.0.0   in service     fd00:1122:3344:102::e


  sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 (active, config generation 16 -> 17):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-073979dd-3248-44a5-9fa1-cc72a140d682   in service 
    fake-vendor   fake-model   serial-c6d33b64-fb96-4129-bab1-7878a06a5f9b   in service 
    fake-vendor   fake-model   serial-e4d937e1-6ddc-4eca-bb08-c1f73791e608   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crucible                                                              335e1dc3-b610-48dd-90bb-9ca5cce1a6d0   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crucible                                                              d5fef28b-4ee8-4443-8c06-7e872c2502f3   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crucible                                                              6477f019-088c-43cf-8508-aa93f868830f   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    02c56a30-7d97-406d-bd34-1eb437fd517d   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    162a2b3f-5fce-4d91-8353-2e3479184b10   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    fbd8f5eb-baa1-4e8f-9124-a48e5341b41f   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    4d7e3e8e-06bd-414c-a468-779e056a9b75   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone                                                            4617d206-4330-4dfa-b9f3-f63a3db834f9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone                                                            4f60b534-eaa3-40a1-b60f-bfdf147af478   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone                                                            ad41be71-6c15-4428-b510-20ceacde4fa6   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone/oxz_crucible_058fd5f9-60a8-4e11-9302-15172782e17d          55a2a61a-1471-49b2-a6d0-b191ed94e057   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_5199c033-4cf9-4ab6-8ae7-566bd7606363          90b46084-4238-45ba-9e26-d3f2623e640e   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_crucible_dfac80b4-a887-430a-ae87-a4e065dba787          bcdc7bf3-bbae-4e7f-81b2-4d94c8f752a4   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_637cd92b-79c8-459a-a1a7-98abde49bdbc   4fecda40-5cf6-4bc4-9bfc-5a9ddc85438a   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_ba4994a8-23f9-4b1a-a84f-a08d74591389   50b029e3-96aa-41e5-bf39-023193a4355e   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_4b2a2238-6721-4e83-ad61-c4611712ca74      70815b76-b7a0-4286-8987-795d539912ba   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_803bfb63-c246-41db-b0da-d3b87ddfc63d      ea8a11bf-a884-4c4f-8df0-3ef9b7aacf43   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_427ec88f-f467-42fa-9bbb-66a91a36103c      7b4ce6bf-95bb-42fe-a4a0-dff31211ab88   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_cc6fdaf4-0195-4cef-950d-7bacd7059787      5d6116c2-ade3-4246-8d02-5591d2622c10   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_0c71b3b2-6ceb-4e8f-b020-b08675e83038             832fd140-d467-4bad-b5e9-63171634087c   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_6444f8a5-6465-4f0b-a549-1993c113569c               42430c80-7836-4191-a4f6-bcee749010fe   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_a690b03d-c29b-471d-ba2b-6d8de82299b4               b72697f0-0058-4c7b-b647-dab4c8b1715d   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/debug                                                           248c6c10-1ac6-45de-bb55-ede36ca56bbd   in service    100 GiB   none          gzip-9     
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/debug                                                           686c19cf-a0d7-45f6-866f-c564612b2664   in service    100 GiB   none          gzip-9     
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/debug                                                           1bca7f71-5e42-4749-91ec-fa40793a3a9a   in service    100 GiB   none          gzip-9     
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/local_storage                                                   cdf3684f-a6cf-4449-b9ec-e696b2c663e2   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/local_storage                                                   3ac089c9-9dec-465b-863a-188e80d71fb4   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/local_storage                                                   43931274-7fe8-4077-825d-dff2bc8efa58   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/local_storage_unencrypted                                             793ac181-1b01-403c-850d-7f5c54bda6c9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/local_storage_unencrypted                                             a4c3032e-21fa-4d4a-b040-a7e3c572cf3c   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/local_storage_unencrypted                                             4847a96e-a267-4ae7-aa3d-805c1e77f81e   in service    none      none          off        
+   oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_nexus_fda5966d-4d7e-4769-b398-186af4ffd98f             87b35d5f-dce7-425a-84fc-0b6546a33f52   in service    none      none          off        


    omicron zones:
    -----------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition    underlay IP          
    -----------------------------------------------------------------------------------------------------------------------
    crucible          058fd5f9-60a8-4e11-9302-15172782e17d   artifact: version 1.0.0   in service     fd00:1122:3344:101::9
    crucible          5199c033-4cf9-4ab6-8ae7-566bd7606363   artifact: version 1.0.0   in service     fd00:1122:3344:101::7
    crucible          dfac80b4-a887-430a-ae87-a4e065dba787   artifact: version 1.0.0   in service     fd00:1122:3344:101::8
    crucible_pantry   637cd92b-79c8-459a-a1a7-98abde49bdbc   artifact: version 1.0.0   in service     fd00:1122:3344:101::c
    crucible_pantry   ba4994a8-23f9-4b1a-a84f-a08d74591389   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:101::6
    external_dns      4b2a2238-6721-4e83-ad61-c4611712ca74   artifact: version 1.0.0   in service     fd00:1122:3344:101::b
    external_dns      803bfb63-c246-41db-b0da-d3b87ddfc63d   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:101::5
    internal_dns      427ec88f-f467-42fa-9bbb-66a91a36103c   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:2::1  
    internal_dns      cc6fdaf4-0195-4cef-950d-7bacd7059787   artifact: version 1.0.0   in service     fd00:1122:3344:2::1  
    internal_ntp      6444f8a5-6465-4f0b-a549-1993c113569c   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:101::3
    internal_ntp      a690b03d-c29b-471d-ba2b-6d8de82299b4   artifact: version 1.0.0   in service     fd00:1122:3344:101::a
    nexus             0c71b3b2-6ceb-4e8f-b020-b08675e83038   artifact: version 0.0.1   in service     fd00:1122:3344:101::4
+   nexus             fda5966d-4d7e-4769-b398-186af4ffd98f   artifact: version 1.0.0   in service     fd00:1122:3344:101::d


  sled d81c6a84-79b8-4958-ae41-ea46c9b19763 (active, config generation 16 -> 17):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-18b20749-0748-4105-bb10-7b13cfc776e2   in service 
    fake-vendor   fake-model   serial-30c16fe4-4229-49d0-ab01-3138f2c7dff2   in service 
    fake-vendor   fake-model   serial-4930954e-9ac7-4453-b63f-5ab97c389a99   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crucible                                                              ba9311dd-89ac-47db-a5e8-d64e8a5fcf70   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crucible                                                              3c2cb304-a466-4ab5-8597-5db8172e2388   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crucible                                                              41107868-c6cc-4ec4-9159-aed688c3ceaf   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/external_dns                                                    429da94b-19f7-48bd-98e9-47842863ba7b   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/external_dns                                                    6f2feeac-a819-447d-9331-64f19d1507ed   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    c2782fb5-af50-401f-92eb-dc0937e2cae2   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    3443a368-199e-4d26-b59f-3f2bbd507761   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone                                                            45cd9687-20be-4247-b62a-dfdacf324929   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone                                                            252ac39f-b9e2-4697-8c07-3a833115d704   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone                                                            1cb0a47a-59ac-4892-8e92-cf87b4290f96   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone/oxz_crucible_694bd14f-cb24-4be4-bb19-876e79cda2c8          543fc3b8-08eb-4e5e-9e05-cf7a91732d5d   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone/oxz_crucible_7c252b64-c5af-4ec1-989e-9a03f3b0f111          3d9537b8-05be-4b1b-a051-f47becf8ec75   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_f55647d4-5500-4ad3-893a-df45bd50d622          c895e8d5-1434-4ecf-8d46-9bf1ecc8cbc9   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_75b220ba-a0f4-4872-8202-dc7c87f062d0   a50cd13a-5749-4e79-bb8b-19229500a8b3   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_7fbd0103-d7f8-48a5-b95e-29bf812cac1f   49336223-f6df-4fe7-bd9f-95123c5622a9   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_external_dns_90dbd6f3-9bcb-4a62-ad85-d61f5b3a36ad      ecb27354-877c-4a24-8982-1298a222ca1c   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_external_dns_f6ec9c67-946a-4da3-98d5-581f72ce8bf0      6f04dd20-5e2c-4fa8-8430-a886470ed140   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_b5edcb10-9ba0-4fd7-9583-1617e5b4b452      1d6eef5e-daab-470c-9aa3-2c92894468ff   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_ea5b4030-b52f-44b2-8d70-45f15f987d01      7ea73f80-c4e0-450a-92dc-8397ce2af14f   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_nexus_3eeb8d49-eb1a-43f8-bb64-c2338421c2c6             50ea8c15-c4c0-4403-a490-d14b3405dfc2   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f10a4fb9-759f-4a65-b25e-5794ad2d07d8               54bbadaf-ec04-41a2-a62f-f5ac5bf321be   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f4d7ec7b-5e5c-4c90-97f2-2ac9d4588a01               b24bee8e-82a0-4b4d-a57c-77a1010f3e38   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/debug                                                           7a6a2058-ea78-49de-9730-cce5e28b4cfb   in service    100 GiB   none          gzip-9     
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/debug                                                           21fd4f3a-ec31-469b-87b1-087c343a2422   in service    100 GiB   none          gzip-9     
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/debug                                                           b1deff4b-51df-4a37-9043-afbd7c70a1cb   in service    100 GiB   none          gzip-9     
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/local_storage                                                   41071985-1dfd-4ce5-8bc2-897161a8bce4   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/local_storage                                                   c65a9c1c-36dc-4ddb-8aac-ec3be8dbb209   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/local_storage                                                   090bd88d-0a43-4040-a832-b13ae721f74f   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/local_storage_unencrypted                                             e009d8b8-4695-4322-b53f-f03f2744aef7   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/local_storage_unencrypted                                             4da74a5b-6911-4cca-b624-b90c65530117   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/local_storage_unencrypted                                             96ae8389-3027-4260-9374-e0f6ce851de2   in service    none      none          off        
+   oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone/oxz_nexus_e9a0e47d-3dad-4dd5-b4b5-19c1ce38b7ea             cde682bf-e713-498b-9020-f2270bf25391   in service    none      none          off        


    omicron zones:
    -----------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition    underlay IP          
    -----------------------------------------------------------------------------------------------------------------------
    crucible          694bd14f-cb24-4be4-bb19-876e79cda2c8   artifact: version 1.0.0   in service     fd00:1122:3344:103::8
    crucible          7c252b64-c5af-4ec1-989e-9a03f3b0f111   artifact: version 1.0.0   in service     fd00:1122:3344:103::9
    crucible          f55647d4-5500-4ad3-893a-df45bd50d622   artifact: version 1.0.0   in service     fd00:1122:3344:103::7
    crucible_pantry   75b220ba-a0f4-4872-8202-dc7c87f062d0   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:103::6
    crucible_pantry   7fbd0103-d7f8-48a5-b95e-29bf812cac1f   artifact: version 1.0.0   in service     fd00:1122:3344:103::a
    external_dns      90dbd6f3-9bcb-4a62-ad85-d61f5b3a36ad   artifact: version 1.0.0   in service     fd00:1122:3344:103::c
    external_dns      f6ec9c67-946a-4da3-98d5-581f72ce8bf0   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:103::5
    internal_dns      b5edcb10-9ba0-4fd7-9583-1617e5b4b452   artifact: version 1.0.0   in service     fd00:1122:3344:3::1  
    internal_dns      ea5b4030-b52f-44b2-8d70-45f15f987d01   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:3::1  
    internal_ntp      f10a4fb9-759f-4a65-b25e-5794ad2d07d8   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:103::3
    internal_ntp      f4d7ec7b-5e5c-4c90-97f2-2ac9d4588a01   artifact: version 1.0.0   in service     fd00:1122:3344:103::b
    nexus             3eeb8d49-eb1a-43f8-bb64-c2338421c2c6   artifact: version 0.0.1   in service     fd00:1122:3344:103::4
+   nexus             e9a0e47d-3dad-4dd5-b4b5-19c1ce38b7ea   artifact: version 1.0.0   in service     fd00:1122:3344:103::d


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   1 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # Update inventory to reflect the three Nexus zones starting.
> sled-set 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron-config latest
set sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron config from latest blueprint (12f19448-6a10-4b4b-ae19-a8c94a566097)

> sled-set 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron-config latest
set sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron config from latest blueprint (12f19448-6a10-4b4b-ae19-a8c94a566097)

> sled-set d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron-config latest
set sled d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron config from latest blueprint (12f19448-6a10-4b4b-ae19-a8c94a566097)

> inventory-generate
generated inventory collection 5ffc4b23-0e6e-40e9-bacd-f83ca33f9792 from configured sleds


> # Planning now should bump the top-level `nexus_generation` to 2, indicating
> # that we want handoff to begin.
> # Note that `blueprint-diff` will show the DNS changes as though the handoff has
> # happened already because that command does not take into account simulated
> # state.
> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 10, num_already_artifact: 10, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 4713f6c4-e8ba-4a28-87a0-df75ebf7b8b6 based on parent blueprint 12f19448-6a10-4b4b-ae19-a8c94a566097
blueprint source: planner with report:
planning report:
* 3 remaining out-of-date zones
* 3 zones waiting to be expunged:
  * zone 0c71b3b2-6ceb-4e8f-b020-b08675e83038: nexus image out-of-date, but nexus_generation 1 is still active
  * zone 3eeb8d49-eb1a-43f8-bb64-c2338421c2c6: nexus image out-of-date, but nexus_generation 1 is still active
  * zone 466a9f29-62bf-4e63-924a-b9efdb86afec: nexus image out-of-date, but nexus_generation 1 is still active
* updating top-level nexus_generation to: 2



> blueprint-diff latest
from: blueprint 12f19448-6a10-4b4b-ae19-a8c94a566097
to:   blueprint 4713f6c4-e8ba-4a28-87a0-df75ebf7b8b6

 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
*   nexus gen::::::::::::::   1 -> 2

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
* DNS zone: "control-plane.oxide.internal": 
-   name: 0c71b3b2-6ceb-4e8f-b020-b08675e83038.host          (records: 1)
-       AAAA fd00:1122:3344:101::4
+   name: 1e2010ea-5755-425c-beca-2a78fec27ecf.host          (records: 1)
+       AAAA fd00:1122:3344:102::e
-   name: 3eeb8d49-eb1a-43f8-bb64-c2338421c2c6.host          (records: 1)
-       AAAA fd00:1122:3344:103::4
-   name: 466a9f29-62bf-4e63-924a-b9efdb86afec.host          (records: 1)
-       AAAA fd00:1122:3344:102::4
*   name: _nexus-lockstep._tcp                               (records: 3 -> 3)
-       SRV  port 12232 0c71b3b2-6ceb-4e8f-b020-b08675e83038.host.control-plane.oxide.internal
-       SRV  port 12232 3eeb8d49-eb1a-43f8-bb64-c2338421c2c6.host.control-plane.oxide.internal
-       SRV  port 12232 466a9f29-62bf-4e63-924a-b9efdb86afec.host.control-plane.oxide.internal
+       SRV  port 12232 1e2010ea-5755-425c-beca-2a78fec27ecf.host.control-plane.oxide.internal
+       SRV  port 12232 e9a0e47d-3dad-4dd5-b4b5-19c1ce38b7ea.host.control-plane.oxide.internal
+       SRV  port 12232 fda5966d-4d7e-4769-b398-186af4ffd98f.host.control-plane.oxide.internal
*   name: _nexus._tcp                                        (records: 3 -> 3)
-       SRV  port 12221 0c71b3b2-6ceb-4e8f-b020-b08675e83038.host.control-plane.oxide.internal
-       SRV  port 12221 3eeb8d49-eb1a-43f8-bb64-c2338421c2c6.host.control-plane.oxide.internal
-       SRV  port 12221 466a9f29-62bf-4e63-924a-b9efdb86afec.host.control-plane.oxide.internal
+       SRV  port 12221 1e2010ea-5755-425c-beca-2a78fec27ecf.host.control-plane.oxide.internal
+       SRV  port 12221 e9a0e47d-3dad-4dd5-b4b5-19c1ce38b7ea.host.control-plane.oxide.internal
+       SRV  port 12221 fda5966d-4d7e-4769-b398-186af4ffd98f.host.control-plane.oxide.internal
+   name: e9a0e47d-3dad-4dd5-b4b5-19c1ce38b7ea.host          (records: 1)
+       AAAA fd00:1122:3344:103::d
+   name: fda5966d-4d7e-4769-b398-186af4ffd98f.host          (records: 1)
+       AAAA fd00:1122:3344:101::d
    unchanged names: 47 (records: 59)

external DNS:
* DNS zone: "oxide.example": 
*   name: example-silo.sys                                   (records: 3 -> 3)
-       A    192.0.2.2
-       A    192.0.2.3
-       A    192.0.2.4
+       A    192.0.2.7
+       A    192.0.2.6
+       A    192.0.2.5
    unchanged names: 4 (records: 6)




> # Planning again should make no changes: we haven't yet performed a handoff,
> # so the old Nexus zones are still in charge.
> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 10, num_already_artifact: 10, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 6d830d26-547e-492b-adfe-c5c4ad9c3751 based on parent blueprint 4713f6c4-e8ba-4a28-87a0-df75ebf7b8b6
blueprint source: planner with report:
planning report:
* 3 remaining out-of-date zones
* 3 zones waiting to be expunged:
  * zone 0c71b3b2-6ceb-4e8f-b020-b08675e83038: nexus image out-of-date, but nexus_generation 1 is still active
  * zone 3eeb8d49-eb1a-43f8-bb64-c2338421c2c6: nexus image out-of-date, but nexus_generation 1 is still active
  * zone 466a9f29-62bf-4e63-924a-b9efdb86afec: nexus image out-of-date, but nexus_generation 1 is still active



> blueprint-diff latest
from: blueprint 4713f6c4-e8ba-4a28-87a0-df75ebf7b8b6
to:   blueprint 6d830d26-547e-492b-adfe-c5c4ad9c3751

 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   2 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # If we expunge one of the OLD nexuses, we should observe
> # that it is re-created.
> blueprint-edit latest expunge-zones 0c71b3b2-6ceb-4e8f-b020-b08675e83038
blueprint 8e0cc787-e068-4a45-97ed-21029cbe4ddf created from latest blueprint (6d830d26-547e-492b-adfe-c5c4ad9c3751): expunged zone 0c71b3b2-6ceb-4e8f-b020-b08675e83038 from sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6


> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 10, num_already_artifact: 10, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (17) that is older than the generation in the parent blueprint (18)
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint e31c9054-8549-4c68-acf9-a01f68d1fc9b based on parent blueprint 8e0cc787-e068-4a45-97ed-21029cbe4ddf
blueprint source: planner with report:
planning report:
* discretionary zones placed:
  * nexus zone on sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 from source artifact: version 0.0.1
* zone updates waiting on discretionary zones



> blueprint-diff latest
from: blueprint 8e0cc787-e068-4a45-97ed-21029cbe4ddf
to:   blueprint e31c9054-8549-4c68-acf9-a01f68d1fc9b

 MODIFIED SLEDS:

  sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 (active, config generation 18 -> 19):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-073979dd-3248-44a5-9fa1-cc72a140d682   in service 
    fake-vendor   fake-model   serial-c6d33b64-fb96-4129-bab1-7878a06a5f9b   in service 
    fake-vendor   fake-model   serial-e4d937e1-6ddc-4eca-bb08-c1f73791e608   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crucible                                                              335e1dc3-b610-48dd-90bb-9ca5cce1a6d0   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crucible                                                              d5fef28b-4ee8-4443-8c06-7e872c2502f3   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crucible                                                              6477f019-088c-43cf-8508-aa93f868830f   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    02c56a30-7d97-406d-bd34-1eb437fd517d   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    162a2b3f-5fce-4d91-8353-2e3479184b10   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    fbd8f5eb-baa1-4e8f-9124-a48e5341b41f   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    4d7e3e8e-06bd-414c-a468-779e056a9b75   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone                                                            4617d206-4330-4dfa-b9f3-f63a3db834f9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone                                                            4f60b534-eaa3-40a1-b60f-bfdf147af478   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone                                                            ad41be71-6c15-4428-b510-20ceacde4fa6   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone/oxz_crucible_058fd5f9-60a8-4e11-9302-15172782e17d          55a2a61a-1471-49b2-a6d0-b191ed94e057   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_5199c033-4cf9-4ab6-8ae7-566bd7606363          90b46084-4238-45ba-9e26-d3f2623e640e   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_crucible_dfac80b4-a887-430a-ae87-a4e065dba787          bcdc7bf3-bbae-4e7f-81b2-4d94c8f752a4   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_637cd92b-79c8-459a-a1a7-98abde49bdbc   4fecda40-5cf6-4bc4-9bfc-5a9ddc85438a   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_ba4994a8-23f9-4b1a-a84f-a08d74591389   50b029e3-96aa-41e5-bf39-023193a4355e   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_4b2a2238-6721-4e83-ad61-c4611712ca74      70815b76-b7a0-4286-8987-795d539912ba   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_803bfb63-c246-41db-b0da-d3b87ddfc63d      ea8a11bf-a884-4c4f-8df0-3ef9b7aacf43   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_427ec88f-f467-42fa-9bbb-66a91a36103c      7b4ce6bf-95bb-42fe-a4a0-dff31211ab88   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_cc6fdaf4-0195-4cef-950d-7bacd7059787      5d6116c2-ade3-4246-8d02-5591d2622c10   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_0c71b3b2-6ceb-4e8f-b020-b08675e83038             832fd140-d467-4bad-b5e9-63171634087c   expunged      none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_nexus_fda5966d-4d7e-4769-b398-186af4ffd98f             87b35d5f-dce7-425a-84fc-0b6546a33f52   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_6444f8a5-6465-4f0b-a549-1993c113569c               42430c80-7836-4191-a4f6-bcee749010fe   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_a690b03d-c29b-471d-ba2b-6d8de82299b4               b72697f0-0058-4c7b-b647-dab4c8b1715d   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/debug                                                           248c6c10-1ac6-45de-bb55-ede36ca56bbd   in service    100 GiB   none          gzip-9     
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/debug                                                           686c19cf-a0d7-45f6-866f-c564612b2664   in service    100 GiB   none          gzip-9     
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/debug                                                           1bca7f71-5e42-4749-91ec-fa40793a3a9a   in service    100 GiB   none          gzip-9     
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/local_storage                                                   cdf3684f-a6cf-4449-b9ec-e696b2c663e2   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/local_storage                                                   3ac089c9-9dec-465b-863a-188e80d71fb4   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/local_storage                                                   43931274-7fe8-4077-825d-dff2bc8efa58   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/local_storage_unencrypted                                             793ac181-1b01-403c-850d-7f5c54bda6c9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/local_storage_unencrypted                                             a4c3032e-21fa-4d4a-b040-a7e3c572cf3c   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/local_storage_unencrypted                                             4847a96e-a267-4ae7-aa3d-805c1e77f81e   in service    none      none          off        
+   oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_44ea25df-71cb-47a8-b82c-c0b5e8f43931             4d49718e-3dbe-4ed5-ad11-3315e1a1921d   in service    none      none          off        


    omicron zones:
    -----------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition    underlay IP          
    -----------------------------------------------------------------------------------------------------------------------
    crucible          058fd5f9-60a8-4e11-9302-15172782e17d   artifact: version 1.0.0   in service     fd00:1122:3344:101::9
    crucible          5199c033-4cf9-4ab6-8ae7-566bd7606363   artifact: version 1.0.0   in service     fd00:1122:3344:101::7
    crucible          dfac80b4-a887-430a-ae87-a4e065dba787   artifact: version 1.0.0   in service     fd00:1122:3344:101::8
    crucible_pantry   637cd92b-79c8-459a-a1a7-98abde49bdbc   artifact: version 1.0.0   in service     fd00:1122:3344:101::c
    crucible_pantry   ba4994a8-23f9-4b1a-a84f-a08d74591389   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:101::6
    external_dns      4b2a2238-6721-4e83-ad61-c4611712ca74   artifact: version 1.0.0   in service     fd00:1122:3344:101::b
    external_dns      803bfb63-c246-41db-b0da-d3b87ddfc63d   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:101::5
    internal_dns      427ec88f-f467-42fa-9bbb-66a91a36103c   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:2::1  
    internal_dns      cc6fdaf4-0195-4cef-950d-7bacd7059787   artifact: version 1.0.0   in service     fd00:1122:3344:2::1  
    internal_ntp      6444f8a5-6465-4f0b-a549-1993c113569c   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:101::3
    internal_ntp      a690b03d-c29b-471d-ba2b-6d8de82299b4   artifact: version 1.0.0   in service     fd00:1122:3344:101::a
    nexus             0c71b3b2-6ceb-4e8f-b020-b08675e83038   artifact: version 0.0.1   expunged ⏳     fd00:1122:3344:101::4
    nexus             fda5966d-4d7e-4769-b398-186af4ffd98f   artifact: version 1.0.0   in service     fd00:1122:3344:101::d
+   nexus             44ea25df-71cb-47a8-b82c-c0b5e8f43931   artifact: version 0.0.1   in service     fd00:1122:3344:101::e


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   2 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)



> sled-set 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron-config latest
set sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron config from latest blueprint (e31c9054-8549-4c68-acf9-a01f68d1fc9b)

> inventory-generate
generated inventory collection 2c0e8abf-b92d-4682-be5f-f0fa1e9e5b2a from configured sleds


> # Bump the set of active Nexus zones; this simulates Nexus handoff.
> set active-nexus-gen 2
will use active Nexus zones from generation 2


> # Planning should now expunge one of the old Nexus zones.
> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 10, num_already_artifact: 10, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 3e332949-6785-4aff-ad86-6134f5ce6152 based on parent blueprint e31c9054-8549-4c68-acf9-a01f68d1fc9b
blueprint source: planner with report:
planning report:
* 1 out-of-date zone expunged:
  * sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, zone 466a9f29-62bf-4e63-924a-b9efdb86afec (nexus)
* 2 remaining out-of-date zones



> blueprint-diff latest
from: blueprint e31c9054-8549-4c68-acf9-a01f68d1fc9b
to:   blueprint 3e332949-6785-4aff-ad86-6134f5ce6152

 MODIFIED SLEDS:

  sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c (active, config generation 18 -> 19):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-727522a7-934f-494d-b5b3-160968e74463   in service 
    fake-vendor   fake-model   serial-72c59873-31ff-4e36-8d76-ff834009349a   in service 
    fake-vendor   fake-model   serial-b5fd5bc1-099e-4e77-8028-a9793c11f43b   in service 


    datasets:
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition    quota     reservation   compression
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_727522a7-934f-494d-b5b3-160968e74463/crucible                                                              feecfda1-9966-43d4-aaef-440b77f0b26d   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crucible                                                              956966b9-8201-437b-81ba-3c8ad2032080   in service     none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crucible                                                              4b0b09bf-94b7-45bf-a6b3-d46af53ae44a   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/clickhouse                                                      5ae11c7e-08fa-4d78-a4ea-14b4a9a10241   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    3e0d6188-c503-49cf-a441-fa7df40ceb43   expunged       none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    5c01fdbd-ff37-44b4-a17b-6d625e6fa48d   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    a2e6e726-7cf1-432d-9ca7-b7cde2f1f742   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    b8f2a09f-8bd2-4418-872b-a4457a3f958c   expunged       none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone                                                            4829f422-aa31-41a8-ab73-95684ff1ef48   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone                                                            3b66453b-7148-4c1b-84a9-499e43290ab4   in service     none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone                                                            841d5648-05f0-47b0-b446-92f6b60fe9a6   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_clickhouse_353b3b65-20f7-48c3-88f7-495bd5d31545        49f8fbb6-5bac-4609-907f-6e3dfc206059   in service     none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone/oxz_crucible_86a22a56-0168-453d-9df1-cb2a7c64b5d3          6e218d0a-13fd-4f70-884e-47e960fa8bb8   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_bd354eef-d8a6-4165-9124-283fb5e46d77          9073fb6b-f973-4bbd-b7cc-ba1abf6cb238   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone/oxz_crucible_e2fdefe7-95b2-4fd2-ae37-56929a06d58c          0582030b-aab6-4d0e-b1d2-64562ee712cd   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_ad6a3a03-8d0f-4504-99a4-cbf73d69b973   1640adb6-70bf-44cf-b05c-bff6dd300cf3   expunged       none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_c484718d-c38b-42d5-8171-743e0fd5e5b7   e9d249aa-4d3a-49c6-8d94-52fef693f8b9   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_6c3ae381-04f7-41ea-b0ac-74db387dbc3a      78f34ce7-42f1-41da-995f-318f32054ad2   expunged       none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_c821c39d-2b2c-4c55-8874-ac12315ba1e4      a21812e1-1b80-4faa-9f2b-51189e0f6999   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_99e2f30b-3174-40bf-a78a-90da8abba8ca      2f204c50-a327-479c-8852-f53ec7a19c1f   expunged       none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_a729999a-6e45-46ca-b51e-0bbb5490387a      eece684d-17ae-4aae-93b3-6928f26722c2   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone/oxz_nexus_1e2010ea-5755-425c-beca-2a78fec27ecf             71228bc8-80b4-4ca3-8075-403f970c25f7   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_62620961-fc4a-481e-968b-f5acbac0dc63               8c4fa711-1d5d-4e93-85f0-d17bff47b063   expunged       none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_c74e3068-8b20-4a62-953b-dab703a442db               5b087884-f80b-4a4f-a672-6e088753933e   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/debug                                                           93957ca0-9ed1-4e7b-8c34-2ce07a69541c   in service     100 GiB   none          gzip-9     
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/debug                                                           318fae85-abcb-4259-b1b6-ac96d193f7b7   in service     100 GiB   none          gzip-9     
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/debug                                                           b46de15d-33e7-4cd0-aa7c-e7be2a61e71b   in service     100 GiB   none          gzip-9     
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/local_storage                                                   2db6b7c1-0f46-4ced-a3ad-48872793360e   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/local_storage                                                   09b9cc9b-3426-470b-a7bc-538f82dede03   in service     none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/local_storage                                                   c31623de-c19b-4615-9f1d-5e1daa5d3bda   in service     none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/local_storage_unencrypted                                             775f9207-c42d-4af2-9186-27ffef67735e   in service     none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/local_storage_unencrypted                                             3560dd69-3b23-4c69-807d-d673104cfc68   in service     none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/local_storage_unencrypted                                             2ad1875a-92ac-472f-8c26-593309f0e4da   in service     none      none          off        
*   oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_nexus_466a9f29-62bf-4e63-924a-b9efdb86afec             8e0bd2bd-23b7-4bc6-9e73-c4d4ebc0bc8c   - in service   none      none          off        
     └─                                                                                                                                                   + expunged                                        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    clickhouse        353b3b65-20f7-48c3-88f7-495bd5d31545   artifact: version 1.0.0   in service       fd00:1122:3344:102::5
    crucible          86a22a56-0168-453d-9df1-cb2a7c64b5d3   artifact: version 1.0.0   in service       fd00:1122:3344:102::a
    crucible          bd354eef-d8a6-4165-9124-283fb5e46d77   artifact: version 1.0.0   in service       fd00:1122:3344:102::8
    crucible          e2fdefe7-95b2-4fd2-ae37-56929a06d58c   artifact: version 1.0.0   in service       fd00:1122:3344:102::9
    crucible_pantry   ad6a3a03-8d0f-4504-99a4-cbf73d69b973   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:102::7
    crucible_pantry   c484718d-c38b-42d5-8171-743e0fd5e5b7   artifact: version 1.0.0   in service       fd00:1122:3344:102::d
    external_dns      6c3ae381-04f7-41ea-b0ac-74db387dbc3a   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:102::6
    external_dns      c821c39d-2b2c-4c55-8874-ac12315ba1e4   artifact: version 1.0.0   in service       fd00:1122:3344:102::c
    internal_dns      99e2f30b-3174-40bf-a78a-90da8abba8ca   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:1::1  
    internal_dns      a729999a-6e45-46ca-b51e-0bbb5490387a   artifact: version 1.0.0   in service       fd00:1122:3344:1::1  
    internal_ntp      62620961-fc4a-481e-968b-f5acbac0dc63   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:102::3
    internal_ntp      c74e3068-8b20-4a62-953b-dab703a442db   artifact: version 1.0.0   in service       fd00:1122:3344:102::b
    nexus             1e2010ea-5755-425c-beca-2a78fec27ecf   artifact: version 1.0.0   in service       fd00:1122:3344:102::e
*   nexus             466a9f29-62bf-4e63-924a-b9efdb86afec   artifact: version 0.0.1   - in service     fd00:1122:3344:102::4
     └─                                                                                + expunged ⏳                          


  sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 (active, config generation 19):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-073979dd-3248-44a5-9fa1-cc72a140d682   in service 
    fake-vendor   fake-model   serial-c6d33b64-fb96-4129-bab1-7878a06a5f9b   in service 
    fake-vendor   fake-model   serial-e4d937e1-6ddc-4eca-bb08-c1f73791e608   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crucible                                                              335e1dc3-b610-48dd-90bb-9ca5cce1a6d0   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crucible                                                              d5fef28b-4ee8-4443-8c06-7e872c2502f3   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crucible                                                              6477f019-088c-43cf-8508-aa93f868830f   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    162a2b3f-5fce-4d91-8353-2e3479184b10   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    02c56a30-7d97-406d-bd34-1eb437fd517d   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    4d7e3e8e-06bd-414c-a468-779e056a9b75   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    fbd8f5eb-baa1-4e8f-9124-a48e5341b41f   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone                                                            4617d206-4330-4dfa-b9f3-f63a3db834f9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone                                                            4f60b534-eaa3-40a1-b60f-bfdf147af478   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone                                                            ad41be71-6c15-4428-b510-20ceacde4fa6   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone/oxz_crucible_058fd5f9-60a8-4e11-9302-15172782e17d          55a2a61a-1471-49b2-a6d0-b191ed94e057   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_5199c033-4cf9-4ab6-8ae7-566bd7606363          90b46084-4238-45ba-9e26-d3f2623e640e   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_crucible_dfac80b4-a887-430a-ae87-a4e065dba787          bcdc7bf3-bbae-4e7f-81b2-4d94c8f752a4   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_637cd92b-79c8-459a-a1a7-98abde49bdbc   4fecda40-5cf6-4bc4-9bfc-5a9ddc85438a   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_ba4994a8-23f9-4b1a-a84f-a08d74591389   50b029e3-96aa-41e5-bf39-023193a4355e   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_4b2a2238-6721-4e83-ad61-c4611712ca74      70815b76-b7a0-4286-8987-795d539912ba   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_803bfb63-c246-41db-b0da-d3b87ddfc63d      ea8a11bf-a884-4c4f-8df0-3ef9b7aacf43   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_427ec88f-f467-42fa-9bbb-66a91a36103c      7b4ce6bf-95bb-42fe-a4a0-dff31211ab88   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_cc6fdaf4-0195-4cef-950d-7bacd7059787      5d6116c2-ade3-4246-8d02-5591d2622c10   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_0c71b3b2-6ceb-4e8f-b020-b08675e83038             832fd140-d467-4bad-b5e9-63171634087c   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_44ea25df-71cb-47a8-b82c-c0b5e8f43931             4d49718e-3dbe-4ed5-ad11-3315e1a1921d   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_nexus_fda5966d-4d7e-4769-b398-186af4ffd98f             87b35d5f-dce7-425a-84fc-0b6546a33f52   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_6444f8a5-6465-4f0b-a549-1993c113569c               42430c80-7836-4191-a4f6-bcee749010fe   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_a690b03d-c29b-471d-ba2b-6d8de82299b4               b72697f0-0058-4c7b-b647-dab4c8b1715d   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/debug                                                           248c6c10-1ac6-45de-bb55-ede36ca56bbd   in service    100 GiB   none          gzip-9     
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/debug                                                           686c19cf-a0d7-45f6-866f-c564612b2664   in service    100 GiB   none          gzip-9     
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/debug                                                           1bca7f71-5e42-4749-91ec-fa40793a3a9a   in service    100 GiB   none          gzip-9     
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/local_storage                                                   cdf3684f-a6cf-4449-b9ec-e696b2c663e2   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/local_storage                                                   3ac089c9-9dec-465b-863a-188e80d71fb4   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/local_storage                                                   43931274-7fe8-4077-825d-dff2bc8efa58   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/local_storage_unencrypted                                             793ac181-1b01-403c-850d-7f5c54bda6c9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/local_storage_unencrypted                                             a4c3032e-21fa-4d4a-b040-a7e3c572cf3c   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/local_storage_unencrypted                                             4847a96e-a267-4ae7-aa3d-805c1e77f81e   in service    none      none          off        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    crucible          058fd5f9-60a8-4e11-9302-15172782e17d   artifact: version 1.0.0   in service       fd00:1122:3344:101::9
    crucible          5199c033-4cf9-4ab6-8ae7-566bd7606363   artifact: version 1.0.0   in service       fd00:1122:3344:101::7
    crucible          dfac80b4-a887-430a-ae87-a4e065dba787   artifact: version 1.0.0   in service       fd00:1122:3344:101::8
    crucible_pantry   637cd92b-79c8-459a-a1a7-98abde49bdbc   artifact: version 1.0.0   in service       fd00:1122:3344:101::c
    crucible_pantry   ba4994a8-23f9-4b1a-a84f-a08d74591389   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:101::6
    external_dns      4b2a2238-6721-4e83-ad61-c4611712ca74   artifact: version 1.0.0   in service       fd00:1122:3344:101::b
    external_dns      803bfb63-c246-41db-b0da-d3b87ddfc63d   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:101::5
    internal_dns      427ec88f-f467-42fa-9bbb-66a91a36103c   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:2::1  
    internal_dns      cc6fdaf4-0195-4cef-950d-7bacd7059787   artifact: version 1.0.0   in service       fd00:1122:3344:2::1  
    internal_ntp      6444f8a5-6465-4f0b-a549-1993c113569c   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:101::3
    internal_ntp      a690b03d-c29b-471d-ba2b-6d8de82299b4   artifact: version 1.0.0   in service       fd00:1122:3344:101::a
    nexus             44ea25df-71cb-47a8-b82c-c0b5e8f43931   artifact: version 0.0.1   in service       fd00:1122:3344:101::e
    nexus             fda5966d-4d7e-4769-b398-186af4ffd98f   artifact: version 1.0.0   in service       fd00:1122:3344:101::d
*   nexus             0c71b3b2-6ceb-4e8f-b020-b08675e83038   artifact: version 0.0.1   - expunged ⏳     fd00:1122:3344:101::4
     └─                                                                                + expunged ✓                          


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   2 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # Two more planning iterations should expunge the remaining two old 0.0.1
> # version Nexus zones.
> blueprint-plan latest latest
INFO skipped noop image source check on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, reason: inventory stale: inventory reported generation (18) that is older than the generation in the parent blueprint (19)
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 05685571-d61f-4754-a2b2-604ea8c45dff based on parent blueprint 3e332949-6785-4aff-ad86-6134f5ce6152
blueprint source: planner with report:
planning report:
* 1 out-of-date zone expunged:
  * sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, zone 44ea25df-71cb-47a8-b82c-c0b5e8f43931 (nexus)
* 1 remaining out-of-date zone



> blueprint-diff latest
from: blueprint 3e332949-6785-4aff-ad86-6134f5ce6152
to:   blueprint 05685571-d61f-4754-a2b2-604ea8c45dff

 MODIFIED SLEDS:

  sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 (active, config generation 19 -> 20):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-073979dd-3248-44a5-9fa1-cc72a140d682   in service 
    fake-vendor   fake-model   serial-c6d33b64-fb96-4129-bab1-7878a06a5f9b   in service 
    fake-vendor   fake-model   serial-e4d937e1-6ddc-4eca-bb08-c1f73791e608   in service 


    datasets:
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition    quota     reservation   compression
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crucible                                                              335e1dc3-b610-48dd-90bb-9ca5cce1a6d0   in service     none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crucible                                                              d5fef28b-4ee8-4443-8c06-7e872c2502f3   in service     none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crucible                                                              6477f019-088c-43cf-8508-aa93f868830f   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    02c56a30-7d97-406d-bd34-1eb437fd517d   expunged       none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    162a2b3f-5fce-4d91-8353-2e3479184b10   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    fbd8f5eb-baa1-4e8f-9124-a48e5341b41f   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    4d7e3e8e-06bd-414c-a468-779e056a9b75   expunged       none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone                                                            4617d206-4330-4dfa-b9f3-f63a3db834f9   in service     none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone                                                            4f60b534-eaa3-40a1-b60f-bfdf147af478   in service     none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone                                                            ad41be71-6c15-4428-b510-20ceacde4fa6   in service     none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone/oxz_crucible_058fd5f9-60a8-4e11-9302-15172782e17d          55a2a61a-1471-49b2-a6d0-b191ed94e057   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_5199c033-4cf9-4ab6-8ae7-566bd7606363          90b46084-4238-45ba-9e26-d3f2623e640e   in service     none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_crucible_dfac80b4-a887-430a-ae87-a4e065dba787          bcdc7bf3-bbae-4e7f-81b2-4d94c8f752a4   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_637cd92b-79c8-459a-a1a7-98abde49bdbc   4fecda40-5cf6-4bc4-9bfc-5a9ddc85438a   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_ba4994a8-23f9-4b1a-a84f-a08d74591389   50b029e3-96aa-41e5-bf39-023193a4355e   expunged       none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_4b2a2238-6721-4e83-ad61-c4611712ca74      70815b76-b7a0-4286-8987-795d539912ba   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_803bfb63-c246-41db-b0da-d3b87ddfc63d      ea8a11bf-a884-4c4f-8df0-3ef9b7aacf43   expunged       none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_427ec88f-f467-42fa-9bbb-66a91a36103c      7b4ce6bf-95bb-42fe-a4a0-dff31211ab88   expunged       none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_cc6fdaf4-0195-4cef-950d-7bacd7059787      5d6116c2-ade3-4246-8d02-5591d2622c10   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_0c71b3b2-6ceb-4e8f-b020-b08675e83038             832fd140-d467-4bad-b5e9-63171634087c   expunged       none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_nexus_fda5966d-4d7e-4769-b398-186af4ffd98f             87b35d5f-dce7-425a-84fc-0b6546a33f52   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_6444f8a5-6465-4f0b-a549-1993c113569c               42430c80-7836-4191-a4f6-bcee749010fe   expunged       none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_a690b03d-c29b-471d-ba2b-6d8de82299b4               b72697f0-0058-4c7b-b647-dab4c8b1715d   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/debug                                                           248c6c10-1ac6-45de-bb55-ede36ca56bbd   in service     100 GiB   none          gzip-9     
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/debug                                                           686c19cf-a0d7-45f6-866f-c564612b2664   in service     100 GiB   none          gzip-9     
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/debug                                                           1bca7f71-5e42-4749-91ec-fa40793a3a9a   in service     100 GiB   none          gzip-9     
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/local_storage                                                   cdf3684f-a6cf-4449-b9ec-e696b2c663e2   in service     none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/local_storage                                                   3ac089c9-9dec-465b-863a-188e80d71fb4   in service     none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/local_storage                                                   43931274-7fe8-4077-825d-dff2bc8efa58   in service     none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/local_storage_unencrypted                                             793ac181-1b01-403c-850d-7f5c54bda6c9   in service     none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/local_storage_unencrypted                                             a4c3032e-21fa-4d4a-b040-a7e3c572cf3c   in service     none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/local_storage_unencrypted                                             4847a96e-a267-4ae7-aa3d-805c1e77f81e   in service     none      none          off        
*   oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_44ea25df-71cb-47a8-b82c-c0b5e8f43931             4d49718e-3dbe-4ed5-ad11-3315e1a1921d   - in service   none      none          off        
     └─                                                                                                                                                   + expunged                                        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    crucible          058fd5f9-60a8-4e11-9302-15172782e17d   artifact: version 1.0.0   in service       fd00:1122:3344:101::9
    crucible          5199c033-4cf9-4ab6-8ae7-566bd7606363   artifact: version 1.0.0   in service       fd00:1122:3344:101::7
    crucible          dfac80b4-a887-430a-ae87-a4e065dba787   artifact: version 1.0.0   in service       fd00:1122:3344:101::8
    crucible_pantry   637cd92b-79c8-459a-a1a7-98abde49bdbc   artifact: version 1.0.0   in service       fd00:1122:3344:101::c
    crucible_pantry   ba4994a8-23f9-4b1a-a84f-a08d74591389   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:101::6
    external_dns      4b2a2238-6721-4e83-ad61-c4611712ca74   artifact: version 1.0.0   in service       fd00:1122:3344:101::b
    external_dns      803bfb63-c246-41db-b0da-d3b87ddfc63d   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:101::5
    internal_dns      427ec88f-f467-42fa-9bbb-66a91a36103c   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:2::1  
    internal_dns      cc6fdaf4-0195-4cef-950d-7bacd7059787   artifact: version 1.0.0   in service       fd00:1122:3344:2::1  
    internal_ntp      6444f8a5-6465-4f0b-a549-1993c113569c   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:101::3
    internal_ntp      a690b03d-c29b-471d-ba2b-6d8de82299b4   artifact: version 1.0.0   in service       fd00:1122:3344:101::a
    nexus             0c71b3b2-6ceb-4e8f-b020-b08675e83038   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:101::4
    nexus             fda5966d-4d7e-4769-b398-186af4ffd98f   artifact: version 1.0.0   in service       fd00:1122:3344:101::d
*   nexus             44ea25df-71cb-47a8-b82c-c0b5e8f43931   artifact: version 0.0.1   - in service     fd00:1122:3344:101::e
     └─                                                                                + expunged ⏳                          


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   2 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)



> blueprint-plan latest latest
INFO skipped noop image source check on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, reason: inventory stale: inventory reported generation (18) that is older than the generation in the parent blueprint (19)
INFO skipped noop image source check on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, reason: inventory stale: inventory reported generation (19) that is older than the generation in the parent blueprint (20)
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 008e1541-3d9d-4a50-a877-eed4a3cf86ab based on parent blueprint 05685571-d61f-4754-a2b2-604ea8c45dff
blueprint source: planner with report:
planning report:
* 1 out-of-date zone expunged:
  * sled d81c6a84-79b8-4958-ae41-ea46c9b19763, zone 3eeb8d49-eb1a-43f8-bb64-c2338421c2c6 (nexus)
* 0 remaining out-of-date zones



> blueprint-diff latest
from: blueprint 05685571-d61f-4754-a2b2-604ea8c45dff
to:   blueprint 008e1541-3d9d-4a50-a877-eed4a3cf86ab

 MODIFIED SLEDS:

  sled d81c6a84-79b8-4958-ae41-ea46c9b19763 (active, config generation 17 -> 18):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-18b20749-0748-4105-bb10-7b13cfc776e2   in service 
    fake-vendor   fake-model   serial-30c16fe4-4229-49d0-ab01-3138f2c7dff2   in service 
    fake-vendor   fake-model   serial-4930954e-9ac7-4453-b63f-5ab97c389a99   in service 


    datasets:
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition    quota     reservation   compression
    --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crucible                                                              ba9311dd-89ac-47db-a5e8-d64e8a5fcf70   in service     none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crucible                                                              3c2cb304-a466-4ab5-8597-5db8172e2388   in service     none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crucible                                                              41107868-c6cc-4ec4-9159-aed688c3ceaf   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/external_dns                                                    429da94b-19f7-48bd-98e9-47842863ba7b   expunged       none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/external_dns                                                    6f2feeac-a819-447d-9331-64f19d1507ed   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    c2782fb5-af50-401f-92eb-dc0937e2cae2   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    3443a368-199e-4d26-b59f-3f2bbd507761   expunged       none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone                                                            45cd9687-20be-4247-b62a-dfdacf324929   in service     none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone                                                            252ac39f-b9e2-4697-8c07-3a833115d704   in service     none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone                                                            1cb0a47a-59ac-4892-8e92-cf87b4290f96   in service     none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone/oxz_crucible_694bd14f-cb24-4be4-bb19-876e79cda2c8          543fc3b8-08eb-4e5e-9e05-cf7a91732d5d   in service     none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone/oxz_crucible_7c252b64-c5af-4ec1-989e-9a03f3b0f111          3d9537b8-05be-4b1b-a051-f47becf8ec75   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_f55647d4-5500-4ad3-893a-df45bd50d622          c895e8d5-1434-4ecf-8d46-9bf1ecc8cbc9   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_75b220ba-a0f4-4872-8202-dc7c87f062d0   a50cd13a-5749-4e79-bb8b-19229500a8b3   expunged       none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_7fbd0103-d7f8-48a5-b95e-29bf812cac1f   49336223-f6df-4fe7-bd9f-95123c5622a9   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_external_dns_90dbd6f3-9bcb-4a62-ad85-d61f5b3a36ad      ecb27354-877c-4a24-8982-1298a222ca1c   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_external_dns_f6ec9c67-946a-4da3-98d5-581f72ce8bf0      6f04dd20-5e2c-4fa8-8430-a886470ed140   expunged       none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_b5edcb10-9ba0-4fd7-9583-1617e5b4b452      1d6eef5e-daab-470c-9aa3-2c92894468ff   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_ea5b4030-b52f-44b2-8d70-45f15f987d01      7ea73f80-c4e0-450a-92dc-8397ce2af14f   expunged       none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone/oxz_nexus_e9a0e47d-3dad-4dd5-b4b5-19c1ce38b7ea             cde682bf-e713-498b-9020-f2270bf25391   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f10a4fb9-759f-4a65-b25e-5794ad2d07d8               54bbadaf-ec04-41a2-a62f-f5ac5bf321be   expunged       none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f4d7ec7b-5e5c-4c90-97f2-2ac9d4588a01               b24bee8e-82a0-4b4d-a57c-77a1010f3e38   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/debug                                                           7a6a2058-ea78-49de-9730-cce5e28b4cfb   in service     100 GiB   none          gzip-9     
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/debug                                                           21fd4f3a-ec31-469b-87b1-087c343a2422   in service     100 GiB   none          gzip-9     
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/debug                                                           b1deff4b-51df-4a37-9043-afbd7c70a1cb   in service     100 GiB   none          gzip-9     
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/local_storage                                                   41071985-1dfd-4ce5-8bc2-897161a8bce4   in service     none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/local_storage                                                   c65a9c1c-36dc-4ddb-8aac-ec3be8dbb209   in service     none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/local_storage                                                   090bd88d-0a43-4040-a832-b13ae721f74f   in service     none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/local_storage_unencrypted                                             e009d8b8-4695-4322-b53f-f03f2744aef7   in service     none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/local_storage_unencrypted                                             4da74a5b-6911-4cca-b624-b90c65530117   in service     none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/local_storage_unencrypted                                             96ae8389-3027-4260-9374-e0f6ce851de2   in service     none      none          off        
*   oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_nexus_3eeb8d49-eb1a-43f8-bb64-c2338421c2c6             50ea8c15-c4c0-4403-a490-d14b3405dfc2   - in service   none      none          off        
     └─                                                                                                                                                   + expunged                                        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    crucible          694bd14f-cb24-4be4-bb19-876e79cda2c8   artifact: version 1.0.0   in service       fd00:1122:3344:103::8
    crucible          7c252b64-c5af-4ec1-989e-9a03f3b0f111   artifact: version 1.0.0   in service       fd00:1122:3344:103::9
    crucible          f55647d4-5500-4ad3-893a-df45bd50d622   artifact: version 1.0.0   in service       fd00:1122:3344:103::7
    crucible_pantry   75b220ba-a0f4-4872-8202-dc7c87f062d0   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:103::6
    crucible_pantry   7fbd0103-d7f8-48a5-b95e-29bf812cac1f   artifact: version 1.0.0   in service       fd00:1122:3344:103::a
    external_dns      90dbd6f3-9bcb-4a62-ad85-d61f5b3a36ad   artifact: version 1.0.0   in service       fd00:1122:3344:103::c
    external_dns      f6ec9c67-946a-4da3-98d5-581f72ce8bf0   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:103::5
    internal_dns      b5edcb10-9ba0-4fd7-9583-1617e5b4b452   artifact: version 1.0.0   in service       fd00:1122:3344:3::1  
    internal_dns      ea5b4030-b52f-44b2-8d70-45f15f987d01   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:3::1  
    internal_ntp      f10a4fb9-759f-4a65-b25e-5794ad2d07d8   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:103::3
    internal_ntp      f4d7ec7b-5e5c-4c90-97f2-2ac9d4588a01   artifact: version 1.0.0   in service       fd00:1122:3344:103::b
    nexus             e9a0e47d-3dad-4dd5-b4b5-19c1ce38b7ea   artifact: version 1.0.0   in service       fd00:1122:3344:103::d
*   nexus             3eeb8d49-eb1a-43f8-bb64-c2338421c2c6   artifact: version 0.0.1   - in service     fd00:1122:3344:103::4
     └─                                                                                + expunged ⏳                          


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   2 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)




> # Update sled configs and inventory to reflect the expunged Nexus zones.
> sled-set 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron-config latest
set sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c omicron config from latest blueprint (008e1541-3d9d-4a50-a877-eed4a3cf86ab)

> sled-set 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron-config latest
set sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 omicron config from latest blueprint (008e1541-3d9d-4a50-a877-eed4a3cf86ab)

> sled-set d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron-config latest
set sled d81c6a84-79b8-4958-ae41-ea46c9b19763 omicron config from latest blueprint (008e1541-3d9d-4a50-a877-eed4a3cf86ab)

> inventory-generate
generated inventory collection a838e97f-3fe3-475a-9dcf-760577308807 from configured sleds


> # Planning now should note that the old zones are gone, but do nothing else:
> # the update is complete. All in-service zones have image sources from the new
> # TUF repo, and all zones using old images are expunged.
> blueprint-plan latest latest
INFO performed noop zone image source checks on sled, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, num_total: 9, num_already_artifact: 9, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO performed noop zone image source checks on sled, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, num_total: 8, num_already_artifact: 8, num_eligible: 0, num_ineligible: 0
INFO BootPartitionDetails inventory hash not found in TUF repo, ignoring for noop checks, sled_id: d81c6a84-79b8-4958-ae41-ea46c9b19763, slot: a, expected_hash: 0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a0a
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial0, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial1, part_number: 913-0000019
INFO skipping board for MGS-driven update (no update necessary), serial_number: serial2, part_number: 913-0000019
INFO ran out of boards for MGS-driven update
generated blueprint 310670a1-8ec3-4579-b1d9-3137808a18d7 based on parent blueprint 008e1541-3d9d-4a50-a877-eed4a3cf86ab
blueprint source: planner with report:
empty planning report



> blueprint-diff latest
from: blueprint 008e1541-3d9d-4a50-a877-eed4a3cf86ab
to:   blueprint 310670a1-8ec3-4579-b1d9-3137808a18d7

 MODIFIED SLEDS:

  sled 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c (active, config generation 19):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-727522a7-934f-494d-b5b3-160968e74463   in service 
    fake-vendor   fake-model   serial-72c59873-31ff-4e36-8d76-ff834009349a   in service 
    fake-vendor   fake-model   serial-b5fd5bc1-099e-4e77-8028-a9793c11f43b   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_727522a7-934f-494d-b5b3-160968e74463/crucible                                                              feecfda1-9966-43d4-aaef-440b77f0b26d   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crucible                                                              956966b9-8201-437b-81ba-3c8ad2032080   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crucible                                                              4b0b09bf-94b7-45bf-a6b3-d46af53ae44a   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/clickhouse                                                      5ae11c7e-08fa-4d78-a4ea-14b4a9a10241   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    5c01fdbd-ff37-44b4-a17b-6d625e6fa48d   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    3e0d6188-c503-49cf-a441-fa7df40ceb43   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    a2e6e726-7cf1-432d-9ca7-b7cde2f1f742   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    b8f2a09f-8bd2-4418-872b-a4457a3f958c   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone                                                            4829f422-aa31-41a8-ab73-95684ff1ef48   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone                                                            3b66453b-7148-4c1b-84a9-499e43290ab4   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone                                                            841d5648-05f0-47b0-b446-92f6b60fe9a6   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_clickhouse_353b3b65-20f7-48c3-88f7-495bd5d31545        49f8fbb6-5bac-4609-907f-6e3dfc206059   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone/oxz_crucible_86a22a56-0168-453d-9df1-cb2a7c64b5d3          6e218d0a-13fd-4f70-884e-47e960fa8bb8   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_bd354eef-d8a6-4165-9124-283fb5e46d77          9073fb6b-f973-4bbd-b7cc-ba1abf6cb238   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone/oxz_crucible_e2fdefe7-95b2-4fd2-ae37-56929a06d58c          0582030b-aab6-4d0e-b1d2-64562ee712cd   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_ad6a3a03-8d0f-4504-99a4-cbf73d69b973   1640adb6-70bf-44cf-b05c-bff6dd300cf3   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_c484718d-c38b-42d5-8171-743e0fd5e5b7   e9d249aa-4d3a-49c6-8d94-52fef693f8b9   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_6c3ae381-04f7-41ea-b0ac-74db387dbc3a      78f34ce7-42f1-41da-995f-318f32054ad2   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_c821c39d-2b2c-4c55-8874-ac12315ba1e4      a21812e1-1b80-4faa-9f2b-51189e0f6999   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_99e2f30b-3174-40bf-a78a-90da8abba8ca      2f204c50-a327-479c-8852-f53ec7a19c1f   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_a729999a-6e45-46ca-b51e-0bbb5490387a      eece684d-17ae-4aae-93b3-6928f26722c2   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone/oxz_nexus_1e2010ea-5755-425c-beca-2a78fec27ecf             71228bc8-80b4-4ca3-8075-403f970c25f7   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_nexus_466a9f29-62bf-4e63-924a-b9efdb86afec             8e0bd2bd-23b7-4bc6-9e73-c4d4ebc0bc8c   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_62620961-fc4a-481e-968b-f5acbac0dc63               8c4fa711-1d5d-4e93-85f0-d17bff47b063   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_c74e3068-8b20-4a62-953b-dab703a442db               5b087884-f80b-4a4f-a672-6e088753933e   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/debug                                                           93957ca0-9ed1-4e7b-8c34-2ce07a69541c   in service    100 GiB   none          gzip-9     
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/debug                                                           318fae85-abcb-4259-b1b6-ac96d193f7b7   in service    100 GiB   none          gzip-9     
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/debug                                                           b46de15d-33e7-4cd0-aa7c-e7be2a61e71b   in service    100 GiB   none          gzip-9     
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/local_storage                                                   2db6b7c1-0f46-4ced-a3ad-48872793360e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/local_storage                                                   09b9cc9b-3426-470b-a7bc-538f82dede03   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/local_storage                                                   c31623de-c19b-4615-9f1d-5e1daa5d3bda   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/local_storage_unencrypted                                             775f9207-c42d-4af2-9186-27ffef67735e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/local_storage_unencrypted                                             3560dd69-3b23-4c69-807d-d673104cfc68   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/local_storage_unencrypted                                             2ad1875a-92ac-472f-8c26-593309f0e4da   in service    none      none          off        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    clickhouse        353b3b65-20f7-48c3-88f7-495bd5d31545   artifact: version 1.0.0   in service       fd00:1122:3344:102::5
    crucible          86a22a56-0168-453d-9df1-cb2a7c64b5d3   artifact: version 1.0.0   in service       fd00:1122:3344:102::a
    crucible          bd354eef-d8a6-4165-9124-283fb5e46d77   artifact: version 1.0.0   in service       fd00:1122:3344:102::8
    crucible          e2fdefe7-95b2-4fd2-ae37-56929a06d58c   artifact: version 1.0.0   in service       fd00:1122:3344:102::9
    crucible_pantry   ad6a3a03-8d0f-4504-99a4-cbf73d69b973   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:102::7
    crucible_pantry   c484718d-c38b-42d5-8171-743e0fd5e5b7   artifact: version 1.0.0   in service       fd00:1122:3344:102::d
    external_dns      6c3ae381-04f7-41ea-b0ac-74db387dbc3a   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:102::6
    external_dns      c821c39d-2b2c-4c55-8874-ac12315ba1e4   artifact: version 1.0.0   in service       fd00:1122:3344:102::c
    internal_dns      99e2f30b-3174-40bf-a78a-90da8abba8ca   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:1::1  
    internal_dns      a729999a-6e45-46ca-b51e-0bbb5490387a   artifact: version 1.0.0   in service       fd00:1122:3344:1::1  
    internal_ntp      62620961-fc4a-481e-968b-f5acbac0dc63   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:102::3
    internal_ntp      c74e3068-8b20-4a62-953b-dab703a442db   artifact: version 1.0.0   in service       fd00:1122:3344:102::b
    nexus             1e2010ea-5755-425c-beca-2a78fec27ecf   artifact: version 1.0.0   in service       fd00:1122:3344:102::e
*   nexus             466a9f29-62bf-4e63-924a-b9efdb86afec   artifact: version 0.0.1   - expunged ⏳     fd00:1122:3344:102::4
     └─                                                                                + expunged ✓                          


  sled 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6 (active, config generation 20):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-073979dd-3248-44a5-9fa1-cc72a140d682   in service 
    fake-vendor   fake-model   serial-c6d33b64-fb96-4129-bab1-7878a06a5f9b   in service 
    fake-vendor   fake-model   serial-e4d937e1-6ddc-4eca-bb08-c1f73791e608   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crucible                                                              335e1dc3-b610-48dd-90bb-9ca5cce1a6d0   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crucible                                                              d5fef28b-4ee8-4443-8c06-7e872c2502f3   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crucible                                                              6477f019-088c-43cf-8508-aa93f868830f   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    162a2b3f-5fce-4d91-8353-2e3479184b10   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    02c56a30-7d97-406d-bd34-1eb437fd517d   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    4d7e3e8e-06bd-414c-a468-779e056a9b75   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    fbd8f5eb-baa1-4e8f-9124-a48e5341b41f   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone                                                            4617d206-4330-4dfa-b9f3-f63a3db834f9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone                                                            4f60b534-eaa3-40a1-b60f-bfdf147af478   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone                                                            ad41be71-6c15-4428-b510-20ceacde4fa6   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone/oxz_crucible_058fd5f9-60a8-4e11-9302-15172782e17d          55a2a61a-1471-49b2-a6d0-b191ed94e057   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_5199c033-4cf9-4ab6-8ae7-566bd7606363          90b46084-4238-45ba-9e26-d3f2623e640e   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_crucible_dfac80b4-a887-430a-ae87-a4e065dba787          bcdc7bf3-bbae-4e7f-81b2-4d94c8f752a4   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_637cd92b-79c8-459a-a1a7-98abde49bdbc   4fecda40-5cf6-4bc4-9bfc-5a9ddc85438a   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_ba4994a8-23f9-4b1a-a84f-a08d74591389   50b029e3-96aa-41e5-bf39-023193a4355e   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_4b2a2238-6721-4e83-ad61-c4611712ca74      70815b76-b7a0-4286-8987-795d539912ba   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_803bfb63-c246-41db-b0da-d3b87ddfc63d      ea8a11bf-a884-4c4f-8df0-3ef9b7aacf43   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_427ec88f-f467-42fa-9bbb-66a91a36103c      7b4ce6bf-95bb-42fe-a4a0-dff31211ab88   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_cc6fdaf4-0195-4cef-950d-7bacd7059787      5d6116c2-ade3-4246-8d02-5591d2622c10   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_0c71b3b2-6ceb-4e8f-b020-b08675e83038             832fd140-d467-4bad-b5e9-63171634087c   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_44ea25df-71cb-47a8-b82c-c0b5e8f43931             4d49718e-3dbe-4ed5-ad11-3315e1a1921d   expunged      none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_nexus_fda5966d-4d7e-4769-b398-186af4ffd98f             87b35d5f-dce7-425a-84fc-0b6546a33f52   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_6444f8a5-6465-4f0b-a549-1993c113569c               42430c80-7836-4191-a4f6-bcee749010fe   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_a690b03d-c29b-471d-ba2b-6d8de82299b4               b72697f0-0058-4c7b-b647-dab4c8b1715d   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/debug                                                           248c6c10-1ac6-45de-bb55-ede36ca56bbd   in service    100 GiB   none          gzip-9     
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/debug                                                           686c19cf-a0d7-45f6-866f-c564612b2664   in service    100 GiB   none          gzip-9     
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/debug                                                           1bca7f71-5e42-4749-91ec-fa40793a3a9a   in service    100 GiB   none          gzip-9     
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/local_storage                                                   cdf3684f-a6cf-4449-b9ec-e696b2c663e2   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/local_storage                                                   3ac089c9-9dec-465b-863a-188e80d71fb4   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/local_storage                                                   43931274-7fe8-4077-825d-dff2bc8efa58   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/local_storage_unencrypted                                             793ac181-1b01-403c-850d-7f5c54bda6c9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/local_storage_unencrypted                                             a4c3032e-21fa-4d4a-b040-a7e3c572cf3c   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/local_storage_unencrypted                                             4847a96e-a267-4ae7-aa3d-805c1e77f81e   in service    none      none          off        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    crucible          058fd5f9-60a8-4e11-9302-15172782e17d   artifact: version 1.0.0   in service       fd00:1122:3344:101::9
    crucible          5199c033-4cf9-4ab6-8ae7-566bd7606363   artifact: version 1.0.0   in service       fd00:1122:3344:101::7
    crucible          dfac80b4-a887-430a-ae87-a4e065dba787   artifact: version 1.0.0   in service       fd00:1122:3344:101::8
    crucible_pantry   637cd92b-79c8-459a-a1a7-98abde49bdbc   artifact: version 1.0.0   in service       fd00:1122:3344:101::c
    crucible_pantry   ba4994a8-23f9-4b1a-a84f-a08d74591389   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:101::6
    external_dns      4b2a2238-6721-4e83-ad61-c4611712ca74   artifact: version 1.0.0   in service       fd00:1122:3344:101::b
    external_dns      803bfb63-c246-41db-b0da-d3b87ddfc63d   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:101::5
    internal_dns      427ec88f-f467-42fa-9bbb-66a91a36103c   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:2::1  
    internal_dns      cc6fdaf4-0195-4cef-950d-7bacd7059787   artifact: version 1.0.0   in service       fd00:1122:3344:2::1  
    internal_ntp      6444f8a5-6465-4f0b-a549-1993c113569c   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:101::3
    internal_ntp      a690b03d-c29b-471d-ba2b-6d8de82299b4   artifact: version 1.0.0   in service       fd00:1122:3344:101::a
    nexus             0c71b3b2-6ceb-4e8f-b020-b08675e83038   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:101::4
    nexus             fda5966d-4d7e-4769-b398-186af4ffd98f   artifact: version 1.0.0   in service       fd00:1122:3344:101::d
*   nexus             44ea25df-71cb-47a8-b82c-c0b5e8f43931   artifact: version 0.0.1   - expunged ⏳     fd00:1122:3344:101::e
     └─                                                                                + expunged ✓                          


  sled d81c6a84-79b8-4958-ae41-ea46c9b19763 (active, config generation 18):

    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-18b20749-0748-4105-bb10-7b13cfc776e2   in service 
    fake-vendor   fake-model   serial-30c16fe4-4229-49d0-ab01-3138f2c7dff2   in service 
    fake-vendor   fake-model   serial-4930954e-9ac7-4453-b63f-5ab97c389a99   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crucible                                                              ba9311dd-89ac-47db-a5e8-d64e8a5fcf70   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crucible                                                              3c2cb304-a466-4ab5-8597-5db8172e2388   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crucible                                                              41107868-c6cc-4ec4-9159-aed688c3ceaf   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/external_dns                                                    429da94b-19f7-48bd-98e9-47842863ba7b   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/external_dns                                                    6f2feeac-a819-447d-9331-64f19d1507ed   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    c2782fb5-af50-401f-92eb-dc0937e2cae2   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    3443a368-199e-4d26-b59f-3f2bbd507761   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone                                                            45cd9687-20be-4247-b62a-dfdacf324929   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone                                                            252ac39f-b9e2-4697-8c07-3a833115d704   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone                                                            1cb0a47a-59ac-4892-8e92-cf87b4290f96   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone/oxz_crucible_694bd14f-cb24-4be4-bb19-876e79cda2c8          543fc3b8-08eb-4e5e-9e05-cf7a91732d5d   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone/oxz_crucible_7c252b64-c5af-4ec1-989e-9a03f3b0f111          3d9537b8-05be-4b1b-a051-f47becf8ec75   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_f55647d4-5500-4ad3-893a-df45bd50d622          c895e8d5-1434-4ecf-8d46-9bf1ecc8cbc9   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_75b220ba-a0f4-4872-8202-dc7c87f062d0   a50cd13a-5749-4e79-bb8b-19229500a8b3   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_7fbd0103-d7f8-48a5-b95e-29bf812cac1f   49336223-f6df-4fe7-bd9f-95123c5622a9   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_external_dns_90dbd6f3-9bcb-4a62-ad85-d61f5b3a36ad      ecb27354-877c-4a24-8982-1298a222ca1c   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_external_dns_f6ec9c67-946a-4da3-98d5-581f72ce8bf0      6f04dd20-5e2c-4fa8-8430-a886470ed140   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_b5edcb10-9ba0-4fd7-9583-1617e5b4b452      1d6eef5e-daab-470c-9aa3-2c92894468ff   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_ea5b4030-b52f-44b2-8d70-45f15f987d01      7ea73f80-c4e0-450a-92dc-8397ce2af14f   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_nexus_3eeb8d49-eb1a-43f8-bb64-c2338421c2c6             50ea8c15-c4c0-4403-a490-d14b3405dfc2   expunged      none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone/oxz_nexus_e9a0e47d-3dad-4dd5-b4b5-19c1ce38b7ea             cde682bf-e713-498b-9020-f2270bf25391   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f10a4fb9-759f-4a65-b25e-5794ad2d07d8               54bbadaf-ec04-41a2-a62f-f5ac5bf321be   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f4d7ec7b-5e5c-4c90-97f2-2ac9d4588a01               b24bee8e-82a0-4b4d-a57c-77a1010f3e38   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/debug                                                           7a6a2058-ea78-49de-9730-cce5e28b4cfb   in service    100 GiB   none          gzip-9     
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/debug                                                           21fd4f3a-ec31-469b-87b1-087c343a2422   in service    100 GiB   none          gzip-9     
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/debug                                                           b1deff4b-51df-4a37-9043-afbd7c70a1cb   in service    100 GiB   none          gzip-9     
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/local_storage                                                   41071985-1dfd-4ce5-8bc2-897161a8bce4   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/local_storage                                                   c65a9c1c-36dc-4ddb-8aac-ec3be8dbb209   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/local_storage                                                   090bd88d-0a43-4040-a832-b13ae721f74f   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/local_storage_unencrypted                                             e009d8b8-4695-4322-b53f-f03f2744aef7   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/local_storage_unencrypted                                             4da74a5b-6911-4cca-b624-b90c65530117   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/local_storage_unencrypted                                             96ae8389-3027-4260-9374-e0f6ce851de2   in service    none      none          off        


    omicron zones:
    -------------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition      underlay IP          
    -------------------------------------------------------------------------------------------------------------------------
    crucible          694bd14f-cb24-4be4-bb19-876e79cda2c8   artifact: version 1.0.0   in service       fd00:1122:3344:103::8
    crucible          7c252b64-c5af-4ec1-989e-9a03f3b0f111   artifact: version 1.0.0   in service       fd00:1122:3344:103::9
    crucible          f55647d4-5500-4ad3-893a-df45bd50d622   artifact: version 1.0.0   in service       fd00:1122:3344:103::7
    crucible_pantry   75b220ba-a0f4-4872-8202-dc7c87f062d0   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:103::6
    crucible_pantry   7fbd0103-d7f8-48a5-b95e-29bf812cac1f   artifact: version 1.0.0   in service       fd00:1122:3344:103::a
    external_dns      90dbd6f3-9bcb-4a62-ad85-d61f5b3a36ad   artifact: version 1.0.0   in service       fd00:1122:3344:103::c
    external_dns      f6ec9c67-946a-4da3-98d5-581f72ce8bf0   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:103::5
    internal_dns      b5edcb10-9ba0-4fd7-9583-1617e5b4b452   artifact: version 1.0.0   in service       fd00:1122:3344:3::1  
    internal_dns      ea5b4030-b52f-44b2-8d70-45f15f987d01   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:3::1  
    internal_ntp      f10a4fb9-759f-4a65-b25e-5794ad2d07d8   artifact: version 0.0.1   expunged ✓       fd00:1122:3344:103::3
    internal_ntp      f4d7ec7b-5e5c-4c90-97f2-2ac9d4588a01   artifact: version 1.0.0   in service       fd00:1122:3344:103::b
    nexus             e9a0e47d-3dad-4dd5-b4b5-19c1ce38b7ea   artifact: version 1.0.0   in service       fd00:1122:3344:103::d
*   nexus             3eeb8d49-eb1a-43f8-bb64-c2338421c2c6   artifact: version 0.0.1   - expunged ⏳     fd00:1122:3344:103::4
     └─                                                                                + expunged ✓                          


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none) (unchanged)
    cluster.preserve_downgrade_option:   (do not modify) (unchanged)

 METADATA:
    internal DNS version:::   1 (unchanged)
    external DNS version:::   1 (unchanged)
    target release min gen:   1 (unchanged)
    nexus gen::::::::::::::   2 (unchanged)

 OXIMETER SETTINGS:
    generation:   1 (unchanged)
    read from::   SingleNode (unchanged)


internal DNS:
  DNS zone: "control-plane.oxide.internal" (unchanged)
    unchanged names: 52 (records: 68)

external DNS:
  DNS zone: "oxide.example" (unchanged)
    unchanged names: 5 (records: 9)



> blueprint-show latest
blueprint  310670a1-8ec3-4579-b1d9-3137808a18d7
parent:    008e1541-3d9d-4a50-a877-eed4a3cf86ab

  sled: 2b8f0cb3-0295-4b3c-bc58-4fe88b57112c
    state:::::::::::::   active
    config generation:   19
    subnet::::::::::::   fd00:1122:3344:102::/64
    last allocated IP:   fd00:1122:3344:102::e

    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-727522a7-934f-494d-b5b3-160968e74463   in service 
    fake-vendor   fake-model   serial-72c59873-31ff-4e36-8d76-ff834009349a   in service 
    fake-vendor   fake-model   serial-b5fd5bc1-099e-4e77-8028-a9793c11f43b   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_727522a7-934f-494d-b5b3-160968e74463/crucible                                                              feecfda1-9966-43d4-aaef-440b77f0b26d   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crucible                                                              956966b9-8201-437b-81ba-3c8ad2032080   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crucible                                                              4b0b09bf-94b7-45bf-a6b3-d46af53ae44a   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/clickhouse                                                      5ae11c7e-08fa-4d78-a4ea-14b4a9a10241   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    5c01fdbd-ff37-44b4-a17b-6d625e6fa48d   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/external_dns                                                    3e0d6188-c503-49cf-a441-fa7df40ceb43   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    a2e6e726-7cf1-432d-9ca7-b7cde2f1f742   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/internal_dns                                                    b8f2a09f-8bd2-4418-872b-a4457a3f958c   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone                                                            4829f422-aa31-41a8-ab73-95684ff1ef48   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone                                                            3b66453b-7148-4c1b-84a9-499e43290ab4   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone                                                            841d5648-05f0-47b0-b446-92f6b60fe9a6   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_clickhouse_353b3b65-20f7-48c3-88f7-495bd5d31545        49f8fbb6-5bac-4609-907f-6e3dfc206059   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/zone/oxz_crucible_86a22a56-0168-453d-9df1-cb2a7c64b5d3          6e218d0a-13fd-4f70-884e-47e960fa8bb8   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_bd354eef-d8a6-4165-9124-283fb5e46d77          9073fb6b-f973-4bbd-b7cc-ba1abf6cb238   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone/oxz_crucible_e2fdefe7-95b2-4fd2-ae37-56929a06d58c          0582030b-aab6-4d0e-b1d2-64562ee712cd   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_ad6a3a03-8d0f-4504-99a4-cbf73d69b973   1640adb6-70bf-44cf-b05c-bff6dd300cf3   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_crucible_pantry_c484718d-c38b-42d5-8171-743e0fd5e5b7   e9d249aa-4d3a-49c6-8d94-52fef693f8b9   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_6c3ae381-04f7-41ea-b0ac-74db387dbc3a      78f34ce7-42f1-41da-995f-318f32054ad2   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_external_dns_c821c39d-2b2c-4c55-8874-ac12315ba1e4      a21812e1-1b80-4faa-9f2b-51189e0f6999   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_99e2f30b-3174-40bf-a78a-90da8abba8ca      2f204c50-a327-479c-8852-f53ec7a19c1f   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_internal_dns_a729999a-6e45-46ca-b51e-0bbb5490387a      eece684d-17ae-4aae-93b3-6928f26722c2   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/zone/oxz_nexus_1e2010ea-5755-425c-beca-2a78fec27ecf             71228bc8-80b4-4ca3-8075-403f970c25f7   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_nexus_466a9f29-62bf-4e63-924a-b9efdb86afec             8e0bd2bd-23b7-4bc6-9e73-c4d4ebc0bc8c   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_62620961-fc4a-481e-968b-f5acbac0dc63               8c4fa711-1d5d-4e93-85f0-d17bff47b063   expunged      none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/zone/oxz_ntp_c74e3068-8b20-4a62-953b-dab703a442db               5b087884-f80b-4a4f-a672-6e088753933e   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/debug                                                           93957ca0-9ed1-4e7b-8c34-2ce07a69541c   in service    100 GiB   none          gzip-9     
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/debug                                                           318fae85-abcb-4259-b1b6-ac96d193f7b7   in service    100 GiB   none          gzip-9     
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/debug                                                           b46de15d-33e7-4cd0-aa7c-e7be2a61e71b   in service    100 GiB   none          gzip-9     
    oxp_727522a7-934f-494d-b5b3-160968e74463/crypt/local_storage                                                   2db6b7c1-0f46-4ced-a3ad-48872793360e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/crypt/local_storage                                                   09b9cc9b-3426-470b-a7bc-538f82dede03   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/crypt/local_storage                                                   c31623de-c19b-4615-9f1d-5e1daa5d3bda   in service    none      none          off        
    oxp_727522a7-934f-494d-b5b3-160968e74463/local_storage_unencrypted                                             775f9207-c42d-4af2-9186-27ffef67735e   in service    none      none          off        
    oxp_72c59873-31ff-4e36-8d76-ff834009349a/local_storage_unencrypted                                             3560dd69-3b23-4c69-807d-d673104cfc68   in service    none      none          off        
    oxp_b5fd5bc1-099e-4e77-8028-a9793c11f43b/local_storage_unencrypted                                             2ad1875a-92ac-472f-8c26-593309f0e4da   in service    none      none          off        


    omicron zones:
    -----------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition    underlay IP          
    -----------------------------------------------------------------------------------------------------------------------
    clickhouse        353b3b65-20f7-48c3-88f7-495bd5d31545   artifact: version 1.0.0   in service     fd00:1122:3344:102::5
    crucible          86a22a56-0168-453d-9df1-cb2a7c64b5d3   artifact: version 1.0.0   in service     fd00:1122:3344:102::a
    crucible          bd354eef-d8a6-4165-9124-283fb5e46d77   artifact: version 1.0.0   in service     fd00:1122:3344:102::8
    crucible          e2fdefe7-95b2-4fd2-ae37-56929a06d58c   artifact: version 1.0.0   in service     fd00:1122:3344:102::9
    crucible_pantry   ad6a3a03-8d0f-4504-99a4-cbf73d69b973   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:102::7
    crucible_pantry   c484718d-c38b-42d5-8171-743e0fd5e5b7   artifact: version 1.0.0   in service     fd00:1122:3344:102::d
    external_dns      6c3ae381-04f7-41ea-b0ac-74db387dbc3a   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:102::6
    external_dns      c821c39d-2b2c-4c55-8874-ac12315ba1e4   artifact: version 1.0.0   in service     fd00:1122:3344:102::c
    internal_dns      99e2f30b-3174-40bf-a78a-90da8abba8ca   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:1::1  
    internal_dns      a729999a-6e45-46ca-b51e-0bbb5490387a   artifact: version 1.0.0   in service     fd00:1122:3344:1::1  
    internal_ntp      62620961-fc4a-481e-968b-f5acbac0dc63   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:102::3
    internal_ntp      c74e3068-8b20-4a62-953b-dab703a442db   artifact: version 1.0.0   in service     fd00:1122:3344:102::b
    nexus             1e2010ea-5755-425c-beca-2a78fec27ecf   artifact: version 1.0.0   in service     fd00:1122:3344:102::e
    nexus             466a9f29-62bf-4e63-924a-b9efdb86afec   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:102::4



  sled: 98e6b7c2-2efa-41ca-b20a-0a4d61102fe6
    state:::::::::::::   active
    config generation:   20
    subnet::::::::::::   fd00:1122:3344:101::/64
    last allocated IP:   fd00:1122:3344:101::e

    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-073979dd-3248-44a5-9fa1-cc72a140d682   in service 
    fake-vendor   fake-model   serial-c6d33b64-fb96-4129-bab1-7878a06a5f9b   in service 
    fake-vendor   fake-model   serial-e4d937e1-6ddc-4eca-bb08-c1f73791e608   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crucible                                                              335e1dc3-b610-48dd-90bb-9ca5cce1a6d0   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crucible                                                              d5fef28b-4ee8-4443-8c06-7e872c2502f3   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crucible                                                              6477f019-088c-43cf-8508-aa93f868830f   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    162a2b3f-5fce-4d91-8353-2e3479184b10   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/external_dns                                                    02c56a30-7d97-406d-bd34-1eb437fd517d   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    4d7e3e8e-06bd-414c-a468-779e056a9b75   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/internal_dns                                                    fbd8f5eb-baa1-4e8f-9124-a48e5341b41f   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone                                                            4617d206-4330-4dfa-b9f3-f63a3db834f9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone                                                            4f60b534-eaa3-40a1-b60f-bfdf147af478   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone                                                            ad41be71-6c15-4428-b510-20ceacde4fa6   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/zone/oxz_crucible_058fd5f9-60a8-4e11-9302-15172782e17d          55a2a61a-1471-49b2-a6d0-b191ed94e057   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_5199c033-4cf9-4ab6-8ae7-566bd7606363          90b46084-4238-45ba-9e26-d3f2623e640e   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_crucible_dfac80b4-a887-430a-ae87-a4e065dba787          bcdc7bf3-bbae-4e7f-81b2-4d94c8f752a4   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_637cd92b-79c8-459a-a1a7-98abde49bdbc   4fecda40-5cf6-4bc4-9bfc-5a9ddc85438a   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_crucible_pantry_ba4994a8-23f9-4b1a-a84f-a08d74591389   50b029e3-96aa-41e5-bf39-023193a4355e   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_4b2a2238-6721-4e83-ad61-c4611712ca74      70815b76-b7a0-4286-8987-795d539912ba   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_external_dns_803bfb63-c246-41db-b0da-d3b87ddfc63d      ea8a11bf-a884-4c4f-8df0-3ef9b7aacf43   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_427ec88f-f467-42fa-9bbb-66a91a36103c      7b4ce6bf-95bb-42fe-a4a0-dff31211ab88   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_internal_dns_cc6fdaf4-0195-4cef-950d-7bacd7059787      5d6116c2-ade3-4246-8d02-5591d2622c10   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_0c71b3b2-6ceb-4e8f-b020-b08675e83038             832fd140-d467-4bad-b5e9-63171634087c   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_nexus_44ea25df-71cb-47a8-b82c-c0b5e8f43931             4d49718e-3dbe-4ed5-ad11-3315e1a1921d   expunged      none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/zone/oxz_nexus_fda5966d-4d7e-4769-b398-186af4ffd98f             87b35d5f-dce7-425a-84fc-0b6546a33f52   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_6444f8a5-6465-4f0b-a549-1993c113569c               42430c80-7836-4191-a4f6-bcee749010fe   expunged      none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/zone/oxz_ntp_a690b03d-c29b-471d-ba2b-6d8de82299b4               b72697f0-0058-4c7b-b647-dab4c8b1715d   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/debug                                                           248c6c10-1ac6-45de-bb55-ede36ca56bbd   in service    100 GiB   none          gzip-9     
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/debug                                                           686c19cf-a0d7-45f6-866f-c564612b2664   in service    100 GiB   none          gzip-9     
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/debug                                                           1bca7f71-5e42-4749-91ec-fa40793a3a9a   in service    100 GiB   none          gzip-9     
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/crypt/local_storage                                                   cdf3684f-a6cf-4449-b9ec-e696b2c663e2   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/crypt/local_storage                                                   3ac089c9-9dec-465b-863a-188e80d71fb4   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/crypt/local_storage                                                   43931274-7fe8-4077-825d-dff2bc8efa58   in service    none      none          off        
    oxp_073979dd-3248-44a5-9fa1-cc72a140d682/local_storage_unencrypted                                             793ac181-1b01-403c-850d-7f5c54bda6c9   in service    none      none          off        
    oxp_c6d33b64-fb96-4129-bab1-7878a06a5f9b/local_storage_unencrypted                                             a4c3032e-21fa-4d4a-b040-a7e3c572cf3c   in service    none      none          off        
    oxp_e4d937e1-6ddc-4eca-bb08-c1f73791e608/local_storage_unencrypted                                             4847a96e-a267-4ae7-aa3d-805c1e77f81e   in service    none      none          off        


    omicron zones:
    -----------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition    underlay IP          
    -----------------------------------------------------------------------------------------------------------------------
    crucible          058fd5f9-60a8-4e11-9302-15172782e17d   artifact: version 1.0.0   in service     fd00:1122:3344:101::9
    crucible          5199c033-4cf9-4ab6-8ae7-566bd7606363   artifact: version 1.0.0   in service     fd00:1122:3344:101::7
    crucible          dfac80b4-a887-430a-ae87-a4e065dba787   artifact: version 1.0.0   in service     fd00:1122:3344:101::8
    crucible_pantry   637cd92b-79c8-459a-a1a7-98abde49bdbc   artifact: version 1.0.0   in service     fd00:1122:3344:101::c
    crucible_pantry   ba4994a8-23f9-4b1a-a84f-a08d74591389   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:101::6
    external_dns      4b2a2238-6721-4e83-ad61-c4611712ca74   artifact: version 1.0.0   in service     fd00:1122:3344:101::b
    external_dns      803bfb63-c246-41db-b0da-d3b87ddfc63d   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:101::5
    internal_dns      427ec88f-f467-42fa-9bbb-66a91a36103c   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:2::1  
    internal_dns      cc6fdaf4-0195-4cef-950d-7bacd7059787   artifact: version 1.0.0   in service     fd00:1122:3344:2::1  
    internal_ntp      6444f8a5-6465-4f0b-a549-1993c113569c   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:101::3
    internal_ntp      a690b03d-c29b-471d-ba2b-6d8de82299b4   artifact: version 1.0.0   in service     fd00:1122:3344:101::a
    nexus             0c71b3b2-6ceb-4e8f-b020-b08675e83038   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:101::4
    nexus             44ea25df-71cb-47a8-b82c-c0b5e8f43931   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:101::e
    nexus             fda5966d-4d7e-4769-b398-186af4ffd98f   artifact: version 1.0.0   in service     fd00:1122:3344:101::d



  sled: d81c6a84-79b8-4958-ae41-ea46c9b19763
    state:::::::::::::   active
    config generation:   18
    subnet::::::::::::   fd00:1122:3344:103::/64
    last allocated IP:   fd00:1122:3344:103::d

    host phase 2 contents:
    ------------------------------
    slot   boot image source      
    ------------------------------
    A      current contents       
    B      artifact: version 1.0.0


    measurements:
    --------------------------------------------------------------------------------
    hash                                                               version      
    --------------------------------------------------------------------------------
    9830767c45f2a02210a177fabafafe2c84501039289483f72cec299b0c78dbcb   version 1.0.0
    ae9279e9135de75e4e137c6da7f939b5a2eae6d931a7f2205df930e37cd58096   version 1.0.0


    physical disks:
    ------------------------------------------------------------------------------------
    vendor        model        serial                                        disposition
    ------------------------------------------------------------------------------------
    fake-vendor   fake-model   serial-18b20749-0748-4105-bb10-7b13cfc776e2   in service 
    fake-vendor   fake-model   serial-30c16fe4-4229-49d0-ab01-3138f2c7dff2   in service 
    fake-vendor   fake-model   serial-4930954e-9ac7-4453-b63f-5ab97c389a99   in service 


    datasets:
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    dataset name                                                                                                   dataset id                             disposition   quota     reservation   compression
    -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crucible                                                              ba9311dd-89ac-47db-a5e8-d64e8a5fcf70   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crucible                                                              3c2cb304-a466-4ab5-8597-5db8172e2388   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crucible                                                              41107868-c6cc-4ec4-9159-aed688c3ceaf   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/external_dns                                                    429da94b-19f7-48bd-98e9-47842863ba7b   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/external_dns                                                    6f2feeac-a819-447d-9331-64f19d1507ed   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    3443a368-199e-4d26-b59f-3f2bbd507761   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/internal_dns                                                    c2782fb5-af50-401f-92eb-dc0937e2cae2   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone                                                            45cd9687-20be-4247-b62a-dfdacf324929   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone                                                            252ac39f-b9e2-4697-8c07-3a833115d704   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone                                                            1cb0a47a-59ac-4892-8e92-cf87b4290f96   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone/oxz_crucible_694bd14f-cb24-4be4-bb19-876e79cda2c8          543fc3b8-08eb-4e5e-9e05-cf7a91732d5d   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/zone/oxz_crucible_7c252b64-c5af-4ec1-989e-9a03f3b0f111          3d9537b8-05be-4b1b-a051-f47becf8ec75   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_f55647d4-5500-4ad3-893a-df45bd50d622          c895e8d5-1434-4ecf-8d46-9bf1ecc8cbc9   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_75b220ba-a0f4-4872-8202-dc7c87f062d0   a50cd13a-5749-4e79-bb8b-19229500a8b3   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_crucible_pantry_7fbd0103-d7f8-48a5-b95e-29bf812cac1f   49336223-f6df-4fe7-bd9f-95123c5622a9   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_external_dns_90dbd6f3-9bcb-4a62-ad85-d61f5b3a36ad      ecb27354-877c-4a24-8982-1298a222ca1c   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_external_dns_f6ec9c67-946a-4da3-98d5-581f72ce8bf0      6f04dd20-5e2c-4fa8-8430-a886470ed140   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_b5edcb10-9ba0-4fd7-9583-1617e5b4b452      1d6eef5e-daab-470c-9aa3-2c92894468ff   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_internal_dns_ea5b4030-b52f-44b2-8d70-45f15f987d01      7ea73f80-c4e0-450a-92dc-8397ce2af14f   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_nexus_3eeb8d49-eb1a-43f8-bb64-c2338421c2c6             50ea8c15-c4c0-4403-a490-d14b3405dfc2   expunged      none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/zone/oxz_nexus_e9a0e47d-3dad-4dd5-b4b5-19c1ce38b7ea             cde682bf-e713-498b-9020-f2270bf25391   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f10a4fb9-759f-4a65-b25e-5794ad2d07d8               54bbadaf-ec04-41a2-a62f-f5ac5bf321be   expunged      none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/zone/oxz_ntp_f4d7ec7b-5e5c-4c90-97f2-2ac9d4588a01               b24bee8e-82a0-4b4d-a57c-77a1010f3e38   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/debug                                                           7a6a2058-ea78-49de-9730-cce5e28b4cfb   in service    100 GiB   none          gzip-9     
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/debug                                                           21fd4f3a-ec31-469b-87b1-087c343a2422   in service    100 GiB   none          gzip-9     
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/debug                                                           b1deff4b-51df-4a37-9043-afbd7c70a1cb   in service    100 GiB   none          gzip-9     
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/crypt/local_storage                                                   41071985-1dfd-4ce5-8bc2-897161a8bce4   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/crypt/local_storage                                                   c65a9c1c-36dc-4ddb-8aac-ec3be8dbb209   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/crypt/local_storage                                                   090bd88d-0a43-4040-a832-b13ae721f74f   in service    none      none          off        
    oxp_18b20749-0748-4105-bb10-7b13cfc776e2/local_storage_unencrypted                                             e009d8b8-4695-4322-b53f-f03f2744aef7   in service    none      none          off        
    oxp_30c16fe4-4229-49d0-ab01-3138f2c7dff2/local_storage_unencrypted                                             4da74a5b-6911-4cca-b624-b90c65530117   in service    none      none          off        
    oxp_4930954e-9ac7-4453-b63f-5ab97c389a99/local_storage_unencrypted                                             96ae8389-3027-4260-9374-e0f6ce851de2   in service    none      none          off        


    omicron zones:
    -----------------------------------------------------------------------------------------------------------------------
    zone type         zone id                                image source              disposition    underlay IP          
    -----------------------------------------------------------------------------------------------------------------------
    crucible          694bd14f-cb24-4be4-bb19-876e79cda2c8   artifact: version 1.0.0   in service     fd00:1122:3344:103::8
    crucible          7c252b64-c5af-4ec1-989e-9a03f3b0f111   artifact: version 1.0.0   in service     fd00:1122:3344:103::9
    crucible          f55647d4-5500-4ad3-893a-df45bd50d622   artifact: version 1.0.0   in service     fd00:1122:3344:103::7
    crucible_pantry   75b220ba-a0f4-4872-8202-dc7c87f062d0   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:103::6
    crucible_pantry   7fbd0103-d7f8-48a5-b95e-29bf812cac1f   artifact: version 1.0.0   in service     fd00:1122:3344:103::a
    external_dns      90dbd6f3-9bcb-4a62-ad85-d61f5b3a36ad   artifact: version 1.0.0   in service     fd00:1122:3344:103::c
    external_dns      f6ec9c67-946a-4da3-98d5-581f72ce8bf0   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:103::5
    internal_dns      b5edcb10-9ba0-4fd7-9583-1617e5b4b452   artifact: version 1.0.0   in service     fd00:1122:3344:3::1  
    internal_dns      ea5b4030-b52f-44b2-8d70-45f15f987d01   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:3::1  
    internal_ntp      f10a4fb9-759f-4a65-b25e-5794ad2d07d8   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:103::3
    internal_ntp      f4d7ec7b-5e5c-4c90-97f2-2ac9d4588a01   artifact: version 1.0.0   in service     fd00:1122:3344:103::b
    nexus             3eeb8d49-eb1a-43f8-bb64-c2338421c2c6   artifact: version 0.0.1   expunged ✓     fd00:1122:3344:103::4
    nexus             e9a0e47d-3dad-4dd5-b4b5-19c1ce38b7ea   artifact: version 1.0.0   in service     fd00:1122:3344:103::d


 COCKROACHDB SETTINGS:
    state fingerprint:::::::::::::::::   (none)
    cluster.preserve_downgrade_option:   (do not modify)

 OXIMETER SETTINGS:
    generation:   1
    read from::   SingleNode

 METADATA:
    created by::::::::::::::   reconfigurator-sim
    created at::::::::::::::   <REDACTED_TIMESTAMP>
    comment:::::::::::::::::   (none)
    internal DNS version::::   1
    external DNS version::::   1
    target release min gen::   1
    nexus gen:::::::::::::::   2
    external networking gen:   14

 PENDING MGS-MANAGED UPDATES: 0

blueprint source: planner with report:
empty planning report




