BUCCが動かせるようになったので試行錯誤のメモ

Concourse CIを触っていると、CredHubを使うためにBUCCというCLIを使うといいらしいと書いてあった。 BUCCはBOSH, UAA, CredHub, Concourseの頭文字を取ったCLIツールのこと。 試してたらいろいろところで詰まって3日消費したので対処方法をメモする。

対処方法

環境

macOS: 10.15.4(19E287)
bucc: v0.9.2
BOSH: 6.2.1-a28042ac-2020-02-10T18:41:00Z

対処1

以下のエラーが出た場合、なんか/Users/username/VirtualBox VMs/vm/vm.vbox'が既に存在しているそうなのでvm.vboxリネームする。

エラーメッセージ:

creating stemcell (bosh-vsphere-esxi-ubuntu-xenial-go_agent 621.71):
  CPI 'create_stemcell' method responded with error: CmdError{"type":"Bosh::Clouds::CloudError","message":"Importing stemcell from '/Users/iMac/.bosh/installations/b3bb6623-9069-4851-5787-381e10457811/tmp/stemcell-manager421934878/image': Retried '2' times: Retried '30' times: Running command: 'VBoxManage import /Users/iMac/.bosh_virtualbox_cpi/stemcells/sc-bd436f87-80f7-4770-4b9e-c47476efc7da/image.ovf', stdout: 'Disks:\n  vmdisk1\t3\t1610088448\thttp://www.vmware.com/interfaces/specifications/vmdk.html#streamOptimized\timage-disk1.vmdk\t588610048\t-1\t\n\nVirtual system 0:\n 0: Suggested OS type: \"Ubuntu_64\"\n    (change with \"--vsys 0 --ostype \u003ctype\u003e\"; use \"list ostypes\" to list all possible values)\n 1: Suggested VM name \"vm\"\n    (change with \"--vsys 0 --vmname \u003cname\u003e\")\n 2: Suggested VM group \"/\"\n    (change with \"--vsys 0 --group \u003cgroup\u003e\")\n 3: Suggested VM settings file name \"/Users/iMac/VirtualBox VMs/vm/vm.vbox\"\n    (change with \"--vsys 0 --settingsfile \u003cfilename\u003e\")\n 4: Suggested VM base folder \"/Users/iMac/VirtualBox VMs\"\n    (change with \"--vsys 0 --basefolder \u003cpath\u003e\")\n 5: Number of CPUs: 1\n    (change with \"--vsys 0 --cpus \u003cn\u003e\")\n 6: Guest memory: 512 MB\n    (change with \"--vsys 0 --memory \u003cMB\u003e\")\n 7: CD-ROM\n    (disable with \"--vsys 0 --unit 7 --ignore\")\n 8: SCSI controller, type LsiLogic\n    (change with \"--vsys 0 --unit 8 --scsitype {BusLogic|LsiLogic}\";\n    disable with \"--vsys 0 --unit 8 --ignore\")\n 9: IDE controller, type PIIX4\n    (disable with \"--vsys 0 --unit 9 --ignore\")\n10: Hard disk image: source image=image-disk1.vmdk, target path=image-disk1.vmdk, controller=9;channel=0\n    (change target path with \"--vsys 0 --unit 10 --disk path\";\n    disable with \"--vsys 0 --unit 10 --ignore\")\n', stderr: '0%!.(MISSING).10%!.(MISSING).20%!.(MISSING).30%!.(MISSING).40%!.(MISSING).50%!.(MISSING).60%!.(MISSING).70%!.(MISSING).80%!.(MISSING).90%!.(MISSING).100%!\(MISSING)nInterpreting /Users/iMac/.bosh_virtualbox_cpi/stemcells/sc-bd436f87-80f7-4770-4b9e-c47476efc7da/image.ovf...\nOK.\n0%!.(MISSING).\nProgress state: VBOX_E_FILE_ERROR\nVBoxManage: error: Appliance import failed\nVBoxManage: error: Machine settings file '/Users/iMac/VirtualBox VMs/vm/vm.vbox' already exists\nVBoxManage: error: Details: code VBOX_E_FILE_ERROR (0x80bb0004), component MachineWrap, interface IMachine\nVBoxManage: error: Context: \"RTEXITCODE handleImportAppliance(HandlerArg *)\" at line 1118 of file VBoxManageAppliance.cpp\n': exit status 1","ok_to_retry":false}

Exit code 1

↓(標準エラーを整形)

creating stemcell (bosh-vsphere-esxi-ubuntu-xenial-go_agent 621.71):
 CPI 'create_stemcell' method responded with error: 
CmdError
{
  "type":"Bosh::Clouds::CloudError",
  "message":"Importing stemcell from '/Users/iMac/.bosh/installations/273875b3-bb23-4652-6346-4e68b41de161/tmp/stemcell-manager823920813/image': Retried '2' times: Retried '30' times: Running command: 'VBoxManage import /Users/iMac/.bosh_virtualbox_cpi/stemcells/sc-e04fa053-9cfc-4eb4-57da-75b4897761fb/image.ovf', 
  stdout: 'Disks:
  vmdisk1   3   1610088448  http://www.vmware.com/interfaces/specifications/vmdk.html#streamOptimized   image-disk1.vmdk    588610048   -1  

Virtual system 0:
 0: Suggested OS type:  "Ubuntu_64 "
    (change with  "--vsys 0 --ostype ¥u003ctype¥u003e "; use  "list ostypes " to list all possible values)
 1: Suggested VM name  "vm "
    (change with  "--vsys 0 --vmname ¥u003cname¥u003e ")
 2: Suggested VM group  "/ "
    (change with  "--vsys 0 --group ¥u003cgroup¥u003e ")
 3: Suggested VM settings file name  "/Users/iMac/VirtualBox VMs/vm/vm.vbox "
    (change with  "--vsys 0 --settingsfile ¥u003cfilename¥u003e ")
 4: Suggested VM base folder  "/Users/iMac/VirtualBox VMs "
    (change with  "--vsys 0 --basefolder ¥u003cpath¥u003e ")
 5: Number of CPUs: 1
    (change with  "--vsys 0 --cpus ¥u003cn¥u003e ")
 6: Guest memory: 512 MB
    (change with  "--vsys 0 --memory ¥u003cMB¥u003e ")
 7: CD-ROM
    (disable with  "--vsys 0 --unit 7 --ignore ")
 8: SCSI controller, type LsiLogic
    (change with  "--vsys 0 --unit 8 --scsitype {BusLogic|LsiLogic} ";
    disable with  "--vsys 0 --unit 8 --ignore ")
 9: IDE controller, type PIIX4
    (disable with  "--vsys 0 --unit 9 --ignore ")
10: Hard disk image: source image=image-disk1.vmdk, target path=image-disk1.vmdk, controller=9;channel=0
    (change target path with  "--vsys 0 --unit 10 --disk path ";
    disable with  "--vsys 0 --unit 10 --ignore ")
',
  stderr: '0%!.(MISSING).10%!.(MISSING).20%!.(MISSING).30%!.(MISSING).40%!.(MISSING).50%!.(MISSING).60%!.(MISSING).70%!.(MISSING).80%!.(MISSING).90%!.(MISSING).100%!¥(MISSING)nInterpreting /Users/iMac/.bosh_virtualbox_cpi/stemcells/sc-e04fa053-9cfc-4eb4-57da-75b4897761fb/image.ovf...
OK.
0%!.(MISSING).
Progress state: VBOX_E_FILE_ERROR
VBoxManage: error: Appliance import failed
VBoxManage: error: Machine settings file '/Users/iMac/VirtualBox VMs/vm/vm.vbox' already exists
VBoxManage: error: Details: code VBOX_E_FILE_ERROR (0x80bb0004), component MachineWrap, interface IMachine
VBoxManage: error: Context:  "RTEXITCODE handleImportAppliance(HandlerArg *) " at line 1118 of file VBoxManageAppliance.cpp': exit status 1",
  "ok_to_retry":false
}


対処方法:

mv ~/VirtualBox\ VMs/vm/vm.vbox ~/VirtualBox\ VMs/vm/vm.vbox.bak

対処2

下のようなエラーが出たらVirtualBoxのバージョンを6.0に下げる。下げたらGuest Additionsをちゃんと削除する。

エラーメッセージ:

Deploying:
   Creating instance 'bosh/0':
     Updating instance disks:
       Updating disks:
         Deploying disk:
           Mounting disk:
             Sending 'get_task' to the agent:
               Agent responded with error: Action Failed get_task: Task 28f938ee-465b-4c3f-7d9c-630ef20c4b6d result: Mounting persistent disk: Getting real device path: Timed out getting real device path for '1ATA'
    
Exit code 1


対処方法: 下記のリンクで6.0をダウンロードして、インストールする。 Download_Old_Builds – Oracle VM VirtualBox

インストールした後はGuest Additionsを削除する。下の図は削除した後だけどまぁ参考にはなると思う。

f:id:pogin:20200803003351p:plain
Guest Additionの削除

参考:
Getting real device path: Timed out getting real device path with VirtualBox 6.1 · Issue #446 · cloudfoundry/bosh-lite
Error while executing "VBoxManage" on vagrant up · Issue #8687 · hashicorp/vagrant

対処3

エラーログの出力にこんなのが含まれてたらVirtualBox/Users/username/VirtualBox VMs/sc-*/を削除して、bucc/state/を削除する。'bucc/state/'を丸ごと削除するのはちょっと違う気がするけどとりえあず動いたのでヨシ。

VBoxManage: error: Could not find a registered machine named 'sc-63dfd707-9060-4278-5fe9-e429c93f9477'
VBoxManage: error: Details: code VBOX_E_OBJECT_NOT_FOUND (0x80bb0001), component VirtualBoxWrap, interface IVirtualBox, callee nsISupports
VBoxManage: error: Context: "FindMachine(Bstr(pszSrcName).raw(), srcMachine.asOutParam())" at line 560 of file VBoxManageMisc.cpp

エラーログ

Deploying:
  Creating instance 'bosh/0':
    Creating VM:
      Creating vm with stemcell cid 'sc-63dfd707-9060-4278-5fe9-e429c93f9477':
        CPI 'create_vm' method responded with error: CmdError{"type":"Bosh::Clouds::CloudError","message":"Creating VM with agent ID '{{befcc327-87e2-48ed-5ec2-621583a767ce}}': Cloning VM: Retried '30' times: Running command: 'VBoxManage clonevm sc-63dfd707-9060-4278-5fe9-e429c93f9477 --snapshot prepared-clone --options link --name vm-b69f7ec4-a742-419e-750d-a998de45a345 --uuid b69f7ec4-a742-419e-750d-a998de45a345 --register', stdout: '', stderr: 'VBoxManage: error: Could not find a registered machine named 'sc-63dfd707-9060-4278-5fe9-e429c93f9477'¥nVBoxManage: error: Details: code VBOX_E_OBJECT_NOT_FOUND (0x80bb0001), component VirtualBoxWrap, interface IVirtualBox, callee nsISupports¥nVBoxManage: error: Context: ¥"FindMachine(Bstr(pszSrcName).raw(), srcMachine.asOutParam())¥" at line 560 of file VBoxManageMisc.cpp¥n': exit status 1","ok_to_retry":false}

Exit code 1


対処方法:

# vmのフォルダの削除
cd ~/VirtualBox\ VMs/
> ls 
sc-63dfd707-9060-4278-5fe9-e429c93f9477/
> ls
Snapshots/                                         sc-63dfd707-9060-4278-5fe9-e429c93f9477.vbox-prev
sc-63dfd707-9060-4278-5fe9-e429c93f9477.vbox       vm.vbox.bak
> rm -rf sc-63dfd707-9060-4278-5fe9-e429c93f9477/

# bucc/state/ の削除
rm -rf bucc/state

試行錯誤の跡

direnvの試行錯誤

buccを使おうと思ったらbuccがないと言われた。

> bucc up --lite
fish: Unknown command: bucc

調べるとdirenvを使えとのことで、インストールする。

brew install direnv

インストールをしたはいいけど.envrcを一旦そのまま読み込もうかと思ったけど、fish shelにそのまま対応しているわけではなさそうでエラーになった。

$ source .envrc 
.envrc (line 2): $(...) is not supported. In fish, please use '(./bin/bucc)'.
eval "$(./bin/bucc env)"
      ^
from sourcing file .envrc
source: Error while reading file '.envrc'

調べるとfishの場合以下のコードを~/.config/fish/config.fishに追加しないといけないらしいので、追加して動かしてみる。

$ eval (direnv hook fish)
$ source ~/.config/fish/config.fish
$ cd bucc
direnv: error /Users/iMac/workspace/concourse_ci/bucc/.envrc is blocked. Run `direnv allow` to approve its content
$ direnv allow
direnv: loading ~/workspace/concourse_ci/bucc/.envrc
direnv: export +BOSH_CA_CERT +BOSH_CLIENT +BOSH_CLIENT_SECRET +BOSH_ENVIRONMENT +BOSH_GW_HOST +BOSH_GW_PRIVATE_KEY +BOSH_GW_USER +CREDHUB_CA_CERT +CREDHUB_CLIENT +CREDHUB_SECRET +CREDHUB_SERVER ~PATH ~XPC_SERVICE_NAME

ようやくこれで.envrcが読み込めるようになる。

参考: direnv – unclutter your .profile | direnv Hook into your shell

buccを使うための試行錯誤

buccを動かしてみるとエラーになって萎え散らかした。 エラーを整形してみるとVBoxManage: error: Machine settings file '/Users/iMac/VirtualBox VMs/vm/vm.vbox' already existsという文字が見えたのでvm.vboxを退避してみる。

⋊> ~/w/c/bucc on master ⨯   ./bin/bucc up --lite
Using flags: --cpi virtualbox --lite
Flag files: '/Users/iMac/workspace/concourse_ci/bucc/state/{cpi,lite,flags}'

Deployment manifest: '/Users/iMac/workspace/concourse_ci/bucc/src/bosh-deployment/bosh.yml'
Deployment state: '/Users/iMac/workspace/concourse_ci/bucc/state/state.json'

Started validating
  Downloading release 'bosh'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bosh'... Finished (00:00:00)
  Downloading release 'bpm'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bpm'... Finished (00:00:00)
  Downloading release 'bosh-virtualbox-cpi'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bosh-virtualbox-cpi'... Finished (00:00:03)
  Downloading release 'os-conf'... Skipped [Found in local cache] (00:00:00)
  Validating release 'os-conf'... Finished (00:00:00)
  Downloading release 'garden-runc'... Skipped [Found in local cache] (00:00:00)
  Validating release 'garden-runc'... Finished (00:00:01)
  Downloading release 'bosh-warden-cpi'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bosh-warden-cpi'... Finished (00:00:00)
  Downloading release 'uaa'... Skipped [Found in local cache] (00:00:00)
  Validating release 'uaa'... Finished (00:00:01)
  Downloading release 'concourse'... Skipped [Found in local cache] (00:00:00)
  Validating release 'concourse'... Finished (00:00:06)
Downloading release 'credhub'... Skipped [Found in local cache] (00:00:00)
  Validating release 'credhub'... Finished (00:00:00)
  Downloading release 'credhub-importer'... Skipped [Found in local cache] (00:00:00)
  Validating release 'credhub-importer'... Finished (00:00:00)
  Downloading release 'vault-credhub-proxy'... Skipped [Found in local cache] (00:00:00)
  Validating release 'vault-credhub-proxy'... Finished (00:00:00)
  Downloading release 'postgres'... Skipped [Found in local cache] (00:00:00)
  Validating release 'postgres'... Finished (00:00:00)
  Downloading release 'bucc-bbr'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bucc-bbr'... Finished (00:00:00)
  Downloading release 'bosh-dns'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bosh-dns'... Finished (00:00:00)
  Downloading release 'director-bosh-dns'... Skipped [Found in local cache] (00:00:00)
  Validating release 'director-bosh-dns'... Finished (00:00:00)
  Validating cpi release... Finished (00:00:00)
  Validating deployment manifest... Finished (00:00:01)
  Downloading stemcell... Skipped [Found in local cache] (00:00:00)
  Validating stemcell... Finished (00:00:02)
Finished validating (00:00:23)

Started installing CPI
  Compiling package 'golang-1.10-linux/48c842421b6f05acf88dc6ec17f7574dade28a86'... Finished (00:00:37)
  Compiling package 'golang-1.10-darwin/9eacb8fc6b1b693e4280be4e916e2000f375bfbf'... Finished (00:00:39)
  Compiling package 'virtualbox_cpi/d1afc1d3d84df8397bc48d3ef9d261fd21f1ffd17d3b02161bc427e948d4ad0e'... Finished (00:00:30)
  Installing packages... Finished (00:00:14)
  Rendering job templates... Finished (00:00:01)
  Installing job 'virtualbox_cpi'... Finished (00:00:00)
Finished installing CPI (00:02:03)

Uploading stemcell 'bosh-vsphere-esxi-ubuntu-xenial-go_agent/621.71'... Failed (00:02:14)
Cleaning up rendered CPI jobs... Finished (00:00:00)

creating stemcell (bosh-vsphere-esxi-ubuntu-xenial-go_agent 621.71):
  CPI 'create_stemcell' method responded with error: CmdError{"type":"Bosh::Clouds::CloudError","message":"Importing stemcell from '/Users/iMac/.bosh/installations/b3bb6623-9069-4851-5787-381e10457811/tmp/stemcell-manager421934878/image': Retried '2' times: Retried '30' times: Running command: 'VBoxManage import /Users/iMac/.bosh_virtualbox_cpi/stemcells/sc-bd436f87-80f7-4770-4b9e-c47476efc7da/image.ovf', stdout: 'Disks:\n  vmdisk1\t3\t1610088448\thttp://www.vmware.com/interfaces/specifications/vmdk.html#streamOptimized\timage-disk1.vmdk\t588610048\t-1\t\n\nVirtual system 0:\n 0: Suggested OS type: \"Ubuntu_64\"\n    (change with \"--vsys 0 --ostype \u003ctype\u003e\"; use \"list ostypes\" to list all possible values)\n 1: Suggested VM name \"vm\"\n    (change with \"--vsys 0 --vmname \u003cname\u003e\")\n 2: Suggested VM group \"/\"\n    (change with \"--vsys 0 --group \u003cgroup\u003e\")\n 3: Suggested VM settings file name \"/Users/iMac/VirtualBox VMs/vm/vm.vbox\"\n    (change with \"--vsys 0 --settingsfile \u003cfilename\u003e\")\n 4: Suggested VM base folder \"/Users/iMac/VirtualBox VMs\"\n    (change with \"--vsys 0 --basefolder \u003cpath\u003e\")\n 5: Number of CPUs: 1\n    (change with \"--vsys 0 --cpus \u003cn\u003e\")\n 6: Guest memory: 512 MB\n    (change with \"--vsys 0 --memory \u003cMB\u003e\")\n 7: CD-ROM\n    (disable with \"--vsys 0 --unit 7 --ignore\")\n 8: SCSI controller, type LsiLogic\n    (change with \"--vsys 0 --unit 8 --scsitype {BusLogic|LsiLogic}\";\n    disable with \"--vsys 0 --unit 8 --ignore\")\n 9: IDE controller, type PIIX4\n    (disable with \"--vsys 0 --unit 9 --ignore\")\n10: Hard disk image: source image=image-disk1.vmdk, target path=image-disk1.vmdk, controller=9;channel=0\n    (change target path with \"--vsys 0 --unit 10 --disk path\";\n    disable with \"--vsys 0 --unit 10 --ignore\")\n', stderr: '0%!.(MISSING).10%!.(MISSING).20%!.(MISSING).30%!.(MISSING).40%!.(MISSING).50%!.(MISSING).60%!.(MISSING).70%!.(MISSING).80%!.(MISSING).90%!.(MISSING).100%!\(MISSING)nInterpreting /Users/iMac/.bosh_virtualbox_cpi/stemcells/sc-bd436f87-80f7-4770-4b9e-c47476efc7da/image.ovf...\nOK.\n0%!.(MISSING).\nProgress state: VBOX_E_FILE_ERROR\nVBoxManage: error: Appliance import failed\nVBoxManage: error: Machine settings file '/Users/iMac/VirtualBox VMs/vm/vm.vbox' already exists\nVBoxManage: error: Details: code VBOX_E_FILE_ERROR (0x80bb0004), component MachineWrap, interface IMachine\nVBoxManage: error: Context: \"RTEXITCODE handleImportAppliance(HandlerArg *)\" at line 1118 of file VBoxManageAppliance.cpp\n': exit status 1","ok_to_retry":false}

Exit code 1

退避する

⋊> ~/w/c/bucc on master ⨯   mv ~/VirtualBox\ VMs/vm/vm.vbox ~/VirtualBox\ VMs/vm/vm.vbox.bak

そしてまた動かすと別のエラーが出た。

⋊> ~/w/c/bucc on master ⨯   ./bin/bucc up --lite
Using flags: --cpi virtualbox --lite
Flag files: '/Users/iMac/workspace/concourse_ci/bucc/state/{cpi,lite,flags}'

Deployment manifest: '/Users/iMac/workspace/concourse_ci/bucc/src/bosh-deployment/bosh.yml'
Deployment state: '/Users/iMac/workspace/concourse_ci/bucc/state/state.json'

Started validating
  Downloading release 'bosh'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bosh'... Finished (00:00:00)
  Downloading release 'bpm'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bpm'... Finished (00:00:00)
  Downloading release 'bosh-virtualbox-cpi'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bosh-virtualbox-cpi'... Finished (00:00:02)
  Downloading release 'os-conf'... Skipped [Found in local cache] (00:00:00)
  Validating release 'os-conf'... Finished (00:00:00)
  Downloading release 'garden-runc'... Skipped [Found in local cache] (00:00:00)
  Validating release 'garden-runc'... Finished (00:00:01)
  Downloading release 'bosh-warden-cpi'... Skipped [Found in local cache] (00:00:00)
Validating release 'bosh-warden-cpi'... Finished (00:00:00)
  Downloading release 'uaa'... Skipped [Found in local cache] (00:00:00)
  Validating release 'uaa'... Finished (00:00:01)
  Downloading release 'concourse'... Skipped [Found in local cache] (00:00:00)
  Validating release 'concourse'... Finished (00:00:05)
  Downloading release 'credhub'... Skipped [Found in local cache] (00:00:00)
  Validating release 'credhub'... Finished (00:00:00)
  Downloading release 'credhub-importer'... Skipped [Found in local cache] (00:00:00)
  Validating release 'credhub-importer'... Finished (00:00:00)
  Downloading release 'vault-credhub-proxy'... Skipped [Found in local cache] (00:00:00)
  Validating release 'vault-credhub-proxy'... Finished (00:00:00)
  Downloading release 'postgres'... Skipped [Found in local cache] (00:00:00)
  Validating release 'postgres'... Finished (00:00:00)
  Downloading release 'bucc-bbr'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bucc-bbr'... Finished (00:00:00)
  Downloading release 'bosh-dns'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bosh-dns'... Finished (00:00:00)
  Downloading release 'director-bosh-dns'... Skipped [Found in local cache] (00:00:00)
  Validating release 'director-bosh-dns'... Finished (00:00:00)
  Validating cpi release... Finished (00:00:00)
  Validating deployment manifest... Finished (00:00:01)
  Downloading stemcell... Skipped [Found in local cache] (00:00:00)
  Validating stemcell... Finished (00:00:02)
Finished validating (00:00:20)

Started installing CPI
  Compiling package 'golang-1.10-linux/48c842421b6f05acf88dc6ec17f7574dade28a86'... Finished (00:00:00)
  Compiling package 'golang-1.10-darwin/9eacb8fc6b1b693e4280be4e916e2000f375bfbf'... Finished (00:00:00)
  Compiling package 'virtualbox_cpi/d1afc1d3d84df8397bc48d3ef9d261fd21f1ffd17d3b02161bc427e948d4ad0e'... Finished (00:00:00)
  Installing packages... Finished (00:00:18)
  Rendering job templates... Finished (00:00:01)
  Installing job 'virtualbox_cpi'... Finished (00:00:00)
Finished installing CPI (00:00:19)

Uploading stemcell 'bosh-vsphere-esxi-ubuntu-xenial-go_agent/621.71'... Finished (00:01:59)

Started deploying
  Creating VM for instance 'bosh/0' from stemcell 'sc-63dfd707-9060-4278-5fe9-e429c93f9477'... Finished (00:00:12)
  Waiting for the agent on VM 'vm-97708d55-4fa5-4bec-40cf-c88d8ef89989' to be ready... Finished (00:02:20)
  Creating disk... Finished (00:00:00)
  Attaching disk 'disk-0f38cf5f-350c-4f2d-7f5a-c8c681c05509' to VM 'vm-97708d55-4fa5-4bec-40cf-c88d8ef89989'... Failed (00:01:16)
Failed deploying (00:03:48)

Cleaning up rendered CPI jobs... Finished (00:00:00)

Deploying:
  Creating instance 'bosh/0':
    Updating instance disks:
      Updating disks:
        Deploying disk:
          Mounting disk:
            Sending 'get_task' to the agent:
              Agent responded with error: Action Failed get_task: Task 28f938ee-465b-4c3f-7d9c-630ef20c4b6d result: Mounting persistent disk: Getting real device path: Timed out getting real device path for '1ATA'

Exit code 1

エラー文で検索してみるとまだ対応できていないという文があってまた悲しい気持ちになった。
Getting real device path: Timed out getting real device path with VirtualBox 6.1 · Issue #446 · cloudfoundry/bosh-lite
このイシューの先の方を見ると2019/12/17に見つかっていてまだ治ってないらしい。 virtualbox/create-env.sh "Mounting persistent disk" error with upgrade to VirtualBox 6.1 (from 6.0) · Issue #378 · cloudfoundry/bosh-deployment


対応できてないらしいのでVirtualBoxを6.0に下げる。このときなんかvmが動いていたので「sc-xxx...」とい名前のvmと「vm-xxxx...」という名前のvmがあったのでとりあえず両方削除する。このときscの方を削除するときになんかエラーが出たがスクショは撮ってないのでちょっとわからない。「vm-xxxx...」の方はvmを落として削除した。

そしてもう一度実行するがまだエラーになる。

$ ./bin/bucc up --lite
Using flags: --cpi virtualbox --lite
Flag files: '/Users/iMac/workspace/concourse_ci/bucc/state/{cpi,lite,flags}'

Deployment manifest: '/Users/iMac/workspace/concourse_ci/bucc/src/bosh-deployment/bosh.yml'
Deployment state: '/Users/iMac/workspace/concourse_ci/bucc/state/state.json'

Started validating
  Downloading release 'bosh'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bosh'... Finished (00:00:00)
  Downloading release 'bpm'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bpm'... Finished (00:00:00)
  Downloading release 'bosh-virtualbox-cpi'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bosh-virtualbox-cpi'... Finished (00:00:03)
  Downloading release 'os-conf'... Skipped [Found in local cache] (00:00:00)
  Validating release 'os-conf'... Finished (00:00:00)
  Downloading release 'garden-runc'... Skipped [Found in local cache] (00:00:00)
  Validating release 'garden-runc'... Finished (00:00:01)
  Downloading release 'bosh-warden-cpi'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bosh-warden-cpi'... Finished (00:00:00)
  Downloading release 'uaa'... Skipped [Found in local cache] (00:00:00)
  Validating release 'uaa'... Finished (00:00:01)
  Downloading release 'concourse'... Skipped [Found in local cache] (00:00:00)
  Validating release 'concourse'... Finished (00:00:06)
  Downloading release 'credhub'... Skipped [Found in local cache] (00:00:00)
  Validating release 'credhub'... Finished (00:00:00)
  Downloading release 'credhub-importer'... Skipped [Found in local cache] (00:00:00)
  Validating release 'credhub-importer'... Finished (00:00:00)
  Downloading release 'vault-credhub-proxy'... Skipped [Found in local cache] (00:00:00)
  Validating release 'vault-credhub-proxy'... Finished (00:00:00)
  Downloading release 'postgres'... Skipped [Found in local cache] (00:00:00)
  Validating release 'postgres'... Finished (00:00:00)
  Downloading release 'bucc-bbr'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bucc-bbr'... Finished (00:00:00)
  Downloading release 'bosh-dns'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bosh-dns'... Finished (00:00:01)
  Downloading release 'director-bosh-dns'... Skipped [Found in local cache] (00:00:00)
  Validating release 'director-bosh-dns'... Finished (00:00:00)
  Validating cpi release... Finished (00:00:00)
  Validating deployment manifest... Finished (00:00:00)
  Downloading stemcell... Skipped [Found in local cache] (00:00:00)
  Validating stemcell... Finished (00:00:03)
Finished validating (00:00:26)

Started installing CPI
  Compiling package 'golang-1.10-linux/48c842421b6f05acf88dc6ec17f7574dade28a86'... Finished (00:00:00)
  Compiling package 'golang-1.10-darwin/9eacb8fc6b1b693e4280be4e916e2000f375bfbf'... Finished (00:00:00)
  Compiling package 'virtualbox_cpi/d1afc1d3d84df8397bc48d3ef9d261fd21f1ffd17d3b02161bc427e948d4ad0e'... Finished (00:00:00)
  Installing packages... Finished (00:00:20)
  Rendering job templates... Finished (00:00:01)
  Installing job 'virtualbox_cpi'... Finished (00:00:00)
Finished installing CPI (00:00:21)

Uploading stemcell 'bosh-vsphere-esxi-ubuntu-xenial-go_agent/621.71'... Skipped [Stemcell already uploaded] (00:00:00)

Started deploying
  Waiting for the agent on VM 'vm-97708d55-4fa5-4bec-40cf-c88d8ef89989'... Failed (00:00:19)
  Deleting VM 'vm-97708d55-4fa5-4bec-40cf-c88d8ef89989'... Finished (00:00:01)
  Creating VM for instance 'bosh/0' from stemcell 'sc-63dfd707-9060-4278-5fe9-e429c93f9477'... Failed (00:01:03)
Failed deploying (00:01:25)

Cleaning up rendered CPI jobs... Finished (00:00:00)

Deploying:
  Creating instance 'bosh/0':
    Creating VM:
      Creating vm with stemcell cid 'sc-63dfd707-9060-4278-5fe9-e429c93f9477':
        CPI 'create_vm' method responded with error: CmdError{"type":"Bosh::Clouds::CloudError","message":"Creating VM with agent ID '{{befcc327-87e2-48ed-5ec2-621583a767ce}}': Cloning VM: Retried '30' times: Running command: 'VBoxManage clonevm sc-63dfd707-9060-4278-5fe9-e429c93f9477 --snapshot prepared-clone --options link --name vm-b69f7ec4-a742-419e-750d-a998de45a345 --uuid b69f7ec4-a742-419e-750d-a998de45a345 --register', stdout: '', stderr: 'VBoxManage: error: Could not find a registered machine named 'sc-63dfd707-9060-4278-5fe9-e429c93f9477'¥nVBoxManage: error: Details: code VBOX_E_OBJECT_NOT_FOUND (0x80bb0001), component VirtualBoxWrap, interface IVirtualBox, callee nsISupports¥nVBoxManage: error: Context: ¥"FindMachine(Bstr(pszSrcName).raw(), srcMachine.asOutParam())¥" at line 560 of file VBoxManageMisc.cpp¥n': exit status 1","ok_to_retry":false}

Exit code 1

よくわからないので~/VirtualBox\ VMs/vmの情報があったので削除してみる。

$ cd ~/VirtualBox\ VMs/
$ ls 
sc-63dfd707-9060-4278-5fe9-e429c93f9477/
$ ~/V/sc-63dfd707-9060-4278-5fe9-e429c93f9477 ls
Snapshots/                                         sc-63dfd707-9060-4278-5fe9-e429c93f9477.vbox-prev
sc-63dfd707-9060-4278-5fe9-e429c93f9477.vbox       vm.vbox.bak
$ ~/V/sc-63dfd707-9060-4278-5fe9-e429c93f9477 rm -rf sc-63dfd707-9060-4278-5fe9-e429c93f9477/

ここで再度buccディレクトリに入るとdirenvが有効になり出していた。ちゃんと有効になるようにdirenv allowを実行する。

$ cd ~/workspace/concourse_ci/bucc/
 direnv: error /Users/iMac/workspace/concourse_ci/bucc/.envrc is blocked. Run `direnv allow` to approve its content
$ direnv allow
direnv: loading ~/workspace/concourse_ci/bucc/.envrc
direnv: export +BOSH_CA_CERT +BOSH_CLIENT +BOSH_CLIENT_SECRET +BOSH_ENVIRONMENT +BOSH_GW_HOST +BOSH_GW_PRIVATE_KEY +BOSH_GW_USER +CREDHUB_CA_CERT +CREDHUB_CLIENT +CREDHUB_SECRET +CREDHUB_SERVER ~PATH ~XPC_SERVICE_NAME

再度bucc up --liteを実行する。

$ bucc up --lite
Using flags: --cpi virtualbox --lite
Flag files: '/Users/iMac/workspace/concourse_ci/bucc/state/{cpi,lite,flags}'

Deployment manifest: '/Users/iMac/workspace/concourse_ci/bucc/src/bosh-deployment/bosh.yml'
Deployment state: '/Users/iMac/workspace/concourse_ci/bucc/state/state.json'

Started validating
  Downloading release 'bosh'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bosh'... Finished (00:00:00)
  Downloading release 'bpm'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bpm'... Finished (00:00:00)
  Downloading release 'bosh-virtualbox-cpi'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bosh-virtualbox-cpi'... Finished (00:00:02)
  Downloading release 'os-conf'... Skipped [Found in local cache] (00:00:00)
  Validating release 'os-conf'... Finished (00:00:00)
  Downloading release 'garden-runc'... Skipped [Found in local cache] (00:00:00)
  Validating release 'garden-runc'... Finished (00:00:01)
  Downloading release 'bosh-warden-cpi'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bosh-warden-cpi'... Finished (00:00:00)
  Downloading release 'uaa'... Skipped [Found in local cache] (00:00:00)
  Validating release 'uaa'... Finished (00:00:01)
  Downloading release 'concourse'... Skipped [Found in local cache] (00:00:00)
  Validating release 'concourse'... Finished (00:00:04)
  Downloading release 'credhub'... Skipped [Found in local cache] (00:00:00)
  Validating release 'credhub'... Finished (00:00:00)
  Downloading release 'credhub-importer'... Skipped [Found in local cache] (00:00:00)
  Validating release 'credhub-importer'... Finished (00:00:00)
  Downloading release 'vault-credhub-proxy'... Skipped [Found in local cache] (00:00:00)
  Validating release 'vault-credhub-proxy'... Finished (00:00:00)
  Downloading release 'postgres'... Skipped [Found in local cache] (00:00:00)
  Validating release 'postgres'... Finished (00:00:00)
  Downloading release 'bucc-bbr'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bucc-bbr'... Finished (00:00:00)
  Downloading release 'bosh-dns'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bosh-dns'... Finished (00:00:00)
  Downloading release 'director-bosh-dns'... Skipped [Found in local cache] (00:00:00)
  Validating release 'director-bosh-dns'... Finished (00:00:00)
  Validating cpi release... Finished (00:00:00)
  Validating deployment manifest... Finished (00:00:01)
  Downloading stemcell... Skipped [Found in local cache] (00:00:00)
  Validating stemcell... Finished (00:00:02)
Finished validating (00:00:19)

Started installing CPI
  Compiling package 'golang-1.10-linux/48c842421b6f05acf88dc6ec17f7574dade28a86'... Finished (00:00:00)
  Compiling package 'golang-1.10-darwin/9eacb8fc6b1b693e4280be4e916e2000f375bfbf'... Finished (00:00:00)
  Compiling package 'virtualbox_cpi/d1afc1d3d84df8397bc48d3ef9d261fd21f1ffd17d3b02161bc427e948d4ad0e'... Finished (00:00:00)
  Installing packages... Finished (00:00:23)
  Rendering job templates... Finished (00:00:01)
  Installing job 'virtualbox_cpi'... Finished (00:00:00)
Finished installing CPI (00:00:24)

Uploading stemcell 'bosh-vsphere-esxi-ubuntu-xenial-go_agent/621.71'... Skipped [Stemcell already uploaded] (00:00:00)

Started deploying
  Creating VM for instance 'bosh/0' from stemcell 'sc-63dfd707-9060-4278-5fe9-e429c93f9477'... Failed (00:01:02)
Failed deploying (00:01:02)

Cleaning up rendered CPI jobs... Finished (00:00:00)

Deploying:
  Creating instance 'bosh/0':
    Creating VM:
      Creating vm with stemcell cid 'sc-63dfd707-9060-4278-5fe9-e429c93f9477':
        CPI 'create_vm' method responded with error: CmdError{"type":"Bosh::Clouds::CloudError","message":"Creating VM with agent ID '{{c93353e5-ec37-4736-4782-81cfb8ff1ffe}}': Cloning VM: Retried '30' times: Running command: 'VBoxManage clonevm sc-63dfd707-9060-4278-5fe9-e429c93f9477 --snapshot prepared-clone --options link --name vm-30e06d52-51c4-47a7-5fac-1b9208d73f66 --uuid 30e06d52-51c4-47a7-5fac-1b9208d73f66 --register', stdout: '', stderr: 'VBoxManage: error: Could not find a registered machine named 'sc-63dfd707-9060-4278-5fe9-e429c93f9477'¥nVBoxManage: error: Details: code VBOX_E_OBJECT_NOT_FOUND (0x80bb0001), component VirtualBoxWrap, interface IVirtualBox, callee nsISupports¥nVBoxManage: error: Context: ¥"FindMachine(Bstr(pszSrcName).raw(), srcMachine.asOutParam())¥" at line 560 of file VBoxManageMisc.cpp¥n': exit status 1","ok_to_retry":false}

Exit code 1

まだダメらしいのでbucc内にリポジトリのコミット対象外のファイルが作成されていないかを調べる。

> cd bucc
> nano .gitignore
#*
*~
.#*
state/
tmp
local.yml
*.DS_Store
.credhub/
.flyrc
.config/
/bin/fly
/bin/credhub
/bin/safe
/bin/bbr
/bin/bosh
/bin/uaa
/vars.yml
/vars.yml.bck
/src/offline_resources
/operators

> ls -la
total 104
drwxr-xr-x  18 iMac  staff    576 Jul 31 03:43 ./
drwxr-xr-x   5 iMac  staff    160 Jul 27 00:52 ../
-rwxr-xr-x   1 iMac  staff     25 Jul 31 03:13 .envrc*
drwxr-xr-x  12 iMac  staff    384 Aug  2 20:12 .git/
-rw-r--r--   1 iMac  staff    186 Jul 27 00:45 .gitignore
-rw-r--r--   1 iMac  staff     69 Jul 27 00:45 .versions
-rw-------   1 iMac  staff    150 Jul 31 03:43 2020-07-30-18-43-15.045-VBoxSVC-92369.log
-rw-r--r--   1 iMac  staff   4614 Jul 27 00:45 CONTRIBUTE.MD
-rw-r--r--   1 iMac  staff  11357 Jul 27 00:45 LICENSE
-rw-r--r--   1 iMac  staff   5788 Jul 27 00:45 README.md
drwxr-xr-x   7 iMac  staff    224 Jul 27 00:45 bbl/
drwxr-xr-x   4 iMac  staff    128 Jul 31 03:15 bin/
drwxr-xr-x   8 iMac  staff    256 Jul 27 00:45 ci/
drwxr-xr-x  28 iMac  staff    896 Jul 27 00:45 ops/
drwxr-xr-x   3 iMac  staff     96 Jul 27 00:45 src/
drwxr-xr-x   6 iMac  staff    192 Jul 31 04:03 state/
-rw-r--r--   1 iMac  staff    224 Jul 27 00:45 support_matrix.yml
-rw-r--r--   1 iMac  staff    270 Jul 31 03:15 vars.yml

state/フォルダが怪しいので削除実行してみる。

$ rm -rf state/
$ bucc up --lite                                                                                                                                                                      20:14:40
Using flags: --cpi virtualbox --lite
Flag files: '/Users/iMac/workspace/concourse_ci/bucc/state/{cpi,lite,flags}'

Deployment manifest: '/Users/iMac/workspace/concourse_ci/bucc/src/bosh-deployment/bosh.yml'
Deployment state: '/Users/iMac/workspace/concourse_ci/bucc/state/state.json'

Started validating
  Downloading release 'bosh'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bosh'... Finished (00:00:01)
  Downloading release 'bpm'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bpm'... Finished (00:00:00)
  Downloading release 'bosh-virtualbox-cpi'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bosh-virtualbox-cpi'... Finished (00:00:04)
  Downloading release 'os-conf'... Skipped [Found in local cache] (00:00:00)
  Validating release 'os-conf'... Finished (00:00:00)
  Downloading release 'garden-runc'... Skipped [Found in local cache] (00:00:00)
  Validating release 'garden-runc'... Finished (00:00:01)
  Downloading release 'bosh-warden-cpi'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bosh-warden-cpi'... Finished (00:00:01)
  Downloading release 'uaa'... Skipped [Found in local cache] (00:00:00)
  Validating release 'uaa'... Finished (00:00:01)
  Downloading release 'concourse'... Skipped [Found in local cache] (00:00:00)
  Validating release 'concourse'... Finished (00:00:06)
  Downloading release 'credhub'... Skipped [Found in local cache] (00:00:00)
  Validating release 'credhub'... Finished (00:00:00)
  Downloading release 'credhub-importer'... Skipped [Found in local cache] (00:00:00)
  Validating release 'credhub-importer'... Finished (00:00:00)
  Downloading release 'vault-credhub-proxy'... Skipped [Found in local cache] (00:00:00)
  Validating release 'vault-credhub-proxy'... Finished (00:00:00)
  Downloading release 'postgres'... Skipped [Found in local cache] (00:00:00)
  Validating release 'postgres'... Finished (00:00:00)
  Downloading release 'bucc-bbr'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bucc-bbr'... Finished (00:00:00)
  Downloading release 'bosh-dns'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bosh-dns'... Finished (00:00:01)
  Downloading release 'director-bosh-dns'... Skipped [Found in local cache] (00:00:00)
  Validating release 'director-bosh-dns'... Finished (00:00:00)
  Validating cpi release... Finished (00:00:00)
  Validating deployment manifest... Finished (00:00:00)
  Downloading stemcell... Skipped [Found in local cache] (00:00:00)
  Validating stemcell... Finished (00:00:03)
Finished validating (00:01:08)

Started installing CPI
  Compiling package 'golang-1.10-linux/48c842421b6f05acf88dc6ec17f7574dade28a86'... Finished (00:00:46)
  Compiling package 'golang-1.10-darwin/9eacb8fc6b1b693e4280be4e916e2000f375bfbf'... Finished (00:00:47)
  Compiling package 'virtualbox_cpi/d1afc1d3d84df8397bc48d3ef9d261fd21f1ffd17d3b02161bc427e948d4ad0e'... Finished (00:00:37)
  Installing packages... Finished (00:00:18)
  Rendering job templates... Finished (00:00:01)
  Installing job 'virtualbox_cpi'... Finished (00:00:00)
Finished installing CPI (00:02:31)

Uploading stemcell 'bosh-vsphere-esxi-ubuntu-xenial-go_agent/621.71'... Finished (00:01:01)

Started deploying
  Creating VM for instance 'bosh/0' from stemcell 'sc-82f2e633-da5f-4edf-475a-549f6e76b311'... Finished (00:00:03)
  Waiting for the agent on VM 'vm-ab69f6c1-b427-483f-4e14-516b8c53f056' to be ready... Finished (00:02:14)
  Creating disk... Finished (00:00:00)
  Attaching disk 'disk-365f8cd7-2c63-496f-616a-5c78ed6fd624' to VM 'vm-ab69f6c1-b427-483f-4e14-516b8c53f056'... Finished (00:00:13)
  Rendering job templates... Finished (00:01:45)
  Compiling package 'autoconf/72f6018683a42677273491968274851f48195dd88c45dd854da29ebc7bcf3c80'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'pkg-config/d22b498c31e81a330284962fa5a9a439961d2d4698856ac24da64e62992c3b18'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'libtool/eb05d480577a53500bac5d5a54fed6a29cbcc2b6aed65f8a6cd5351cd1e1900a'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'automake/369b4f0a8bfda6a94c041c449dde63f663ecc887ef39675b6d96c14b235c55f1'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'golang/e84bb0a48f00f92e3a1086feb199436af258b568'... Skipped [Package already compiled] (00:00:01)
  Compiling package 'openjdk_1.8.0/02e0b9c20f7e41ff9b80b10feeba0a7f0a1a773d'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'golang-1-linux/8fb48ae1b653b7d0b49d0cbcea856bb8da8a5700'... Skipped [Package already compiled] (00:00:01)
  Compiling package 'golang/50f89362badfb290dc09c1d7e3791b5be6ef8865dd36009fdffb325883242e07'... Skipped [Package already compiled] (00:00:01)
  Compiling package 'zlib/2c4ee9fde36d42651fdd4b22edcb81e71dfaf6f4e646bca32764cbe24fb8617d'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'util-linux/6310f68e8294c980de62481bced2fc915f449e3a2cc2d13a7a2a49c4a612d825'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'lzo/7e1e471f81c73a7aeb4f0b56d02d6b0a554d05baf6e02107b435b12d9f88f450'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'ruby-2.6.5-r0.29.0/269dc54d5306119b0e4f89be04f6c470b4876f552753815586fd1ab8ebeaa70d'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'mysql/440cfa0993fc387154f20775119925d74440a8247fc9c58976c9ee99c1bdcba7'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'libpq/a83e0662fb3d483552de8e02df46809b6c6755e6f64f83f1cac244db61b5c342'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'golang-1.10-linux/48c842421b6f05acf88dc6ec17f7574dade28a86'... Skipped [Package already compiled] (00:00:02)
  Compiling package 'apparmor/01e813bbfdad58b49d011653221fd4e308d5f6d97883e309171e042f060c75b8'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'libseccomp/5761014f014d57ba48ccff9e88185f8afa4152676d7936d5d8e8d9efc1e2adc7'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'golang-1.11-linux/1713e92cb48ac5a86a78bb8eba12d69cf05d13382411128a3bd7b748585d22ba'... Skipped [Package already compiled] (00:00:01)
  Compiling package 'tini/3d7b02f3eeb480b9581bec4a0096dab9ebdfa4bc'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'bpm-runc/796202c2568ebf561fc62617e8e2909986b60a7e'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'golang-1.13-linux/1dc53bfedfac5545e4139496bd4f0fef1f6410c09e936411c50911ac7afbcb2d'... Skipped [Package already compiled] (00:00:02)
  Compiling package 'credhub/d0b84ea3ea0de9d132011e17b7ff8abfcaed11a2'... Skipped [Package already compiled] (00:00:01)
  Compiling package 'postgres-9.4/601f3635b43d0e7ba3ae866e3bd69425cdf33f7fb34a7f1bb21cc26818fb598e'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'postgres-common/9e812f515167406f22e2f983a6c325b0a54e1bd6128aa44e1b8f8bc44034d01f'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'bosh-dns/138f3bd2440ba97f0a7d8912facb5d4a2b320850'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'grootfs/daf6e8224b7d9d189b383e518656e792e1571224f23cf9a82780f3c58ffbc5e8'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'xfs-progs/b8baad87ddfdd32b428001fbdf4b2fd4e1bb9a28a4aa196782d3e5f92650d546'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'uaa/0b2b84bc51350e4c469c539a7646b939081cf945'... Skipped [Package already compiled] (00:00:05)
  Compiling package 'btrfs_tools/797f8df53d2881f034366408b3f043a57f8f4c51'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'thresholder/62ae2c4aa6637a64296fa6c33707e7d8a94a79c6f68ddb2c94e1a2c1845653b2'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'postgres-9.6.10/04ecac16e7e53e17d1a1799c0fe874f262f1960ba37514da1b3a30d1c58c13c0'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'guardian/cb3c46794779884567822f5009c56fa3ceb7681a8ae640f4a51967a445e4efc3'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'director/7da7966c7452459aec32b4b60654ae77e4fb34f9888b70861ecb84a82d342b57'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'warden_cpi/a9d5dc6b81cd181be08db2fcf5f751e25ea5fe3c'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'verify_multidigest/64d1958934e10a0eccc05ddf0d7ba0c8215e6f6d4c227cb93998087335378fa8'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'busybox/549ea5ccc88f92f8df15e4d46e40495627ed42c54ffd04ea5ad509611320651c'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'containerd/1a8c5e5d082109f919ea87e89e7b3ce183794cbbd4b38fd656102cd8a7926b90'... Skipped [Package already compiled] (00:00:00)
  Compiling package 's3cli/7e752dee192da026f6a0cdf2653b855cc6efbe6b041564660f8520c39ddd5a78'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'netplugin-shim/e5f52051e32ff2c46cb1ef2657a2b1a23299fe6be68b3035bf94f42253b7225c'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'runc/4b4e68c825db39ae247a9c178bebfca7a4c1b755dcb85bd6d175dba890e63495'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'credhub-cli/492c6726d284c471c394a74c272e0860c6408fa0'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'greenskeeper/c3bacbd2942d88780e0d7ddaf680f183086095d7730d6394145f1732312eeb1e'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'tini/cd19db4c74ad08902ca63bea2a78ff60fdf1007abcd6bf2bf34b895282a45ac9'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'tar/49f95c03d4d9ccb283d8e9473c941d654a51660ae9cc40a7f4f2c98d3a0652da'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'director-bosh-dns/2b895d0de42a1c03defc8570e0b0e24ae8776dde'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'concourse/5d62dbcf6977f358f0ea925f8274b6c05d7a8376'... Skipped [Package already compiled] (00:00:28)
  Compiling package 'bosh-gcscli/52223432539bbd0607db053f542440869688b4404dd65f2ddf33c2d195b1b891'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'iptables/a18e112e3c62ec193e03f328626908ad61a2cf86a032380b4305a67956be941c'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'health_monitor/5b655029a0794bd4bda04196accf9c9fb2b9a6217aef9833242a9f26d119c2f7'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'luna-hsm-client-7.4/746f3c30aadc0af7afc2d5cddcc16d8836a8f845'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'bpm/8366da1860667621bdbce0891ffac62597e673ff'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'vault-credhub-proxy/f02fecc6c7df0573bbcdccd10aad5fcb83e71b8dd6072883aa3044beb4f7c20f'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'garden-idmapper/011bebdcb701fae8aa0dd90032dd68ee02095b98ab13edfa41e767429707952b'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'nginx/4cf27fedc69b8b74c26b1e45df7ea715dc9eb427654aab00ef652182b7d81bb5'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'gonats/f58980bd4b0436ff65f588627116dfff63f346f4d13175b7ba47380ab89e08a6'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'dontpanic/4aa0cf0d8d7ee44e2534b773e5bbe91fb5bca30b4109eee5beefbe61e4169338'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'postgres-11.7/4a8e82758189ba642509333845f778c757f65fb0862351ecb4b662200b68c794'... Skipped [Package already compiled] (00:00:00)
  Compiling package 'davcli/58f558960854f58c55e3d506d3906019178dbc189fbbed1616b8b3c7c02142ea'... Skipped [Package already compiled] (00:00:00)
  Updating instance 'bosh/0'... Finished (00:12:01)
  Waiting for instance 'bosh/0' to be running... Finished (00:04:22)
  Running the post-start scripts 'bosh/0'... Finished (00:00:03)
Finished deploying (00:21:37)

Cleaning up rendered CPI jobs... Finished (00:00:00)

Succeeded

ようやくVMのデプロイが成功した。
ここに至るまで3日かかっているので人柱としてここにメモを残す。

参考

How to recreate BOSH Director VM when the Stemcell is deleted from vSphere