Hi Team, While installing airship in a bottle on a physical node, behind a proxy, with dev minimal configuration. The setup is stuck with maas pod in a crashloop ... Below mentioned are the display from the installation script and the kubectl describe for maas pod. I'll be grateful if anyone can help me solve how to get maas out of this loop? NAMESPACE NAME READY STATUS RESTARTS AGE kube-system auxiliary-etcd-mtn15r07c001 3/3 Running 12 23h kube-system bootstrap-armada-mtn15r07c001 4/4 Running 16 23h kube-system calico-etcd-anchor-56fjc 1/1 Running 0 23h kube-system calico-etcd-mtn15r07c001 1/1 Running 0 23h kube-system calico-kube-controllers-56c54d8cf8-r955j 1/1 Running 0 23h kube-system calico-node-r9bdv 1/1 Running 0 23h kube-system calico-settings-866vn 0/1 Completed 0 23h kube-system coredns-764f47bb78-5tsc4 1/1 Running 0 23h kube-system coredns-764f47bb78-hv5j6 1/1 Running 0 23h kube-system coredns-764f47bb78-zsjst 1/1 Running 0 23h kube-system haproxy-mtn15r07c001 1/1 Running 4 23h kube-system ingress-error-pages-5ccf96bf7d-d7955 1/1 Running 0 23h kube-system ingress-error-pages-5ccf96bf7d-mxz68 1/1 Running 0 23h kube-system ingress-ggdvw 1/1 Running 0 23h kube-system kubernetes-apiserver-anchor-8btb7 1/1 Running 0 23h kube-system kubernetes-apiserver-mtn15r07c001 1/1 Running 0 23h kube-system kubernetes-controller-manager-anchor-b4ztr 1/1 Running 0 23h kube-system kubernetes-controller-manager-mtn15r07c001 1/1 Running 0 23h kube-system kubernetes-etcd-anchor-n9fwl 1/1 Running 0 23h kube-system kubernetes-etcd-mtn15r07c001 1/1 Running 0 23h kube-system kubernetes-proxy-2x2l9 1/1 Running 0 23h kube-system kubernetes-scheduler-anchor-mqw5j 1/1 Running 0 23h kube-system kubernetes-scheduler-mtn15r07c001 1/1 Running 0 23h kube-system nfs-provisioner-7799d64d59-z2wwd 1/1 Running 0 23h ucp airship-ucp-keystone-memcached-memcached-74d79d8896-cff8q 1/1 Running 0 23h ucp airship-ucp-rabbitmq-rabbitmq-0 1/1 Running 0 23h ucp divingbell-apparmor-default-7czhv 1/1 Running 0 22h ucp divingbell-apt-default-trvxq 1/1 Running 0 22h ucp divingbell-ethtool-default-mdkdv 1/1 Running 0 22h ucp divingbell-exec-default-n8z7r 1/1 Running 0 22h ucp divingbell-limits-default-wp2p9 1/1 Running 0 22h ucp divingbell-mounts-default-fc036fae-vrwmv 1/1 Running 0 22h ucp divingbell-perm-default-rv4ff 1/1 Running 0 22h ucp divingbell-sysctl-default-x8jpz 1/1 Running 0 22h ucp divingbell-uamlite-default-g9dnv 1/1 Running 0 22h ucp ingress-86576d6599-zdf7q 1/1 Running 0 23h ucp ingress-error-pages-5c97bb46bb-c9jhz 1/1 Running 0 23h ucp keystone-api-7c99d578b7-fvf6j 1/1 Running 0 23h ucp keystone-bootstrap-qsf4g 0/1 Completed 0 23h ucp keystone-credential-setup-6xsjs 0/1 Completed 0 23h ucp keystone-db-init-lpj2t 0/1 Completed 0 23h ucp keystone-db-sync-m28br 0/1 Completed 0 23h ucp keystone-domain-manage-rj66q 0/1 Completed 0 23h ucp keystone-fernet-rotate-1553644800-m2gx8 0/1 Init:0/1 0 21h ucp keystone-fernet-setup-8ffkj 0/1 Completed 0 23h ucp keystone-rabbit-init-95xht 0/1 Completed 0 23h ucp maas-bootstrap-admin-user-7bfgx 0/1 Init:0/1 0 21h ucp maas-db-init-r5mkj 0/1 Init:0/1 0 21h ucp maas-db-sync-gpwq2 0/1 Init:0/1 0 21h ucp maas-export-api-key-tk9c8 0/1 Init:0/1 0 21h ucp maas-import-resources-kftsl 0/1 Init:0/1 0 21h ucp maas-ingress-567777887c-v9fzp 1/2 CrashLoopBackOff 261 21h ucp maas-ingress-errors-798cbd8c4c-q987s 0/1 ContainerCreating 0 21h ucp maas-rack-0 0/1 Init:0/1 0 21h ucp maas-rack-1 0/1 Pending 0 21h ucp maas-region-0 0/1 Init:0/1 0 21h ucp mariadb-ingress-6c9dcbc755-bp5r6 1/1 Running 0 23h ucp mariadb-ingress-error-pages-b7f9f85c7-qbnh8 1/1 Running 0 23h ucp mariadb-server-0 1/1 Running 0 23h ucp postgresql-0 1/1 Running 0 23h root@mtn15r07c001:~# kubectl describe pods maas-ingress-567777887c-v9fzp --namespace=ucp Name: maas-ingress-567777887c-v9fzp Namespace: ucp Node: mtn15r07c001/135.21.35.69 Start Time: Tue, 26 Mar 2019 23:55:29 +0000 Labels: application=maas component=ingress pod-template-hash=1233334437 release_group=airship-maas Annotations: configmap-bin-hash=4b7d801062899a7d636c1f3e1c943bfad865192b964fea74b9057d85eec28d52 configmap-etc-hash=6ae6a39a1a7edf9c6d28d6952cf28fa1673062dc655a10ed04484f4ac80ffb8a Status: Running IP: 135.21.35.69 Controlled By: ReplicaSet/maas-ingress-567777887c Init Containers: init: Container ID: docker://6abdaa7b1adc8a1c3e1a3e7cb39c20684c63aa19a72b3261298cfdff21cd0188 Image: quay.io/stackanetes/kubernetes-entrypoint:v0.3.1 Image ID: docker-pullable://quay.io/stackanetes/kubernetes-entrypoint@sha256:32b1b657ee4bcc9cc7a1529e31d8e1a06376172373ee020f97f3e78168fde4b6 Port: <none> Host Port: <none> Command: kubernetes-entrypoint State: Terminated Reason: Completed Exit Code: 0 Started: Tue, 26 Mar 2019 23:55:33 +0000 Finished: Tue, 26 Mar 2019 23:55:33 +0000 Ready: True Restart Count: 0 Environment: POD_NAME: maas-ingress-567777887c-v9fzp (v1:metadata.name) NAMESPACE: ucp (v1:metadata.namespace) INTERFACE_NAME: eth0 PATH: /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/ DEPENDENCY_SERVICE: DEPENDENCY_DAEMONSET: DEPENDENCY_CONTAINER: DEPENDENCY_POD_JSON: COMMAND: echo done Mounts: /var/run/secrets/kubernetes.io/serviceaccount from maas-ingress-token-8qlcl (ro) maas-ingress-vip-init: Container ID: docker://195e75792c7592c90cff15703a7a977c721b4f863e0834033a72302e683a3a7d Image: docker.io/busybox:latest Image ID: docker-pullable://busybox@sha256:061ca9704a714ee3e8b80523ec720c64f6209ad3f97c0ff7cb9ec7d19f15149f Port: <none> Host Port: <none> Command: /tmp/maas-vip-configure.sh start State: Terminated Reason: Completed Exit Code: 0 Started: Tue, 26 Mar 2019 23:55:34 +0000 Finished: Tue, 26 Mar 2019 23:55:34 +0000 Ready: True Restart Count: 0 Environment: addr: 192.169.1.5/32 interface: maas-vip mode: routed Mounts: /mnt/host-rootfs from host-rootfs (ro) /tmp/maas-vip-configure.sh from maas-bin (ro) /var/run/secrets/kubernetes.io/serviceaccount from maas-ingress-token-8qlcl (ro) Containers: maas-ingress-vip: Container ID: docker://8be5e78def6312c70d48f0bbe57c77e4b95ab3e5a417416cc0c6d1d3d44ff536 Image: docker.io/busybox:latest Image ID: docker-pullable://busybox@sha256:061ca9704a714ee3e8b80523ec720c64f6209ad3f97c0ff7cb9ec7d19f15149f Port: <none> Host Port: <none> Command: /bin/init State: Running Started: Tue, 26 Mar 2019 23:55:35 +0000 Ready: True Restart Count: 0 Environment: addr: 192.169.1.5/32 interface: maas-vip mode: routed Mounts: /etc/inittab from maas-etc (ro) /tmp/maas-vip-configure.sh from maas-bin (ro) /var/run/secrets/kubernetes.io/serviceaccount from maas-ingress-token-8qlcl (ro) maas-ingress: Container ID: docker://a892c56049d267479c0298e3fe077eed4cc0a73968d069ad5b4eee8fb6f9431f Image: quay.io/kubernetes-ingress-controller/nginx-ingress-controller:0.20.0 Image ID: docker-pullable://quay.io/kubernetes-ingress-controller/nginx-ingress-controller@sha256:f6180c5397d2361c317aff1314dc192ab0f9f515346a5319422cdc264f05d2d9 Port: <none> Host Port: <none> Command: /tmp/maas-ingress.sh start State: Waiting Reason: CrashLoopBackOff Last State: Terminated Reason: Error Exit Code: 255 Started: Wed, 27 Mar 2019 20:13:16 +0000 Finished: Wed, 27 Mar 2019 20:13:16 +0000 Ready: False Restart Count: 243 Environment: POD_NAMESPACE: ucp (v1:metadata.namespace) POD_NAME: maas-ingress-567777887c-v9fzp (v1:metadata.name) RELEASE_NAME: airship-maas HTTP_PORT: 80 HTTPS_PORT: 443 HEALTHZ_PORT: 10254 STATUS_PORT: 18080 ERROR_PAGE_SERVICE: maas-ingress-error DEFAULT_ERROR_PORT: 8181 Mounts: /tmp/maas-ingress.sh from maas-bin (ro) /var/run/secrets/kubernetes.io/serviceaccount from maas-ingress-token-8qlcl (ro) Conditions: Type Status Initialized True Ready False PodScheduled True Volumes: maas-bin: Type: ConfigMap (a volume populated by a ConfigMap) Name: maas-bin Optional: false maas-etc: Type: ConfigMap (a volume populated by a ConfigMap) Name: maas-etc Optional: false host-rootfs: Type: HostPath (bare host directory volume) Path: / HostPathType: maas-ingress-token-8qlcl: Type: Secret (a volume populated by a Secret) SecretName: maas-ingress-token-8qlcl Optional: false QoS Class: BestEffort Node-Selectors: ucp-control-plane=enabled Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s node.kubernetes.io/unreachable:NoExecute for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Warning BackOff 2m (x5500 over 20h) kubelet, mtn15r07c001 Back-off restarting failed container root@mtn15r07c001:~# Regards, Muzammil Architect Network & Shared Services 469-600-0477 [cid:image001.png@01D32007.C3B5AE40]