<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
        {font-family:宋体;
        panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
        {font-family:"Cambria Math";
        panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
        {font-family:DengXian;
        panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
        {font-family:Calibri;
        panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
        {font-family:"Calibri Light";
        panose-1:2 15 3 2 2 2 4 3 2 4;}
@font-face
        {font-family:"\@宋体";
        panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
        {font-family:"\@等线";
        panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
        {font-family:"Segoe Script";
        panose-1:3 11 5 4 2 0 0 0 0 3;}
@font-face
        {font-family:"Segoe UI";
        panose-1:2 11 5 2 4 2 4 2 2 3;}
@font-face
        {font-family:Tahoma;
        panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
        {font-family:Consolas;
        panose-1:2 11 6 9 2 2 4 3 2 4;}
@font-face
        {font-family:"Monotype Corsiva";
        panose-1:3 1 1 1 1 2 1 1 1 1;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
        {margin:0cm;
        margin-bottom:.0001pt;
        font-size:12.0pt;
        font-family:"Times New Roman",serif;}
h1
        {mso-style-priority:9;
        mso-style-link:"Heading 1 Char";
        mso-margin-top-alt:auto;
        margin-right:0cm;
        mso-margin-bottom-alt:auto;
        margin-left:0cm;
        font-size:24.0pt;
        font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
        {mso-style-priority:99;
        color:blue;
        text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
        {mso-style-priority:99;
        color:purple;
        text-decoration:underline;}
span.Heading1Char
        {mso-style-name:"Heading 1 Char";
        mso-style-priority:9;
        mso-style-link:"Heading 1";
        font-family:"Calibri Light",sans-serif;
        color:#2E74B5;}
p.msonormal0, li.msonormal0, div.msonormal0
        {mso-style-name:msonormal;
        mso-margin-top-alt:auto;
        margin-right:0cm;
        mso-margin-bottom-alt:auto;
        margin-left:0cm;
        font-size:12.0pt;
        font-family:宋体;}
span.EmailStyle19
        {mso-style-type:personal;
        font-family:"Calibri",sans-serif;
        color:#1F497D;}
span.EmailStyle21
        {mso-style-type:personal-reply;
        font-family:DengXian;
        color:windowtext;}
.MsoChpDefault
        {mso-style-type:export-only;
        font-size:10.0pt;}
@page WordSection1
        {size:612.0pt 792.0pt;
        margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
        {page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="ZH-CN" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Hi,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Thanks very much for your reply.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">I adjust the replica count on site level (set 1, instead of 2) and<b><span style="color:red"> ceph-rgw pod</span></b> still have
<b><span style="color:red">getsockopt: connection refused error</span></b>. Below is the log detail:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian;color:red">root@cab23-r720-11:~# kubectl describe pod ceph-rgw-5b6645c456-rsv4k -n ceph<o:p></o:p></span></b></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Name:           ceph-rgw-5b6645c456-rsv4k<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Namespace:      ceph<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Node:           cab23-r720-11/10.23.22.11<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Start Time:     Wed, 07 Nov 2018 23:07:06 +0000<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Labels:         application=ceph<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">                component=rgw<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">                pod-template-hash=1622017012<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">                release_group=airship-ucp-ceph-rgw<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Annotations:    configmap-bin-hash=aee34fa624622fb03c48b85c014e805a1012f74f772bc0f3a1e91597839ce49e<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">                configmap-etc-client-hash=38eb0b2eb23d31bcd3c4238c2bf9f6b8acd335659d94b3fcfff6c333ed1339b2<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Status:         Running<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">IP:             10.97.38.77<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Controlled By:  ReplicaSet/ceph-rgw-5b6645c456<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Events:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">  Type     Reason     Age                  From                    Message<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">  ----     ------     ----                 ----                    -------<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">  Warning  BackOff    5m (x737 over 7h)    kubelet, cab23-r720-11  Back-off restarting failed container<o:p></o:p></span></p>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian;color:red">  Warning  Unhealthy  39s (x1154 over 7h)  kubelet, cab23-r720-11  Readiness probe failed: Get http://10.97.38.77:8088/: dial tcp 10.97.38.77:8088: getsockopt:
 connection refused<o:p></o:p></span></b></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian;color:red">root@cab23-r720-11:~# kubectl logs -f ceph-rgw-5b6645c456-rsv4k -n ceph<o:p></o:p></span></b></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">+ export LC_ALL=C<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">+ LC_ALL=C<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">+ : 0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">++ uname -n<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">+ : ceph-rgw-5b6645c456-rsv4k<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">+ : ''<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">+ : ''<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">+ : 0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">+ : 9000<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">+ : 0.0.0.0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">+ : /etc/ceph/ceph.client.admin.keyring<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">+ : /var/lib/ceph/radosgw/ceph-rgw-5b6645c456-rsv4k/keyring<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">+ : /var/lib/ceph/bootstrap-rgw/ceph.keyring<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">+ [[ ! -e /etc/ceph/ceph.conf ]]<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">+ '[' 0 -eq 1 ']'<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">+ '[' '!' -e /var/lib/ceph/radosgw/ceph-rgw-5b6645c456-rsv4k/keyring ']'<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">+ RGW_FRONTENDS='civetweb port=8088'<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">+ '[' 0 -eq 1 ']'<o:p></o:p></span></p>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian;color:red">+ /usr/bin/radosgw --cluster ceph --setuser ceph --setgroup ceph -d -n client.rgw.ceph-rgw-5b6645c456-rsv4k -k /var/lib/ceph/radosgw/ceph-rgw-5b6645c456-rsv4k/keyring
 --rgw-socket-path= --rgw-zonegroup= --rgw-zone= '--rgw-frontends=civetweb port=8088'<o:p></o:p></span></b></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">2018-11-08 06:53:53.769321 7f3c7826de80  0 deferred set uid:gid to 64045:64045 (ceph:ceph)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">2018-11-08 06:53:53.769371 7f3c7826de80  0 ceph version 12.2.3 (2dab17a455c09584f2a85e6b10888337d1ec8949) luminous (stable), process (unknown), pid 8<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian;color:red">root@cab23-r720-11:~# kubectl get pods -n ceph</span></b><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"><o:p></o:p></span></b></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">NAME                                                        READY     STATUS      RESTARTS   AGE<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">airship-ucp-ceph-provisioners-ceph-ns-key-generator-8vm8b   0/1       Completed   0          20h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-bootstrap-mp5tn                                        0/1       Completed   0          22h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-cephfs-client-key-generator-4sqrd                      0/1       Completed   0          20h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-cephfs-provisioner-676684f6bd-48fq8                    1/1       Running     0          20h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-cephfs-provisioner-676684f6bd-mqwnj                    1/1       Running     0          20h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-mds-6bfb74d9c7-gqgtl                                   1/1       Running     0          22h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-mds-6bfb74d9c7-sk4pw                                   1/1       Running     0          22h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-mds-keyring-generator-m2rjj                            0/1       Completed   0          22h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-mgr-6dc44fc75b-jtv7w                                   0/1       Pending     0          22h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-mgr-6dc44fc75b-jvstm                                   1/1       Running     0          22h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-mgr-keyring-generator-m56p5                            0/1       Completed   0          22h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-mon-check-6db6b569b6-flg76                             1/1       Running     0          22h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-mon-h2gsm                                              1/1       Running     0          21h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-mon-keyring-generator-5phjm                            0/1       Completed   0          22h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-osd-default-64779b8c-c74ms                             1/1       Running     0          22h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-osd-default-6ea9de2c-hn4tm                             1/1       Running     0          22h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-osd-default-70a54190-t54l7                             1/1       Running     0          22h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-osd-default-7544b6da-mxfj6                             1/1       Running     1          22h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-osd-default-7cfc44c1-vbqs4                             1/1       Running     0          22h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-osd-default-83945928-66m9s                             1/1       Running     0          22h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-osd-default-be8e8cc4-2vnxb                             1/1       Running     0          22h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-osd-default-f9249fa9-8gw25                             1/1       Running     0          22h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-osd-keyring-generator-fnrgk                            0/1       Completed   0          22h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-rbd-pool-4dzjz                                         0/1       Completed   0          22h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-rbd-provisioner-84bc5c88c7-smfcn                       1/1       Running     0          20h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-rbd-provisioner-84bc5c88c7-vtc5g                       1/1       Running     0          20h<o:p></o:p></span></p>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian;color:red">ceph-rgw-5b6645c456-rsv4k                                   0/1       Running     74         8h<o:p></o:p></span></b></p>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian;color:red">ceph-rgw-5b6645c456-sgzpt                                   0/1       Running     74         8h<o:p></o:p></span></b></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-rgw-storage-init-pqf6q                                 0/1       Completed   0          8h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-storage-keys-generator-9fx4k                           0/1       Completed   0          22h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ingress-65dc849968-9zlqn                                    1/1       Running     0          22h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ingress-65dc849968-cc8xp                                    1/1       Running     0          22h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ingress-error-pages-796b76c856-dnpcp                        1/1       Running     0          22h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ingress-error-pages-796b76c856-tt9x4                        1/1       Running     0          22h<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"><o:p> </o:p></span></p>
<p class="MsoNormal" style="text-align:justify;text-justify:inter-ideograph;background:white">
<b><span lang="EN-US" style="font-size:10.5pt;font-family:"Monotype Corsiva";color:#1F497D">Best Regards!</span></b><span lang="EN-US" style="font-size:10.5pt;font-family:"Segoe UI",sans-serif"><o:p></o:p></span></p>
<p class="MsoNormal" style="text-align:justify;text-justify:inter-ideograph;background:white">
<b><span lang="EN-US" style="font-size:10.5pt;font-family:"Monotype Corsiva";color:#1F497D">Qiaolin Tu</span></b><span lang="EN-US" style="font-size:10.5pt;font-family:"Segoe UI",sans-serif"><o:p></o:p></span></p>
<p class="MsoNormal" style="text-align:justify;text-justify:inter-ideograph;background:white">
<span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma",sans-serif;color:#7F7F7F">NSB MN 5G ECE HZ CN2 SG04</span><span lang="EN-US" style="font-size:10.5pt;font-family:"Segoe UI",sans-serif"><o:p></o:p></span></p>
<p class="MsoNormal" style="text-align:justify;text-justify:inter-ideograph;background:white">
<span lang="EN-US" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:gray">Mobile:
</span><span lang="EN-US" style="font-size:10.0pt;font-family:"Arial",sans-serif;color:gray"> +86 138 057 59684</span><span lang="EN-US" style="font-size:10.5pt;font-family:"Segoe UI",sans-serif"><o:p></o:p></span></p>
<p class="MsoNormal" style="text-align:justify;text-justify:inter-ideograph;background:white">
<span lang="EN-US" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:gray">E-Mail:  
<a href="mailto:qiaolin.tu@nokia-sbell.com">qiaolin.tu@nokia-sbell.com</a></span><span lang="EN-US" style="font-size:10.5pt;font-family:"Segoe UI",sans-serif"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif"> SKELS, KASPARS <ks3019@att.com>
<br>
<b>Sent:</b> Wednesday, November 07, 2018 4:28 AM<br>
<b>To:</b> Tu, Qiaolin (NSB - CN/Hangzhou) <qiaolin.tu@nokia-sbell.com>; Li, Maxwell (NSB - CN/Hangzhou) <maxwell.li@nokia-sbell.com><br>
<b>Cc:</b> GORSHUNOV, ROMAN <roman.gorshunov@att.com>; MEADOWS, ALAN <am240k@att.com>; MCEUEN, MATT <MM9745@att.com>; PACHECO, RODOLFO J <rp2723@att.com>; 'airship-discuss@lists.airshipit.org' <airship-discuss@lists.airshipit.org><br>
<b>Subject:</b> RE: Airship installation Questions<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Hi Qiaolin/Maxwell,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">it seems like you may be using 1 control node for your deployment.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">The
</span><span lang="EN-US" style="font-size:11.0pt;font-family:Consolas;color:#1F497D">ceph-mgr</span><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> chart is set to have 2 replicas and is trying to launch them (here
 you get a port clash).<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Generally speaking, the manifests (by default) are targeted for 3 control node (HA) configuration, including ceph to reflect production-like HA deployment<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><a href="https://github.com/openstack/airship-treasuremap/blob/master/global/software/charts/ucp/ceph/ceph-client-update.yaml#L145">https://github.com/openstack/airship-treasuremap/blob/master/global/software/charts/ucp/ceph/ceph-client-update.yaml#L145</a><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">That said, you may adjust the replica count on site level (set 1, instead of 2) as well, as well as OSD count here by doing overrides (matching how
 many OSDs you have)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><a href="https://github.com/openstack/airship-treasuremap/blob/master/site/airship-seaworthy/software/charts/ucp/ceph/ceph-client-update.yaml">https://github.com/openstack/airship-treasuremap/blob/master/site/airship-seaworthy/software/charts/ucp/ceph/ceph-client-update.yaml</a><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">And also, adjustments in other charts may be required to set this up for a single control plane node, here is more info on reference site<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><a href="https://airship-treasuremap.readthedocs.io/en/latest/seaworthy.html">https://airship-treasuremap.readthedocs.io/en/latest/seaworthy.html</a><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Kindly, Kaspars<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Kaspars Skels [<a href="mailto:kaspars.skels@gmail.com">mailto:kaspars.skels@gmail.com</a>]
<br>
<b>Sent:</b> Tuesday, November 6, 2018 2:10 PM<br>
<b>To:</b> <a href="mailto:qiaolin.tu@nokia-sbell.com">qiaolin.tu@nokia-sbell.com</a><br>
<b>Cc:</b> MEADOWS, ALAN <<a href="mailto:am240k@att.com">am240k@att.com</a>>; MONTEIRO, FELIPE C <<a href="mailto:fm577c@att.com">fm577c@att.com</a>>; BARTRA, RICK <<a href="mailto:rb560u@att.com">rb560u@att.com</a>>; REDDY, CHINASUBBA <<a href="mailto:cr3938@att.com">cr3938@att.com</a>>;
 GORSHUNOV, ROMAN <<a href="mailto:roman.gorshunov@att.com">roman.gorshunov@att.com</a>>; KHUNTIA, SOUMITRA <<a href="mailto:sk698p@att.com">sk698p@att.com</a>>; KABANOV, DMITRII <<a href="mailto:dk370c@att.com">dk370c@att.com</a>>; Mark Burnett <<a href="mailto:mark.m.burnett@gmail.com">mark.m.burnett@gmail.com</a>>;
 VOLKOV, ANDREY <<a href="mailto:av903u@att.com">av903u@att.com</a>>; <a href="mailto:avolkov@mirantis.com">
avolkov@mirantis.com</a>; Chris Wedgwood <<a href="mailto:cw@f00f.org">cw@f00f.org</a>>; PALLAV GUPTA <<a href="mailto:pallavgupta84@gmail.com">pallavgupta84@gmail.com</a>>; GUPTA, SANGEET <<a href="mailto:sg774j@att.com">sg774j@att.com</a>>;
<a href="mailto:zuul@review01.openstack.org">zuul@review01.openstack.org</a>; HUSSEY, SCOTT T <<a href="mailto:sh8121@att.com">sh8121@att.com</a>>; PACHECO, RODOLFO J <<a href="mailto:rp2723@att.com">rp2723@att.com</a>>;
<a href="mailto:maxwell.li@nokia-sbell.com">maxwell.li@nokia-sbell.com</a>; SKELS, KASPARS <<a href="mailto:ks3019@att.com">ks3019@att.com</a>><br>
<b>Subject:</b> Re: Airship installation Questions<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
</div>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">On Tue, Nov 6, 2018 at 3:42 AM Tu, Qiaolin (NSB - CN/Hangzhou) <<a href="mailto:qiaolin.tu@nokia-sbell.com">qiaolin.tu@nokia-sbell.com</a>> wrote:<o:p></o:p></span></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Hi,</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">I also found that pod(<b><span style="color:red">ceph-mgr-6dc44fc75b-25n24</span></b>) is always on the pending
 state. It report error as below: </span><b><span lang="EN-US" style="font-size:10.5pt;color:red">  </span></b><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian;color:red">Warning</span></b><b><span lang="EN-US" style="font-size:10.5pt;color:red"> </span></b><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian;color:red">
 FailedScheduling</span></b><b><span lang="EN-US" style="font-size:10.5pt;color:red"> </span></b><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian;color:red"> 1m (x125 over 36m)</span></b><b><span lang="EN-US" style="font-size:10.5pt;color:red"> </span></b><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian;color:red">
 default-scheduler</span></b><b><span lang="EN-US" style="font-size:10.5pt;color:red"> </span></b><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian;color:red"> 0/1 nodes are available: 1 node(s) didn't have free ports for the requested pod
 ports.</span></b><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">root@cab23-r720-11:~# kubectl get pods --all-namespaces</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">NAMESPACE</span><span lang="EN-US" style="font-size:10.5pt">    </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 NAME</span><span lang="EN-US" style="font-size:10.5pt">                                                       </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> READY</span><span lang="EN-US" style="font-size:10.5pt">    </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 STATUS</span><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> RESTARTS</span><span lang="EN-US" style="font-size:10.5pt">  </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 AGE</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph</span><span lang="EN-US" style="font-size:10.5pt">      </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
</span><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">airship-ucp-ceph-provisioners-ceph-ns-key-generator-n5vzj</span><span lang="EN-US" style="font-size:10.5pt">  </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 0/1</span><span lang="EN-US" style="font-size:10.5pt">      </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Completed</span><span lang="EN-US" style="font-size:10.5pt">  </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 0</span><span lang="EN-US" style="font-size:10.5pt">         </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> 20m</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph</span><span lang="EN-US" style="font-size:10.5pt">         </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ceph-cephfs-client-key-generator-656rd</span><span lang="EN-US" style="font-size:10.5pt">                     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> 0/1</span><span lang="EN-US" style="font-size:10.5pt">      </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 Completed</span><span lang="EN-US" style="font-size:10.5pt">  </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> 0</span><span lang="EN-US" style="font-size:10.5pt">         </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 20m</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph</span><span lang="EN-US" style="font-size:10.5pt">         </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ceph-cephfs-provisioner-676684f6bd-trf5h</span><span lang="EN-US" style="font-size:10.5pt">                   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> 1/1</span><span lang="EN-US" style="font-size:10.5pt">      </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 Running</span><span lang="EN-US" style="font-size:10.5pt">    </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> 0</span><span lang="EN-US" style="font-size:10.5pt">         </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 20m</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph</span><span lang="EN-US" style="font-size:10.5pt">         </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ceph-cephfs-provisioner-676684f6bd-zfk2s</span><span lang="EN-US" style="font-size:10.5pt">                   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> 1/1</span><span lang="EN-US" style="font-size:10.5pt">      </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 Running</span><span lang="EN-US" style="font-size:10.5pt">    </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> 0</span><span lang="EN-US" style="font-size:10.5pt">         </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 20m</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph</span><span lang="EN-US" style="font-size:10.5pt">         </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ceph-mds-6bfb74d9c7-btbt5</span><span lang="EN-US" style="font-size:10.5pt">                                  </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> 1/1</span><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
</span><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Running</span><span lang="EN-US" style="font-size:10.5pt">    </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 0</span><span lang="EN-US" style="font-size:10.5pt">         </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> 37m</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph</span><span lang="EN-US" style="font-size:10.5pt">         </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ceph-mds-6bfb74d9c7-qw4xl</span><span lang="EN-US" style="font-size:10.5pt">                                  </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> 1/1</span><span lang="EN-US" style="font-size:10.5pt">      </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 Running</span><span lang="EN-US" style="font-size:10.5pt">    </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> 0</span><span lang="EN-US" style="font-size:10.5pt">         </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 37m</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph</span><span lang="EN-US" style="font-size:10.5pt">         </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ceph-mds-keyring-generator-dlqjt</span><span lang="EN-US" style="font-size:10.5pt">                           </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> 0/1</span><span lang="EN-US" style="font-size:10.5pt">      </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 Completed</span><span lang="EN-US" style="font-size:10.5pt">  </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> 0</span><span lang="EN-US" style="font-size:10.5pt">         </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 53m</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian;color:red">ceph</span></b><b><span lang="EN-US" style="font-size:10.5pt;color:red">         </span></b><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian;color:red">
 ceph-mgr-6dc44fc75b-25n24</span></b><b><span lang="EN-US" style="font-size:10.5pt;color:red">                                  </span></b><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian;color:red"> 0/1</span></b><b><span lang="EN-US" style="font-size:10.5pt;color:red">      </span></b><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian;color:red">
 Pending</span></b><b><span lang="EN-US" style="font-size:10.5pt;color:red">    </span></b><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian;color:red"> 0</span></b><b><span lang="EN-US" style="font-size:10.5pt;color:red">         </span></b><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian;color:red">
 37m</span></b><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph</span></b><b><span lang="EN-US" style="font-size:10.5pt">         </span></b><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ceph-mgr-6dc44fc75b-42mqz</span></b><b><span lang="EN-US" style="font-size:10.5pt">                                  </span></b><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> 1/1</span></b><b><span lang="EN-US" style="font-size:10.5pt">      </span></b><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 Running</span></b><b><span lang="EN-US" style="font-size:10.5pt">    </span></b><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> 0</span></b><b><span lang="EN-US" style="font-size:10.5pt">         </span></b><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 37m</span></b><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph</span><span lang="EN-US" style="font-size:10.5pt">         </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ceph-mgr-keyring-generator-7dftx</span><span lang="EN-US" style="font-size:10.5pt">                           </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> 0/1</span><span lang="EN-US" style="font-size:10.5pt">      </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 Completed</span><span lang="EN-US" style="font-size:10.5pt">  </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> 0</span><span lang="EN-US" style="font-size:10.5pt">         </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 53m</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph</span><span lang="EN-US" style="font-size:10.5pt">         </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ceph-mon-cfrf6</span><span lang="EN-US" style="font-size:10.5pt">                                             </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> 1/1</span><span lang="EN-US" style="font-size:10.5pt">      </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 Running</span><span lang="EN-US" style="font-size:10.5pt">    </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> 0</span><span lang="EN-US" style="font-size:10.5pt">         </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 41m</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph</span><span lang="EN-US" style="font-size:10.5pt">         </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ceph-mon-check-6db6b569b6-67vvm</span><span lang="EN-US" style="font-size:10.5pt">                        </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
</span><span lang="EN-US" style="font-size:10.5pt">    </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">1/1</span><span lang="EN-US" style="font-size:10.5pt">      </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 Running</span><span lang="EN-US" style="font-size:10.5pt">    </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> 0</span><span lang="EN-US" style="font-size:10.5pt">         </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 53m</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph</span><span lang="EN-US" style="font-size:10.5pt">         </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ceph-mon-keyring-generator-55ps8</span><span lang="EN-US" style="font-size:10.5pt">                           </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> 0/1</span><span lang="EN-US" style="font-size:10.5pt">      </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 Completed</span><span lang="EN-US" style="font-size:10.5pt">  </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> 0</span><span lang="EN-US" style="font-size:10.5pt">         </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 53m</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">root@cab23-r720-11:~#
<b><span style="color:red">kubectl describe pod ceph-mgr-6dc44fc75b-25n24 -n ceph</span></b></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Name:</span><span lang="EN-US" style="font-size:10.5pt">          </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ceph-mgr-6dc44fc75b-25n24</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Namespace:</span><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ceph</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Node:</span><span lang="EN-US" style="font-size:10.5pt">          </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 <none></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Labels:</span><span lang="EN-US" style="font-size:10.5pt">        </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 application=ceph</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">               </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> component=mgr</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">               </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> pod-template-hash=2870097316</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">               </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> release_group=airship-ucp-ceph-client</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Annotations:</span><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 configmap-bin-hash=d23610f5cc67014b596eb45b9d47ddb97997d6ec5fd3289fb264429a260f39a9</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">               </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> configmap-etc-client-hash=0174be85f29398aa5cea5fccb9537e0e0f25ea2d2f280182e9e2506a1be1b115</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Status:</span><span lang="EN-US" style="font-size:10.5pt">        </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 Pending</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">IP:</span><span lang="EN-US" style="font-size:10.5pt">            </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Controlled By:</span><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ReplicaSet/ceph-mgr-6dc44fc75b</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Init Containers:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> init:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Image:</span><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__quay.io_stackanetes_kubernetes-2Dentrypoint-3Av0.3.1&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=L2WcX1Ge33cpIHXX6krAgw&m=Yfn1URqa4p-w7xoxiueJJP2SNYUZZCsOA07XxDCOxEM&s=QVq3KXWVyPVji_O3s5wgjBk7wnbkw3swE9ddmYytPOw&e=" target="_blank">
quay.io/stackanetes/kubernetes-entrypoint:v0.3.1</a></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Port:</span><span lang="EN-US" style="font-size:10.5pt">      </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 <none></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Host Port:</span><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 <none></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Command:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> kubernetes-entrypoint</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Environment:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> POD_NAME:</span><span lang="EN-US" style="font-size:10.5pt">       </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
</span><span lang="EN-US" style="font-size:10.5pt">      </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-mgr-6dc44fc75b-25n24 (v1:<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__metadata.name&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=L2WcX1Ge33cpIHXX6krAgw&m=Yfn1URqa4p-w7xoxiueJJP2SNYUZZCsOA07XxDCOxEM&s=DIlvVxm8OFCSVZEOPMgsZQb4rkRx8zql64UE_2OnMjU&e=" target="_blank">metadata.name</a>)</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> NAMESPACE:</span><span lang="EN-US" style="font-size:10.5pt">            </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ceph (v1:metadata.namespace)</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> INTERFACE_NAME:</span><span lang="EN-US" style="font-size:10.5pt">       </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 eth0</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> PATH:</span><span lang="EN-US" style="font-size:10.5pt">                 </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> DEPENDENCY_SERVICE:</span><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ceph:ceph-mon</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> DEPENDENCY_JOBS:</span><span lang="EN-US" style="font-size:10.5pt">      </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ceph-storage-keys-generator,ceph-mgr-keyring-generator</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> DEPENDENCY_DAEMONSET:</span><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">      </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">DEPENDENCY_CONTAINER:</span><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">      </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">DEPENDENCY_POD_JSON:</span><span lang="EN-US" style="font-size:10.5pt">  </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">      </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">COMMAND:</span><span lang="EN-US" style="font-size:10.5pt">              </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 echo done</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Mounts:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> /var/run/secrets/<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__kubernetes.io_serviceaccount&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=L2WcX1Ge33cpIHXX6krAgw&m=Yfn1URqa4p-w7xoxiueJJP2SNYUZZCsOA07XxDCOxEM&s=S6tMkfnBpnWWGsjH58zRIhEcnxQ0dJINNWuoTXXeNyI&e=" target="_blank">kubernetes.io/serviceaccount</a>
 from ceph-mgr-token-pgbwp (ro)</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> ceph-init-dirs:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Image:</span><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__docker.io_ceph_daemon-3Atag-2Dbuild-2Dmaster-2Dluminous-2Dubuntu-2D16.04&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=L2WcX1Ge33cpIHXX6krAgw&m=Yfn1URqa4p-w7xoxiueJJP2SNYUZZCsOA07XxDCOxEM&s=wD6kGoJq_VjM3q9MaytwbkA4gjV0HuHeKt7ZJ_419m4&e=" target="_blank">
docker.io/ceph/daemon:tag-build-master-luminous-ubuntu-16.04</a></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Port:</span><span lang="EN-US" style="font-size:10.5pt">      </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 <none></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Host Port:</span><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 <none></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Command:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> /tmp/init-dirs.sh</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Environment:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> CLUSTER:</span><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ceph</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Mounts:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> /etc/ceph from pod-etc-ceph (rw)</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> /run from pod-run (rw)</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> /tmp/init-dirs.sh from ceph-client-bin (ro)</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> /var/lib/ceph from pod-var-lib-ceph (rw)</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> /var/run/secrets/<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__kubernetes.io_serviceaccount&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=L2WcX1Ge33cpIHXX6krAgw&m=Yfn1URqa4p-w7xoxiueJJP2SNYUZZCsOA07XxDCOxEM&s=S6tMkfnBpnWWGsjH58zRIhEcnxQ0dJINNWuoTXXeNyI&e=" target="_blank">kubernetes.io/serviceaccount</a>
 from ceph-mgr-token-pgbwp (ro)</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Containers:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> ceph-mgr:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Image:</span><span lang="EN-US" style="font-size:10.5pt">      </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__docker.io_ceph_daemon-3Atag-2Dbuild-2Dmaster-2Dluminous-2Dubuntu-2D16.04&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=L2WcX1Ge33cpIHXX6krAgw&m=Yfn1URqa4p-w7xoxiueJJP2SNYUZZCsOA07XxDCOxEM&s=wD6kGoJq_VjM3q9MaytwbkA4gjV0HuHeKt7ZJ_419m4&e=" target="_blank">
docker.io/ceph/daemon:tag-build-master-luminous-ubuntu-16.04</a></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Ports:</span><span lang="EN-US" style="font-size:10.5pt">      </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 7000/TCP, 9283/TCP</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Host Ports:</span><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 7000/TCP, 9283/TCP</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Command:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> /mgr-start.sh</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
</span><span lang="EN-US" style="font-size:10.5pt">  </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Liveness:</span><span lang="EN-US" style="font-size:10.5pt">  </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 exec [/tmp/mgr-check.sh liveness] delay=30s timeout=5s period=10s #success=1 #failure=3</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Readiness:</span><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 exec [/tmp/mgr-check.sh readiness] delay=30s timeout=5s period=10s #success=1 #failure=3</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Environment:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> CLUSTER:</span><span lang="EN-US" style="font-size:10.5pt">         </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ceph</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">  </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
</span><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ENABLED_MODULES:</span><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 restful</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">status</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">prometheus</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Mounts:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> /etc/ceph from pod-etc-ceph (rw)</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> /etc/ceph/ceph.client.admin.keyring from ceph-client-admin-keyring
 (ro)</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> /etc/ceph/ceph.conf from ceph-client-etc (ro)</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> /mgr-start.sh from ceph-client-bin (ro)</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> /run from pod-run (rw)</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> /tmp/mgr-check.sh from ceph-client-bin (ro)</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> /var/lib/ceph from pod-var-lib-ceph (rw)</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> /var/lib/ceph/bootstrap-mgr/ceph.keyring from ceph-bootstrap-mgr-keyring
 (rw)</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> /var/run/secrets/<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__kubernetes.io_serviceaccount&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=L2WcX1Ge33cpIHXX6krAgw&m=Yfn1URqa4p-w7xoxiueJJP2SNYUZZCsOA07XxDCOxEM&s=S6tMkfnBpnWWGsjH58zRIhEcnxQ0dJINNWuoTXXeNyI&e=" target="_blank">kubernetes.io/serviceaccount</a>
 from ceph-mgr-token-pgbwp (ro)</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Conditions:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Type</span><span lang="EN-US" style="font-size:10.5pt">          </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 Status</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> PodScheduled</span><span lang="EN-US" style="font-size:10.5pt">  </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 False </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Volumes:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> pod-etc-ceph:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Type:</span><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 EmptyDir (a temporary directory that shares a pod's lifetime)</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Medium:</span><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">  </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">ceph-client-bin:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Type:</span><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ConfigMap (a volume populated by a ConfigMap)</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Name:</span><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ceph-client-bin</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Optional:</span><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 false</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> ceph-client-etc:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Type:</span><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ConfigMap (a volume populated by a ConfigMap)</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Name:</span><span lang="EN-US" style="font-size:10.5pt">     </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ceph-client-etc</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Optional:</span><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 false</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> pod-var-lib-ceph:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Type:</span><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 EmptyDir (a temporary directory that shares a pod's lifetime)</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Medium:</span><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">  </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">pod-run:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Type:</span><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 EmptyDir (a temporary directory that shares a pod's lifetime)</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Medium:</span><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 Memory</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> ceph-client-admin-keyring:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Type:</span><span lang="EN-US" style="font-size:10.5pt">       </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 Secret (a volume populated by a Secret)</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> SecretName:</span><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ceph-client-admin-keyring</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Optional:</span><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 false</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> ceph-bootstrap-mgr-keyring:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Type:</span><span lang="EN-US" style="font-size:10.5pt">       </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 Secret (a volume populated by a Secret)</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> SecretName:</span><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ceph-bootstrap-mgr-keyring</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
</span><span lang="EN-US" style="font-size:10.5pt">  </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Optional:</span><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 false</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> ceph-mgr-token-pgbwp:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Type:</span><span lang="EN-US" style="font-size:10.5pt">       </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 Secret (a volume populated by a Secret)</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> SecretName:</span><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ceph-mgr-token-pgbwp</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Optional:</span><span lang="EN-US" style="font-size:10.5pt">   </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 false</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">QoS Class:</span><span lang="EN-US" style="font-size:10.5pt">      </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 BestEffort</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Node-Selectors:</span><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ceph-mgr=enabled</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Tolerations:</span><span lang="EN-US" style="font-size:10.5pt">    </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__node.kubernetes.io_not-2Dready-3ANoExecute&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=L2WcX1Ge33cpIHXX6krAgw&m=Yfn1URqa4p-w7xoxiueJJP2SNYUZZCsOA07XxDCOxEM&s=7UGHV8v22mtkm09xG6MoMxOg7RO9aa7lQkwQd3yYYqw&e=" target="_blank">
node.kubernetes.io/not-ready:NoExecute</a> for 300s</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt">                </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__node.kubernetes.io_unreachable-3ANoExecute&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=L2WcX1Ge33cpIHXX6krAgw&m=Yfn1URqa4p-w7xoxiueJJP2SNYUZZCsOA07XxDCOxEM&s=U8nhQAM3YHPjGEUgzGDzxxM8T5YYO0V9_PBd7yfaXpU&e=" target="_blank">
node.kubernetes.io/unreachable:NoExecute</a> for 300s</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Events:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Type</span><span lang="EN-US" style="font-size:10.5pt">    </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 Reason</span><span lang="EN-US" style="font-size:10.5pt">           </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Age</span><span lang="EN-US" style="font-size:10.5pt">                </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 From</span><span lang="EN-US" style="font-size:10.5pt">              </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> Message</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> ----</span><span lang="EN-US" style="font-size:10.5pt">    </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ------</span><span lang="EN-US" style="font-size:10.5pt">           </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> ----</span><span lang="EN-US" style="font-size:10.5pt">               </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">
 ----</span><span lang="EN-US" style="font-size:10.5pt">              </span><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian"> -------</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span lang="EN-US" style="font-size:10.5pt;color:red"> </span></b><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian;color:red"> Warning</span></b><b><span lang="EN-US" style="font-size:10.5pt;color:red"> </span></b><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian;color:red">
 FailedScheduling</span></b><b><span lang="EN-US" style="font-size:10.5pt;color:red"> </span></b><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian;color:red"> 1m (x125 over 36m)</span></b><b><span lang="EN-US" style="font-size:10.5pt;color:red"> </span></b><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian;color:red">
 default-scheduler</span></b><b><span lang="EN-US" style="font-size:10.5pt;color:red"> </span></b><b><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian;color:red"> 0/1 nodes are available: 1 node(s) didn't have free ports for the requested pod
 ports.</span></b><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-align:justify;text-justify:inter-ideograph;background:white">
<b><span lang="EN-US" style="font-size:10.5pt;font-family:"Monotype Corsiva";color:#1F497D">Best Regards!</span></b><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-align:justify;text-justify:inter-ideograph;background:white">
<b><span lang="EN-US" style="font-size:10.5pt;font-family:"Monotype Corsiva";color:#1F497D">Qiaolin Tu</span></b><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-align:justify;text-justify:inter-ideograph;background:white">
<span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma",sans-serif;color:#7F7F7F">NSB MN 5G ECE HZ CN2 SG04</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-align:justify;text-justify:inter-ideograph;background:white">
<span lang="EN-US" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:gray">Mobile:
</span><span lang="EN-US" style="font-size:10.0pt;font-family:"Arial",sans-serif;color:gray"> +86 138 057 59684</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-align:justify;text-justify:inter-ideograph;background:white">
<span lang="EN-US" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:gray">E-Mail:  
<a href="mailto:qiaolin.tu@nokia-sbell.com" target="_blank">qiaolin.tu@nokia-sbell.com</a></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US"><o:p></o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Tu,
 Qiaolin (NSB - CN/Hangzhou) <br>
<b>Sent:</b> Tuesday, November 06, 2018 1:46 PM<br>
<b>To:</b> 'MEADOWS, ALAN' <<a href="mailto:am240k@att.com" target="_blank">am240k@att.com</a>>; Kaspars Skels <<a href="mailto:kaspars.skels@gmail.com" target="_blank">kaspars.skels@gmail.com</a>><br>
<b>Cc:</b> MONTEIRO, FELIPE C <<a href="mailto:fm577c@att.com" target="_blank">fm577c@att.com</a>>; BARTRA, RICK <<a href="mailto:rb560u@att.com" target="_blank">rb560u@att.com</a>>; REDDY, CHINASUBBA <<a href="mailto:cr3938@att.com" target="_blank">cr3938@att.com</a>>;
 GORSHUNOV, ROMAN <<a href="mailto:roman.gorshunov@att.com" target="_blank">roman.gorshunov@att.com</a>>; KHUNTIA, SOUMITRA <<a href="mailto:sk698p@att.com" target="_blank">sk698p@att.com</a>>; KABANOV, DMITRII <<a href="mailto:dk370c@att.com" target="_blank">dk370c@att.com</a>>;
<a href="mailto:mark.m.burnett@gmail.com" target="_blank">mark.m.burnett@gmail.com</a>; VOLKOV, ANDREY <<a href="mailto:av903u@att.com" target="_blank">av903u@att.com</a>>;
<a href="mailto:avolkov@mirantis.com" target="_blank">avolkov@mirantis.com</a>; <a href="mailto:cw@f00f.org" target="_blank">
cw@f00f.org</a>; <a href="mailto:pallavgupta84@gmail.com" target="_blank">pallavgupta84@gmail.com</a>; GUPTA, SANGEET <<a href="mailto:sg774j@att.com" target="_blank">sg774j@att.com</a>>;
<a href="mailto:pete@port.direct" target="_blank">pete@port.direct</a>; <a href="mailto:zuul@review01.openstack.org" target="_blank">
zuul@review01.openstack.org</a>; HUSSEY, SCOTT T <<a href="mailto:sh8121@att.com" target="_blank">sh8121@att.com</a>>; PACHECO, RODOLFO J <<a href="mailto:rp2723@att.com" target="_blank">rp2723@att.com</a>>; Li, Maxwell (NSB - CN/Hangzhou) <<a href="mailto:maxwell.li@nokia-sbell.com" target="_blank">maxwell.li@nokia-sbell.com</a>><br>
<b>Subject:</b> Airship installation Questions</span><span lang="EN-US"><o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Hi,</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">Thanks very much for your kindly support.</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:DengXian">I also encountered a problem when install multi-node airship. It blocked by 2 ceph-rgw pods. They crash off and
 run again and again. Pods error log as bellow:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:宋体">root@cab23-r720-11:~#
<b><span style="color:#DF402A">kubectl describe pod ceph-rgw-6ff5ff866d-4x66n -n ceph</span></b></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:宋体">Events:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:宋体">Type Reason Age From Message</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:宋体">---- ------ ---- ---- -------</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:宋体">Normal Scheduled 1m default-scheduler Successfully assigned ceph-rgw-6ff5ff866d-4x66n to cab23-r720-11</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:宋体">Normal SuccessfulMountVolume 1m kubelet, cab23-r720-11 MountVolume.SetUp succeeded for volume "pod-etc-ceph"</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:宋体">Normal SuccessfulMountVolume 1m kubelet, cab23-r720-11 MountVolume.SetUp succeeded for volume "pod-var-lib-ceph"</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:宋体">Normal SuccessfulMountVolume 1m kubelet, cab23-r720-11 MountVolume.SetUp succeeded for volume "pod-run"</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:宋体">Normal SuccessfulMountVolume 1m kubelet, cab23-r720-11 MountVolume.SetUp succeeded for volume "ceph-rgw-etc"</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:宋体">Normal SuccessfulMountVolume 1m kubelet, cab23-r720-11 MountVolume.SetUp succeeded for volume "ceph-rgw-bin"</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:宋体">Normal SuccessfulMountVolume 1m kubelet, cab23-r720-11 MountVolume.SetUp succeeded for volume "ceph-bootstrap-rgw-keyring"</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:宋体">Normal SuccessfulMountVolume 1m kubelet, cab23-r720-11 MountVolume.SetUp succeeded for volume "ceph-rgw-token-sjg9x"</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:宋体">Normal Pulled 1m kubelet, cab23-r720-11 Container image "<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__quay.io_stackanetes_kubernetes-2Dentrypoint-3Av0.3.1&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=L2WcX1Ge33cpIHXX6krAgw&m=Yfn1URqa4p-w7xoxiueJJP2SNYUZZCsOA07XxDCOxEM&s=QVq3KXWVyPVji_O3s5wgjBk7wnbkw3swE9ddmYytPOw&e=" target="_blank">quay.io/stackanetes/kubernetes-entrypoint:v0.3.1</a>"
 already present on machine</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:宋体"> </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:宋体">Normal Started 1m kubelet, cab23-r720-11 Started container</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:宋体">Normal Pulled 1m kubelet, cab23-r720-11 Container image "<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__docker.io_ceph_daemon-3Atag-2Dbuild-2Dmaster-2Dluminous-2Dubuntu-2D16.04&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=L2WcX1Ge33cpIHXX6krAgw&m=Yfn1URqa4p-w7xoxiueJJP2SNYUZZCsOA07XxDCOxEM&s=wD6kGoJq_VjM3q9MaytwbkA4gjV0HuHeKt7ZJ_419m4&e=" target="_blank">docker.io/ceph/daemon:tag-build-master-luminous-ubuntu-16.04</a>"
 already present on machine</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:宋体">Normal Created 1m kubelet, cab23-r720-11 Created container</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:宋体">Normal Started 1m kubelet, cab23-r720-11 Started container</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt;font-family:宋体"> </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span lang="EN-US" style="font-size:10.5pt;font-family:宋体;color:#DF402A">Warning Unhealthy 18s (x6 over 1m) kubelet, cab23-r720-11 Readiness probe failed: Get
<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__10.97.38.105-3A8088_&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=L2WcX1Ge33cpIHXX6krAgw&m=Yfn1URqa4p-w7xoxiueJJP2SNYUZZCsOA07XxDCOxEM&s=N6CGj_cMP5_eYfe9DOVCi3m-z6jWPpRQNrRRkYg6kjA&e=" target="_blank">
http://10.97.38.105:8088/</a>: dial tcp <a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__10.97.38.105-3A8088&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=L2WcX1Ge33cpIHXX6krAgw&m=Yfn1URqa4p-w7xoxiueJJP2SNYUZZCsOA07XxDCOxEM&s=_MBsJiSpie7BI64_sUyyqznHkaLMa1UEOyINiKSIfEE&e=" target="_blank">
10.97.38.105:8088</a>: getsockopt: connection refused</span></b><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-align:justify;text-justify:inter-ideograph;background:white">
<b><span lang="EN-US" style="font-size:10.5pt;font-family:"Monotype Corsiva";color:#1F497D">Best Regards!</span></b><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-align:justify;text-justify:inter-ideograph;background:white">
<b><span lang="EN-US" style="font-size:10.5pt;font-family:"Monotype Corsiva";color:#1F497D">Qiaolin Tu</span></b><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-align:justify;text-justify:inter-ideograph;background:white">
<span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma",sans-serif;color:#7F7F7F">NSB MN 5G ECE HZ CN2 SG04</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-align:justify;text-justify:inter-ideograph;background:white">
<span lang="EN-US" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:gray">Mobile:
</span><span lang="EN-US" style="font-size:10.0pt;font-family:"Arial",sans-serif;color:gray"> +86 138 057 59684</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-align:justify;text-justify:inter-ideograph;background:white">
<span lang="EN-US" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:gray">E-Mail:  
<a href="mailto:qiaolin.tu@nokia-sbell.com" target="_blank">qiaolin.tu@nokia-sbell.com</a></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:10.5pt"> </span><span lang="EN-US"><o:p></o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif"> MEADOWS,
 ALAN <<a href="mailto:am240k@att.com" target="_blank">am240k@att.com</a>> <br>
<b>Sent:</b> Saturday, November 03, 2018 5:39 AM<br>
<b>To:</b> Kaspars Skels <<a href="mailto:kaspars.skels@gmail.com" target="_blank">kaspars.skels@gmail.com</a>>; Li, Maxwell (NSB - CN/Hangzhou) <<a href="mailto:maxwell.li@nokia-sbell.com" target="_blank">maxwell.li@nokia-sbell.com</a>><br>
<b>Cc:</b> MONTEIRO, FELIPE C <<a href="mailto:fm577c@att.com" target="_blank">fm577c@att.com</a>>; BARTRA, RICK <<a href="mailto:rb560u@att.com" target="_blank">rb560u@att.com</a>>; REDDY, CHINASUBBA <<a href="mailto:cr3938@att.com" target="_blank">cr3938@att.com</a>>;
 GORSHUNOV, ROMAN <<a href="mailto:roman.gorshunov@att.com" target="_blank">roman.gorshunov@att.com</a>>; KHUNTIA, SOUMITRA <<a href="mailto:sk698p@att.com" target="_blank">sk698p@att.com</a>>; KABANOV, DMITRII <<a href="mailto:dk370c@att.com" target="_blank">dk370c@att.com</a>>;
<a href="mailto:mark.m.burnett@gmail.com" target="_blank">mark.m.burnett@gmail.com</a>; VOLKOV, ANDREY <<a href="mailto:av903u@att.com" target="_blank">av903u@att.com</a>>;
<a href="mailto:avolkov@mirantis.com" target="_blank">avolkov@mirantis.com</a>; <a href="mailto:cw@f00f.org" target="_blank">
cw@f00f.org</a>; <a href="mailto:pallavgupta84@gmail.com" target="_blank">pallavgupta84@gmail.com</a>; GUPTA, SANGEET <<a href="mailto:sg774j@att.com" target="_blank">sg774j@att.com</a>>;
<a href="mailto:pete@port.direct" target="_blank">pete@port.direct</a>; <a href="mailto:zuul@review01.openstack.org" target="_blank">
zuul@review01.openstack.org</a>; HUSSEY, SCOTT T <<a href="mailto:sh8121@att.com" target="_blank">sh8121@att.com</a>>; Tu, Qiaolin (NSB - CN/Hangzhou) <<a href="mailto:qiaolin.tu@nokia-sbell.com" target="_blank">qiaolin.tu@nokia-sbell.com</a>>; PACHECO, RODOLFO
 J <<a href="mailto:rp2723@att.com" target="_blank">rp2723@att.com</a>><br>
<b>Subject:</b> RE: Airship Version Questions</span><span lang="EN-US"><o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri Light",sans-serif">Hi Maxwell!</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri Light",sans-serif"> </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri Light",sans-serif">Great to see additional people trying Airship out.</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri Light",sans-serif"> </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri Light",sans-serif">Treasuremap does change quite frequently.  In fact, this is from a lot of the great work Kaspars
 has been doing – building a CI/CD pipeline to not only keep treasuremap fresh and referencing the latest working versions of Airship components but also validating that the YAML documents are able to provision a multi-node baremetal physical environment by
 way of third-party gates. </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri Light",sans-serif"> </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri Light",sans-serif">This gives us a high degree of confidence that no matter what version of treasuremap you have
 decided to start working with to deploy your own environments it should work.</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri Light",sans-serif"> </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri Light",sans-serif">To be sure, we do understand when getting started it is nice to work with a stable target that
 isn’t constantly changing.    Kaspars has introduced tagging to provide a human readable reference (using dates).  These are not on any particular cadence, but usually follow more in-depth tested release beyond just automated CI/CD using the manifests:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri Light",sans-serif"> </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-family:"Calibri Light",sans-serif"><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_openstack_airship-2Dtreasuremap_releases&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=L2WcX1Ge33cpIHXX6krAgw&m=Yfn1URqa4p-w7xoxiueJJP2SNYUZZCsOA07XxDCOxEM&s=ZyIbYVxKvMan1A5Fw3GshH0lifNZHRUnU_40MqtumxA&e=" target="_blank"><span style="color:windowtext">https://github.com/openstack/airship-treasuremap/releases</span></a></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri Light",sans-serif"> </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri Light",sans-serif">For right now with regard to pegleg, the best way to leverage the version of pegleg that has been
 tested with the treasuremap manifests is to pull it the one used in the baremetal CI/CD gate test directly from the target tag Jenkinsfile.  For example, for v18.11.01:</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri Light",sans-serif"> </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-family:"Calibri Light",sans-serif"><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_openstack_airship-2Dtreasuremap_blob_v18.11.01_tools_gate_Jenkinsfile-23L15&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=L2WcX1Ge33cpIHXX6krAgw&m=Yfn1URqa4p-w7xoxiueJJP2SNYUZZCsOA07XxDCOxEM&s=S0oZ2OKnKI07o5yGWGvwz6_gUToysqjc9W_EKPR8eTY&e=" target="_blank"><span style="color:windowtext">https://github.com/openstack/airship-treasuremap/blob/v18.11.01/tools/gate/Jenkinsfile#L15</span></a></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-family:"Calibri Light",sans-serif"> </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-family:"Calibri Light",sans-serif">Please feel free to get on the airship mailing list (<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__airshipit.org&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=L2WcX1Ge33cpIHXX6krAgw&m=Yfn1URqa4p-w7xoxiueJJP2SNYUZZCsOA07XxDCOxEM&s=9mXi3m93VupawhG1pIMsk99_Ng5NFUCbs-6ip-2NxTY&e=" target="_blank">airshipit.org</a>)
 to connect with a wider audience or our IRC channel!</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-family:"Calibri Light",sans-serif"> </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-family:"Calibri Light",sans-serif">Alan Meadows </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Kaspars
 Skels [<a href="mailto:kaspars.skels@gmail.com" target="_blank">mailto:kaspars.skels@gmail.com</a>]
<br>
<b>Sent:</b> Friday, November 02, 2018 2:27 PM<br>
<b>To:</b> <a href="mailto:maxwell.li@nokia-sbell.com" target="_blank">maxwell.li@nokia-sbell.com</a><br>
<b>Cc:</b> MONTEIRO, FELIPE C <<a href="mailto:fm577c@att.com" target="_blank">fm577c@att.com</a>>; BARTRA, RICK <<a href="mailto:rb560u@att.com" target="_blank">rb560u@att.com</a>>; REDDY, CHINASUBBA <<a href="mailto:cr3938@att.com" target="_blank">cr3938@att.com</a>>;
 GORSHUNOV, ROMAN <<a href="mailto:roman.gorshunov@att.com" target="_blank">roman.gorshunov@att.com</a>>; KHUNTIA, SOUMITRA <<a href="mailto:sk698p@att.com" target="_blank">sk698p@att.com</a>>; KABANOV, DMITRII <<a href="mailto:dk370c@att.com" target="_blank">dk370c@att.com</a>>;
<a href="mailto:mark.m.burnett@gmail.com" target="_blank">mark.m.burnett@gmail.com</a>; VOLKOV, ANDREY <<a href="mailto:av903u@att.com" target="_blank">av903u@att.com</a>>;
<a href="mailto:avolkov@mirantis.com" target="_blank">avolkov@mirantis.com</a>; <a href="mailto:cw@f00f.org" target="_blank">
cw@f00f.org</a>; <a href="mailto:pallavgupta84@gmail.com" target="_blank">pallavgupta84@gmail.com</a>; GUPTA, SANGEET <<a href="mailto:sg774j@att.com" target="_blank">sg774j@att.com</a>>;
<a href="mailto:pete@port.direct" target="_blank">pete@port.direct</a>; <a href="mailto:zuul@review01.openstack.org" target="_blank">
zuul@review01.openstack.org</a>; HUSSEY, SCOTT T <<a href="mailto:sh8121@att.com" target="_blank">sh8121@att.com</a>>;
<a href="mailto:qiaolin.tu@nokia-sbell.com" target="_blank">qiaolin.tu@nokia-sbell.com</a>; MEADOWS, ALAN <<a href="mailto:am240k@att.com" target="_blank">am240k@att.com</a>>; PACHECO, RODOLFO J <<a href="mailto:rp2723@att.com" target="_blank">rp2723@att.com</a>><br>
<b>Subject:</b> Re: Airship Version Questions</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> <o:p></o:p></span></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">+ Alan/Rodolfo<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> <o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> <o:p></o:p></span></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">On Thu, Nov 1, 2018 at 3:37 AM Li, Maxwell (NSB - CN/Hangzhou) <<a href="mailto:maxwell.li@nokia-sbell.com" target="_blank">maxwell.li@nokia-sbell.com</a>> wrote:<o:p></o:p></span></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<div>
<div>
<h1 style="margin-top:0cm;background:white"><span lang="EN-US">Hi Airship Team:<o:p></o:p></span></h1>
<h1 style="margin-top:0cm;background:white"><span lang="EN-US"> <o:p></o:p></span></h1>
<h1 style="margin-top:0cm;background:white"><span lang="EN-US">I have a problem when I deploy airship on my server. There are new commits in airship-pegleg and airship-treasuremap, almost erveryday. And there are no tags or branches in these code repositories.
 Could I get a commit ID about these repositories so that I could deploy airship.<o:p></o:p></span></h1>
<h1 style="margin-top:0cm;background:white"><span lang="EN-US"> <o:p></o:p></span></h1>
<h1 style="margin-top:0cm;background:white"><span lang="EN-US">Thanks a lot!<o:p></o:p></span></h1>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-family:"Segoe Script",sans-serif">Best Regards!</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-family:"Segoe Script",sans-serif">Maxwell Li</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> <o:p></o:p></span></p>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</body>
</html>