<div dir="ltr"><div>Hi Alex!</div><div><br></div><div>Sorry for the delay. Have you had the opportunity to verify that this issue still persists with the latest version of Airship-in-a-Bottle? There have been several changes since the last time we visited this that may resolve the above.<br></div><div><br></div>Regards,<br><div><div>Drew Walters<br></div></div></div><br><div class="gmail_quote"><div dir="ltr">On Tue, Dec 11, 2018 at 9:29 AM Balsiger Daniel, INI-EAI-INO-MBL <<a href="mailto:Daniel.Balsiger@swisscom.com">Daniel.Balsiger@swisscom.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div dir="ltr">
<div id="gmail-m_3317665842947469246divtagdefaultwrapper" style="font-size:12pt;color:rgb(0,0,0);font-family:Calibri,Helvetica,sans-serif" dir="ltr">
<p style="margin-top:0px;margin-bottom:0px">Hi there everyone <br>
</p>
<p style="margin-top:0px;margin-bottom:0px"><br>
</p>
<p style="margin-top:0px;margin-bottom:0px">Thanks for the quick replies, I tried a new install on a fresh VM, behaves the same, problem is persisting:</p>
<p style="margin-top:0px;margin-bottom:0px"><br>
</p>
<p style="margin-top:0px;margin-bottom:0px">I see in Postgresql-0 logs:</p>
<p style="margin-top:0px;margin-bottom:0px">--snip</p>
<p style="margin-top:0px;margin-bottom:0px"></p>
<div>FATAL: the database system is in recovery mode<br>
LOG: database system was not properly shut down; automatic recovery in progress<br>
LOG: invalid record length at 0/102A400<br>
LOG: redo is not required<br>
LOG: MultiXact member wraparound protections are now enabled<br>
LOG: database system is ready to accept connections<br>
LOG: autovacuum launcher started<br>
FATAL: could not open relation mapping file "global/pg_filenode.map": No such file or directory<br>
LOG: autovacuum launcher process (PID 79) exited with exit code 1<br>
LOG: terminating any other active server processes<br>
LOG: all server processes terminated; reinitializing<br>
LOG: database system was interrupted; last known up at 2018-12-11 15:25:38 UTC<br>
LOG: database system was not properly shut down; automatic recovery in progress</div>
--snip
<p></p>
<p style="margin-top:0px;margin-bottom:0px"><br>
</p>
<p style="margin-top:0px;margin-bottom:0px">and in mariadb-server-0 logs:</p>
<p style="margin-top:0px;margin-bottom:0px">--snip</p>
<p style="margin-top:0px;margin-bottom:0px"></p>
<div>ubuntu@airship:~$ sudo kubectl -n ucp logs mariadb-server-0<br>
2018-12-11 15:25:35,704 - OpenStack-Helm Mariadb - INFO - This instance hostname: mariadb-server-0<br>
2018-12-11 15:25:36,310 - OpenStack-Helm Mariadb - INFO - Kubernetes API Version: v1.10.2<br>
2018-12-11 15:25:36,313 - OpenStack-Helm Mariadb - INFO - Will use "airship-ucp-mariadb-mariadb-state" configmap for cluster state info<br>
2018-12-11 15:25:36,313 - OpenStack-Helm Mariadb - INFO - Getting cluster state<br>
2018-12-11 15:25:36,348 - OpenStack-Helm Mariadb - INFO - The cluster is currently in "init" state.<br>
2018-12-11 15:25:36,348 - OpenStack-Helm Mariadb - INFO - Getting cluster state<br>
2018-12-11 15:25:36,455 - OpenStack-Helm Mariadb - INFO - The cluster is currently in "init" state.<br>
2018-12-11 15:25:36,456 - OpenStack-Helm Mariadb - INFO - Waiting for cluster to start running<br>
2018-12-11 15:25:36,456 - OpenStack-Helm Mariadb - INFO - Getting cluster state<br>
2018-12-11 15:25:36,474 - OpenStack-Helm Mariadb - INFO - The cluster is currently in "init" state.<br>
2018-12-11 15:25:56,491 - OpenStack-Helm Mariadb - INFO - Getting cluster state<br>
2018-12-11 15:25:56,637 - OpenStack-Helm Mariadb - INFO - The cluster is currently in "init" state.<br>
2018-12-11 15:26:16,657 - OpenStack-Helm Mariadb - INFO - Getting cluster state<br>
2018-12-11 15:26:16,678 - OpenStack-Helm Mariadb - INFO - The cluster is currently in "init" state.<br>
2018-12-11 15:26:36,684 - OpenStack-Helm Mariadb - INFO - Getting cluster state<br>
2018-12-11 15:26:36,697 - OpenStack-Helm Mariadb - INFO - The cluster is currently in "init" state.<br>
2018-12-11 15:26:56,717 - OpenStack-Helm Mariadb - INFO - Getting cluster state<br>
2018-12-11 15:26:56,749 - OpenStack-Helm Mariadb - INFO - The cluster is currently in "init" state.<br>
2018-12-11 15:27:16,761 - OpenStack-Helm Mariadb - INFO - Getting cluster state<br>
2018-12-11 15:27:16,876 - OpenStack-Helm Mariadb - INFO - The cluster is currently in "init" state.</div>
--snip<br>
<p></p>
<p style="margin-top:0px;margin-bottom:0px"><br>
</p>
<p style="margin-top:0px;margin-bottom:0px"><br>
</p>
<p style="margin-top:0px;margin-bottom:0px">Best Regards, D<br>
</p>
<br>
<div style="color:rgb(0,0,0)">
<hr style="display:inline-block;width:98%">
<div id="gmail-m_3317665842947469246divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b> Alex Arnoldy <<a href="mailto:alex.arnoldy@suse.com" target="_blank">alex.arnoldy@suse.com</a>><br>
<b>Sent:</b> Monday, December 10, 2018 7:48 PM<br>
<b>To:</b> MCEUEN, MATT ; <a href="mailto:airship-discuss@lists.airshipit.org" target="_blank">airship-discuss@lists.airshipit.org</a>; Balsiger Daniel, INI-EAI-INO-MBL<br>
<b>Subject:</b> RE: Airship in a bottle install failure...</font>
<div> </div>
</div>
<div lang="EN-US">
<div class="gmail-m_3317665842947469246x_WordSection1">
<p class="gmail-m_3317665842947469246x_MsoNormal"><span style="color:rgb(31,73,125)">Hi Matt,</span></p>
<p class="gmail-m_3317665842947469246x_MsoNormal"><span style="color:rgb(31,73,125)"> </span></p>
<p class="gmail-m_3317665842947469246x_MsoNormal"><span style="color:rgb(31,73,125)">Here is the commit I’m using:</span></p>
<p class="gmail-m_3317665842947469246x_MsoNormal"><span style="color:rgb(31,73,125)"> </span></p>
<p class="gmail-m_3317665842947469246x_MsoNormal"><span style="font-family:"Courier New";color:rgb(31,73,125)">commit 221441f1bff351ab366b02d6fd7856b70b06108f</span></p>
<p class="gmail-m_3317665842947469246x_MsoNormal"><span style="font-family:"Courier New";color:rgb(31,73,125)">Author: Bryan Strassner <<a href="mailto:bryan.strassner@gmail.com" target="_blank">bryan.strassner@gmail.com</a>></span></p>
<p class="gmail-m_3317665842947469246x_MsoNormal"><span style="font-family:"Courier New";color:rgb(31,73,125)">Date: Mon Nov 19 17:12:10 2018 -0600</span></p>
<p class="gmail-m_3317665842947469246x_MsoNormal"><span style="font-family:"Courier New";color:rgb(31,73,125)"> </span></p>
<p class="gmail-m_3317665842947469246x_MsoNormal"><span style="font-family:"Courier New";color:rgb(31,73,125)"> Update apiserver for admission controller</span></p>
<p class="gmail-m_3317665842947469246x_MsoNormal"><span style="font-family:"Courier New";color:rgb(31,73,125)"> </span></p>
<p class="gmail-m_3317665842947469246x_MsoNormal"><span style="font-family:"Courier New";color:rgb(31,73,125)"> Update the apiserver's command prefix to match between the apiserver</span></p>
<p class="gmail-m_3317665842947469246x_MsoNormal"><span style="font-family:"Courier New";color:rgb(31,73,125)"> chart and the genesis api server.</span></p>
<p class="gmail-m_3317665842947469246x_MsoNormal"><span style="font-family:"Courier New";color:rgb(31,73,125)"> </span></p>
<p class="gmail-m_3317665842947469246x_MsoNormal"><span style="font-family:"Courier New";color:rgb(31,73,125)"> Includes an optimization of virsh commands to parallelize and wait for</span></p>
<p class="gmail-m_3317665842947469246x_MsoNormal"><span style="font-family:"Courier New";color:rgb(31,73,125)"> cloud init to complete (requires Ubuntu 16.04.4)</span></p>
<p class="gmail-m_3317665842947469246x_MsoNormal"><span style="font-family:"Courier New";color:rgb(31,73,125)"> </span></p>
<p class="gmail-m_3317665842947469246x_MsoNormal"><span style="font-family:"Courier New";color:rgb(31,73,125)"> Change-Id: I793d210e15c3c13e8b662bd2459ed8bcba30d434</span></p>
<p class="gmail-m_3317665842947469246x_MsoNormal"><span style="color:rgb(31,73,125)"> </span></p>
<p class="gmail-m_3317665842947469246x_MsoNormal"><span style="color:rgb(31,73,125)">I’m happy to start over to see if a new pull resolves the issue, but it happened to me twice in a row so I thought I’d preserve the environment for examination.</span></p>
<p class="gmail-m_3317665842947469246x_MsoNormal"><span style="color:rgb(31,73,125)"> </span></p>
<p class="gmail-m_3317665842947469246x_MsoNormal"><span style="color:rgb(31,73,125)">Best,</span></p>
<p class="gmail-m_3317665842947469246x_MsoNormal"><span style="color:rgb(31,73,125)"> </span></p>
<div>
<p class="gmail-m_3317665842947469246x_MsoNormal"><span style="font-size:10pt;font-family:"Tahoma",sans-serif;color:black">--Alex.</span></p>
<p class="gmail-m_3317665842947469246x_MsoNormal"><span style="font-size:10pt;font-family:"Tahoma",sans-serif;color:black"> </span></p>
<p class="gmail-m_3317665842947469246x_MsoNormal" style="margin-bottom:12pt"><b><i><span style="font-family:"Arial",sans-serif;color:black">Alex Arnoldy</span></i></b><i><span style="font-size:10pt;font-family:"Arial",sans-serif;color:black"><br>
Software Defined Infrastructure Solutions Architect<br>
SUSE<br>
</span></i><span style="font-size:10pt;font-family:"Tahoma",sans-serif;color:black"><a href="mailto:Alex.Arnoldy@SUSE.com" id="gmail-m_3317665842947469246LPlnk816272" class="gmail-m_3317665842947469246OWAAutoLink" target="_blank"><i><span style="font-family:"Arial",sans-serif">Alex.Arnoldy@SUSE.com</span></i></a></span><i><span style="font-size:10pt;font-family:"Arial",sans-serif;color:black"><br>
(P) +1 (408) 828-9797</span></i><span style="font-size:10pt;font-family:"Tahoma",sans-serif;color:black"></span></p>
</div>
<p class="gmail-m_3317665842947469246x_MsoNormal"><span style="color:rgb(31,73,125)"> </span></p>
<div>
<div style="border-color:rgb(225,225,225) currentcolor currentcolor;border-style:solid none none;border-width:1pt medium medium;padding:3pt 0in 0in">
<p class="gmail-m_3317665842947469246x_MsoNormal"><b>From:</b> MCEUEN, MATT <<a href="mailto:MM9745@att.com" target="_blank">MM9745@att.com</a>> <br>
<b>Sent:</b> Monday, December 10, 2018 9:33 AM<br>
<b>To:</b> <a href="mailto:airship-discuss@lists.airshipit.org" target="_blank">airship-discuss@lists.airshipit.org</a>; Alex Arnoldy <<a href="mailto:alex.arnoldy@suse.com" target="_blank">alex.arnoldy@suse.com</a>>; INI-EAI-INO-MBL Balsiger Daniel <<a href="mailto:Daniel.Balsiger@swisscom.com" target="_blank">Daniel.Balsiger@swisscom.com</a>><br>
<b>Subject:</b> RE: Airship in a bottle install failure...</p>
</div>
</div>
<p class="gmail-m_3317665842947469246x_MsoNormal"> </p>
<p class="gmail-m_3317665842947469246x_MsoNormal">Weird, the maas-db-init job is running fine for me with a fresh deployment of airship in a bottle. Alex, are you seeing that “no pg_hba.conf” error current aiab code, or can you give git commit where you’re hitting the issue?</p>
<p class="gmail-m_3317665842947469246x_MsoNormal"> </p>
<p class="gmail-m_3317665842947469246x_MsoNormal">Daniel, can you please run “sudo kubectl -n ucp logs mariadb-server-0” and share the results? Looks like MariaDB isn’t starting cleanly for some reason.</p>
<p class="gmail-m_3317665842947469246x_MsoNormal"> </p>
<p class="gmail-m_3317665842947469246x_MsoNormal">Thanks,<br>
Matt</p>
<p class="gmail-m_3317665842947469246x_MsoNormal"> </p>
</div>
</div>
</div>
</div>
</div>
_______________________________________________<br>
Airship-discuss mailing list<br>
<a href="mailto:Airship-discuss@lists.airshipit.org" target="_blank">Airship-discuss@lists.airshipit.org</a><br>
<a href="http://lists.airshipit.org/cgi-bin/mailman/listinfo/airship-discuss" rel="noreferrer" target="_blank">http://lists.airshipit.org/cgi-bin/mailman/listinfo/airship-discuss</a></blockquote></div>