{"id":936,"date":"2015-02-09T15:20:37","date_gmt":"2015-02-09T20:20:37","guid":{"rendered":"https:\/\/www.softwareab.net\/wordpress\/?p=936"},"modified":"2015-02-09T15:28:37","modified_gmt":"2015-02-09T20:28:37","slug":"lync-server-2013-front-end-event-32174","status":"publish","type":"post","link":"https:\/\/www.softwareab.net\/wordpress\/lync-server-2013-front-end-event-32174\/","title":{"rendered":"Lync Server 2013: Front-end Fails to Start"},"content":{"rendered":"

Received message “Server startup delayed ... fabric pool manager has not finished initial placement of users<\/code>?” Read our solution!<\/p>\n

<\/p>\n

Hi All – quick writeup today. I’ve been doing a *lot* of work on Lync Server 2013<\/a> and Acano<\/a> integration. As part of this effort I went through I have a simple all-in-one Lync FrontEnd (FE) server running in my environment. I built it all on my OpenStack Icehouse<\/a> deployment and things looked pretty good…but those of you in the know realize that I really didn’t follow best-practices in doing so. No insult to OpenStack, of course, but really your Lync FE is best placed on a proper organizational DMZ instead of a private internal network…and I don’t think it’s possible to use OpenStack Neutron GRE Networking<\/a> as I’m doing without that side-effect \ud83d\ude09<\/p>\n

So…what did I do? I kept my working Lync FE on OpenStack but simply stopped it. Then I converted the qcow2<\/code><\/a> to VMware VMDK<\/a> format, then converted the resulting raw “flat” file to have a proper VMDK disk descriptor<\/a>, and created a custom VMware VM (attaching my converted disk). Started up my shiny-new converted image on my ESXi 5.5<\/a> host, and it All Came Up \ud83d\ude42 Woohoo!<\/p>\n

Except…it didn’t really start. In my case, the error code was Windows Event 32174 as shown below:<\/p>\n

Log Name: Lync Server\r\nSource: LS User Services\r\nEvent ID: 32174\r\nTask Category: (1006)\r\nServer startup is being delayed because fabric pool manager has not finished initial placement of users.\r\n\r\nCurrently waiting for routing group: {EF5151C7-B5E1-53B8-9F61-0CC90C82B9F6}.\r\nNumber of groups potentially not yet placed: 7.\r\nTotal number of groups: 7.\r\nCause: This is normal during cold-start of a Pool and during server startup.\r\nIf you continue to see this message many times, it indicates that insufficient number of Front-Ends are available in the Pool.\r\nResolution:\r\nDuring a cold-start of a large Pool it can take upto an hour for the placement process to finish as it needs to populate all the Front-End databases with data from the Backup Store. If the Pool is running and the Front-End is just started, this is normal for some time. If this repeats for a long time, ensure that all the Front-Ends configured for this Pool are up and running. If multiple Front-Ends have been recently decommissioned, run Reset-CsPoolRegistrarState -ResetType QuorumLossRecovery to enable the Pool to recover from Quorum Loss and make progress.<\/code><\/pre>\n
More specifically, the “Lync Server Front-End” Windows service was stuck in Starting...<\/code> state. Search on that (as well as my specific Windows Event error code 32174) resulted in lots of matches: As you will find mentioned here<\/a>. And also here<\/a>. Not to mention here<\/a>. And certainly not forgetting the problem as documented here<\/a>.<\/p>\n
Wow. That’s a lot of failures! <\/p>\n
The majority of the problems indicate a certificates error. Under Windows Server 2012, if you have any intermediate certificates in your local machine’s Trusted CA store then Lync FE will fail to start. There’s even a handy Windows PowerShell script<\/a> to check for this condition (as well as other misplaced \/ mismatched certificates). But in my case…nada.<\/p>\n
Now – one thing I had to do was re-IP my Lync FE server, simply because the original IP was “owned” by OpenStack Neutron (and thus responses would not route correctly back to the migrated Lync FE). I don’t know if that was the problem; at least one TechNet article<\/a> indicates that – as long as your DNS records are up-to-date – you can change the Lync FE IP address all you want.<\/p>\n
But I still needed to solve my problem!<\/p>\n
After much event log research I found the point which led to failures:<\/p>\n
Log Name: Lync Server\r\nSource: LS User Services\r\nEvent ID: 32131\r\nTask Category: (1006)\r\nServer is waiting for the first run of user replicator task to complete. This could take a while depending on the network connectivity with the Active Directory and the number of users in the deployment. The server will continue to be in the starting phase until this operation completes.<\/code><\/pre>\n
The next “LS User Services” message after that was the 32174 message above. That message kept repeating every 2 minutes. I put on my thinking cap and thought…it’s a user synchronization problem. So I dug around even more and found some messages that indicated database status:<\/p>\n