Posted in ESX

Headache – VMware Inventory Services – Error Starting Services

look for ds.log in “c:\programdata\vmware\infrastructure\inventory service\logs”

[2014-11-07 04:01:00,622 WrapperListener_start_runner FATAL com.vmware.vim.dataservices.WrapperListenerImpl] Error starting service:
org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘instanceUUID’ defined in class path resource [server/config/server-config.xml]: Cannot resolve reference to bean ‘store’ while setting bean property ‘targetObject’; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘storeFactory’ defined in class path resource [server/config/query-server-config.xml]: Invocation of init method failed; nested exception is com.xhive.error.XhiveException: FEDERATION_NOT_FOUND: Federation C:\Program Files\VMware\Infrastructure\Inventory Service\data\xdb.bootstrap not found
at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:275)
at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:104)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1244)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1008)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:470)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory$1.run(AbstractAutowireCapableBeanFactory.java:409)
at java.security.AccessController.doPrivileged(Native Method)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:380)
at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:264)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:220)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:261)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:185)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:164)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:423)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:729)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:381)
at org.springframework.context.support.ClassPathXmlApplicationContext.<init>(ClassPathXmlApplicationContext.java:139)
at org.springframework.context.support.ClassPathXmlApplicationContext.<init>(ClassPathXmlApplicationContext.java:93)
at com.vmware.vim.dataservices.DataService.getService(DataService.java:213)
at com.vmware.vim.dataservices.WrapperListenerImpl.start(WrapperListenerImpl.java:52)
at org.tanukisoftware.wrapper.WrapperManager$12.run(WrapperManager.java:3560)
Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘storeFactory’ defined in class path resource [server/config/query-server-config.xml]: Invocation of init method failed; nested exception is com.xhive.error.XhiveException: FEDERATION_NOT_FOUND: Federation C:\Program Files\VMware\Infrastructure\Inventory Service\data\xdb.bootstrap not found
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1336)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:471)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory$1.run(AbstractAutowireCapableBeanFactory.java:409)
at java.security.AccessController.doPrivileged(Native Method)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:380)
at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:264)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:220)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:261)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:185)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:164)
at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:276)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:901)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:815)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:440)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory$1.run(AbstractAutowireCapableBeanFactory.java:409)
at java.security.AccessController.doPrivileged(Native Method)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:380)
at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:264)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:220)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:261)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:185)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:164)
at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:269)
… 20 more
Caused by: com.xhive.error.XhiveException: FEDERATION_NOT_FOUND: Federation C:\Program Files\VMware\Infrastructure\Inventory Service\data\xdb.bootstrap not found
at xDB_9_0_11.aW.bL(xdb:403)
at xDB_9_0_11.aW.<init>(xdb:173)
at xDB_9_0_11.uB.a(xdb:73)
at xDB_9_0_11.CN.a(xdb:201)
at xDB_9_0_11.CN.init(xdb:225)
at xDB_9_0_11.CN.init(xdb:238)
at xDB_9_0_11.CN.init(xdb:233)
at com.vmware.vim.query.server.store.impl.StoreFactoryImpl.init(StoreFactoryImpl.java:167)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.invokeCustomInitMethod(AbstractAutowireCapableBeanFactory.java:1412)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.invokeInitMethods(AbstractAutowireCapableBeanFactory.java:1373)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1333)
… 42 more

Somehow during an update to vcenter 5.5 u2 the file xdb.bootstrap went missing I checked in the folder and there was two files named xdb.bootstrap.new and xdb.bootstrap.old. I used my best judgement and selected xdb.bootstrap.new and renamed it to xdb.bootstrap. Attempted to start the service and bam it worked!

headache – VMware Concurrent svMotions Per Datastore Limit

currently when you enter maintenance mode on a datastore, the vcenter will initiate i think 8 svmotions (storage vmotions) which takes quite a toll on our SAN. I’ve been following this thread: http://communities.vmware.com/thread/331892 which pointed me to this blog entry: http://www.boche.net/blog/index.php/2009/01/05/guest-blog-entry-vmotion-performance/

A Cold Migration has a cost of 1 and a Hot Migration aka VMotion has a cost of 4. I first set mine to 12 as I wanted to see if it would now allow 3 VMotions at once, I now permanently have mine set to 24 which gives me 6 simultaneous VMotions per Host (6×4 = 24).

by modifying the cost we can modify the number of svmotions that occur at once.

this article has good info: http://frankdenneman.nl/2012/06/limiting-the-number-of-storage-vmotions/

The operation cost of a Storage vMotion for datastores is set to 16, the max cost of a datastore is 128.

i set mine as

<ResourceManager>
<maxCostPerHost>8</maxCostPerHost>
<MaxCostPerEsx41DS>38</MaxCostPerEsx41DS>
</ResourceManager>

and this is allowing 4 hot svmotions.