Quantcast
Channel: VMware Communities : Popular Discussions - Backup & Recovery
Viewing all 64650 articles
Browse latest View live

Limit concurrent backups in VDP 5.8


VSA CommVault SIMPANA 10 SP9 VSA - Unable to read the disk for virtual machine

$
0
0

Hallo VMware Community,

 

we are running VSA Backup of CommVault SIMPANA. We are using a VSA Proxy. To the Proxy the VMFS-5 LUNs are mapped read-only so that we can use SAN as transport mode for the VMs which are located on that datastores.

We have testet many things but always still getting the error message "Failure Reason:Could not read data from the virtual disk" and the Job failed. At the beginning we started with one Subclient for all the VMs but now we switched to one Subclient per VM so that the jobs are running sequentially step by step but the error still occurs.

 

Error Code (at SIMPANA Console):

Description: Unable to read the disk [] for virtual machine [xxx] on Host [xxx]. [Beim Verarbeiten der Anfrage ist mindestens ein Fehler aufgetreten., Failed to ReadCurrVmdkFile (W32.774)]

Source: xxx, Process: vsbkp    

 

8340  1b88  01/25 00:33:11 89467 stat- ID [readdisk], Bytes [26381910425], Time [133.847090] Sec(s), Average Speed [187.973832] MB/Sec

8340  1b88  01/25 00:33:11 89467 CVMDiskInfo::DecrementMaxNDBHandlesAllowed() - Max allowed NBD Open handles for backup are now [0]

8340  1b88  01/25 00:33:11 89467 CVMDiskInfo::IncrementMaxNDBHandlesAllowed() - Max allowed NBD Open handles for backup are now [1]

8340  1b88  01/25 00:33:11 89467 VSBkpWorker::BackupVMDisk() - Using default extent size

8340  1b88  01/25 00:33:11 89467 VSBkpWorker::BackupVMDisk() - Disabling CRC Processing as change Id [52 47 9b 90 ff f5 be 24-37 6c f9 43 a2 89 58 e3/57] is supplied

8340  1b88  01/25 00:33:11 89467 VSBkpChangeIdFile::ReadChangeID() - Not using a Change ID

8340  6     01/25 00:33:11 89467 ### GetService --- Reopening connection

8340  6     01/25 00:33:12 89467 ### CVIWrapper::_GetDiskInfoArr --- Updating disk label from [Festplatte 1] to [Hard disk 1]

8340  6     01/25 00:33:13 89467 ### CVIWrapper::_GetDiskInfoArr --- Updating disk label from [Festplatte 2] to [Hard disk 2]

8340  1b88  01/25 00:33:13 89467 There are 6 entries in the allocated extent table for xxx.vmdk

8340  1b88  01/25 00:33:13 89467 VSBkpWorker::BackupVMDisk() - Extent Size [262144] bytes [512] sectors [512] bytes per sector

8340  1b88  01/25 00:33:13 89467 VSBkpWorker::BackupVMDisk() - Sending File Header Path:[\501de18e-3138-67f9-2514-daffc1b51880\scsi0-1-xxx_1.vmdk] with size:[450971566080]

8340  1b88  01/25 00:33:13 89467 VSBkpWorker::AddVMMetadataFile() - Adding metadata file [D:\Program Files\CommVault\Simpana\iDataAgent\JobResults\CV_JobResults\iDataAgent\VirtualServerAgent\2\375\VolHdr(501de18e-3138-67f9-2514-daffc1b51880_scsi0-1-xxx_1.vmdk).imf] to list to be uploaded to index cache

8340  1b88  01/25 00:33:13 89467 VSBkpWorker::BackupVMDisk() - Backing up disk/volume [xxx_1.vmdk]

8340  1b88  01/25 00:33:13 89467 VSBkpWorker::BackupVMDisk() - Using Fixed Length Extent Names

8340  234c  01/25 00:33:13 89467 VSBkpWorker::ArchiveExtentProcessor() - Send volume or disk data to MA thread

8340  2134  01/25 00:34:35 89467 VSBkpCoordinator::OnIdle_Running() - Waiting for [1] VMs to be processed.  [xxx]

8340  2134  01/25 00:34:35 89467 VSBkpCoordinator::DumpStreamInfo() - StreamId = 1, RCID = 189844, ReservationId = 137886, MediaAgent = s190a0010, Agent = s190a0010  []

8340  1b88  01/25 00:34:50 89467 CVMDiskInfo::ReadDisk() - VixDiskLib_Read failed Err=3e80 One of the parameters supplied is invalid

8340  1b88  01/25 00:34:50 89467 VSBkpWorker::BackupVMDisk() - Failed to read from virtual disk [xxx_1.vmdk],  [0x80070306:{..\..\..\CommClient\VirtualServer\VMInfo\ArchiveVirtualDiskFile.cpp[CArchiveVirtualDiskFile::GetNextBlock(535)]} + {..\..\..\CommClient\VirtualServer\VMInfo\VmdkVcb4ExtentReader.cpp[CVmdkVcb4ExtentReader::ReadBlock(664)]/W32.774.(Beim Verarbeiten der Anfrage ist mindestens ein Fehler aufgetreten.)-Failed to ReadCurrVmdkFile}]

 

We are running the latest version of VMware ESXi and also the latest version of the vSphere Server.

 

Maybe someone of you is also using VSA backup of SIMPANA and can help us to resolve this issue.

 

Thanks a lot

Best Regards

Philipp

VDP Error Code 30901 - "A backup/restore/validate activity did not start within the allotted time."

$
0
0

Hello guys, how u doing?

 

I have a VDP Applicante (not Advanced) showing this error message:

 

03/15/2015 21:02:46 PM: Backup job named "VM" completed.

03/15/2015 21:02:46 PM: Task execution failed.

03/15/2015 21:02:46 PM: Error Code 30901: A backup/restore/validate activity did not start within the allotted time.

03/15/2015 21:02:46 PM: Backup job named "VM" started.

 

There's about 40 VMs being backed up.

 

The backup window starts, some VMs are made and about one hour after this starts to happen.

Half of the VMs shows this error and after a while others VMs start being backed up normally again.

 

Tha backup window is not tight, there's a lot of time remaining.

There's enough space do backup everything.

I thought about the concurrent backups, but the VDP version does not allow to change the backup job hour.

 

VDP version: 5.1

vCenter version: 5.1.0

 

Thx in advance!

VDP - Cannot even get to config page

$
0
0

We have deployed the OVA file and started the box. THe boxes gives a IP and advises us to connect to: https://<IP address>:8543/vdp-configure

 

All we get is a display page:

This web page is not available

 

Going to the IP without the port on the end displays:

Service unavailable!

The server is temporarily unable to service your request due to maintenance downtime or capacity problems. Please try again later.

If you think this is a server error, please contact the webmaster.

Error 503

172.16.32.227
Thu Mar 19 13:16:06 2015
Apache

Have tried redeploying the VM to see if anything happens and have also turned off our proxy settings.

any ideas?

Backup job failing - Error 3 (One of the parameters was invalid)

$
0
0

Hello,

as stated above my backup job is failing and I don't know why.

 

 

From the vSphere Web Client I get the following message on the task console:

 

VDP server execution error code: 10055

 

 

And from the logs I deducted that the important part is the one below:

 

/usr/local/avamarclient/var/Backup_test....log

2015-04-17T18:55:18.478-05:-30 avvcbimage Info <9666>: Available transport modes are file:san:hotadd:nbdssl:nbd

2015-04-17T18:55:18.478-05:-30 avvcbimage Info <9667>: Calling ConnectEx with servername=10.64.208.104 vmxspec=moref=vm-13 on port 443 snapshot(snapshot-26)

2015-04-17T18:55:18.478-05:-30 avvcbimage Info <9668>: virtual machine will be connected readonly

2015-04-17T18:55:18.478-05:-30 avvcbimage Info <16041>: VDDK:VixDiskLib: VixDiskLib_ConnectEx: Establish connection using (null).

2015-04-17T18:55:18.478-05:-30 avvcbimage Info <16041>: VDDK:VixDiskLib: VixDiskLib_Connect: Establish connection.

2015-04-17T18:55:18.478-05:-30 avvcbimage Info <16041>: VDDK:VixDiskLib: A thumbprint is required for SSL certificate validation. vixDiskLib.c line 2446

2015-04-17T18:55:18.478-05:-30 avvcbimage Info <16041>: VDDK:VixDiskLib: VixDiskLib_Connect: Failed to allocate connection. Error 3 (One of the parameters was invalid) at 3914.

 

All my software if version 6.0.

If there is anymore information I can provide please tell me.

VDP 6 Expand Storage Did not Rebalance files

$
0
0

I expanded the space on the VDP 6 appliance from 2TB to 4TB by expanding the files (from 3 to 6).  But it is still showing over 80% full and growing after several days.  It should be around 40% now.  How can I force it to rebalance the backups between the new files or at least to acknowledge that it can use the new space?  It does say the capacity is 4.1TB, but it says the deduplicated size is 3.3TB which is totally bogus.

 

According to status.dpn, the garbage collection just ran.  It took nearly 2 hours and "recovered 12.09 GB".  So garbage collection didn't rebalance the files.

hfscheck ran yesterday successfully, so that didn't rebalance.

It has been thru a half dozen 12 hour maintenance windows. no luck.

All services are running, the only alarm is the VDP: [002] The VDP appliance is nearly full.

 

So how to I get it to rebalance?

Snapshotbackup causes consolidate disk files which causes the Virtual Windows Server to reboot

$
0
0

Hi All

A customer of mine have a big issue with their backup since a couple of Days ago and we Believe it's due to an upgrade of ESXi hosts to 5.5.0,3029944 but not 100% sure.

All ESXi hosts are upgrdaed 10 Days agon and they uses NetBackup (7.6.0.3) to do backup of the virtual servers via SAN and NBD.

During the backupwindow we see that some servers (not the same all the time) have done a robbot, looking in vSphere client we see that a disk consolidation has been issued directly after the snapshot is removed see attached image

consolidate.JPG

In Windows Event Viewer on the affected servers we get:
ID 6008 - The previous system shutdown at 21:04:45 on 2015-09-24 was unexpected.

 

and:

ID 41 - The system has rebooted without cleanly shutting down first. This error could be caused if the system stopped responding, crashed, or lost power unexpectedly.

 

Some servers have rebooted two or Three times during the last 10 Days while most servers are unaffected.

We have checked that affected servers are not on the same ESXi host, not the same Datastore, not the same physical storage, not on the same OS (2008R2 and 2012R2)

 

We have started a case against VMware but I'll try this way as well. i don't have the VMware log at this time but have requested it from VMware admin.

 

This setup have worked fine during the last 6 months and thats why I suspect the ESXi upgrade....

Anyone seen this?


Veeam backup taking 9 hours on a 2tb backup then disconnecting for 20 minutes at the end

$
0
0

Im using Veeam 8.0 to backup one of my File server VMs    windows server 2008r2   Its about a 2 TB VM and it takes about 9 hours just for an incremental that is only processing about 13 gb of data.    At the end of the backup,  Vsphere tells me its removing snapshot.   it gets to about 99% and then the VM disconnects from the system and it takes about 20 minutes for it to come back online.   I have talked to Veeam and they say its normal for it to do what its doing but not at this length of time and theytold me to go to VMware.    VMware tells me to try the boards for help.

 

anyone have any Idea why its taking this long and disconnecting.

 

thanks

Dave


VDP failing claiming not enough space....I don't believe it

$
0
0

2016-02-02T20:00:16.719-01:00 avvcbimage Info <14625>: WorkOrder Disk Info:

  Prior Disk '2000': file(base):'[wb_prod_ql01os] WB Prod QL01/WB Prod QL01.vmdk', backItUp=1

               snapshot file:'[wb_prod_ql01os] WB Prod QL01/WB Prod QL01.vmdk'

               prior size(KB):0, current size(KB):57671680, match=0

               prior change block ID:''

               Datastore:'wb_prod_ql01os' Directly Accessible=1

  Prior Disk '2016': file(base):'[wb_prod_shard01] WB Prod QL01/WB Prod QL01.vmdk', backItUp=0

               snapshot file:'[wb_prod_shard01] WB Prod QL01/WB Prod QL01.vmdk'

               prior size(KB):0, current size(KB):1572864000, match=0

               prior change block ID:''

               Datastore:'wb_prod_shard01' Directly Accessible=1

.

SNIP

.

2016-02-02T20:00:20.265-01:00 avvcbimage Info <19704>: DataStore Storage Info:wb_prod_ql01os capacity=90999619584    free=30713839616

2016-02-02T20:00:20.265-01:00 avvcbimage Info <19716>: DS Capacity=90999619584    FreeSpace=30713839616    / HD committed=59255284393    unCommitted=594            un

Shared=59055800320

2016-02-02T20:00:20.289-01:00 avvcbimage Info <19704>: DataStore Storage Info:wb_prod_shard01 capacity=1675037245440  free=63387467776

2016-02-02T20:00:20.289-01:00 avvcbimage Info <19716>: DS Capacity=1675037245440  FreeSpace=63387467776    / HD committed=1610612736000  unCommitted=597            un

Shared=1610612736000

2016-02-02T20:00:20.290-01:00 avvcbimage Info <19717>: DS(wb_prod_shard01) does not have enough free space (63387467776   ) for disks used (80530636800).

2016-02-02T20:00:20.290-01:00 avvcbimage Error <19661>: Datastore does not have enough free space for snapshot

I've pasted prudent entries from my VDP appliance log file above.

Basically I am backing up a single disk on a 7-disk VM. You can see in the first log entries above (before the SNIP) that disk 'wb_prod_ql01os' is marked for Backup (backItUp=1), then the next disk, 'wb_prod_shard01' is not marked for backup (backItUp=0).

We then go down the logs (below the SNIP above) and see that VDP has failed due to 'Datastore does not have enough free space for snapshot', but it's pointing at 'wb_prod_shard01' as the culprit! That disk is not marked for backup so why on earth is it causing VDP to fail??

 

Any help hugely appreciated

internal proxy crash VDP 6.1.1.19

$
0
0

Hello Everyone,

 

Often in the morning we cannot connect to the VDP appliance from Vcenter. When I logon to the configuration page the internal proxy gives the following error:

"Appliance is currently not configured with any proxies. click on the action menu to configure a proxy"

 

Often the only way to get the internal proxy running is to restart the whole appliance.

This happens almost every morning.

 

The VDP appliance is running on a NFS datastore and is running version 6.1.1.19.

The performance test is passed.

 

Also getting the mesage "the most recent checkpoint for the vdp appliance was outdated"

 

Any idea how to solve this?

Can't connect to Data Recovery Appliance

$
0
0

 

I keep running into this one error trying to set up Data Recovery. I have it installed and the appliance imported. I go into the Solutions and Applications section and the VMware Data Recovery screen. I put in the IP of the appliance and click connect. It asks me for the password for the vSphere server and while that prompt is up, it shows an "Authentication failed" error. Once I enter that password, every time I click connect for the rest of my vSphere session, I'll get this error:

 

 

Error: Could not log onto the server. The connect attempt timed out. Please make sure that the Data Recovery Appliance is turned on

 

 

It is, of course turned on and I can go to the web interface, log in and click around fine. Not sure what I could be missing. Is there a specific port it's trying to connect on that I could test out? I'm at a loss as to why it would break at this point.

 

 

-Daniel

 

 

queryChangedDiskAreas problem

$
0
0

Hi,

 

I am trying to query the changed blocks of a disk as described in the "designing Backup solutions for for VMware vSphere".

 

For whatever deviceKey I try I get an "invalid argument" error indicating that the deviceKey is wrong

 

Steps I do:

 

+create snapshot

 

+ wait till snapshot is done

 

+ try the queryChangedDiskAreas()

 

How can I get the deviceKey?

 

Thanks,

 

Nico

Virtual Machine backup and recovery.

$
0
0

Hi,

 

We have VSphere 5.0 and would like to find easy way to backup virtual machines not only file level but in case of some problems we would like to be able to easy  restore virtual machine as cost of having virtual machine down is way more expensive than any software.

 

I had few good reviews on Veeam backup and recovery so my question would be what would be the best software to do virtual machine backup. Price is not an issue here as having one VM down for 3 hours may cost hundreds of thousands.

 

What would you recoomend it may be Vmware solution or third party doesnt matter.

VDP 5.5.5 - Could not connect to the requested VDP Appliance - The SSO Server could not be found. Please make sure the SSO configuration on the VDP Appliance is correct.

$
0
0

Hi,

I have installed VDP 5.5.5 on 2 different subnet in a single VCenter. First VDP is in the same subnet (192.168.50.x) than the VCenter 5.5. No issues at all. It works like a charm. My other VDP 5.5.5 appliance is under another subnet (192.168.51.x) and both subnet have no issues to see each other. However, we I go to the Web Client and I try to start it I got this error message ...

 

 

Could not connect to the requested VDP Appliance.

 

 

The SSO Server could not be found. Please make sure the SSO configuration on the VDP Appliance is correct.

 

 

Would you like to be directed to the VDP Configuration utility to troubleshoot the issue?

 

How can I troubleshoot why it can't connect to SSO?

 

PS : The time is in sync. VCenter and VDP have the same time.

VDP: [004] The VDP appliance datastore is approaching maximum capacity

$
0
0

Hi,

 

I've got this alarm "VDP: [004] The VDP appliance datastore is approaching maximum capacity" because the datastore where i have the VDP virtual disks is almost with the exact size of the virtual disks.

 

I've disabled the alarm, but everytime i reboot the VDP appliance the alarm recreated and enabled.

 

Is there any way to make VDP not recreate this alarm definition?


VDP stop working after domain administrator password change.

$
0
0

We recently changed domain administrator password and stop the domain administrator permission to the vCentre. Looks like now the VDP machine stop working.

The symptoms are: cannot access VDP via web, only ssh.

I looked trough the vdr-server.log and there are a lot of these errors:

2015-04-15 14:30:05,470 INFO  [com.emc.vdr.server.VDRServer$1]-server.ConnectionService: Trying to establish connection with vCenter.

2015-04-15 14:30:05,471 INFO  [com.emc.vdr.server.VDRServer$1]-server.VDRExternalServerAccessConfig: loading default values forcefully: true

2015-04-15 14:30:05,471 INFO  [com.emc.vdr.server.VDRServer$1]-server.VDRExternalServerAccessConfig: Get mc access...

2015-04-15 14:30:05,480 INFO  [com.emc.vdr.server.VDRServer$1]-service.AdapterUtils: MCS Web Services URL: https://hydra.ecom90.co.uk:9443/services/mcService  MCUserId="MCUser"  MCUserPswd="*****************************"

2015-04-15 14:30:05,492 INFO  [com.emc.vdr.server.VDRServer$1]-httpclient.HttpMethodDirector: I/O exception (java.net.ConnectException) caught when processing request: Connection refused

2015-04-15 14:30:05,492 INFO  [com.emc.vdr.server.VDRServer$1]-httpclient.HttpMethodDirector: Retrying request

2015-04-15 14:30:05,513 INFO  [com.emc.vdr.server.VDRServer$1]-httpclient.HttpMethodDirector: I/O exception (java.net.ConnectException) caught when processing request: Connection refused

2015-04-15 14:30:05,513 INFO  [com.emc.vdr.server.VDRServer$1]-httpclient.HttpMethodDirector: Retrying request

2015-04-15 14:30:05,514 INFO  [com.emc.vdr.server.VDRServer$1]-httpclient.HttpMethodDirector: I/O exception (java.net.ConnectException) caught when processing request: Connection refused

2015-04-15 14:30:05,514 INFO  [com.emc.vdr.server.VDRServer$1]-httpclient.HttpMethodDirector: Retrying request

2015-04-15 14:30:05,514 INFO  [com.emc.vdr.server.VDRServer$1]-http.HTTPSender: Unable to sendViaPost to url[https://hydra.ecom90.co.uk:9443/services/mcService?wsdl]

java.net.ConnectException: Connection refused

  at java.net.PlainSocketImpl.socketConnect(Native Method)

  at java.net.PlainSocketImpl.doConnect(Unknown Source)

  at java.net.PlainSocketImpl.connectToAddress(Unknown Source)

  at java.net.PlainSocketImpl.connect(Unknown Source)

  at java.net.SocksSocketImpl.connect(Unknown Source)

  at java.net.Socket.connect(Unknown Source)

  at com.sun.net.ssl.internal.ssl.SSLSocketImpl.connect(Unknown Source)

  at com.emc.avamar.mcsdk.adapter.service.TrustAllSSLProtocolSocketFactory.createSocket(TrustAllSSLProtocolSocketFactory.java:128)

  at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707)

  at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionManager.java:1361)

  at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387)

  at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)

  at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)

  at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:346)

  at org.apache.axis2.transport.http.AbstractHTTPSender.executeMethod(AbstractHTTPSender.java:542)

  at org.apache.axis2.transport.http.HTTPSender.sendViaPost(HTTPSender.java:199)

  at org.apache.axis2.transport.http.HTTPSender.send(HTTPSender.java:76)

  at org.apache.axis2.transport.http.CommonsHTTPTransportSender.writeMessageWithCommons(CommonsHTTPTransportSender.java:400)

  at org.apache.axis2.transport.http.CommonsHTTPTransportSender.invoke(CommonsHTTPTransportSender.java:225)

  at org.apache.axis2.engine.AxisEngine.send(AxisEngine.java:435)

  at org.apache.axis2.description.OutInAxisOperationClient.send(OutInAxisOperation.java:402)

  at org.apache.axis2.description.OutInAxisOperationClient.executeImpl(OutInAxisOperation.java:229)

  at org.apache.axis2.client.OperationClient.execute(OperationClient.java:165)

  at com.avamar.mc.sdk.client.McServiceStub.login(McServiceStub.java:5084)

  at com.avamar.mc.sdk.client.McServiceClient.login(McServiceClient.java:119)

  at com.avamar.mc.sdk.client.McServiceClient.connect(McServiceClient.java:105)

  at com.emc.avamar.mcsdk.adapter.service.ServiceInstance.connect(ServiceInstance.java:313)

  at com.emc.avamar.mcsdk.adapter.service.ServiceInstance.<init>(ServiceInstance.java:225)

  at com.emc.avamar.mcsdk.adapter.service.ServiceInstance.<init>(ServiceInstance.java:187)

  at com.emc.vdr.server.VDRExternalServerAccessConfig.getFromAdapterDefault(VDRExternalServerAccessConfig.java:67)

  at com.emc.vdr.server.VDRExternalServerAccessConfig.getFromPropsDefault(VDRExternalServerAccessConfig.java:126)

  at com.emc.vdr.server.ConnectionService.run(ConnectionService.java:40)

  at java.lang.Thread.run(Unknown Source)

2015-04-15 14:30:05,514 ERROR [com.emc.vdr.server.VDRServer$1]-service.AdapterUtils: ServiceInstance failed to establish connection

org.apache.axis2.AxisFault: Connection refused

  at org.apache.axis2.AxisFault.makeFault(AxisFault.java:430)

  at org.apache.axis2.transport.http.HTTPSender.sendViaPost(HTTPSender.java:203)

  at org.apache.axis2.transport.http.HTTPSender.send(HTTPSender.java:76)

  at org.apache.axis2.transport.http.CommonsHTTPTransportSender.writeMessageWithCommons(CommonsHTTPTransportSender.java:400)

  at org.apache.axis2.transport.http.CommonsHTTPTransportSender.invoke(CommonsHTTPTransportSender.java:225)

  at org.apache.axis2.engine.AxisEngine.send(AxisEngine.java:435)

  at org.apache.axis2.description.OutInAxisOperationClient.send(OutInAxisOperation.java:402)

  at org.apache.axis2.description.OutInAxisOperationClient.executeImpl(OutInAxisOperation.java:229)

  at org.apache.axis2.client.OperationClient.execute(OperationClient.java:165)

  at com.avamar.mc.sdk.client.McServiceStub.login(McServiceStub.java:5084)

  at com.avamar.mc.sdk.client.McServiceClient.login(McServiceClient.java:119)

  at com.avamar.mc.sdk.client.McServiceClient.connect(McServiceClient.java:105)

  at com.emc.avamar.mcsdk.adapter.service.ServiceInstance.connect(ServiceInstance.java:313)

  at com.emc.avamar.mcsdk.adapter.service.ServiceInstance.<init>(ServiceInstance.java:225)

  at com.emc.avamar.mcsdk.adapter.service.ServiceInstance.<init>(ServiceInstance.java:187)

  at com.emc.vdr.server.VDRExternalServerAccessConfig.getFromAdapterDefault(VDRExternalServerAccessConfig.java:67)

  at com.emc.vdr.server.VDRExternalServerAccessConfig.getFromPropsDefault(VDRExternalServerAccessConfig.java:126)

  at com.emc.vdr.server.ConnectionService.run(ConnectionService.java:40)

  at java.lang.Thread.run(Unknown Source)

Caused by: java.net.ConnectException: Connection refused

  at java.net.PlainSocketImpl.socketConnect(Native Method)

  at java.net.PlainSocketImpl.doConnect(Unknown Source)

  at java.net.PlainSocketImpl.connectToAddress(Unknown Source)

  at java.net.PlainSocketImpl.connect(Unknown Source)

  at java.net.SocksSocketImpl.connect(Unknown Source)

  at java.net.Socket.connect(Unknown Source)

  at com.sun.net.ssl.internal.ssl.SSLSocketImpl.connect(Unknown Source)

  at com.emc.avamar.mcsdk.adapter.service.TrustAllSSLProtocolSocketFactory.createSocket(TrustAllSSLProtocolSocketFactory.java:128)

  at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707)

  at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionManager.java:1361)

  at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387)

  at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)

  at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)

  at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:346)

  at org.apache.axis2.transport.http.AbstractHTTPSender.executeMethod(AbstractHTTPSender.java:542)

  at org.apache.axis2.transport.http.HTTPSender.sendViaPost(HTTPSender.java:199)

  ... 17 more

2015-04-15 14:30:05,515 ERROR [com.emc.vdr.server.VDRServer$1]-service.AdapterUtils: ServiceInstance failed to obtain domain "/"

java.lang.NullPointerException

  at com.emc.avamar.mcsdk.adapter.service.ServiceInstance.getDomain(ServiceInstance.java:496)

  at com.emc.avamar.mcsdk.adapter.service.ServiceInstance.getRootDomain(ServiceInstance.java:462)

  at com.emc.vdr.server.VDRServer.getVCenterClient(VDRServer.java:402)

  at com.emc.vdr.server.VDRExternalServerAccessConfig.getFromAdapterDefault(VDRExternalServerAccessConfig.java:86)

  at com.emc.vdr.server.VDRExternalServerAccessConfig.getFromPropsDefault(VDRExternalServerAccessConfig.java:126)

  at com.emc.vdr.server.ConnectionService.run(ConnectionService.java:40)

  at java.lang.Thread.run(Unknown Source)

2015-04-15 14:30:05,515 ERROR [com.emc.vdr.server.VDRServer$1]-server.VDRServer: VDRServer.getVCenterClient cannot obtain VCenterClient

java.lang.NullPointerException

  at com.emc.vdr.server.VDRServer.getVCenterClient(VDRServer.java:403)

  at com.emc.vdr.server.VDRExternalServerAccessConfig.getFromAdapterDefault(VDRExternalServerAccessConfig.java:86)

  at com.emc.vdr.server.VDRExternalServerAccessConfig.getFromPropsDefault(VDRExternalServerAccessConfig.java:126)

  at com.emc.vdr.server.ConnectionService.run(ConnectionService.java:40)

  at java.lang.Thread.run(Unknown Source)

2015-04-15 14:30:05,515 ERROR [com.emc.vdr.server.VDRServer$1]-server.VDRExternalServerAccessConfig: Unable to fetch the vCenter credential from web service: null

2015-04-15 14:30:05,515 ERROR [com.emc.vdr.server.VDRServer$1]-server.ConnectionService: Unable to get the vi access: no protocol:

2015-04-15 14:30:05,515 INFO  [com.emc.vdr.server.VDRServer$1]-server.ConnectionService: Retry after 5 seconds ...

 

In a desperate attempt I created a new VDP machine and got the same symptoms

I tried the dpnctl start all but it errors (see attached file).

Those machine worked until few days ago and now they gone!

 

Does anyone know how to resolve these issue?

 

Thanks in advance.

 

Rob

 

P.S.

I am using vCenter 5.1 VDP 5.1

VDP not sending Summary Report since Sunday (time change).

$
0
0

I just noticed that the (4) VDP appliances I am testing all stopped sending the Email Summary Report after the Daylight Savings time change on Sunday. the last report was generated Sunday morning at 12:00am. Now all the appliances are reporting this:

 

VDP: Send email summary report error. The email summary report timer is set to the incorrect hour. It does not match the vdrdb value.

 

The time this error is generated is 11:00:00pm which is exactly one hour from when it should be running.

I think this is a Daylight Savings time issue but dont know how to address it.

Any help would be greatly appreciated.

 

RickH

VMware Data protection5.5 error code: 10014

$
0
0

Hello!

 

I have vCenter and ESX 5.1.

I have installed VMware Data Protection 5.5. Then the backup starting i see next error:

An unexpected error occurred with the following error code: 10014. More information may be available in the client logs which can be downloaded from the configuration application

(https://<VDP hostname>:8543/vdp-configure).

error

27.12.2013 13:26:34

VDP: Backup Job

vSphere Data Protection 5.5

 

What is it mean&

VDP backups always fail regardless of state

$
0
0

Hello,

 

I have tried to deploy VDP of several versions with the same result in order to evaluate the product but can't get it to backup a single host regardless of powered on or shut down. The deployment were done following the VDP administration guide to the point.

During the process I started out with VDP 5.1 then upgraded both vcenter server and VDP to 5.5 and 5.5.6 respectively with almost the same issue. I have set new vdp users with administrative permissions, redeployed vdp, tested several different vm hosts in all possible states with or without snapshots present but same result. Backup starts but fail in under a minute due to what looks like no permission to read the .vmx file, I can however download and view the file using infrastructure client as long as the vm host is shut down.

I have also tried all suggested solutions that I could find on the kb, no special chars in the datacenter etc.

 

I am starting to get a bit frustrated and the feeling is that this product is flawed. Any ideas would be greatly appreciated.

 

The most recent attempts in VDP 5.5.6 give the following log output:

 

====================================================================================================================================================

Client Name ::CentOS QNAP Management Server  |  Workorder ID :: null  |  Completed Time ::Tue, 8 Apr 2014 23:42:57 CEST

=====================================================================================================================================================

<browse env-locale-cs="ANSI_X3.4-1968" ack="no" msgver="1" targetCid="514330c10e51fd762447275e43f5f51df0a8780b" maxelems="1" filesize="21332" cid="b99ef535b8c7d127017ffa9288ebd64a2d613302" showdebug="false"><file inode="423343" date="2014-04-08 19:32:41" internal="0" group="root" protection="lrwxrwxrwx" name="var-proxy-7" size="31" links="1" viewable="1" user="root">

 

*********** /usr/local/avamarclient/var-proxy-7/InitialTestBackup-1396993349036-514330c10e51fd762447275e43f5f51df0a8780b-1016-vmimagel.log ***********

<logheader platform="Linux" env-locale-cs="ANSI_X3.4-1968" process_id="avvcbimage" version="7.0.182-99" tz="CEST" />

 

--------------------------------------------------------------------------------------------------------

-----  START avvcbimage log 2014-04-08 23:42:31 CEST  [7.0.182-99 Linux-x86_64]

--------------------------------------------------------------------------------------------------------

 

2014-04-08T23:42:31.936+2:00 avvcbimage Info <5008>: Logging to /usr/local/avamarclient/var-proxy-7/InitialTestBackup-1396993349036-514330c10e51fd762447275e43f5f51df0a8780b-1016-vmimagel.log

2014-04-08T23:42:31.936+2:00 avvcbimage Info <5174>: - Reading /root/.avamar

2014-04-08T23:42:31.936+2:00 avvcbimage Info <5174>: - Reading /usr/local/avamar/etc/usersettings.cfg

2014-04-08T23:42:31.936+2:00 avvcbimage Info <5174>: - Reading /usr/local/avamarclient/var-proxy-7/avvcbimage.cmd

2014-04-08T23:42:31.936+2:00 avvcbimage Info <5174>: - Reading /usr/local/avamarclient/var/avvcbimageAll.cmd

2014-04-08T23:42:31.938+2:00 avvcbimage Info <6673>: CTL listening on port 51445

2014-04-08T23:42:31.939+2:00 avvcbimage Info <10684>: Setting ctl message version to 3 (from 1)

2014-04-08T23:42:31.939+2:00 avvcbimage Info <16136>: Setting ctl max message size to 268435456

2014-04-08T23:42:31.942+2:00 avvcbimage Warning <6788>: Found unknown section 'browse-from-catalog' in workorder, ignoring

2014-04-08T23:42:31.943+2:00 avvcbimage Warning <17809>: VAMI Statistics Push Provider DISABLED.

2014-04-08T23:42:31.961+2:00 avvcbimage Info <18664>: Login(https://vcenter.lab.local:443/sdk) Datacenter: 'Datacenter01'

2014-04-08T23:42:31.961+2:00 avvcbimage Info <0000>:      - connected to 'VirtualCenter' - version: 'VMware vCenter Server 5.5.0 build-1623101',  apiVersion:'5.5'

2014-04-08T23:42:32.024+2:00 avvcbimage Info <14692>: Login test is OK.

2014-04-08T23:42:32.079+2:00 avvcbimage Info <0000>: VM Info: VMX version 4(F), ctk enabled(T), fault tolerant (F), Guest OS CentOS 4/5/6 (64-bit), Cloud UUID = NoUUID. version=8

2014-04-08T23:42:32.129+2:00 avvcbimage Info <14625>: WorkOrder Disk Info:

  Disk '2000': file(base):'[QNAP02-Datastore201] CentOS QNAP Management Server/CentOS QNAP Management Server.vmdk', backItUp=1

               snapshot file:'[QNAP02-Datastore201] CentOS QNAP Management Server/CentOS QNAP Management Server.vmdk'

               prior size(KB):0, current size(KB):16777216, match=0

               prior change block ID:''

               Datastore:'QNAP02-Datastore201' Directly Accessible=1

2014-04-08T23:42:32.130+2:00 avvcbimage Info <11979>: proxy VM DNS name is: 127.0.0.2,vdp-hq-esx01.lab.local,vdp-hq-esx01,192.168.0.12

2014-04-08T23:42:32.130+2:00 avvcbimage Info <18672>: proxy VM Instance name is: vdp-hq-esx01.lab.local-proxy-7

2014-04-08T23:42:32.130+2:00 avvcbimage Info <17793>: proxy VM Moref is: vm-1401

2014-04-08T23:42:32.130+2:00 avvcbimage Info <16010>: vCenter 'Datacenter01' is vcenter.lab.local

2014-04-08T23:42:32.130+2:00 avvcbimage Info <11981>: VM's host is hq-esx02.lab.local

2014-04-08T23:42:32.130+2:00 avvcbimage Info <11982>: VM's primary storage location is [QNAP02-Datastore201] CentOS QNAP Management Server/CentOS QNAP Management Server.vmx

2014-04-08T23:42:32.130+2:00 avvcbimage Info <11983>: VM's vCenter ID is vm-1277

2014-04-08T23:42:33.320+2:00 avvcbimage Info <0000>: Proxy Host Name=hq-esx01.lab.local(5.1 build-1157734) VM Host Name=hq-esx02.lab.local(5.1 build-1157734)

2014-04-08T23:42:33.320+2:00 avvcbimage Info <11984>: VM's backup account on vdp-hq-esx01.lab.local is /vcenter.lab.local/VirtualMachines/CentOS_QNAP_Management_Server_Ui0niBEuhZa7fTHZF4vjOg

2014-04-08T23:42:33.320+2:00 avvcbimage Info <11986>: Changed block tracking is engaged for this VM

2014-04-08T23:42:33.320+2:00 avvcbimage Info <11988>: A reference to a valid prior backup is not available so this will be a full level zero backup.

2014-04-08T23:42:33.404+2:00 avvcbimage Info <17779>:  task task-5528 migration status:0

2014-04-08T23:42:33.446+2:00 avvcbimage Warning <6788>: Found unknown section 'browse-from-catalog' in workorder, ignoring

2014-04-08T23:42:33.448+2:00 avvcbimage Info <5174>: - Reading /usr/local/avamarclient/var-proxy-7/avvcbimage.cmd

2014-04-08T23:42:33.448+2:00 avvcbimage Info <5174>: - Reading /usr/local/avamarclient/var/avvcbimageAll.cmd

2014-04-08T23:42:33.448+2:00 avvcbimage Info <7084>: target[0]=[QNAP02-Datastore201] CentOS QNAP Management Server/CentOS QNAP Management Server.vmdk

2014-04-08T23:42:33.461+2:00 avvcbimage Info <18664>: Login(https://vcenter.lab.local:443/sdk) Datacenter: 'Datacenter01'

2014-04-08T23:42:33.462+2:00 avvcbimage Info <0000>:      - connected to 'VirtualCenter' - version: 'VMware vCenter Server 5.5.0 build-1623101',  apiVersion:'5.5'

2014-04-08T23:42:33.486+2:00 avvcbimage Info <14692>: Login test is OK.

2014-04-08T23:42:33.508+2:00 avvcbimage Info <16041>: VDDK:OBJLIB-LIB: Objlib initialized.

 

2014-04-08T23:42:33.508+2:00 avvcbimage Info <16041>: VDDK:VixDiskLib: Attempting to locate advanced transport module in "/usr/lib/vmware-vix-disklib".

 

2014-04-08T23:42:34.430+2:00 avvcbimage Info <16041>: VDDK:VixDiskLib: Advanced transport plugin was successfully loaded into vixDiskLib.

 

2014-04-08T23:42:34.430+2:00 avvcbimage Info <16041>: VDDK:VixDiskLib: Enabling advanced transport modes.

 

2014-04-08T23:42:34.430+2:00 avvcbimage Info <16041>: VDDK:OBJLIB-LIB: Objlib initialized.

 

2014-04-08T23:42:34.431+2:00 avvcbimage Info <16041>: VDDK:VixDiskLib: Initialize transport modes.

 

2014-04-08T23:42:34.431+2:00 avvcbimage Info <16041>: VDDK:VixDiskLib: Available transport modes: file:san:hotadd:nbdssl:nbd.

 

2014-04-08T23:42:34.431+2:00 avvcbimage Info <16041>: VDDK:VMware VixDiskLib (5.5) Release build-1556136

 

2014-04-08T23:42:34.451+2:00 avvcbimage Info <16041>: VDDK:VixDiskLibVim: VixDiskLibVim_Init: Initialization is completed.

 

2014-04-08T23:42:34.451+2:00 avvcbimage Info <9666>: Available transport modes are file:san:hotadd:nbdssl:nbd

2014-04-08T23:42:34.451+2:00 avvcbimage Info <16041>: VDDK:VixDiskLib: VixDiskLib_PrepareForAccess: Prepare to access disk.

 

2014-04-08T23:42:34.451+2:00 avvcbimage Info <16041>: VDDK:VixDiskLib: VixDiskLib_Connect: Establish connection.

 

2014-04-08T23:42:34.451+2:00 avvcbimage Info <16041>: VDDK:VixDiskLibVim: VixDiskLibVim_AllowVMotion: Disable VMotion.

 

2014-04-08T23:42:35.106+2:00 avvcbimage Info <17818>: VixDiskLib vMotion reservation successfully enabled by 'vSphere Data Protection'

2014-04-08T23:42:35.106+2:00 avvcbimage Info <16011>: Running cleanup of old backups.

2014-04-08T23:42:35.106+2:00 avvcbimage Info <16041>: VDDK:VixDiskLib: VixDiskLib_Cleanup: Remove previous mount points and clean up .

 

2014-04-08T23:42:35.106+2:00 avvcbimage Info <16041>: VDDK:VixDiskLib: VixDiskLib_Connect: Establish connection.

 

2014-04-08T23:42:35.106+2:00 avvcbimage Info <16041>: VDDK:VixDiskLib: VixDiskLib_Disconnect: Disconnect.

 

2014-04-08T23:42:35.106+2:00 avvcbimage Info <16048>: VixDiskLib_Cleanup() found no prior mounts to cleanup.

2014-04-08T23:42:35.131+2:00 avvcbimage Info <18664>: Login(https://vcenter.lab.local:443/sdk) Datacenter: 'Datacenter01'

2014-04-08T23:42:35.131+2:00 avvcbimage Info <0000>:      - connected to 'VirtualCenter' - version: 'VMware vCenter Server 5.5.0 build-1623101',  apiVersion:'5.5'

2014-04-08T23:42:35.154+2:00 avvcbimage Info <14692>: Login test is OK.

2014-04-08T23:42:35.762+2:00 avvcbimage Info <14644>: The VM '[QNAP02-Datastore201] CentOS QNAP Management Server/CentOS QNAP Management Server.vmx' has no old snapshots to delete.

2014-04-08T23:42:35.784+2:00 avvcbimage Info <14664>: no snapshots are present on this VM.

2014-04-08T23:42:35.784+2:00 avvcbimage Info <15994>: Logging into datacenter path of 'folder?dcPath=Datacenter01'

2014-04-08T23:42:35.943+2:00 avvcbimage Info <14673>: All Datastore Info:

  datastore:'Local-hq-esx01                   '  capacity=434865438720    free=425348562944

  datastore:'QNAP02-Datastore201        '  capacity=2973996417024   free=2415045640192

2014-04-08T23:42:35.943+2:00 avvcbimage Info <14675>: All VM Info (7/7):

  VM:'CentOS QNAP Management Server/          '  last modified on '08-Apr-2014 21:39'

  VM:'vcenter.lab.local/                 '  last modified on '08-Apr-2014 12:39'

  VM:'vcenter/                                '  last modified on '08-Apr-2014 13:11'

2014-04-08T23:42:36.038+2:00 avvcbimage Info <14677>: All VM file Info:

  File:'CentOS QNAP Management Server-ctk.vmdk            ' last modified on '05-Mar-2014 10:22'  size=1049088

  File:'CentOS QNAP Management Server-flat.vmdk           ' last modified on '05-Mar-2014 10:22'  size=17179869184

  File:'CentOS QNAP Management Server.nvram               ' last modified on '05-Mar-2014 10:22'  size=8684

  File:'CentOS QNAP Management Server.nvram.txt           ' last modified on '30-Jan-2014 19:00'  size=8684

  File:'CentOS QNAP Management Server.vmdk                ' last modified on '24-Feb-2014 15:49'  size=620

  File:'CentOS QNAP Management Server.vmsd                ' last modified on '24-Feb-2014 15:49'  size=43

  File:'CentOS QNAP Management Server.vmx                 ' last modified on '08-Apr-2014 21:39'  size=3004

  File:'CentOS QNAP Management Server.vmx.txt             ' last modified on '30-Jan-2014 19:00'  size=2984

  File:'CentOS QNAP Management Server.vmxf                ' last modified on '08-Apr-2014 21:39'  size=284

  File:'vmware-2.log                                      ' last modified on '29-Jan-2014 08:18'  size=114456

  File:'vmware-3.log                                      ' last modified on '29-Jan-2014 08:44'  size=122823

  File:'vmware-4.log                                      ' last modified on '29-Jan-2014 08:52'  size=125758

  File:'vmware-5.log                                      ' last modified on '31-Jan-2014 11:44'  size=154480

  File:'vmware-6.log                                      ' last modified on '31-Jan-2014 11:59'  size=254378

  File:'vmware-7.log                                      ' last modified on '24-Feb-2014 15:37'  size=148629

  File:'vmware.log                                        ' last modified on '05-Mar-2014 10:22'  size=141769

2014-04-08T23:42:36.038+2:00 avvcbimage Info <14620>: Logging into datacenter 'vcenter.lab.local' with user 'vdpuser@LAB.LOCAL'

2014-04-08T23:42:36.216+2:00 avvcbimage Warning <0000>: No HTTP content was returned from datacenter from downloadFileData 'vcenter.lab.local'.

2014-04-08T23:42:36.216+2:00 avvcbimage Warning <17803>: Download VM .vmx file retry, count=0.

2014-04-08T23:42:41.269+2:00 avvcbimage Warning <0000>: No HTTP content was returned from datacenter from downloadFileData 'vcenter.lab.local'.

2014-04-08T23:42:41.269+2:00 avvcbimage Warning <17803>: Download VM .vmx file retry, count=1.

2014-04-08T23:42:46.389+2:00 avvcbimage Warning <0000>: No HTTP content was returned from datacenter from downloadFileData 'vcenter.lab.local'.

2014-04-08T23:42:46.389+2:00 avvcbimage Warning <17803>: Download VM .vmx file retry, count=2.

2014-04-08T23:42:51.389+2:00 avvcbimage Error <17804>: Max retries for downloading VM .vmx file exceeded, count=3.

2014-04-08T23:42:51.389+2:00 avvcbimage Error <17821>: failed to download vm metadata, try later

2014-04-08T23:42:51.390+2:00 avvcbimage Info <9772>: Starting graceful (staged) termination, failed to download vm metadata (wrap-up stage)

2014-04-08T23:42:51.390+2:00 avvcbimage Error <0000>: [IMG0009] createSnapshot: snapshot creation  or pre/post snapshot script failed

2014-04-08T23:42:51.390+2:00 avvcbimage Error <0000>: [IMG0009] createSnapshot: snapshot creation/pre-script/post-script failed

2014-04-08T23:42:51.390+2:00 avvcbimage Info <9763>: snapshot created:false NOMC:false ChangeBlTrackingAvail:true UsingChBl:true

2014-04-08T23:42:51.390+2:00 avvcbimage Info <16041>: VDDK:VixDiskLib: VixDiskLib_EndAccess: Disk access completed.

 

2014-04-08T23:42:51.390+2:00 avvcbimage Info <16041>: VDDK:VixDiskLib: VixDiskLib_Connect: Establish connection.

 

2014-04-08T23:42:51.390+2:00 avvcbimage Info <16041>: VDDK:VixDiskLibVim: VixDiskLibVim_AllowVMotion: Enable VMotion.

 

2014-04-08T23:42:51.392+2:00 avvcbimage Info <16038>: Final summary, cancelled/aborted 0, snapview 1, exitcode 157: miscellaneous error

2014-04-08T23:42:51.929+2:00 avvcbimage Info <17819>: VixDiskLib vMotion reservation successfully released

 

--------------------------------------------------------------------------------------------------------

----- END avvcbimage log 2014-04-08 23:42:56 CEST  (9 warnings, 4 errors, 0 fatal errors)

--------------------------------------------------------------------------------------------------------

 

 

 

*********** /usr/local/avamarclient/var-proxy-7/InitialTestBackup-1396993349036-514330c10e51fd762447275e43f5f51df0a8780b-1016-vmimagel.alg ***********

<logheader platform="Linux" env-locale-cs="ANSI_X3.4-1968" process_id="InitialTestBackup-1396993349036" version="7.0.182-99" tz="CEST" />

vdp 6.1.2 cannot create some backup jobs

$
0
0

Hi All,

following documentation i've installed and configure VDP 6.1.2 virtual appliance on Vcenter 6.0.0.10200.

In dashboard all services are green (up&running). Performance analysys tests has been passed.

I can login to vdp through vcenter, edit report settings, backup time window.

 

I can create a backup job of a Win7 VM but can't create for other Win Server or Linux VM.

 

In the "Create Backup Job" wizard window, when i click on "Finish" web page become grey and unresposive.

It remains hung as long as i reload Vcenter web interface.

 

Time cfg and DNS resolution are ok. All hosts and virtual appliance are on the same subnet and i use standard virtual switches.

 

I can't find anything significant in logs.

 

Thanks for attention

Regards

Nicola

 

Update...

I've opened a support with Vmware: it's a vsphere client bug. They sent me a patch and now it's all fine.

Patch will be available in next release.

Regards

Nicola

Viewing all 64650 articles
Browse latest View live


Latest Images