Menneisyys
02-15-2006, 10:40 AM
(In case you've missed the frontpage story, I also post this here.)
As readers of my articles already know, you do need a backup software under Windows Mobile 5 too and there're only two reliable backup solutions: Sprite Backup 5 (http://spritesoftware.com/) and Spb Backup 1.0 (http://www.spbsoftwarehouse.com/products/backup/?en).
(Please note that you should only use these links to get these applications. For example, some Chinese site at http://download.enet.com.cn/html/EN465552006012001.html advertises a beta, build 1441 version of Spb Backup as the "final" one.)
I've already elaborated on the (missing) capabilities of these two applications in my previous articles (please make sure you read them). The only real difference between the final version of Spb Backup and the reviewed betas is the newly added scheduled backup (see screenshot 1 (http://www.winmobiletech.com/kuvat/SpbBackupScheduled-1.bmp.png) and 2 (http://www.winmobiletech.com/kuvat/SpbBackupScheduled-2.bmp.png); in the latter one, the 'm t k...' stuff is the Finnish for the weekdays). Therefore, the reader is referred to the linked, earlier articles for more information on the capabilities. As with all my other articles, you're supposed to read my previous articles and my forum posts (they're linked in the "Recommended reading" section; you may also want to follow the links elsewhere in the article, they also contain a lot of interesting and related information) on the subject – I don't want to repeat the (pretty extensive) information here I've already spoken about in my old(er) articles or forum posts.
(Incidentally, you may ask why I need more time to test the scheduling capabilities. It's pretty simple. Scheduled backups may have problems because of how the operating system behaves when it's awaken. As you may have heard, it's not necessarily behaving like as it should – this have been the source of a lot of problems, particularly under WM2003/ WM2003SE. That is, I need to make some time-comsuming 'does it really awake? Doesn't it shut down during the backup? Are operating system hacks needed to keep it awake in all the supported operating systems? Does the latency of the storage cards' becoming available only some seconds after powering up the Pocket PC cause problems?' reliability tests. Finally, advanced tests like Exchange PIM backup tests also require some time.)
Now, some direct comparison of the capabilities, the compliance with my test devices, the speed and the backup file sizes of the two applications.
Generic stuff and capabilities
Comparison chart here (http://www.winmobiletech.com/sekalaiset/SpbSpriteBackupComparisonChart.html)
Much as Spb Backup definitely has a lead by having a nice, separately downloadable/installable desktop extractor tool (http://www.winmobiletech.com/kuvat/SpbBackupDesktopExtractor.png), which, as opposed to STGViewer and even HPC Vault (http://www.pocketpcmag.com/blogs/index.php?blog=3&p=442&more=1) is even able to restore the entire registry/all WinCE databases to the desktop (but only to the desktop, unlike HPC Vault; this is certainly a problem, given that it isn't capable of selective WinCE database restoring on the PDA), Spb is decidecly weaker in some other, important areas, particularly as far as desktop-based and remote (Internet/LAN-based) backup/restore is concerned. It doesn't have the ability to selectively backup/restore WindowsCE databases either. The latter could be nice in cases – for example, when you only need a certain WinCE database (for example, the Contacts database only), particularly from another Pocket PC. Sprite Backup is stronger in these areas.
One of my biggest complaints with Sprite Backup is the lack of any similar, desktop-based tool, as far as file / system database / Registry extraction is concerned. It wouldn't be complicated to write one. Even I, despite officially not having the Sprite backup file format information, could easily implement it. This would be even easier for the Sprite folks because they don't need to discover the file/storage format of their own backup files. (Note that I've written/authored several backup restorer/extractor tools – see for example my HTC xBackup extractor tool (http://pocketpcmag.com/forum/topic.asp?TOPIC_ID=16922) and ActiveSync Contacts extractor tool (http://www.pocketpcthoughts.com/forums/viewtopic.php?t=43819).)
For the casual user that doesn't need a desktop PC-based backup agent and doesn't need the excellent, seamless backup capabilities of ActiveSync (http://www.pocketpcmag.com/blogs/index.php?blog=3&p=442&more=1), Spb's approach (the PDA-based backup) can be sufficient, though.
Another big disappointment with the new Sprite Backup is the lack of the excellent device upgrade mode (http://spritesoftware.crmdesk.com/answer.aspx?id=168&back=browse.aspx%23p15) of previous, pre-WM5 versions. This upgrade mode makes it unnecessary to do what has been done for example here (http://www.pocketpcthoughts.com/forums/viewtopic.php?t=40209) and here (http://www.winmobiletech.com/pl720restore/). The lack of this feature is really painful.
As far as Spb Backup is concerned, it has another problem: when you backup, you can include/exclude any file from the backup set. However, the same is not possible when you restore your backup - as opposed to the backup program (http://www.winmobiletech.com/kuvat/SpbBackupRC1CustomBackup.bmp.png), there's no Options button on the restoration screen (http://www.winmobiletech.com/kuvat/SpbBackupRestoreNoChoosableFile.bmp.png).
The only way to restore just a given set of files (and not all of them), you will need to turn to Spb Backup Unpack, unpack all the files in a backup file onto a desktop PC and transfer the given files to the PDA. This is certainly much more cumbersome than Sprite's approach.
Finally, as far as exclusion is concerned, in Sprite Backup you can define automatic exclusion rules (so that you don't end up manually having to exlude all, say, *.tmp files in all directories). This is, unfortunately, not possible in Spb Backup.
Benchmarks
Comparison chart here (http://www.winmobiletech.com/sekalaiset/SpbSpriteBackupBenchmarkChart.html)
As can clearly be seen, Spb Backup is about two times slower on both devices than Sprite Backup. It's especially slow at restoring some 30 Mbytes on the Wizard. On the other hand, it creates about 20% smaller (and, what is more, executable) backup files – and works wonderfully with both devices, unlike Sprite.
New problems found with Sprite Backup 5
In addition to its inability to work with HP devices with Credant/HP Protect installed (http://spritesoftware.crmdesk.com/answer.aspx?id=227&back=browse.aspx%23p26), Sprite Backup also has problems with some other, bootup-time services. For example, many Pocket PC Phone Edition devices (for example, the HTC Wizard-rebrand Qtek 9100 with the latest, official ROM version 1.6.7.1 (http://www.pocketpcmag.com/blogs/index.php?blog=3&p=518&more=1)) pop up a notification upon booting, displaying the geographical location of the user. This will cause the Today screen to be displayed and the Pocket PC to start working, while Sprite continues backing up in the background. Unfortunately, removing the SIM card from the Wizard won't help in this case because, then, the "no SIM card found" dialer will be displayed and, after exiting it, you'll also be taken to the Today screen. The only way to switch back to Sprite Backup to actually see what is happening is executing it again.
All in all, it's better not to use Sprite Backup to back up devices like this because of the (even if they're small/negligable) inconsistencies this problem may cause.
Note that this bug isn't present with earlier HTC Wizard ROM versions, which don't display the location notification after a soft reset.
Verdict
I think it's a bit early to say which backup app to go for, particularly if you want to back up Exchange-synchronized data or regularly use the scheduled backup capabilities (or, the remote/desktop agent-based backup capabilities).
If you, however, have a WM5 Pocket PC incompatible with Sprite Backup (some iPAQ's, some PPC PE devices), I think it's safe to go straight for Spb Backup, regardless of the outcome of my further tests. Particularly, because it also has a trial version and is considerably cheaper (unless you own an earlier version of Sprite and use the mail-in rebate) – unlike Sprite Backup.
Also, if you plan to back up your Pocket PC's with earlier operating systems with a unified, capable tool (instead of, say, the pretty incapable tools of most Pocket PC's, except for WM2003+ iPAQ's, which have the Sprite Backup-based, capable and reliable iPAQ Backup), go for Spb Backup. That way, you only need to spend $20 on a backup tool that works on all non-Pocket PC 2000 devices.
However, Sprite Backup does have features that Spb Backup just can't match – see for example the question of selective file restoration, network backups or the highly useful automated desktop-based backups (if you used ActiveSync backups, you will like it too). If you have a compatible device and can make a decent deal with the Sprite folks as far as further upgrades are concerned (or money-back guarantee if on your new ROM version/new device it doesn't work), Sprite Backup may be a better solution.
Recommended reading
Sprite Backup 5 is out (http://www.pocketpcmag.com/blogs/index.php?blog=3&p=517&more=1)
A review of the latest Spb Backup beta (http://www.pocketpcmag.com/blogs/index.php?blog=3&title=wm5_users_new_beta_version_of_spb_backup&more=1)
Dell Axim x51v users: refrain from using the built-in Data Backup! It's unreliable (http://www.pocketpcmag.com/blogs/index.php?blog=3&title=dell_axim_x51v_users_refrain_from_using&more=1) (incidentally, the backup/restore times I've measured with the same test suite were 4:00 and 7:46, respectively; it created a 59Mbyte backup file).
The PPCT review of Spb Backup (build 1606 – please note that the final version tested in my article is build 1775) (http://www.pocketpcthoughts.com/forums/viewtopic.php?p=389122). I certainly recommend the comments – a lot of additional questions are explained there.
ADDITION (16-Feb-2006): According to AximSite forum member netsyd (http://www.aximsite.com/boards/showthread.php?p=1000165), while Sprite Backup is incompatible with synchronized Exchange data, Spb Backup has no problems with dealing with them.
As readers of my articles already know, you do need a backup software under Windows Mobile 5 too and there're only two reliable backup solutions: Sprite Backup 5 (http://spritesoftware.com/) and Spb Backup 1.0 (http://www.spbsoftwarehouse.com/products/backup/?en).
(Please note that you should only use these links to get these applications. For example, some Chinese site at http://download.enet.com.cn/html/EN465552006012001.html advertises a beta, build 1441 version of Spb Backup as the "final" one.)
I've already elaborated on the (missing) capabilities of these two applications in my previous articles (please make sure you read them). The only real difference between the final version of Spb Backup and the reviewed betas is the newly added scheduled backup (see screenshot 1 (http://www.winmobiletech.com/kuvat/SpbBackupScheduled-1.bmp.png) and 2 (http://www.winmobiletech.com/kuvat/SpbBackupScheduled-2.bmp.png); in the latter one, the 'm t k...' stuff is the Finnish for the weekdays). Therefore, the reader is referred to the linked, earlier articles for more information on the capabilities. As with all my other articles, you're supposed to read my previous articles and my forum posts (they're linked in the "Recommended reading" section; you may also want to follow the links elsewhere in the article, they also contain a lot of interesting and related information) on the subject – I don't want to repeat the (pretty extensive) information here I've already spoken about in my old(er) articles or forum posts.
(Incidentally, you may ask why I need more time to test the scheduling capabilities. It's pretty simple. Scheduled backups may have problems because of how the operating system behaves when it's awaken. As you may have heard, it's not necessarily behaving like as it should – this have been the source of a lot of problems, particularly under WM2003/ WM2003SE. That is, I need to make some time-comsuming 'does it really awake? Doesn't it shut down during the backup? Are operating system hacks needed to keep it awake in all the supported operating systems? Does the latency of the storage cards' becoming available only some seconds after powering up the Pocket PC cause problems?' reliability tests. Finally, advanced tests like Exchange PIM backup tests also require some time.)
Now, some direct comparison of the capabilities, the compliance with my test devices, the speed and the backup file sizes of the two applications.
Generic stuff and capabilities
Comparison chart here (http://www.winmobiletech.com/sekalaiset/SpbSpriteBackupComparisonChart.html)
Much as Spb Backup definitely has a lead by having a nice, separately downloadable/installable desktop extractor tool (http://www.winmobiletech.com/kuvat/SpbBackupDesktopExtractor.png), which, as opposed to STGViewer and even HPC Vault (http://www.pocketpcmag.com/blogs/index.php?blog=3&p=442&more=1) is even able to restore the entire registry/all WinCE databases to the desktop (but only to the desktop, unlike HPC Vault; this is certainly a problem, given that it isn't capable of selective WinCE database restoring on the PDA), Spb is decidecly weaker in some other, important areas, particularly as far as desktop-based and remote (Internet/LAN-based) backup/restore is concerned. It doesn't have the ability to selectively backup/restore WindowsCE databases either. The latter could be nice in cases – for example, when you only need a certain WinCE database (for example, the Contacts database only), particularly from another Pocket PC. Sprite Backup is stronger in these areas.
One of my biggest complaints with Sprite Backup is the lack of any similar, desktop-based tool, as far as file / system database / Registry extraction is concerned. It wouldn't be complicated to write one. Even I, despite officially not having the Sprite backup file format information, could easily implement it. This would be even easier for the Sprite folks because they don't need to discover the file/storage format of their own backup files. (Note that I've written/authored several backup restorer/extractor tools – see for example my HTC xBackup extractor tool (http://pocketpcmag.com/forum/topic.asp?TOPIC_ID=16922) and ActiveSync Contacts extractor tool (http://www.pocketpcthoughts.com/forums/viewtopic.php?t=43819).)
For the casual user that doesn't need a desktop PC-based backup agent and doesn't need the excellent, seamless backup capabilities of ActiveSync (http://www.pocketpcmag.com/blogs/index.php?blog=3&p=442&more=1), Spb's approach (the PDA-based backup) can be sufficient, though.
Another big disappointment with the new Sprite Backup is the lack of the excellent device upgrade mode (http://spritesoftware.crmdesk.com/answer.aspx?id=168&back=browse.aspx%23p15) of previous, pre-WM5 versions. This upgrade mode makes it unnecessary to do what has been done for example here (http://www.pocketpcthoughts.com/forums/viewtopic.php?t=40209) and here (http://www.winmobiletech.com/pl720restore/). The lack of this feature is really painful.
As far as Spb Backup is concerned, it has another problem: when you backup, you can include/exclude any file from the backup set. However, the same is not possible when you restore your backup - as opposed to the backup program (http://www.winmobiletech.com/kuvat/SpbBackupRC1CustomBackup.bmp.png), there's no Options button on the restoration screen (http://www.winmobiletech.com/kuvat/SpbBackupRestoreNoChoosableFile.bmp.png).
The only way to restore just a given set of files (and not all of them), you will need to turn to Spb Backup Unpack, unpack all the files in a backup file onto a desktop PC and transfer the given files to the PDA. This is certainly much more cumbersome than Sprite's approach.
Finally, as far as exclusion is concerned, in Sprite Backup you can define automatic exclusion rules (so that you don't end up manually having to exlude all, say, *.tmp files in all directories). This is, unfortunately, not possible in Spb Backup.
Benchmarks
Comparison chart here (http://www.winmobiletech.com/sekalaiset/SpbSpriteBackupBenchmarkChart.html)
As can clearly be seen, Spb Backup is about two times slower on both devices than Sprite Backup. It's especially slow at restoring some 30 Mbytes on the Wizard. On the other hand, it creates about 20% smaller (and, what is more, executable) backup files – and works wonderfully with both devices, unlike Sprite.
New problems found with Sprite Backup 5
In addition to its inability to work with HP devices with Credant/HP Protect installed (http://spritesoftware.crmdesk.com/answer.aspx?id=227&back=browse.aspx%23p26), Sprite Backup also has problems with some other, bootup-time services. For example, many Pocket PC Phone Edition devices (for example, the HTC Wizard-rebrand Qtek 9100 with the latest, official ROM version 1.6.7.1 (http://www.pocketpcmag.com/blogs/index.php?blog=3&p=518&more=1)) pop up a notification upon booting, displaying the geographical location of the user. This will cause the Today screen to be displayed and the Pocket PC to start working, while Sprite continues backing up in the background. Unfortunately, removing the SIM card from the Wizard won't help in this case because, then, the "no SIM card found" dialer will be displayed and, after exiting it, you'll also be taken to the Today screen. The only way to switch back to Sprite Backup to actually see what is happening is executing it again.
All in all, it's better not to use Sprite Backup to back up devices like this because of the (even if they're small/negligable) inconsistencies this problem may cause.
Note that this bug isn't present with earlier HTC Wizard ROM versions, which don't display the location notification after a soft reset.
Verdict
I think it's a bit early to say which backup app to go for, particularly if you want to back up Exchange-synchronized data or regularly use the scheduled backup capabilities (or, the remote/desktop agent-based backup capabilities).
If you, however, have a WM5 Pocket PC incompatible with Sprite Backup (some iPAQ's, some PPC PE devices), I think it's safe to go straight for Spb Backup, regardless of the outcome of my further tests. Particularly, because it also has a trial version and is considerably cheaper (unless you own an earlier version of Sprite and use the mail-in rebate) – unlike Sprite Backup.
Also, if you plan to back up your Pocket PC's with earlier operating systems with a unified, capable tool (instead of, say, the pretty incapable tools of most Pocket PC's, except for WM2003+ iPAQ's, which have the Sprite Backup-based, capable and reliable iPAQ Backup), go for Spb Backup. That way, you only need to spend $20 on a backup tool that works on all non-Pocket PC 2000 devices.
However, Sprite Backup does have features that Spb Backup just can't match – see for example the question of selective file restoration, network backups or the highly useful automated desktop-based backups (if you used ActiveSync backups, you will like it too). If you have a compatible device and can make a decent deal with the Sprite folks as far as further upgrades are concerned (or money-back guarantee if on your new ROM version/new device it doesn't work), Sprite Backup may be a better solution.
Recommended reading
Sprite Backup 5 is out (http://www.pocketpcmag.com/blogs/index.php?blog=3&p=517&more=1)
A review of the latest Spb Backup beta (http://www.pocketpcmag.com/blogs/index.php?blog=3&title=wm5_users_new_beta_version_of_spb_backup&more=1)
Dell Axim x51v users: refrain from using the built-in Data Backup! It's unreliable (http://www.pocketpcmag.com/blogs/index.php?blog=3&title=dell_axim_x51v_users_refrain_from_using&more=1) (incidentally, the backup/restore times I've measured with the same test suite were 4:00 and 7:46, respectively; it created a 59Mbyte backup file).
The PPCT review of Spb Backup (build 1606 – please note that the final version tested in my article is build 1775) (http://www.pocketpcthoughts.com/forums/viewtopic.php?p=389122). I certainly recommend the comments – a lot of additional questions are explained there.
ADDITION (16-Feb-2006): According to AximSite forum member netsyd (http://www.aximsite.com/boards/showthread.php?p=1000165), while Sprite Backup is incompatible with synchronized Exchange data, Spb Backup has no problems with dealing with them.