Bleeding edge : Manually transfer backups

[GMMan]

I'm pretty sure most of you are aware that there are some problems with the Palm backup servers right now. It comes as a great inconvenience for those who are migrating devices or Doctoring them. I decided to dig into the backup system once again, and this time see if I can extract the data from the source. This guide will show you how to transfer the most basic and critical part of the backups: the applications database.

You will need Novacom and developer mode enabled on both the device you're transferring from (device A) and to (device B).

1. Open up a shell session on device A. Use Novaterm for this purpose. For Windows, look at

C:\Program Files\Palm, Inc\terminal\novaterm.bat

For Linux and Mac OS X, type this into your Terminal:

novaterm

2. Make a directory to store the backup:

mkdir /media/internal/backupTmp

3. Run pre-backup:

luna-send -n 1 -f -a com.palm.service.backup palm://com.palm.db/internal/preBackup '{"tempDir":"/media/internal/backupTmp", "maxTempBytes":"99999999"}'

You should see a response like this:

{                                                                                                                                                                                               
    "description": "incremental=381, , com.palm.account:1=2, com.palm.app.email.prefs:1=1, com.palm.app.messagingprefs:1=1, com.palm.browserhistory:1=2, com.palm.browserpreferences:1=4, com.pa
lm.calendar:1=1, com.palm.calendarprefs:1=1, com.palm.callcapabilities.telephony:1=1, com.palm.clock.prefs:1=1, com.palm.location.LocationServicesPrefs:1=1",                                   
    "files": [                                                                                                                                                                                  
        "backup-1353831235696178.json"                                                                                                                                                          
    ],                                                                                                                                                                                          
    "full": true,                                                                                                                                                                               
    "incrementalKey": {                                                                                                                                                                         
        "deletedRev": 6400,                                                                                                                                                                     
        "rev": 6401                                                                                                                                                                             
    },                                                                                                                                                                                          
    "returnValue": true,                                                                                                                                                                        
    "version": 8,                                                                                                                                                                               
    "warnings": 0                                                                                                                                                                               
}

Note under "files" the file name. Also note the version.
4. Run post-backup

luna-send -n 1 -f -a com.palm.service.backup palm://com.palm.db/internal/postBackup {}

5. Put the device in USB Drive mode, and pull out the file in the backupTmp directory.
6. Set up device B. If you get stuck on the restore section, use the activation bypass tool (see link in resource list, found in my sig). At this point your webOS Account should be set up, but you will not have any of your old data.
7. Enter USB Drive mode on device B, and create the backupTmp directory. Put the file you extracted from device A in there.
8. Open a shell session on device B.
9. Run pre-restore:

luna-send -n 1 -f -a com.palm.service.backup palm://com.palm.db/internal/preRestore '{"version":8}'

Replace the version number with the one from the pre-backup response. You should get a response like this:

{                                                                                                                                                                                               
    "proceed": true,                                                                                                                                                                            
    "returnValue": true                                                                                                                                                                         
}

Make sure proceed is true.
10. Run post-restore:

luna-send -n 1 -f -a com.palm.service.backup palm://com.palm.db/internal/postRestore '{"files": ["backup-name.json"], "tempDir":"/media/internal/backupTmp", "version":8}'

Replace "backup-name.json" with the file name noted from step 3, and also replace the version number as noted in step 3. After a moment the command should return true.
11. Type this into the shell for device B:

reboot

12. After the reboot, enter your credentials for your Synergy accounts. Verify that your data has been mostly restored.

Caveat: I noticed Gmail doesn't seem to restore properly in the Email app. Remove and re-add the account and it will work.

The above has been tested using my TouchPad and webOS Emulator 3.0.5.

More instructions on migrating the rest coming soon.

[SebastianHa]

I just tested it on an 2.2.4 emulator and took a look at the resulting json file. I think there is missing something as not all data seems to be there.

E.g. I could not find contact photos which normally are backed up and restored, too. There must be more to do for a full backup. I am still searching but could not find it, yet.

[SebastianHa]

see here for what should be included in a full backup: Palm Support : Using Backup

[GMMan]

Originally Posted by SebastianHa

I just tested it on an 2.2.4 emulator and took a look at the resulting json file. I think there is missing something as not all data seems to be there.

E.g. I could not find contact photos which normally are backed up and restored, too. There must be more to do for a full backup. I am still searching but could not find it, yet.

Contact photos don't actually need to be run through the backup system. Just copy and paste it to the new device. It's the .contactphotos folder in the USB Drive partition.

As mentioned, this guide is only for the app database. I'm researching on how the rest works.

App restore is done by the First Run app, and is not in the realm of the backup service.

[SebastianHa]

I know but it would be very nice to understand the full backup procedure and being able to set up your own backup-server.

btw: thanks for your great work, I really appreciate it!

[hans109h]

GMMan,

What are your thoughts about using backup data from, say a touchpad, to restore a pre?

Hans

[GMMan]

Originally Posted by hans109h

GMMan,

What are your thoughts about using backup data from, say a touchpad, to restore a pre?

Hans

Could work, if the database kinds are still the same. I'm not sure how exactly the DB service imports the data, but considering you can do it from phone to table and there is no serverside processing, it seems possible. Try it on an emulator first.

[hans109h]

If you're cutting and pasting GMMan's commands, not that in step 10 you'll need to capitalize the b in the word Backup to point to the correct directory.

Hans

[hans109h]

Originally Posted by GMMan

Could work, if the database kinds are still the same. I'm not sure how exactly the DB service imports the data, but considering you can do it from phone to table and there is no serverside processing, it seems possible. Try it on an emulator first.

You, my friend, are a genius! Tested in emulator, reported back with a fatal error on reboot, but then restarted the emulator and the backup had taken. Did it again on my FrankenPre2 and I have my touchpad data on my phone now!

Do you take donations?

Hans

[gizmo21]

so will these commands also work on-device-only with wterm (as root) or xecutah /xTerm?

[GMMan]

Originally Posted by gizmo21

so will these commands also work on-device-only with wterm (as root) or xecutah /xTerm?

Definitely. You'll have to transfer files with a different way, though.