Page 23 of 55 FirstFirst ... 13181920212223242526272833 ... LastLast
Results 441 to 460 of 1081
Like Tree13Likes
  1. carrel's Avatar
    Posts
    425 Posts
    Global Posts
    426 Global Posts
    #441  
    Quote Originally Posted by Unclevanya View Post
    http://citeseerx.ist.psu.edu/viewdoc...=rep1&type=pdf

    It appears someone outside of this group is looking at optimizing flash storage on Linux and they propose a new way of doing that.
    That's a cool idea. Nice find.

    I did a quick look and didn't find any source code anywhere. But I have been told that I have bad "Google-**". Implementing from scratch is a big project.
  2. carrel's Avatar
    Posts
    425 Posts
    Global Posts
    426 Global Posts
    #442  
    Hey, the auto-censor-bot edited my post above. I wrote "Google-Fu" as in Kung-Fu and somehow, that is too racy for this crowd. :-)
  3. rksand's Avatar
    Posts
    151 Posts
    Global Posts
    152 Global Posts
    #443  
    So I'm running 96mb compcache and the following in sysctl.conf:

    Code:
    vm.swappiness = 50
    vm.vfs_cache_pressure = 200
    vm.dirty_expire_centisecs = 18000
    vm.dirty_writeback_centisecs = 6000
    Things had been chugging along nicely all day, but then I was running Classic and there was a drastic change in the swap utilization followed by a Luna restart.

    Code:
    swpd     free    buff    cache   si      so
    91904    2520    1464    50840   0       0
    91904    3896    1504    49136   37      0
    91904    3896    1512    49140   0       0
    91904    8272    1528    49148   0       0
    91904    8812    1544    49176   8       0
    91904    8752    1560    49180   0       0
    91376    12780   1664    43220   14      0
    32500    108604          2012    46400   491     0
    32472    67968   9800    59532   74      0
    32472    48392   12840   70764   0       0
    32472    36960   13024   82784   1       0
    32468    10644   13624   88524   153     0
    Any thoughts?
  4. snpalavan's Avatar
    Posts
    71 Posts
    Global Posts
    72 Global Posts
    #444  
    Quote Originally Posted by rksand View Post
    So I'm running 96mb compcache and the following in sysctl.conf:

    ...

    Things had been chugging along nicely all day, but then I was running Classic and there was a drastic change in the swap utilization followed by a Luna restart.

    ...

    Any thoughts?
    Same issue with me but when using the camcorder, seems that any high use of memory just overloads the phone...
  5. #445  
    I am not sure but it cant be the sysctl settings, they are not that far off from the palm defaults.

    Try the palm sysctl defaults and see if the issue still arises.

    If the issue still is there, then change the compcache size to 32mb, then if that makes things worse and not better try changing the compcache size to 128mb.

    Basically just seeing if first the sysctl is the problem, then ruling that out and moving onto a "too large" or "too small" compcache.
  6. carrel's Avatar
    Posts
    425 Posts
    Global Posts
    426 Global Posts
    #446  
    Quote Originally Posted by rksand View Post
    So I'm running 96mb compcache and the following in sysctl.conf:

    Code:
    vm.swappiness = 50
    vm.vfs_cache_pressure = 200
    vm.dirty_expire_centisecs = 18000
    vm.dirty_writeback_centisecs = 6000
    Things had been chugging along nicely all day, but then I was running Classic and there was a drastic change in the swap utilization followed by a Luna restart.

    Code:
    swpd     free    buff    cache   si      so
    91904    2520    1464    50840   0       0
    91904    3896    1504    49136   37      0
    91904    3896    1512    49140   0       0
    91904    8272    1528    49148   0       0
    91904    8812    1544    49176   8       0
    91904    8752    1560    49180   0       0
    91376    12780   1664    43220   14      0
    32500    108604          2012    46400   491     0
    32472    67968   9800    59532   74      0
    32472    48392   12840   70764   0       0
    32472    36960   13024   82784   1       0
    32468    10644   13624   88524   153     0
    Any thoughts?
    Well, I know its kind of obvious, but you are running out of memory. Even if we completely nail the VM problems and optimize it perfectly, this is still just a Pre- and it really needs more memory. Now that doesn't mean that we have nailed all the problems or optimized perfectly, but I'm just saying... There are limits. In your case, I can't tell if Classic went on a memory feeding frenzy or if the VM system went wonky.

    But, let's be optimistic and see what we can figure out... A few questions:
    • What else were you running? Did you have a lot of apps open? What were you doing in Classic?
    • Above you say that you are running a 96 Meg compcache, but you don't mention physical swap. Did you enable the physical swap? Can you send the output of '/sbin/swapon -s' ? If you are not running the physical swap with compcache, then running out of memory is completely unsurprising.


    One area we really haven't explored is increasing the size of the physical swap. Assuming that you are using a physical swap, then you need more memory and swap is going to be your only option. Yes swap is slow, but I personally will take slow over crashed anyday. Now we have a 100M swap partition. I'd love to be able to increase it to 256 or 384. Maybe we can create and add a swap file, but it just seems wrong to me to create a swap file on a flash file system. Might work, but something about it scares me. I'd prefer to understand what that device is that /dev/mapper/store-swap calls out.
  7. #447  
    Quote Originally Posted by carrel View Post
    Maybe we can create and add a swap file, but it just seems wrong to me to create a swap file on a flash file system. Might work, but something about it scares me.
    I am pretty sure that the swap partition we are currently using is on the same flash media (actually its an SSD) that the rest of the OS resides on.

    So I dont really understand the difference, its not like there is a separate media device in the phone for the physical swap. That would be utterly pointless and better spent on more RAM instead.

    So I dont really see what the issue is with moving the swap from one part of the SSD to another part of the SSD.
  8. carrel's Avatar
    Posts
    425 Posts
    Global Posts
    426 Global Posts
    #448  
    OK, if its an SSD, that make some sense. Let's find the disk and have a look...

    I rebooted so I could look at the top of dmesg and see the root device. Then let's see what's on it.

    Code:
    root@ - Palm Pre:/var/home/root# /usr/sbin/parted /dev/mmcblk0
    GNU Parted 1.8.9
    Using /dev/mmcblk0
    Welcome to GNU Parted! Type 'help' to view a list of commands.
    (parted) print
    print
    Model: Unknown (unknown)
    Disk /dev/mmcblk0: 8221MB
    Sector size (logical/physical): 512B/512B
    Partition Table: msdos
    
    Number  Start   End     Size    Type     File system  Flags
     1      524kB   4719kB  4194kB  primary               palo
     2      4719kB  38.3MB  33.6MB  primary  ext3
     3      38.3MB  8221MB  8183MB  primary               lvm
    Partition #3 is an LVM with most of the space. Let's look at it.

    Code:
    root@ - Palm Pre:/var/home/root# /usr/sbin/vgdisplay
      --- Volume group ---
      VG Name               store
      System ID
      Format                lvm2
      Metadata Areas        2
      Metadata Sequence No  14
      VG Access             read/write
      VG Status             resizable
      MAX LV                0
      Cur LV                8
      Open LV               7
      Max PV                0
      Cur PV                1
      Act PV                1
      VG Size               7.62 GB
      PE Size               8.00 MB
      Total PE              975
      Alloc PE / Size       972 / 7.59 GB
      Free  PE / Size       3 / 24.00 MB
      VG UUID               MiFyGF-ov2x-hX1e-PA40-k1jU-ge1d-M0kpNK
    and
    Code:
    root@ - Palm Pre:/var/home/root# /usr/sbin/lvdisplay
      --- Logical volume ---
      LV Name                /dev/store/root
      VG Name                store
      LV UUID                I3Nc7e-z4kT-zMzg-nJ9A-L418-03eS-C6s8uD
      LV Write Access        read/write
      LV Status              available
      # open                 1
      LV Size                456.00 MB
      Current LE             57
      Segments               1
      Allocation             inherit
      Read ahead sectors     auto
      - currently set to     256
      Persistent major       254
      Persistent minor       0
      Block device           254:0
    
      --- Logical volume ---
      LV Name                /dev/store/var
      VG Name                store
      LV UUID                RA9oHF-HSaT-lvHN-AaxK-wfod-pxS2-535TyB
      LV Write Access        read/write
      LV Status              available
      # open                 1
      LV Size                64.00 MB
      Current LE             8
      Segments               1
      Allocation             inherit
      Read ahead sectors     auto
      - currently set to     256
      Persistent major       254
      Persistent minor       1
      Block device           254:1
    
      --- Logical volume ---
      LV Name                /dev/store/update
      VG Name                store
      LV UUID                W1axj4-I67Q-WrsH-l57s-YWcM-NGNK-EDqrMY
      LV Write Access        read/write
      LV Status              available
      # open                 0
      LV Size                16.00 MB
      Current LE             2
      Segments               1
      Allocation             inherit
      Read ahead sectors     auto
      - currently set to     256
      Persistent major       254
      Persistent minor       2
      Block device           254:2
    
      --- Logical volume ---
      LV Name                /dev/store/log
      VG Name                store
      LV UUID                079euH-Myjc-H6US-IKl9-P7yy-QP2N-6roUM3
      LV Write Access        read/write
      LV Status              available
      # open                 1
      LV Size                24.00 MB
      Current LE             3
      Segments               1
      Allocation             inherit
      Read ahead sectors     auto
      - currently set to     256
      Persistent major       254
      Persistent minor       3
      Block device           254:3
    
      --- Logical volume ---
      LV Name                /dev/store/media
      VG Name                store
      LV UUID                KK2qLk-x96W-eCgi-TTH8-CVyV-zQTk-kp591L
      LV Write Access        read/write
      LV Status              available
      # open                 1
      LV Size                6.67 GB
      Current LE             854
      Segments               1
      Allocation             inherit
      Read ahead sectors     auto
      - currently set to     256
      Persistent major       254
      Persistent minor       4
      Block device           254:4
    
      --- Logical volume ---
      LV Name                /dev/store/swap
      VG Name                store
      LV UUID                8dRgu4-UfRo-bwYU-hjyK-PwPq-7yTd-8yBIlz
      LV Write Access        read/write
      LV Status              available
      # open                 1
      LV Size                104.00 MB
      Current LE             13
      Segments               1
      Allocation             inherit
      Read ahead sectors     auto
      - currently set to     256
      Persistent major       254
      Persistent minor       5
      Block device           254:5
    
      --- Logical volume ---
      LV Name                /dev/store/mojodb
      VG Name                store
      LV UUID                j9AsLj-iDoF-eniK-2K2M-VeIF-xvPb-udrP02
      LV Write Access        read/write
      LV Status              available
      # open                 1
      LV Size                144.00 MB
      Current LE             18
      Segments               1
      Allocation             inherit
      Read ahead sectors     auto
      - currently set to     256
      Persistent major       254
      Persistent minor       6
      Block device           254:6
    
      --- Logical volume ---
      LV Name                /dev/store/filecache
      VG Name                store
      LV UUID                S2JJWS-nmtT-nX7D-jys6-7fpK-XSaQ-DTZD5q
      LV Write Access        read/write
      LV Status              available
      # open                 1
      LV Size                136.00 MB
      Current LE             17
      Segments               4
      Allocation             inherit
      Read ahead sectors     auto
      - currently set to     256
      Persistent major       254
      Persistent minor       7
      Block device           254:7
    So there it is. The lvm named "store" has all the Linux partitions in it. We can see that swap is 104M and media is 6.67G. Now what we want to do is decrease the size of media and use that to increase the size of swap. I think we should be able to do that with an LVM, but it's late and I'm going to sleep now. But that was a fun look. More later...
  9. carrel's Avatar
    Posts
    425 Posts
    Global Posts
    426 Global Posts
    #449  
    And the good news is that Palm provided us with resize2fs and lvreduce so we have all the tools necessary to shrink /media/internal and the tool lvextend so we can then grow swap.

    Basic outline:
    1. reboot to ensure swap is not in use.
    2. swapoff /dev/store/swap
    3. umount /media/internal/ (this may be hard)
    4. e2fsck -f /dev/mapper/store-media
    5. run resize2fs for /dev/mapper/store-media with the new size (about 256 M smaller)
    6. run lvreduce for /dev/mapper/store-media with the new size
    7. run lvextend for /dev/mapper/store-swap with the new size
    8. reboot


    Just gotta work on the sizes... But really... I'm going to sleep now...
  10. #450  
    Quote Originally Posted by carrel View Post
    And the good news is that Palm provided us with resize2fs and lvreduce so we have all the tools necessary to shrink /media/internal and the tool lvextend so we can then grow swap.

    Basic outline:
    1. reboot to ensure swap is not in use.
    2. swapoff /dev/store/swap
    3. umount /media/internal/ (this may be hard)
    4. e2fsck -f /dev/mapper/store-media
    5. run resize2fs for /dev/mapper/store-media with the new size (about 256 M smaller)
    6. run lvreduce for /dev/mapper/store-media with the new size
    7. run lvextend for /dev/mapper/store-swap with the new size
    8. reboot


    Just gotta work on the sizes... But really... I'm going to sleep now...
    Before you go down that path. Most sources say that swap files are just as effective as swap partitions with current kernels. At this stage - rather than resize the partition, why not just add a file to the swap devices and see what happens?
  11. #451  
    Man my phone died on thursday and my new one is ready to pick up today. so much has happened in the past few days with this. looks like some great progress though. are there any settings that people are having success with right now?
  12. #452  
    Quote Originally Posted by Unclevanya View Post
    Before you go down that path. Most sources say that swap files are just as effective as swap partitions with current kernels. At this stage - rather than resize the partition, why not just add a file to the swap devices and see what happens?
    A while ago I added a swap file to my media internal part of the file system. Yeah I had more swap but when I tried to get into usb mode it for fail because the phone couldn't lock the file system. If you dont mind not having usb mode then you can give it a shot. Nobody is saying you cant do it. I was able to get Usb mode back by unmounting the swap. in the end I didnt see much benefit with a swap file.
    Sprint pre -> Motorola Photon 4G
  13. #453  
    Quote Originally Posted by theXfactor2011 View Post
    A while ago I added a swap file to my media internal part of the file system. Yeah I had more swap but when I tried to get into usb mode it for fail because the phone couldn't lock the file system. If you dont mind not having usb mode then you can give it a shot. Nobody is saying you cant do it. I was able to get Usb mode back by unmounting the swap. in the end I didnt see much benefit with a swap file.
    By USB Mode do you mean to share files with your PC or USB Passthru? In either case - I guess you could still validate that extra swap would help before resizing partitions on the phone which is the goal of this.
  14. rksand's Avatar
    Posts
    151 Posts
    Global Posts
    152 Global Posts
    #454  
    Or setup sftp and don't use the usb cable anymore. Its my preferred method, but transferring movies is a little slow.
  15.    #455  
    Graffix31- read post #411 and continue on from there, I think this is a good place to re-engage

    http://forums.precentral.net/palm-pr...memory-21.html
    Last edited by loopytee; 06/01/2011 at 06:13 PM.
    What does this button do?


    crappy phones -->treo 600--> 700p--> 755p--> Pre--->Pre- 2.1 F104-----Franken Pre+ 2.1 f105 ---> Franken pre2 2.2.4
    touchpad 16gig uberkernel woop woop!!!
  16.    #456  
    That being said , Should I update the first post on this thread? point them to start reading from post #411. I refer to #411 because it quotes the most recent directions and then the next post begins the most current discussion and tweaking of this information. what do you all think?

    the first post currently directs people to post #74 I think.
    Last edited by loopytee; 06/01/2011 at 06:20 PM.
    What does this button do?


    crappy phones -->treo 600--> 700p--> 755p--> Pre--->Pre- 2.1 F104-----Franken Pre+ 2.1 f105 ---> Franken pre2 2.2.4
    touchpad 16gig uberkernel woop woop!!!
  17. #457  
    not yet, I want to first finalise some things, I think we have found some better settings since that time.

    I will update it when i know for sure.
  18. #458  
    Latest settings. Your gonna laugh.

    /etc/sysctl.conf

    Code:
    vm.swappiness = 30
    vm.vfs_cache_pressure = 200
    vm.dirty_expire_centisecs = 18000
    vm.dirty_writeback_centisecs = 6000

    /etc/event.d/compcache

    make sure to add these lines if you havent already!!

    Code:
    mkswap /dev/store/swap
    swapon /dev/store/swap
    comment out line "modprobe ramzswap disksize_kb="

    Code:
     #modprobe ramzswap disksize_kb=
    comment out line "swapon /dev/ramzswap0 -p 100"

    Code:
      #swapon /dev/ramzswap0 -p 100
    Yup thats right.

    Completely disabling compcache.

    With the low swapiness and the new disk swap, I am having excellent results.

    Maybe we can increase the disk swap size to 200mb for this set up, as there isnt the compcache as well.
  19. #459  
    looks good, ill give it a try.
  20. #460  
    Quote Originally Posted by Unclevanya View Post
    By USB Mode do you mean to share files with your PC or USB Passthru? In either case - I guess you could still validate that extra swap would help before resizing partitions on the phone which is the goal of this.
    PC. I haven't tried anything with passthru
    Sprint pre -> Motorola Photon 4G

Posting Permissions