Solid State Store, Cheap and Fast Use DDR3 Memory, Linux and mdadm

Posted in Uncategorized on September 28th, 2010 by admin

So you want to have extremely fast storage. You also don’t have a boat load of money sitting around to do it with. Well I have a solution. I’ve been experimenting with mdadm and /dev/ram on my system the size of memory disk are 64MB so for testing I’ve created a raid array to see just how fast my memory would act as a ram drive.

#sudo mdadm –create /dev/md3 –level=0 –raid-devices=8 /dev/ram0 /dev/ram1 /dev/ram2 /dev/ram3 /dev/ram4 /dev/ram5 /dev/ram6 /dev/ram7
mdadm: metadata format 00.90 unknown, ignored.
mdadm: metadata format 00.90 unknown, ignored.
mdadm: array /dev/md3 started.
#sudo mke2fs /dev/md3
#sudo mount /dev/md3 /mnt/
#df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/md3              496M  2.3M  468M   1% /mnt
So I get just about a 500 meg ram disk. So then running the following command yield rediculous speeds. Even when were talking about 500megs. Their are easily affordable system with 16gigs of ram, creating a 12gig wouldn’t be that hard to create. Might need to increase the size of ram disk but still. Once you see these numbers. Well here they are.
I did the first test with 4 ram disk in a raid 0. Here are the results.
#/opt/1$ sudo hdparm -t /dev/md4
/dev/md4:
Timing buffered disk reads:  254 MB in  0.34 seconds = 743.04 MB/sec
#/opt/1$ sudo hdparm -t /dev/md4
/dev/md4:
Timing buffered disk reads:  254 MB in  0.35 seconds = 734.65 MB/sec
Now like above I redid the test with the 8 ram disk in a raid 0.
/dev/md3:
Timing buffered disk reads:  510 MB in  0.54 seconds = 936.91 MB/sec
/dev/md3:
Timing buffered disk reads:  510 MB in  0.54 seconds = 937.48 MB/sec
Running the same test on a 500gb plater Seagate 7200.12 I get
#sudo hdparm -t /dev/sdb1
/dev/sdb1:
Timing buffered disk reads:  376 MB in  3.01 seconds = 124.93 MB/sec
Thats a 10x improvement when compared to a regular harddrive. Their are probably other factors to consider.
But one thing this tells me is that I could create a ram disk raid it and then sync data to it that I need to be able to read at a ridiculously rate. With more memory their are more possibilities. Now if only the hardware solution to this wasn’t so ridiculouslyy over priced.
With out the raid I got even better performance you can adjust the size of ram disk, but I haven’t experimented with it my self.
~$ sudo hdparm -t /dev/ram0
/dev/ram0:
Timing buffered disk reads:   64 MB in  0.04 seconds = 1469.95 MB/sec
:~$ sudo hdparm -t /dev/ram0
/dev/ram0:
Timing buffered disk reads:   64 MB in  0.04 seconds = 1711.82 MB/sec
:~$ /dev/ram0:
Timing buffered disk reads:   64 MB in  0.04 seconds = /dev/ram0:

Timing buffered disk reads:   64 MB in  0.04 seconds = 1637.50 MB/sec
ron@router:~$ sudo hdparm -t /dev/ram0
/dev/ram0:
Timing buffered disk reads:   64 MB in  0.04 seconds = 1568.40 MB/sec

MB/sec

$ sudo hdparm -t /dev/ram0
/dev/ram0:
Timing buffered disk reads:   64 MB in  0.04 seconds = 1568.40 MB/sec
Tags: , , ,

STUPIDFLANDER.ORG

Posted in Uncategorized on September 23rd, 2010 by admin

Going to be moving the flashy part of this site to STUPIDFLANDER.ORG this will be where I’ll be putting my flash and other experimental content.

http://stupidflander.org

Tags: ,

Music Collection

Posted in Uncategorized on September 22nd, 2010 by admin

My music collection server is back up. Any of the following will get you their.

https://www.phuckyou.us

http://dfgs.info

Their are several others but their too long to be worth mentioning.

Tags: ,

WordPress

Posted in Uncategorized on September 20th, 2010 by admin

Might of noticed the site has changed. Removed the frames, music and flash animations and phuckyou.us is down, along with some of my other sites. Well I’ll be moving my flashy site to another domain and using this one to present a more professional look and feel since it is associated with my name. I’ll also be going through and trying to fix up or delete older post and probably posting more new post. The word press is quite a bit easier to use and the old site was just starting to look dated.

So all my post have been migrated, still working on a better solution for migrating my pictures but for now this will have to do.

The old site as well as the ampache/phuckyou.us site will be moved to a new server I have coming in tomorrow. Stayed tunned for links to that new system.

Tags: , ,

Zipit

Posted in Computers, Linux, Uncategorized on September 20th, 2010 by Ronald Prettyman

Its been awhile since I’ve touched it, but I sort of reached my goal, figured out the rest. Yet to sit down and actually execute the plan. Lack of time really.

But to sort of pass the ball on this. I built the kernel to my specifications, wrote it to memory then set up the root file system with build root. Boot time is almost instant, after posting and mounting the sd card I have a quick script to load the modules for audio, wifi and keymap and then prepare the suspend. Then it displays login. Runs extremely fast and got memory useage down to about 3megs total size of rootfs is about 25megs. So the next step to create a useable device was a chroot. Use build root to get it booted and load drivers then have getty do a other shell like so

chroot /debian/sbin/login

To get the powerbutton to work I mapped the button to ctrl+alt+delete then in init changed the behavior of ctrl+alt+delete to run the suspend script. Wrote a basic one from scratch plenty of examples on google.

To get audio to work on buildroot you have to configure /dev manually by moving some objects around and setting permissions.

For the chroot, well its just a basic chroot, mount /proc and link /dev

So then I could have a debian userland boot in less then 3 seconds in the palm of my hand. I’ll post my configs for busybox and buildroot and write up some steps for the chroot boot process but from the information above, anyone should be able to get a working enviroment to boot in 3 seconds. Major improvement over ubuntu which was booting in about 5 minutes.

What works,

  1. Power botton
  2. Suspend
  3. Audio
  4. Keyboard
  5. X
  6. WiFi

What doesn’t

  1. Hybernate
  2. Headphones (well the quality is still garbage)
Tags: , , ,