Andrew Cooke | Contents | Latest | RSS | Previous | Next

C[omp]ute

Welcome to my blog, which was once a mailing list of the same name and is still generated by mail. Please reply via the "comment" links.

Always interested in offers/projects/new ideas. Eclectic experience in fields like: numerical computing; Python web; Java enterprise; functional languages; GPGPU; SQL databases; etc. Based in Santiago, Chile; telecommute worldwide. CV; email.

Personal Projects

Choochoo Training Diary

Last 100 entries

[Programming] React Leaflet; AliExpress Independent Sellers; Applebaum - Twilight of Democracy; [Politics] Back + US Elections; [Programming,Exercise] Simple Timer Script; [News] 2019: The year revolt went global; [Politics] The world's most-surveilled cities; [Bike] Hope Freehub; [Restaurant] Mama Chau's (Chinese, Providencia); [Politics] Brexit Podcast; [Diary] Pneumonia; [Politics] Britain's Reichstag Fire moment; install cairo; [Programming] GCC Sanitizer Flags; [GPU, Programming] Per-Thread Program Counters; My Bike Accident - Looking Back One Year; [Python] Geographic heights are incredibly easy!; [Cooking] Cookie Recipe; Efficient, Simple, Directed Maximisation of Noisy Function; And for argparse; Bash Completion in Python; [Computing] Configuring Github Jekyll Locally; [Maths, Link] The Napkin Project; You can Masquerade in Firewalld; [Bike] Servicing Budget (Spring) Forks; [Crypto] CIA Internet Comms Failure; [Python] Cute Rate Limiting API; [Causality] Judea Pearl Lecture; [Security, Computing] Chinese Hardware Hack Of Supermicro Boards; SQLAlchemy Joined Table Inheritance and Delete Cascade; [Translation] The Club; [Computing] Super Potato Bruh; [Computing] Extending Jupyter; Further HRM Details; [Computing, Bike] Activities in ch2; [Books, Link] Modern Japanese Lit; What ended up there; [Link, Book] Logic Book; Update - Garmin Express / Connect; Garmin Forerunner 35 v 230; [Link, Politics, Internet] Government Trolls; [Link, Politics] Why identity politics benefits the right more than the left; SSH Forwarding; A Specification For Repeating Events; A Fight for the Soul of Science; [Science, Book, Link] Lost In Math; OpenSuse Leap 15 Network Fixes; Update; [Book] Galileo's Middle Finger; [Bike] Chinese Carbon Rims; [Bike] Servicing Shimano XT Front Hub HB-M8010; [Bike] Aliexpress Cycling Tops; [Computing] Change to ssh handling of multiple identities?; [Bike] Endura Hummvee Lite II; [Computing] Marble Based Logic; [Link, Politics] Sanity Check For Nuclear Launch; [Link, Science] Entropy and Life; [Link, Bike] Cheap Cycling Jerseys; [Link, Music] Music To Steal 2017; [Link, Future] Simulated Brain Drives Robot; [Link, Computing] Learned Index Structures; Solo Air Equalization; Update: Higher Pressures; Psychology; [Bike] Exercise And Fuel; Continental Race King 2.2; Removing Lowers; Mnesiacs; [Maths, Link] Dividing By Zero; [Book, Review] Ray Monk - Ludwig Wittgenstein: The Duty Of Genius; [Link, Bike, Computing] Evolving Lacing Patterns; [Jam] Strawberry and Orange Jam; [Chile, Privacy] Biometric Check During Mail Delivery; [Link, Chile, Spanish] Article on the Chilean Drought; [Bike] Extended Gear Ratios, Shimano XT M8000 (24/36 Chainring); [Link, Politics, USA] The Future Of American Democracy; Mass Hysteria; [Review, Books, Links] Kazuo Ishiguro - Never Let Me Go; [Link, Books] David Mitchell's Favourite Japanese Fiction; [Link, Bike] Rear Suspension Geometry; [Link, Cycling, Art] Strava Artwork; [Link, Computing] Useful gcc flags; [Link] Voynich Manuscript Decoded; [Bike] Notes on Servicing Suspension Forks; [Links, Computing] Snap, Flatpack, Appimage; [Link, Computing] Oracle is leaving Java (to die); [Link, Politics] Cubans + Ultrasonics; [Book, Link] Laurent Binet; VirtualBox; [Book, Link] No One's Ways; [Link] The Biggest Problem For Cyclists Is Bad Driving; [Computing] Doxygen, Sphinx, Breathe; [Admin] Brokw Recent Permalinks; [Bike, Chile] Buying Bearings in Santiago; [Computing, Opensuse] Upgrading to 42.3; [Link, Physics] First Support for a Physics Theory of Life; [Link, Bike] Peruvian Frame Maker; [Link] Awesome Game Theory Tit-For-Tat Thing; [Food, Review] La Fabbrica - Good Italian Food In Santiago; [Link, Programming] MySQL UTF8 Broken; [Link, Books] Latin American Authors

© 2006-2017 Andrew Cooke (site) / post authors (content).

RAID on SuSE Linux 10.2

From: "andrew cooke" <andrew@...>

Date: Sun, 4 Mar 2007 21:12:44 -0300 (CLST)

In retrospect, software RAID in Linux is easy.  If you're doing a clean
install there's nothing to it.  However, I couldn't (for a long time) find
anything that said this.  So I read explanations about RAID technology and
wondered how on earth I could boot from a software RAID - it seemed like a
chicken and egg situation unless you went with simple mirroring, which was
inefficient.

So I started by trying to install the OS on a separate PATA disk (the
P5LD2 has a single parallel IDE controller that is intended for CD/DVD). 
Luckily this failed (Grub crashed) and when I went to the SuSE IRC channel
some jerk knew enough to imply I was an idiot, but not enough to answer
any questions.

Still, it was useful to know I was wrong.  Searching some more I found
this page -
http://en.opensuse.org/How_to_install_SUSE_Linux_on_software_RAID -
(obvious in retrospect, but I turned it up only when I switched googling
from "suse" to "opensuse").  That was enough to make me realise I had
missed a "RAID button" on the installer interface.

In fact, I hadn't missed it - I just didn't realise how powerful it was.

So here's what I did - it uses just the 4 identical SATA disks I bought
and it gives you a system completely on RAID that makes efficient use of
disk space.  All the below is via the "expert" partitioning section of the
install (from scratch).

1 - Partition each disk the same.  I used the following scheme for all:
  sd?1:  100MB  (destined to be /boot)
  sd?2:    4GB  (destined to be swap)
  sd?3   290GB  (destined to be root)
(Incidentally, I don't quite see how 320GB drives end up being 290GB in
size).

2 - Instead of formatting these partitions, mark them to be used as RAID
(in the create or edit dialogue, select "do not format" and then "RAID").

3 - Use the drop-down RAID button/menu to join these into three different
RAID devides:
  md0:   100MB RAID 1  /boot  (ext3, mirrored across all disks)
  md1:   3x4GB RAID 5  swap
  md2: 3x290GB RAID 5  /      (ext3)
Note that /boot is RAID 1, which means each disk is the same.  That lets
you bootstrap the system (RAID5 would be unreadable because it's striped).
 This is a waste of space, but it's very small so doesn't matter.  Next,
swap is RAID just so that the system doesn't crash if a disk dies (it
would be faster to have swap without RAID, distributed across all disks). 
Finally, I use a single partition for everything else.  You can, of
course, do something more complex.

Once you do this "everything just works".  The md0... devices "replace"
sda1..., sdb1.. and SuSE does all the right things.  The only difference
from normal is that when it boots you see lots of exciting messages as the
kernel puts everything together.

One final note - it seems that it's best to use SMART for disk monitoring
(or you may not realise when a disk dies).

For the record this was with SuSE 10.2, x86 64bit, and I finally
downloaded the CDs since it was faster overall than repeated experiments
with network install.

Summary: once you work up the courage (and use the RAID button/menu) this
is easy.

Andrew

How about post-install

From: Fabian Wein <fwein@...>

Date: Thu, 31 Jul 2008 18:38:16 +0200

How to convert an existing system to a RAID system when the
I get a new (identical) drive?

Thanks,

Fabian

How about post-install

From: "andrew cooke" <andrew@...>

Date: Thu, 31 Jul 2008 21:20:48 -0400 (CLT)

---------------------------- Original Message ----------------------------
From:    "Fabian Wein" <fwein@...>
Date:    Thu, July 31, 2008 12:38 pm
--------------------------------------------------------------------------

How to convert an existing system to a RAID system when the
I get a new (identical) drive?

Thanks,

Fabian

Re: How about post-install

From: "andrew cooke" <andrew@...>

Date: Thu, 31 Jul 2008 21:23:36 -0400 (CLT)

gah!  i just messed up forwarding this to my blog - i will delete what is
there and the reply, but the simple answer is that i don't know.

i *guess* you might be able to make a system with one disk (ie create a
two disk raid in a broken state) and then copy your data to that.  after
that you could delete the existing data and use that old disk to extend
the array on the new disk.

but this sounds very risky to me.  given the price of disks, i would
suggest buying two, and then once you are sure they are working together,
copy across the data, delete and add the old disk in ("grow").

i am not sure i gave all details on the blog, but at one point i did lose
a system playing around.  i am not 100% confident in the dynamic
modification of the raid, and i am not an expert...

good luck,
andrew

Comment on this post