Andrew Cooke | Contents | Latest | RSS | Previous | Next

C[omp]ute

Welcome to my blog, which was once a mailing list of the same name and is still generated by mail. Please reply via the "comment" links.

Always interested in offers/projects/new ideas. Eclectic experience in fields like: numerical computing; Python web; Java enterprise; functional languages; GPGPU; SQL databases; etc. Based in Santiago, Chile; telecommute worldwide. CV; email.

Personal Projects

Choochoo Training Diary

Last 100 entries

[Programming] React Leaflet; AliExpress Independent Sellers; Applebaum - Twilight of Democracy; [Politics] Back + US Elections; [Programming,Exercise] Simple Timer Script; [News] 2019: The year revolt went global; [Politics] The world's most-surveilled cities; [Bike] Hope Freehub; [Restaurant] Mama Chau's (Chinese, Providencia); [Politics] Brexit Podcast; [Diary] Pneumonia; [Politics] Britain's Reichstag Fire moment; install cairo; [Programming] GCC Sanitizer Flags; [GPU, Programming] Per-Thread Program Counters; My Bike Accident - Looking Back One Year; [Python] Geographic heights are incredibly easy!; [Cooking] Cookie Recipe; Efficient, Simple, Directed Maximisation of Noisy Function; And for argparse; Bash Completion in Python; [Computing] Configuring Github Jekyll Locally; [Maths, Link] The Napkin Project; You can Masquerade in Firewalld; [Bike] Servicing Budget (Spring) Forks; [Crypto] CIA Internet Comms Failure; [Python] Cute Rate Limiting API; [Causality] Judea Pearl Lecture; [Security, Computing] Chinese Hardware Hack Of Supermicro Boards; SQLAlchemy Joined Table Inheritance and Delete Cascade; [Translation] The Club; [Computing] Super Potato Bruh; [Computing] Extending Jupyter; Further HRM Details; [Computing, Bike] Activities in ch2; [Books, Link] Modern Japanese Lit; What ended up there; [Link, Book] Logic Book; Update - Garmin Express / Connect; Garmin Forerunner 35 v 230; [Link, Politics, Internet] Government Trolls; [Link, Politics] Why identity politics benefits the right more than the left; SSH Forwarding; A Specification For Repeating Events; A Fight for the Soul of Science; [Science, Book, Link] Lost In Math; OpenSuse Leap 15 Network Fixes; Update; [Book] Galileo's Middle Finger; [Bike] Chinese Carbon Rims; [Bike] Servicing Shimano XT Front Hub HB-M8010; [Bike] Aliexpress Cycling Tops; [Computing] Change to ssh handling of multiple identities?; [Bike] Endura Hummvee Lite II; [Computing] Marble Based Logic; [Link, Politics] Sanity Check For Nuclear Launch; [Link, Science] Entropy and Life; [Link, Bike] Cheap Cycling Jerseys; [Link, Music] Music To Steal 2017; [Link, Future] Simulated Brain Drives Robot; [Link, Computing] Learned Index Structures; Solo Air Equalization; Update: Higher Pressures; Psychology; [Bike] Exercise And Fuel; Continental Race King 2.2; Removing Lowers; Mnesiacs; [Maths, Link] Dividing By Zero; [Book, Review] Ray Monk - Ludwig Wittgenstein: The Duty Of Genius; [Link, Bike, Computing] Evolving Lacing Patterns; [Jam] Strawberry and Orange Jam; [Chile, Privacy] Biometric Check During Mail Delivery; [Link, Chile, Spanish] Article on the Chilean Drought; [Bike] Extended Gear Ratios, Shimano XT M8000 (24/36 Chainring); [Link, Politics, USA] The Future Of American Democracy; Mass Hysteria; [Review, Books, Links] Kazuo Ishiguro - Never Let Me Go; [Link, Books] David Mitchell's Favourite Japanese Fiction; [Link, Bike] Rear Suspension Geometry; [Link, Cycling, Art] Strava Artwork; [Link, Computing] Useful gcc flags; [Link] Voynich Manuscript Decoded; [Bike] Notes on Servicing Suspension Forks; [Links, Computing] Snap, Flatpack, Appimage; [Link, Computing] Oracle is leaving Java (to die); [Link, Politics] Cubans + Ultrasonics; [Book, Link] Laurent Binet; VirtualBox; [Book, Link] No One's Ways; [Link] The Biggest Problem For Cyclists Is Bad Driving; [Computing] Doxygen, Sphinx, Breathe; [Admin] Brokw Recent Permalinks; [Bike, Chile] Buying Bearings in Santiago; [Computing, Opensuse] Upgrading to 42.3; [Link, Physics] First Support for a Physics Theory of Life; [Link, Bike] Peruvian Frame Maker; [Link] Awesome Game Theory Tit-For-Tat Thing; [Food, Review] La Fabbrica - Good Italian Food In Santiago; [Link, Programming] MySQL UTF8 Broken; [Link, Books] Latin American Authors

© 2006-2017 Andrew Cooke (site) / post authors (content).

Beagle, Computing in Science and Engineering

From: "andrew cooke" <andrew@...>

Date: Wed, 24 Dec 2008 11:05:23 -0300 (CLST)

While at the AGU conference I noticed this magazine (Computing in Science
and Engineering) - http://cise.aip.org/

It's not the most professional looking magazine in the world, but it is by
far the closest I've found to a magazine that covers the kind of work I
do.  So I subscribed - got a cheap price and the last 10 years on CD.

I copied the back issues from CD to my hard drive and then wondered what
to do.  They are broken down into one article per file, but they are PDF
and I had no way of searching them.

Then I remembered Beagle, which I have carefully de-installed from my
computer for several years now because it seemed (1) useless and (2) used
up so much CPU.  Beagle is the default Linux document indexing system
(think Google for your local disk).

Anyway, it's improved hugely.  It no longer locks up the computer when
you're trying to get something done.  And it appears to return moderately
useful results.  So I can now search for something like "python numerical
vector" and the second hit (when ordered by relevance) is "Python for
Scientific Computing" from the magazine.

You can also restrict to certain file types (ext:pdf), exclude terms
(-foo), etc etc.  It even indexes music metadata (so you can search for
artists) and email.

The KDE Kerry interface does quite a good job of presenting the data too -
you can click on a file and it is handed off to an appropriate handler
(although HTML is going to konquerer instead of the mozilla configured for
the desktop).

It does, however, still seem to crash quite regularly.  You can see this
by doing

  tail ~/.beagle/Log/current-Beagle

which will show a message about SIGSEGV or by typing beagle-status which
will say it cannot connect.  To restart just type "beagled" at the command
line.

I also enabled extended filesystem attributes by modifying the fstab from
/home to include the user_xattr option.  Apparently this makes things a
bit faster.

One check I did, when I found some old files I thought I had been deleted,
surprised me: it immediately picks up on deleted files and excludes them
from the results.  Which is nice.

Andrew

Tweaking Beagle and KDE

From: "andrew cooke" <andrew@...>

Date: Wed, 31 Dec 2008 12:32:28 -0300 (CLST)

While Kerry (the KDE Beagle client) looks nicer (more compact), it hangs
regularly.  The Beagle search app (beagle-search from the command line, or
just "Search" from the SuSE menu) is much more robust.

If you use Firefox, you need to make sure that:

1 - the default browser is Firefox.  Configure Desktop -> General ->
Default Applications -> Web Browser

2 - html files are associated with Firefox.  Configure Desktop -> Advanced
-> File Associations and then find text/html in the tree widget.

To make sure that everything is indexed at the start, follow the
instructions at http://beagle-project.org/FAQ

 $ beagle-shutdown
 $ export BEAGLE_EXERCISE_THE_DOG=1
 $ beagled

Also enable user attributes on your file system by modifying /etc/fstab as
described at http://beagle-project.org/Enabling_Extended_Attributes

To check what is happening, use beagle-status, but don't be worried if
there are a lot of directories to scan on subsequent logins.  Each login,
beagle slowly re-scans everything.

To check whether a particular file is indexed, use
  beagle-query uri:file:///path/to/file
and see fi anything is returned.


I still haven't worked out how to get email indexed.  I use imap, and have
the files downloaded locally, but I don't use kmail or evolution and the
files are generally in directories whose names begin with a "dot".  I
think you can fake things by configuring kmail or evolution (in addition
to the email client you actually use), but this still doesn't track any
changes.  The file backend will handle emails, but doesn't look in "dot"
files.  Apparently symlinks don't fool it either...

Andrew

Comment on this post