Andrew Cooke | Contents | Latest | RSS | Twitter | Previous | Next

C[omp]ute

Welcome to my blog, which was once a mailing list of the same name and is still generated by mail. Please reply via the "comment" links.

Always interested in offers/projects/new ideas. Eclectic experience in fields like: numerical computing; Python web; Java enterprise; functional languages; GPGPU; SQL databases; etc. Based in Santiago, Chile; telecommute worldwide. CV; email.

Personal Projects

Lepl parser for Python.

Colorless Green.

Photography around Santiago.

SVG experiment.

Professional Portfolio

Calibration of seismometers.

Data access via web services.

Cache rewrite.

Extending OpenSSH.

C-ORM: docs, API.

Last 100 entries

[Link, Computing] Useful gcc flags; [Link] Voynich Manuscript Decoded; [Bike] Notes on Servicing Suspension Forks; [Links, Computing] Snap, Flatpack, Appimage; [Link, Computing] Oracle is leaving Java (to die); [Link, Politics] Cubans + Ultrasonics; [Book, Link] Laurent Binet; VirtualBox; [Book, Link] No One's Ways; [Link] The Biggest Problem For Cyclists Is Bad Driving; [Computing] Doxygen, Sphinx, Breathe; [Admin] Brokw Recent Permalinks; [Bike, Chile] Buying Bearings in Santiago; [Computing, Opensuse] Upgrading to 42.3; [Link, Physics] First Support for a Physics Theory of Life; [Link, Bike] Peruvian Frame Maker; [Link] Awesome Game Theory Tit-For-Tat Thing; [Food, Review] La Fabbrica - Good Italian Food In Santiago; [Link, Programming] MySQL UTF8 Broken; [Link, Books] Latin American Authors; [Link, Computing] Optimizatin Puzzle; [Link, Books, Politics] Orwell Prize; [Link] What the Hell Is Happening With Qatar?; [Link] Deep Learning + Virtual Tensor Machines; [Link] Scaled Composites: Largest Wingspan Ever; [Link] SCP Foundation; [Bike] Lessons From 2 Leading 2 Trailing; [Link] Veg Restaurants in Santiago; [Link] List of Contemporary Latin American Authors; [Bike] FTHR; [Link] Whoa - NSA Reduces Collection (of US Residents); [Link] Red Bull's Breitbart; [Link] Linux Threads; [Link] Punycode; [Link] Bull / Girl Statues on Wall Street; [Link] Beautiful Chair Video; Update: Lower Pressures; [Link] Neat Python Exceptions; [Link] Fix for Windows 10 to Avoid Ads; [Link] Attacks on ZRTP; [Link] UK Jazz Invasion; [Review] Cuba; [Link] Aricle on Gender Reversal of US Presidential Debate; {OpenSuse] Fix for Network Offline in Updater Applet; [Link] Parkinson's Related to Gut Flora; Farellones Bike Park; [Meta] Tags; Update: Second Ride; Schwalbe Thunder Burt 2.1 v Continental X-King 2.4; Mountain Biking in Santiago; Books on Ethics; Security Fail from Command Driven Interface; Everything Old is New Again; Interesting Take on Trump's Lies; Chutney v6; References on Entropy; Amusing "Alexa.." broadcast; The Shame of Chile's Education System; Playing mp4 gifs in Firefox on Opensuses Leap 42.2; Concurrency at Microsoft; Globalisation: Uk -> Chile; OpenSuse 42.2 and Synaptics Touch-Pads; Even; Cherry Jam; Lebanese Writer Amin Maalouf; C++ - it's the language of the future; Learning From Trump; Chinese Writer Hu Fayun; And; Apricot Jam; Also; Excellent Article on USA Politics; Oh Metafilter; Prejudice Against The Rurals; Also, Zizek; Trump; Why Trump Won; Doxygen + Latex on CentOS 6; SMASH - Solve 5 Biggest Problems in Physics; Good article on racism, brexit, and social divides; Grandaddy are back!; Consciousness From Max Entropy; Democrats; Harvard Will Fix Black Poverty; Modelling Bicycle Wheels; Amusing Polling Outlier; If Labour keeps telling working class people...; Populism and Choice; Books on Defeat; Enrique Ferrari - Argentine Author; Transcript of German Scientists on Learning of Hiroshima; Calvert Journal; Owen Jones on Twitter; Possible Japanese Authors; Complex American Literature; Chutney v5; Weird Componentized Virus; Interesting Argentinian Author - Antonio Di Benedetto; Useful Thread on MetaPhysics; RAND on fighting online anarchy (2001); NSA Hacked

© 2006-2017 Andrew Cooke (site) / post authors (content).

Mixed Integer Programming in Python

From: andrew cooke <andrew@...>

Date: Mon, 29 Aug 2011 17:22:25 -0300

The weather in NY has left me with a free afternoon at work, so I have been
looking at mixed integer programming (this is not completely self-indulgent -
it's related to compressive sensing, which we might use).

My motivating example was this question on Stack Overflow -
http://stackoverflow.com/questions/7076349/is-there-a-good-way-to-do-this-type-of-mining

These notes describe largely separate (because I didn't get very far) aspects:
describing that particular problem and Python libraries.


Python Libraries

It seems that mixed integer and linear programming are not, in general, well
supported by open source projects.  See, for example, the comparison of
running times for commercial and open source solutions here:
http://scip.zib.de/

Support in Python reflects that.  My initial candidate was pulp-or
http://code.google.com/p/pulp-or/ but many links there are dead (with ominous
notes about a "transition").  So then I turned to Coopr
https://software.sandia.gov/trac/coopr which, from the text there, may be what
pulp-or is combining with.  However, the documentation was both minimal and
aimed at experts - I really need something more introductory.

At this point I started looking for an implementation in any language, and
identified SCIP http://scip.zib.de/ (as mentioned earlier) as one of the most
active and efficient.  And - a rare positive moment within this work - it has
a Python 3.2 library that looks very nice
http://code.google.com/p/python-zibopt/ although the installation instructions
suggest things are still rather alpha
http://code.google.com/p/python-zibopt/wiki/Installation


Framing the Problem

At first I assumed that the clustering problem described above would be easy
to solve.  But all my initial approaches contained variable numbers of
variables.  This can be avoided, to some extent, by using control variables,
which are binary flags that indicate whether some other variable is used or
not, but the next problem was how to express various constraints as linear
expressions.

I still don't have a perfect solution, but here are some notes to remind me of
how far I have got:

 - By default, every point is in the vertical group for that column.
 - We want to minimise the number of vertical groups, while also minimising
   "gaps" in horizontal groups.
 - Each point has a vertical (1) / horizontal (0) control variable.  The sum
   of these is one contribution to the final weight.
 - Each point has an additional variable which is the horizontal group
   number.  Originally these start at 0 (left) and increment across the row.
 - The sum of the rightmost group number on each row is also minimised.
   This reduces the number of groups.
 - There is a constraint that each successive group number from left to
   right must be the same as the neighbour to the left, or one more.
 - Finally, there is a complex weight that depends on the number of 
   horizontal "gaps" between two points when they have the same group 
   number.  I think this can be generated programmatically, but it's a bit
   complex (especially since it must be ignored when groups are vertical).
   This weight should also be minimised.

Writing that down, it doesn't seem very impressive, but it was a lot of
work... :o(

Andrew

Non-Comemrcial

From: andrew cooke <andrew@...>

Date: Mon, 29 Aug 2011 19:01:52 -0300

The SCIP and related code is non-commercial only.

Andrew

lp_solve

From: andrew cooke <andrew@...>

Date: Mon, 29 Aug 2011 19:40:46 -0300

OK, so it seems like the best-supported (but not fastest or ost advanced)
package is lp_solve, and it also has some kind of python interface.

http://lpsolve.sourceforge.net/

Andrew

Comment on this post