Andrew Cooke | Contents | Latest | RSS | Previous | Next

C[omp]ute

Welcome to my blog, which was once a mailing list of the same name and is still generated by mail. Please reply via the "comment" links.

Always interested in offers/projects/new ideas. Eclectic experience in fields like: numerical computing; Python web; Java enterprise; functional languages; GPGPU; SQL databases; etc. Based in Santiago, Chile; telecommute worldwide. CV; email.

Personal Projects

Choochoo Training Diary

Last 100 entries

Surprise Paradox; [Books] Good Author List; [Computing] Efficient queries with grouping in Postgres; [Computing] Automatic Wake (Linux); [Computing] AWS CDK Aspects in Go; [Bike] Adidas Gravel Shoes; [Computing, Horror] Biological Chips; [Books] Weird Lit Recs; [Covid] Extended SIR Models; [Art] York-based Printmaker; [Physics] Quantum Transitions are not Instantaneous; [Computing] AI and Drum Machines; [Computing] Probabilities, Stopping Times, Martingales; bpftrace Intro Article; [Computing] Starlab Systems - Linux Laptops; [Computing] Extended Berkeley Packet Filter; [Green] Mainspring Linear Generator; Better Approach; Rummikub Solver; Chilean Poetry; Felicitations - Empowerment Grant; [Bike] Fixing Spyre Brakes (That Need Constant Adjustment); [Computing, Music] Raspberry Pi Media (Audio) Streamer; [Computing] Amazing Hack To Embed DSL In Python; [Bike] Ruta Del Condor (El Alfalfal); [Bike] Estimating Power On Climbs; [Computing] Applying Azure B2C Authentication To Function Apps; [Bike] Gearing On The Back Of An Envelope; [Computing] Okular and Postscript in OpenSuse; There's a fix!; [Computing] Fail2Ban on OpenSuse Leap 15.3 (NFTables); [Cycling, Computing] Power Calculation and Brakes; [Hardware, Computing] Amazing Pockit Computer; Bullying; How I Am - 3 Years Post Accident, 8+ Years With MS; [USA Politics] In America's Uncivil War Republicans Are The Aggressors; [Programming] Selenium and Python; Better Walking Data; [Bike] How Fast Before Walking More Efficient Than Cycling?; [COVID] Coronavirus And Cycling; [Programming] Docker on OpenSuse; Cadence v Speed; [Bike] Gearing For Real Cyclists; [Programming] React plotting - visx; [Programming] React Leaflet; AliExpress Independent Sellers; Applebaum - Twilight of Democracy; [Politics] Back + US Elections; [Programming,Exercise] Simple Timer Script; [News] 2019: The year revolt went global; [Politics] The world's most-surveilled cities; [Bike] Hope Freehub; [Restaurant] Mama Chau's (Chinese, Providencia); [Politics] Brexit Podcast; [Diary] Pneumonia; [Politics] Britain's Reichstag Fire moment; install cairo; [Programming] GCC Sanitizer Flags; [GPU, Programming] Per-Thread Program Counters; My Bike Accident - Looking Back One Year; [Python] Geographic heights are incredibly easy!; [Cooking] Cookie Recipe; Efficient, Simple, Directed Maximisation of Noisy Function; And for argparse; Bash Completion in Python; [Computing] Configuring Github Jekyll Locally; [Maths, Link] The Napkin Project; You can Masquerade in Firewalld; [Bike] Servicing Budget (Spring) Forks; [Crypto] CIA Internet Comms Failure; [Python] Cute Rate Limiting API; [Causality] Judea Pearl Lecture; [Security, Computing] Chinese Hardware Hack Of Supermicro Boards; SQLAlchemy Joined Table Inheritance and Delete Cascade; [Translation] The Club; [Computing] Super Potato Bruh; [Computing] Extending Jupyter; Further HRM Details; [Computing, Bike] Activities in ch2; [Books, Link] Modern Japanese Lit; What ended up there; [Link, Book] Logic Book; Update - Garmin Express / Connect; Garmin Forerunner 35 v 230; [Link, Politics, Internet] Government Trolls; [Link, Politics] Why identity politics benefits the right more than the left; SSH Forwarding; A Specification For Repeating Events; A Fight for the Soul of Science; [Science, Book, Link] Lost In Math; OpenSuse Leap 15 Network Fixes; Update; [Book] Galileo's Middle Finger; [Bike] Chinese Carbon Rims; [Bike] Servicing Shimano XT Front Hub HB-M8010; [Bike] Aliexpress Cycling Tops; [Computing] Change to ssh handling of multiple identities?; [Bike] Endura Hummvee Lite II; [Computing] Marble Based Logic; [Link, Politics] Sanity Check For Nuclear Launch; [Link, Science] Entropy and Life

© 2006-2017 Andrew Cooke (site) / post authors (content).

Arguing About Tests, Still

From: andrew cooke <andrew@...>

Date: Fri, 22 Mar 2013 19:00:05 -0300

[This is partly esprit d'escalier and party notes to try again on Monday,
because I had this conversation yesterday and completely failed to make my
points.]


So, yesterday, I was talking to someone (let's call him S) about testing.  And
why S's employees didn't do it (or various other "best practices").

S argued that he was making progress, but that it was difficult because adding
extra time for tests, CI, etc made prices higher, when the client was already
very demanding.

At this point maybe it would have good to ask S why he thought I wrote tests.
I promise it's not because I find them a good way to spend extra time.  In
fact, I think they help me do my work faster.

Which perhaps sheds some light on S's problem.

If good (excuse my lack of modesty here; I'll return to this below) engineers
use tests to do their work faster then of course the client is going to be
unhappy.  Why are they being charged more for something that means less work?

Now S isn't dumb.  There's a reason he needs more time for tests.  The reason
is that currently his engineers don't use them.  So this time is, effectively,
on-the-job training.  That's the positive take.  The negative take is that the
tests are checklist items that his engineers will do without conviction or
understanding - rote work with little gain.

Which is putting the horse before the cart.  You can't go to a client and say
"my engineers suck, so I am going to charge you extra."  Instead, S needs to
improve his engineers.  And fast.

So what to do?

One thing you can do is ask the engineers why they don't test.  One answer I
got was that there was never enough time.  And I can undestand this.  If
you've never used tests it can seem counter-intuitive that they save time.  So
maybe what that engineer needs is the encouragement and freedom to explore a
little: give him some extra time so he can learn to save time in the future.


Now, back to my modesty.  In my previous job I was just an average programmer.
What I was praised for was my moderation - that I knew when to compromise, and
how to find a balance between "best practices" and "getting shit done".

Which is ironic, because yesterday I found myself shouting at S, in the role
of the extremist developer, foaming at the mouth about lack of standards.


On Monday I hope I have the energy to try again.

Andrew


PS. One more statement I forgot to pick up on: "I write tests, but only use
them to solve the problem at the time".  Which is doing 99% of the work for
only 50% of the gain.  So I really need to explain how tests help refactoring.

Re: Arguing About Tests, Still

From: Michiel Buddingh <michiel@...>

Date: Fri, 22 Mar 2013 23:40:34 +0100

Experiences may also greatly differ depending on the kind of
programming you do.  Tests are almost indespensible when writing
mathematical code or complex business logic.  They are increasingly
hard to write, for diminishing gains, as the number of side effects
increases.  Defining a 'side effect' as a result of the code that is
not, or not consistently measurable from other code.

Unit tests aren't going to find a race condition, and they're not
going to pick up browser incompatibilities, or the fact that the UI
suddenly feels 'sluggish' after the lastest bugfix.  And there are
many software engineers who spend far more time fixing these 'side
effects' than they spend on traditional bugs.


--
Michiel

Do What Makes Sense

From: andrew cooke <andrew@...>

Date: Sat, 23 Mar 2013 08:33:52 -0300

Sure the idea is to do what makes sense.  I said above - simply writing tests
to complete a checkbox is not the answer.

But to do that you need to have some experience.  And to do that you need to
invest some time to learn.  And to get that to happen... well, that's the hard
part, because it involves changing the working culture.


As for where tests help - I don't think there's hard and fast rules there,
either.  You oterate; at the end of a job you can look back and ask what went
wrong and how it could be done better.

ON a recent project I was supplying one small part.  It was a cache for a
client-server (as described at http://www.acooke.org/portfolio/cache/).  I
wrote a pile of integration tests that included a script that set up and
pulled down servers.  It worked really well and was a huge help.  But
returning to the project a year later, everything is broken because the rest
of the project has moved on.

So I am asking myself what I could have done better.  End-to-end tests were
really useful, but including other libraries in the tests made them fragile.
Should I have forked the rest of the system?  Used CI to detect changes and
then fix incrementally?  I don't know - there are lots of hard technical
issues (the work is behind a VPN with an uncooperative client).


Related to the above - there's a group benefit to all doing tests.  When
you're the only person in the room using them it's harder (practically and
psychologically) than when you're in a supportive culture.

Andrew

Comment on this post