Skip to main content

Design for Testing

Good testing influences your design. Too many developers (and managers) are stuck in the waterfall mentality of design, code, test, and deploy. Forces across the industry are pushing to move the testing phase to the beginning of this line, and many just don't understand how that works. Testing should be the first consideration, and thus is influential to all other aspects of the development process.

The problem with testing as a secondary consideration is the design and architecture of the software never lends itself to proper testing when you don't plan way ahead. The consideration of testing can drive your design to be easier to test, but also can encourage generally good programming practices and well-made designs in the architecture. We can use a persisted class as a good example, because this is a use-case where testing is very important, but we have to consider the burden of a full database tied into the class we are testing.

When we develop our database item class before any testing is considered, we create it fairly in a straight-forward manner. After everything is coded, we decide to do some testing but we have a couple problems to face. The first thing to concern us is that our class inherits some ItemSchema super-class, and instances of it must exist in context to some database, which creates a large dependency on the test and thus leads to the test being unreliable. Secondly, we have many functions not easily testable (perhaps they can only be confirmed by locals within the function, which we can not access). We need to redesign everything to solve these issues, but we could have avoided this by using a more testable design in the first place.

To solve the first problem, we have to consider what we are actually testing. We are not testing the persistence framework our application utilizes, but just one ItemSchema sub-class we had to write. Obviously, separation is key. We only care about the functionality we wrote into the type, and we can extract all this into a mixin class, which our original ItemSchema can inherit. However, in our tests, a special TestItem class may also inherit it and perform the testing we need, without bringing a database into the picture.

Tackling the second problem of individual functions, the solutions can vary. If any internal data is important, perhaps it is too internal, and the code generating it could be extracted into its own method, which we can test independently. If our method does not return anything, perhaps this is something it could return and thus we could test for it. However, don't return things you do not need in production, as this bloats the interface and inevitably some code will come to depend on this contract that was only intended as a testing mechanism. It can even be acceptable to wrap a returning method with a public API non-returning version, simply to push a more stable API (it is easier to add returns than remove them) to the consumers of the API.

We have to stop looking at the testing as a second, or third class citizen in the steps we take in development. Our design, development time-lines, and architecture should all be done with testing and quality assurance first in mind. We must focus on how to ensure the stability and accuracy of our code before we can ever trust it, and if we can not trust it, all time developing it is a waste. It is this fact that offsets all arguments by opponents of proper testing (yes, they exist) who are afraid of the time wasted by testing. Wasted time is illusionary, as we only see the time it takes but we don't see the time it save us. However, isn't that the point?

Comments

Popular posts from this blog

CARDIAC: The Cardboard Computer

I am just so excited about this. CARDIAC. The Cardboard Computer. How cool is that? This piece of history is amazing and better than that: it is extremely accessible. This fantastic design was built in 1969 by David Hagelbarger at Bell Labs to explain what computers were to those who would otherwise have no exposure to them. Miraculously, the CARDIAC (CARDboard Interactive Aid to Computation) was able to actually function as a slow and rudimentary computer.  One of the most fascinating aspects of this gem is that at the time of its publication the scope it was able to demonstrate was actually useful in explaining what a computer was. Could you imagine trying to explain computers today with anything close to the CARDIAC? It had 100 memory locations and only ten instructions. The memory held signed 3-digit numbers (-999 through 999) and instructions could be encoded such that the first digit was the instruction and the second two digits were the address of memory to operat...

Statement Functions

At a small suggestion in #python, I wrote up a simple module that allows the use of many python statements in places requiring statements. This post serves as the announcement and documentation. You can find the release here . The pattern is the statement's keyword appended with a single underscore, so the first, of course, is print_. The example writes 'some+text' to an IOString for a URL query string. This mostly follows what it seems the print function will be in py3k. print_("some", "text", outfile=query_iostring, sep="+", end="") An obvious second choice was to wrap if statements. They take a condition value, and expect a truth value or callback an an optional else value or callback. Values and callbacks are named if_true, cb_true, if_false, and cb_false. if_(raw_input("Continue?")=="Y", cb_true=play_game, cb_false=quit) Of course, often your else might be an error case, so raising an exception could be useful...

Announcing Feet, a Python Runner

I've been working on a problem that's bugged me for about as long as I've used Python and I want to announce my stab at a solution, finally! I've been working on the problem of "How do i get this little thing I made to my friend so they can try it out?" Python is great. Python is especially a great language to get started in, when you don't know a lot about software development, and probably don't even know a lot about computers in general. Yes, Python has a lot of options for tackling some of these distribution problems for games and apps. Py2EXE was an early option, PyInstaller is very popular now, and PyOxide is an interesting recent entry. These can be great options, but they didn't fit the kind of use case and experience that made sense to me. I'd never really been about to put my finger on it, until earlier this year: Python needs LÖVE . LÖVE, also known as "Love 2D", is a game engine that makes it super easy to build ...