Striving towards perfection is a noble and admirable goal, yet in the journey towards it, the ether of forgetfulness infects us all. The sad truth is we tend to forget the mistakes and errors we made as we moved towards our goal of perfection. This is shown in two major ways

1) we often show a lack of tolerance and patience towards others in our group on their own journey.

2) We seem to focus on the result not the requirements endured to get there.

The acceptance of youth and inexperience and the errors they need to make, seems to have been replaced by the ruthless coldness of intolerance, inflated ego and a general lack of understanding and compassion.

Knowledge is a wonderful thing and we often love to be seen as being knowledgeable. Yet the knowledgeable person, expert or leader often uses their knowledge like a fountain expounding information and like an over flowing vessel, often making a mess in their wake. The information that makes up knowledge does not make anyone wiser only more knowledgeable. The true wisdom is in knowing when to say something and when not to, when to help and when not to. The basic difference between knowledge and wisdom is how to use it, silence can be a far greater educational tool than providing the answers.

The journey of learning is what is truly memorable and the foundation of wisdom.

Once you have an answer, you are biased. We hold on to our answers tenaciously, fighting tooth and nail in their defence, rarely letting go of them and the more we do so, the harder and tighter we hold on to them and they us. There’s the rub, once devoted to an answer we become zealots and almost fanatical about its virtues. So in such an environment, how can we grow and develop. To quote many Hong Kong martial arts movies, “How can you learn when your cup is already full? Empty your cup.” The basic idea is that with preconceived ideas, how can new truths be discovered?

Your eyes see but they do not observe. 

Experts focus on their strengths while masters allow for possibilities to develop.

When leading, others follow but true leaders also listen.

We live in a flawed culture, we all know it but most of us seem not to even notice. Harsh words but when it comes to our daily lives we seem to expect perfection from all others but allow ourselves the benefit and luxury of compassion, understanding and tolerance.

Perfection is the goal to strive for and we all should aim to get as close as possible. Yet we mere humans are not perfect and therefore the end results of us striving for perfection often leads to less than perfect outcomes.

Look back through history and we see, a fairly recent cultural shift from destiny and the preordained, to we are responsible for our own life and all of our failings are our own doing.  “Les Miserables”. The cultural shift has been brutal, no longer can someone be down on their luck or a victim of circumstance, instead everything can be calculated, designed, controlled and predicted, we are responsible for our own lot in life.

There is a good TED talk by Alain de Botton on this subject

There were poor unfortunates and people who had a hard time of it but now they have been found wanting and therefore are losers and no-hopers. The tolerance and understanding of things beyond our control has been circumvented by the capitalistic ideal of perfection and just rewards. There is no longer room for errors, mistakes or failure and therefore anyone showing or seeming to harbour these traits is excised for the good of the “whole”.

A rather bleak view of the world but somehow for all our advances we seem to have forgotten our own humanity. I firmly believe in rewarding effort and work but I also believe that true advances don’t just happen but are often the result of many failures, mistakes and errors of judgment. It is only through these errors and mistakes that we can truly learn and grow. The individual must have a desire to develop and grow, and only through encouragement and support can this be truly achieved. Think of a small child, do you scold them whenever they make an error or do something wrong, or do you try to explain, protect and develop the individual. A strict military style may still work in the short term but ultimately you end up with small frightened children too scared to try or do anything, crippled by fear.

Is this where we want to be?

So, what about serendipity and synergy, well interestingly enough, most great advances in human knowledge owe all or part of their existence to the synergy of personalities and the events which resulted in the serendipity of discovery. So next time you’ve got all the answers and plans mapped out, take a step back and allow silence to teach and the synergy of the group find that point of serendipity…… Eureka. !!

No process or action can become 100% efficient without negatively impacting the surrounding processes or the interconnections which make up the whole.

This idea can easily be seen the following examples

1) A production line in a manufacturing plant; at the beginning the parts are loaded onto a conveyor belt to be assembled at each point along the assembly line. If the parts are loaded onto the conveyor belt with the “highest efficiency” then the whole production line eventually bottle necks under the inundation of parts. So many parts could be loaded at the beginning of the production line that the conveyor belt can not even move the physical weight of the initial parts. Assuming that the conveyor belt can move the massive load of parts to the next station then this process will become the bottle neck.

The basic fact is that the simplest tasks can be made so efficient that they can actually begin to put loading pressure upon the more “complex” processes or actions in the work stream.

2) In teaching the most basic definition is to expose students to ideas and facts. Efficiency in teaching can be attained by “giving students the answers”. The students now have the end result in the shortest possible time therefore highly efficient. They can now regurgitate back the answer at will and all is well, in “efficiency land” but at what cost?

So how is the second example negative?

The student has taken a shortcut to get the answers but has been robbed of the journey of self-discovery and right to comprehend the concept in their own way. Why is this important? The simple and undeniable fact is that not everyone understands things the same way, we all see the world differently and our minds grasp concepts in varying ways. In teaching, the fact is that no matter how good the lesson plan, different students will pick up on different points. You will often experience the influx of questions from students trying to make the concept (lesson) part of their knowledge. This is why varying the types of examples and alternate strategies to get the concept across is very important in my opinion.

I have personally run into the darker side of “giving students the answers”. The end result may be reasonably successful at the targeted level, say high school biology but once the student enters university the cracks often appear in that the students don’t seem to comprehend the underlying concepts of the ideas or have even been taught incorrectly by a teacher who themselves had a flawed perception of the fundamentals. This type of rote learning is efficient only to a degree and at a specific level. The sad truth is that only when you appreciate a concept or idea from multiple angles (perspectives) do you begin to comprehend and understand its true nature. Efficiency in conveying ideas and facts lay the foundations for future cracks in comprehension.

Economy of scale, bigger is better, diversify and “expand or perish” are familiar concepts, so much so that we just accept them without question. We rarely question the wisdom or trade-offs these catch phrases and their core philosophies entail.

The common approach is to find something to make more efficient, these are commonly the simplest tasks in a chain. To focus on these easily measured and easily modified processes seems beneficial but like in biochemistry once you effect the level of one chemical entity, the chemical systems equilibrium(s) are affected because of their interconnection.

When focusing on efficiency, keep in mind that focusing the “laser of efficiency” upon a certain task may cause adverse effects due to the cascade effect of proximity.

Final thoughts for now.

What if the efficiency becomes detrimental to the overall wellbeing of the whole? Where are the tip points, the hysteresis, and the “endocrine system” of an organisation? Difficult answers to simple questions. The problem we face when trying to find and answer these questions is that humans work in linear time, 20/20 hind sight, we often only become aware of things after they begin to happen and then we tend to react. Not a bad evolutionary response, fight or flight; but how can we stretch past this and see into the whole.

Yet this is not always the case, consider that the problem may not be the striving towards increased efficiency but the materials utilised in striving for it. No matter how hard we try, the basic truth is that any process in which people are involved in, has inherent limitations because of the human elements.

It is interesting and paradoxical that the human animal to function efficiently must have periods of rest and even diversion. Have you ever pulled an all-nighter to complete a project due the next day? The result is fatigue and usually not the best work. Side effects include emotional shifts (moods) and a distorted view of the finish result.

Well now extrapolate that to a solid 6 days with only 6 hours sleep and 3 of those hours on the very first night. Yes it can be done, no I don’t recommend it. The work becomes numbing and often and luckily the higher functioning work which involves higher mental skills such as thought are in the first days. The result is very sever fatigue and a case of diminishing returns, where version control becomes a haze and the final piece of work suffers from the lack of a clear view. The human body can be pushed but it pushes back hard, after such a task it takes months for the body to return to a state of normalcy.

OK the above extreme example is ridiculous but highlights the fact that tasks can not be optimised infinitely.

Wikipedia states that:

The Doppler effect (or Doppler shift) is the change in frequency of a wave (or other periodic event) for an observer moving relative to its source. Named after the Austrian physicist Christian Doppler, who proposed it in 1842 in Prague.

Its effect can commonly be heard when a vehicle approaches, passes, and recedes from an observer. The frequency of the vehicle or horn etc. is perceived as higher when received during the approach compared to the emitted frequency, identical at the instant of passing by, and lower when moving away (receding).

When the source of the waves is moving toward the observer, each successive wave crest is emitted from a position closer to the observer than the previous wave. This means that each wave takes slightly less time to reach the observer than the previous wave. Hence, the time between the arrival of successive wave crests at the observer is reduced, causing an increase in the frequency. While they are travelling, the distance between successive wave fronts is reduced, so the waves “bunch together”. Conversely, if the source of waves is moving away from the observer, each wave is emitted from a position farther from the observer than the previous wave, so the arrival time between successive waves is increased, reducing the frequency. The distance between successive wave fronts is then increased, so the waves “spread out”.

So what does this have to do with time management and projects etc……..?

Well I have never met anyone who precisely manages their time. Sounds bad, but unfortunately true. Think about it, we can assign time estimates, we can have an idea of how long tasks will take but we actually can never give a precise time stamp such as that task will take 1:13:18. This is what I mean by precise.

I don’t expect anyone to be able to accomplish this completely but we can improve the situation if we become aware of the “Doppler effect” when we engage in tasks. For example how many of us have said “I can help, you! Should only take a couple of minutes.” Have you ever helped someone with their computer? Those couple of minutes become hours because once engaged in the task at hand, time seems to skew. Unexpected problems pop up, the task was actually more convoluted, complex, complicated than you expected, you expected it to be something else; or you just honestly thought it would take only a short time and seem to get involved and lose track of time when you’re working on something.

I personally tend to do the latter so much so that there is time, and Steve time when I’m working on something because you don’t stop until it’s finished.

So what of the Doppler effect? Well, when not engaged in the task and looking at it from the outside, observing the task calmly in the distance, no stress, no pressure almost serene. Our perspective of the task seems small, like a car in the distance there’s no urgency and it seems small, almost insignificant.

When the task is at hand, the actual work takes on a sense of urgency and true scale. The task takes on its own dimensions, not those predicted or estimated by us but its actual form, warts and all. The task becomes enveloping and the most important thing at this point in time because we are engaged. We lose track of time, schedules can slip and we even chase rainbows down blind alleys because we try to make the task fit into our previously conceived notion of what it was. The end seems so far and the mountain to climb can seem so high that we may tend to procrastinate, avoid and generally hide from the fact that the task was not as it seemed in the beginning.

When the task is approaching the deadline or completion, things seem to move at a quicker pace, the time left on the task or project seems to evaporate. Interestingly the tasks can become more defined and therefore accomplished with greater ease, the skills have been honed or acquired, the nature of the true task has begun to show itself and the end is in sight and happily embraced.  However, this may not be the case.

What is this all about; well we tend to colour our perception of how long things will take, we often underestimate the tasks at hand and therefore the required effort, we can also overestimate (fudge) the timelines and effort involved in a bid to give ourselves a sense of control. Often people will rise to the occasion and work overtime, through lunch and even weekends, when in the belly of the task, but should we then take these efforts and extrapolate that our fudged metrics and greyed opaque time constraints are accurate or based on reality? These problems are universal and we all do it to some degree but projects and tasks are not uniform pieces of work, they exist like plum puddings, patches of smooth consistency with areas of varying densities (raisins, mixed peel etc.), these areas are tasks which are more complex, complicated or just unknown.

So how can we deal with this?

The first thing is to be aware, most projects and tasks are not consistent in effort or degree of difficulty. The ability to examine and explore the project, sift out more difficult tasks and subtasks and prioritise them is beneficial. Striving towards the framing or putting guidelines in place to aid and clarify is also very helpful. And finally the awareness that all projects and tasks are their own “animal”.

Biologically speaking animals and plants are grouped by their similarities and teased out by their differences. Even in a population of a single species there is variation. Surely tasks and projects are no more diverse, each may share similar traits to others but they are never really the same. Even if a carbon copy project was run, the outcomes would vary because the time it was undertaken would be different, the staff, the economic climate etc. etc.… could also vary.

The environment and our position in it, effects perception, this is a simple idea but difficult to enable. The fact in any organisation is that tasks are divided up to help efficiency and productivity. This is a tried and true approach yet when you have a disjoint between groups, all hell can break loose. Imagine a typical company with management, staff and silos responsible for certain activities such as programming, sales, administration etc. you get the idea. Now a disjoint would mean by definition that these silos or groups would not share the same world view as each other, they may be similar but never the same. The focus of each group would be different by the very nature of the organisational structure. Fertile grounds for a Doppler shift, differing perspectives.

Say the management wish to grow the company, sales are motivated to sell by means of commissions (more money for them), the programmers just want to code and be left alone, the administration wants clear view and control, over all and sundry. One organism pulling in different directions. The idea of being a team player is raised on high and touted as a company value and all is well?

The Doppler effect by its very nature means that each group will see their environment differently and although the same entity, perceived differently. The real dangers come from the lack of awareness between silos, the sales reps up sell, management wish to expand and grow and the “grunt work” is done by the people engaged at the coal face, coding etc. They are the best ones to gauge the true nature of the tasks at hand and the capacity for growth. Sure, stretch targets are good, people will often rise to the occasion but if stretched too far or too quickly, errors and catastrophe are around the corner. If the “grunt workers” in the company are working long hours in overtime, through their lunch breaks and on their weekends then the sales reps (on commission) and the management team are not team players, in my opinion.

The differing perspectives (Doppler effects) are distorting the true situation and we all should be aware of these effects.

The set and forget, out of sight out of mind and even your greatest strength can be your weakness are all very familiar phrases to most of us. So what does this mean to most of us in our day to day lives?

The greatest thing about programming is the fact you can create something from nothing; all you need are the basics, computer, language and time. No other thing we create can be made from such a point of nothingness. The wood worker requires timber and physical tools, the metal worker metal etc. but when it comes to creating software you can create everything even the tools. This virtual world is liberating and basically unrestricted except by our own limitations. This freedom from the physical world is its greatest strength but also its greatest weakness.

We are physical beings and as such experience our environment by our senses, touch, smell, sight, taste and hearing. Because of this we relate better to things that share our way of experiencing the world. People relate better to cats and dogs (furry mammals) than they do to fish. Many fish are doomed to die because they do not experience and interact with the world in a similar manner to people.

The usual pets such as cats and dogs breathe air; can vocalise (meow or bark) to get attention and live in the atmospheric environment as we do, which means that smells can be shared by both people and pet. This last one seems strange but the fact is when the kitty litter tray is dirty or the pet has made a mess people can smell the result easily. In the case of fish, however, when the water in a fish tank becomes “stale” from their waste products or from over feeding, the water does not smell bad to us until it becomes really toxic. The person looking after a fish tank often looks only at water clarity as a means of gauging the condition of the tank, the problem with this is battery acid is also clear and yet toxic. The fact we do not live in water means that this environment is rather foreign to us and therefore we can naturally sense only some of the important parameters required for fish to live. This is why many fish die due to our inexperience as fish keepers.

So how does the fish keeper overcome the “out of sight out of mind” dilemma of fish keeping, the answer is actually rather simple, they use test kits to check pH, ammonia, nitrite, nitrate, alkalinity and many more parameters depending on the goal of the tank. This doesn’t really sound simple does it? But the actual fact is the fish keeper uses all the above tools to gauge the state of the aquatic environment, yet his greatest ally is in fact the simplest which is regular water changes of 10 to 20 percent usually weekly. Yes, that’s right, regular maintenance is your only real ally when you are dealing with a foreign or alien environment.

So what does fish keeping have to do with programming? Well the fact the virtual world our programs live in is a completely alien or foreign environment means that we are not naturally aware of the state or conditions in this environment without using tools to test and monitor it. The regular water changes may be considered regular updates or upgrades. The set and forget environment of software is its greatest strength and also its greatest weakness. Just like a fish tank we will only notice the bad (really bad) water quality when it smells foul and this is usually too late. Similarly we only tend to notice software when it breaks.

If you don’t like fish then maybe the aircraft industry is a better analogy for you. The fuselage of aircraft undergoes many stresses during normal operation and basic metallurgy tells us that if metal is bent back and forth many times, it will eventually fail. The resulting metal fatigue is usually invisible to the naked eye and to monitor it requires special equipment and expertise. The cost of which would be prohibitive if tested every flight or every week. This is where the aircraft manufacturer specifies maintenance schedules for testing and replacement of specific parts. Next time you fly think of this and think about if the plane was your software would your maintenance find the metal fatigue?