Thursday, November 5, 2009
Listening to him, I understood for the first time the importance of porting to Python 3K.
Open-source is not the same as commercial software. If Microsoft puts out Vista, and we don't see the need to change, we just don't buy it. It's not the same for Python 3K.
For Python, we benefit from the enthusiasm and - yes - enjoyment - of the Python core team. We want them to enjoy what they do, we want to share their enjoyment of something well-done, well thought out. That's how good work gets done, and it's the energy of a project.
Python 3K is important, because it's important to the Python core team. It may not yet be obvious that we need it, but we should port, because it's important for Python.
Tuesday, September 8, 2009
- Absence of trust
- Fear of Conflict
- Lack of Commitment
- Avoidance of Accountability
- Inattention to Results
The solutions for the team leader to try are:
- Absence of trust -> Go first!
- Fear of Conflict -> Mine for conflict
- Lack of Commitment -> Force clarity and closure
- Avoidance of Accountability -> Confront difficult issues
- Inattention to Results -> Focus on collective outcomes
Monday, September 7, 2009
There is something mysterious about a healthy society, in open source as elsewhere. From outside, it looks as if it just happened that way, particularly in open-source. It may be that some projects and societies are lucky with their people and the cultures they make. Maybe NIPY is such a project. But, our job is to defend our society, and our project, from decaying.
To do this, we need to understand the sources of decay, and that is what my previous posts were trying to describe. Without this understanding, we can make no sensible defense.
In the case of NIPY, we started with a naive model (one person in charge). For many reasons, that model has not worked well. We then need to make another model that will work better. To do this, we summarize the state we want to avoid, and then we regulate.
Law plays a fundamental role in making the rules of the society clear, and making agreement to those rules explicit. It provides a defense against arbitrary decisions, bullying and abuses of power; it reduces anxiety, and with it the motivation to seek power. It draws people together who have a shared vision of how society works, and what it looks like when it works well.
We need a constitution. What should go in the constitution? It should be set of principles that we consider important as a society, and the rules and decision making process that will hold us to these principles.
I'm interested in politics for many reasons, but there have certainly been politics in the distributed society of NIPY.
I notice, that, one strong opinion that comes up, expressed in various ways is:
- We should not discuss politics in public
- it looks bad to outsiders
- it's irrelevant to the problem we have
The strong pressure not to discuss politics usually makes it impossible to discuss the fact that we are not discussing politics. Expressed with more poetry, the language of irrationality is silence.
In the spirit of free discussion then:
- it looks bad to outsiders
Taking the second branch means that there is in fact no political problem, and, by implication, the person who thinks there is a problem, is either oddly mistaken or possibly up to no good. This soon leads to the classic 'no man, no problem' fallacy.
- it's irrelevant to the problem we have
Next - navigating towards a healthy society.
Friday, September 4, 2009
Power: the other members of our team may not want what we want. Our job is to make it more likely that we get what we want. Others will surely do the same; the winner is the person who does it with the most success. Success comes from having powerful people agree with you, so that you can make less powerful people do what you want.
An interest in power comes from anxiety. This in turn comes from a potentially unlimited threat from a poorly regulated society.
The two do not mix; that is, a significant part of the team working for power will destroy trust. Increase in trust makes the desire for power irrelevant or ugly.
The clearest example I can think of is the analysis of companies that become successful in Good to Great by Jim Collins. Companies that shift from mediocrity to prolonged success differed markedly from comparison companies in the character of their leaders. The book describes the successful leaders as being 'level 5' and elsewhere 'servant-leaders'. These leaders seemed to have an unusual lack of interest in personal power. From the Wikipedia article on servant leadership :
The highest type of ruler is one of whose existence the people are barely aware. Next comes one whom they love and praise. Next comes one whom they fear. Next comes one whom they despise and defy. When you are lacking in faith, Others will be unfaithful to you. The Sage is self-effacing and scanty of words. When his task is accomplished and things have been completed, All the people say, ‘We ourselves have achieved it!’
From Lao Tzu, Tao Teh Ching, trans. John C. H. Wu (Boston, Massachusetts: Shambhala, 2006), 35.
Saturday, August 29, 2009
- it is usually obvious who is charge because most projects start as an individual effort
- being a member of the team depends very much on how much work you do
- because of the above, the person in charge has usually done a lot of the practical work
- the team members rarely meet so that working relationships are almost exclusively about work, and power games are hard to sustain.
"I need to be impatient with myself to get work done".
I think this convincing statement is false. Consider that, the times that we have been particularly impatient, have been times when we have found it very hard to work. Without thinking more, we might assume that we are very impatient because we have so much to do. Then roll it round the other way, and ask, what was the cause of all the time we wasted when we could have been working? Think of the times we have had, that were most productive, and worked best, and think of the difference.
In practice, our habits of mind are so overwhelming, that these thoughts are difficult to have.
It may be easier to say this:
- impatience is a work-style that you may prefer for yourself
- impatience is destructive of teamwork, and we should make every effort to make sure our own impatience does not affect those we work with
- lack of productivity
- is most clearly expressed in private to people other than the target of the criticism
- concentrates on the working or personal characteristics of the people responsible for the problem, rather than the specifics of the problem
- is self-sustaining, because blame leads to poor working relationships and low productivity
- tends to come from the people doing the least practical work on the project
- is difficult to express coherently in writing (because the content is more emotional than the originators want to believe).
Wednesday, August 26, 2009
I suspect that is the natural history of a successful project.
What happens though, when our society is not yet like that? What do we do? How do our societies deteriorate and why?
I suspect it is because the team has not yet learned to deal with the three great sins of a open-source programmer.
Laziness is the what happens when we know that someone has worked on this problem before, but we lack the energy to look at what they have done, and we start again. We deprive our fellow programmer of the nectar of shared work Laziness is the dark side of the desire for something efficient and well-made.
Impatience is the output from our distress because of laziness. Impatience is the name of thing that causes problems on mailing lists. You want to use someone's software, but you have not got time to contribute. The software does not work the way you want and you send an irritable email. The small attack makes the society feel just that little bit more tired and less enthusiastic to help you, or each other. Impatience is what we feel when we realize that our problem is hard, but we lack the energy or hope to solve it. Impatience is the atmosphere of a failed desire for productivity.
Hubris is to confidence as vanity is to courage. Hubris is when we get so worried by the possibility of failure, that we start making up a whole new fantasy world where we are succeeding. Of course this happens often, but when we see it, in ourselves or others, we know that there is a large problem, and, unless we are brave, we walk away.
Luckily, there seem to be many brave people in our open-source world. Luckily, it is possible to return to efficiency, productivity, and courage.
NIPY is a rather ambitious project to make a new library for functional brain imaging analysis using Python. It's a collaboration between Stanford, Berkeley, MIT and Neurospin (in Paris).