Monday, December 28, 2009

The Diagonal Economy 6: Small Worlds Theory



Small Worlds theory is one method of quantifying and optimizing networks, and is often applied to the optimization of networks in business and economics.  Most people are familiar with the theory because it has produced, among other things, the “hub-and-spoke” design for airline routes.  While small worlds theory has broad applicability in business and social networks, it tends to ignore many factors that influence the actual effectiveness and efficiency of coordination and communication in human networks.  My intent with this post is to propose a theoretical structure for the Diagonal Economy that builds on the small worlds theory of network optimization, but that accounts for the issue of hierarchy to create a flat, non-hierarchal network structure that will facilitate coordination and communication in parallel to our present economic system.

Without regard for hierarchy or span of control, small worlds theory optimizes the shortest path length (e.g. for airlines flights) by heavy reliance on hubs to minimize connections.  However, this theory’s reliance solely on path length optimization fails to account for the information processing burden created at these hubs (e.g. span of control, SNAFU, etc.) nor does it account for the side effects of this necessarily hierarchal structure.  For example, the hub-and-spoke small worlds systems suggested by Watt and Strogatz, among other current small worlds theorists, create excessive dependencies on the hubs in these models.  This creates a network that is neither topologically flat (there are significant dependencies of most nodes on the hub), nor resilient (a breakdown of a hub causes chaos). 

Additionally, the hub-and-spoke models created in traditional small worlds optimization is not compatible with the span of control capability of human nodes in those networks.  Span of control is, essentially, the number of other humans that one human can effectively manage in a hierarchy—a number which tends to settle at about 5.  Where humans are a component of the networks optimized through traditional hub-and-spoke small worlds systems, the information processing burden at the hubs is exacerbated because multiple layers of human hierarchy are required to manage the activities of the hub.

While the math of the standard hub-and-spoke small worlds optimization process is complex (see, e.g. http://en.wikipedia.org/wiki/Watts_and_Strogatz_model), my intuition is that an effort to balance minimization of path length and minimization of information processing burden of hierarchy (and other more subjective side effects of hierarchal structure) will result in a very different optimal network structure than that suggested by the Watts and Strogatz model, and one that will facilitate far superior information processing by any real world process running on such a network. Basically, I’m suggesting that, because the hub-and-spoke model fails to account for the issues of hierarchy (and the associated issue of span of control), it fails to actually optimize the network for human reality (instead forcing upon us a system that squeezes humans into a machine role).  Below, I propose an alternative structure that I think is broadly applicable and that will allow for more efficient coordination and communication in human structures precisely because it is non-hierarchal.

First, one factor that must be considered in formulating this alternative structure is that, while optimization of a network in some theoretical set it may permissible to ignore physical geography, in the Diagonal Economy the demands of production tied to geography (e.g. food, water, energy, family) demand at least some degree of local clustering (as, I think, does our psychology to some degree due to our development in such an environment).

Next, it is necessary when developing such a theory to recognize that, when humans comprise the nodes in such a system, there is a limit to the number of effective connections in which each node can participate (and to avoid span of control issues popping up even in non-hierarchal systems).  The concept in anthropology known as Dunbar’s Number suggests that this number for humans is approximately 150.  The jury is out on whether new technologies (e.g. social networking software) or psychological developments (such as autism – see “Create Your Own Economy” by Tyler Cowen) may be changing that, but for now Dunbar’s Number seems to provide a reasonable guide. 

Next, I think that the effectiveness of people in any system improves when those people are not being squeezed into the role of a cog in a giant hierarchy, but instead are working in a self-directed, self-motivated capacity with peers.  Human creativity, passion, drive, and so many other subjective qualities seem to fare better when self-actualized, rather than acting as an, essentially, an insect.

Finally, variable loyalty or strength of connection is simply a reality in any human-based network, and is something that conventional small-worlds theory ignores.  Even within the 150 links supported by Dunbar’s Number, some will be far stronger than others.  One factor supporting this is the shared connectivity between links (e.g. A links to B and C, but B and C are also linked).  Another factor is geographic proximity, though there are certainly proxies in cyberspace (e.g. shared language).

With all of these factors taken in to account, my theory of an optimal flat network is most simply described from the perspective of a single node:  a number of close, strong, and generally mutually shared links, and a diverse array of medium and distant, weak or strong links.  Here is a simple graphic illustrating this concept:


However, it is how these sets are combined that is critical—and that I have previously stated incorrectly (at least per my current theory).  In the past, I suggested that these sets combine as follows:


The structure portrayed in the above graphic portrays more of a lattice structure, and suggests a pattern of interconnectivity that is too uniform to support either flat network optimization (the distant connections are too uniform and too uniformly close) or to support emergence (which, from observation, only seems to exist in situations with very dense, diverse, and variably distant sets of weak connections).

I’ve hinted at the solution in the past:


But in reality this graphic still relies far too heavily on regular and close connections.  The above graphic implies (incorrectly) that these distant and irregular connections (as shown by the bold black lines in the graphic above) are minor parts of the network and only utilized by occasional nodes--in fact, they are the core of the network and are just as critical as the close connections depicted above.  Additionally, the medium-close connections (as shown by the repeated pattern of four connections to nearby nodes) are excessively standardized.  An optimal configuration would show a far more random and variable set of medium and distant/weak connections.

Here's an example:
Compare that to the same nodes networked in a traditional hub-and-spoke system:
Notice that, in the hub-and-spoke system, one node in each close cluster is in control--it's the "hub," and communication between subordinate nodes through these hubs creates dependency.  While the hub-and-spoke system provides a minimally shorter path in many cases, my theory is that the information processing burden imposed at the hubs, combined with the lack of self-sufficiency and resiliency, makes the hub-and-spoke model inferior to the "rhizome" model of more egalitarian connections.

One clear weakness in this model is that it cannot be objectively and mathematically quantified in the manner of the Watts and Strogatz model.  First, the desire to optimize both path length and multiple human factors simultaneously is antithetical to mathematical analysis (you can only optimize for one thing).  When there are multiple factors to be balanced, there are probably many different effective structures, and the potential for “local peaks” presents a significant challenge (where slight tweaking of a variable degrades the performance of the model, thereby preventing further exploration that would, eventually, identify a superior structure).  There is also the fundamental challenge of conducting controlled experiments or simulations to evaluate highly complex human structures.  Therefore, this theory is necessarily based on an intuitive application of these factors and anecdotal evidence.  As with the development of all human systems, I think optimization of flat human networks, a cornerstone of the Diagonal Economy, is best achieved through the development and fine-tuning of a series of (rough) guiding principles:

1.  (Strong):  Approximately 1/3 geographically (or otherwise) close and strong/loyal connections that share significant interconnectivity among each other.
2.  (Weak):  Approximately 2/3 geographically (or otherwise) distant connections, of variable strength/loyalty that are largely not shared by the above group.
3.  (Self-Aware):  A self-awareness of these principles in the creation and maintenance of connections
4.  (Shared Principles):  Particularly within the context of creating a “diagonal” network that overlaps but exists out of phase with a “large world,” a criteria in creating new connections should also be whether that connection understands and applies this theory in its own connections (which can be accomplished through education and facilitation or discrimination).

That’s pretty simple, but I think largely ignored and potentially revolutionary when applied.  Ultimately, if the Diagonal Economy can develop and latch-on to a superior structure for coordination and communication, it will quickly spread as a means for individuals to maintain and improve quality of life through increased self-sufficiency and resilience despite the troubles besetting hierarchy.

Readers may also find my litigation checklist of interest.

Rhizome is published every Monday morning.  You can subscribe to this blog's RSS feed at:  http://www.jeffvail.net/rss.xml

Monday, December 21, 2009

The Diagonal Economy 5: The Power of Networks

It’s tempting at first to view the Diagonal Economy as fancy gloss on retreat into a more circumscribed social network.  This view, however, fails to capture the power and complexity of two critical but little understood theories of organization that promise to elegance and efficiency to the Diagonal Economy.  The first is really a set of theories and observations often described as “small worlds” theory.  The second is the much more ethereal notion of emergence—almost wholly a mystery to modern science, yet critical (we think) to such functions as consciousness and developmental microbiology.  Combined, these two concepts transform the Diagonal Economy from an inefficient and isolationist form of economic organization to a system that can provide superior coordination of production and information processing than is possible within our modern economy.  In this post, I’ll explore the importance of efficient coordination to the viability of the Diagonal Economy.  In the next two posts, I’ll address small worlds theory and emergence as applied to the Diagonal Economy. 

Simply put, this is the backbone of the Diagonal Economy—the theoretical structure that animates this theory, and that makes it a truly viable and implementable course for our future, as opposed to mere fantasy.  Personally, I find the intersection of the notion of the Diagonal Economy with these animating theories very exciting, which is why I’m devoting a separate post to both small worlds theory and emergence (yes, they are already written, and will appear the next two Mondays, respectively).  While I’ve addressed small worlds theory before, next week’s post will correct significant mistakes in my previous writing and provide a clear methodology and set of guiding principles for optimizing flat small worlds networks to be far more efficient than the currently prevailing small worlds gold standard.  Similarly, the application of emergence to the Diagonal Economy should be intriguing, as it is a field of science that controls phenomena as critical as consciousness and human development, but that we fundamentally don’t understand.

Today, however, my aim is to discuss the importance of efficiency and effectiveness of coordination of production and information processing.  Both of the next two posts, on small worlds optimization and emergence, provide tools to make the Diagonal Economy better at economic coordination and at information processing.  But why do we care about this?  Quite simply, this is what separates the Diagonal Economy from the simplistic alternative of merely going “back to the land” or other isolationist or self-sufficiency theories as alternatives to our current system.  These simpler alternatives fail precisely because they cannot compete with the economic power of hierarchal structures—even accounting for energy descent and other factors that undercut hierarchies.  From food production to manufacturing and knowledge industries, even oppressive and poorly-functioning hierarchies will out-perform isolated self-sufficiency. 

If these isolated nodes of self-sufficiency connect, communicate, and interact, then they will enjoy an improve position relative to hierarchal structures.  Especially in light of the massive challenges facing our civilization in the coming decades, and in light of our desire not merely to survive but to prosper and to build a better world than today, a vibrant alternative will require a superior mode of organization.  It will require a superior mode of coordinating complex economic production, communicating and processing information, of building a creative and elegantly simple culture.  It will need to do this without succumbing to the temptations of hierarchy, especially during times of crisis, by leveraging an organizing structure more powerful and efficient than hierarchy—even more powerful and efficient than current optimizations of hierarchies plus networks, hierarchies plus commons as seen in our current society (note, here, that while civilization has never been a pure hierarchy, our current system of hierarchy plus network is plainly not sufficiently free from the problems of hierarchy to escape the Problem of Growth).

Additionally, from the perspective of the diagonal, the Diagonal Economy will begin as a complementary structure that is coextensive but out of phase with our current system.  However, it will be precisely because it leverages a more efficient information processing structure that it will be able to eventually supplant the substrate hierarchies as the dominant system (which will obviate the causes of the Problem of Growth).

Readers may also find my litigation checklist of interest.

Friday, December 18, 2009

Nuclear energy, hierarchy, and civilizational "pain management"

Back from an extended break on Kaua'i, and back to blogging (new Diagonal Economy post soon).  From the mailbag:

This video on liquid flouride thorium fast breeder reactors was recently sent to me:


Some people think that nuclear energy, particularly fast breeder reactors that ues far less fuel, may be the solution to our energy problems.  I have serious concerns.

I'm generally opposed to nuclear power, though not on the traditional grounds. Initially, I think we'll have fuel and net energy issues if we try to rely on conventional reactors. I'm not yet convinced that a thorough net-energy analysis has been run on breeder reactors, but I'm open to the possibility that they provide sufficient net energy (I'd draw the line at roughly 10:1 after a fully-inclusive accounting of energy inputs). That said, I don't think the technology is mature enough to know this either way at this time (and it's a potential deal-breaker in my view). Also, I'm concerned by the long time of energy payback with nuclear--as with most forms of renewably-generated electricity, a high percentage of the energy input comes up front, but the payback is stretched over the next 30-50 years. That can create a real energy "cash-flow" problem, what I've called the "Renewables Gap" (not that I'd classify nuclear as renewable, but breeders come effectively close to that).

However, it may be possible to overcome all of these issues.  I think we may even be able to find a way to address the many and serious externalities of nuclear power (namely spent fule disposal, proliferation risk, operational risk). What concerns me most about nuclear (all reactor types) is that they are exceedingly centralized and maintain and spawn intensification of hierarchy. I think this the most significant problem because, ultimately, we need to overcome our addiction to perpetual growth if we ever want to be truly sustainable. My theory is that, at its core, we will not solve growth unless we reduce the excess of hierarchy in our civilization.  For that reason, nuclear energy, even the potential of very efficient and "safe" breeder reactors, is like a chronic-pain patient treating their narcotic side effects and rebound pain with new and more powerful narcotics... it may postpone the problem, but ultimately it's making it much, much worse.

(This is actually one of the first topics I wrote about on this blog.  See Energy, Society, and Hierarchy.  The more I think about and learn about our situation, the more I confirm these opinions...)

Readers may also find my litigation checklist of interest.

Tuesday, December 01, 2009

About Rhizome

My Name is Jeff Vail--I'm an author and attorney in Denver, Colorado.

My writing focuses on the problems facing our civilization as viewed through the lens of the structure and terrain of human interaction.  Specifically:

- The Problem of Growth (the hierarchal nature of our civilization demands growth, and is therefore unsustainable).
- Hierarchy vs. Rhizome:  the inefficiency of hierarchal coordination, and the potential for consciously scale-free, networked self-sufficiency ("Rhizome").
- The New Map: a critique of the notion that Nation-States will continue to dominate our world.
- The Diagonal Economy:  my proposal for transition to a sustainable and fulfilling economic and political structure during the coming (and ongoing) catabolic collapse of our present structure.

I try to apply this theoretical framework to topics where I have specific experience from my current career as an attorney and my previous career as an intelligence officer and counterterrorism analyst:  geopolitics, energy, law, and economics.

Readers may also want to purchase (or download for free) my book, A Theory of Power.  Look for a second book (synthesizing the topics listed above) in the (relatively) near future.  In the meanwhile, I try to post to this blog every Monday morning, and I contribute articles to The Oil Drum about once a month.  Please feel free to contact me via email--I do my best to respond quickly, but I apologize in advance if it takes me a few days.

Sailing off Panarea, Italy:

Rhizome is published every Monday morning.  You can subscribe to this blog's RSS feed at:  http://www.jeffvail.net/rss.xml