7 years, 10 months ago

Co-Production of Data and Knowledge

Here’s an analogy for the so-called hierarchy of Data, Information, Knowledge and Wisdom DIKW).

  • Data = Flour
  • Information = Bread
  • Knowledge = A Recipe for Bread-and-Butter Pudding
  • Wisdom = Only Eating A Small Portion

Note that Information isn’t made solely from Data, Knowledge isn’t made solely from Information, and Wisdom isn’t made solely from Knowledge. See also my post on the Wisdom of the Tomato.


That’s enough analogies. Let me now explain what I think is wrong with this so-called hierarchy.

Firstly, the term “hierarchy” seems to imply that there are three similar relationships.

  • between Data and Information
  • between Information and Knowledge
  • and between Knowledge and Wisdom

 as well as implying some logical or chronological sequence

  • Data before Information
  • Information before Knowledge
  • Knowledge before Wisdom

and quantitative relationships

  • Much more data than information
  • Much more information than knowledge
  • Tiny amounts of wisdom

    But my objection to DIKW is not just that it isn’t a valid hierarchy or pyramid, but it isn’t even a valid schema. It encourages people to regard Data-Information-Knowledge-Wisdom as a fairly rigid classification scheme, and to enter into debates as to whether something counts as “information” or “knowledge”. For example, people often argue that something only counts as “knowledge” if it is in someone’s head. I regard these debates as unhelpful and unproductive.

    A number of writers attack the hierarchical DIKW schema, and propose alternative ways of configuring the four elements. For example, Dave Snowden says that “knowledge is the means by which we create information out of data”. Meanwhile Tom Graves suggests we regard DIKW not as ‘layers’, but as distinct dimensions in a concept-space.

    But I don’t see how any of these DIKW remixes escapes the most fundamental difficulty of DIKW, which is a naive epistemology that has been discredited since the Enlightenment. You don’t simply build knowledge out of data. Knowledge develops through Judgement (Kant), Circular Epistemology and Dialectic (Hegel), Assimilation and Accommodation (Piaget), Conjecture and Refutation (Popper), Proof and Refutation (Lakatos), Languaging and Orientation (Maturana), and/or Mind (Bateson).

    What all of these thinkers share is the rejection of the Aristotelian idea of “one-way traffic” from data to knowledge, and an insistance that data must be framed by knowledge. Thus we may validate knowledge by appealing to empirical evidence (data), but we only pick up data in the first place in accordance with our preconceptions and observation practices (knowledge). Among other things, this explains why organizations struggle to accommodate (and respond effectively to) weak signals, and why they persistently fail to “connect the dots”.

    And if architects and engineers persist in trying to build information systems and knowledge management systems according to the DIKW schema, they will continue to fall short of supporting organizational intelligence properly.


    References


    Updated 8 December 2012