recentpopularlog in

robertogreco : andyclark   2

The Humane Representation of Thought on Vimeo
"Closing keynote at the UIST and SPLASH conferences, October 2014.

References to baby-steps towards some of the concepts mentioned:

Dynamic reality (physical responsiveness):
- The primary work here is Hiroshi Ishii's "Radical Atoms":
- but also relevant are the "Soft Robotics" projects at Harvard:
- and at Otherlab:
- and some of the more avant-garde corners of material science and 3D printing

Dynamic conversations and presentations:
- Ken Perlin's "Chalktalk" changes daily; here's a recent demo:

Context-sensitive reading material:

"Explore-the-model" reading material:

Evidence-backed models:

Direct-manipulation dynamic authoring:

Modes of understanding:
- Jerome Bruner:
- Howard Gardner:
- Kieran Egan:

Embodied thinking:
- Edwin Hutchins:
- Andy Clark:
- George Lakoff:
- JJ Gibson:
- among others:

I don't know what this is all about:



New representations of thought — written language, mathematical notation, information graphics, etc — have been responsible for some of the most significant leaps in the progress of civilization, by expanding humanity’s collectively-thinkable territory.

But at debilitating cost. These representations, having been invented for static media such as paper, tap into a small subset of human capabilities and neglect the rest. Knowledge work means sitting at a desk, interpreting and manipulating symbols. The human body is reduced to an eye staring at tiny rectangles and fingers on a pen or keyboard.

Like any severely unbalanced way of living, this is crippling to mind and body. But it is also enormously wasteful of the vast human potential. Human beings naturally have many powerful modes of thinking and understanding.

Most are incompatible with static media. In a culture that has contorted itself around the limitations of marks on paper, these modes are undeveloped, unrecognized, or scorned.

We are now seeing the start of a dynamic medium. To a large extent, people today are using this medium merely to emulate and extend static representations from the era of paper, and to further constrain the ways in which the human body can interact with external representations of thought.

But the dynamic medium offers the opportunity to deliberately invent a humane and empowering form of knowledge work. We can design dynamic representations which draw on the entire range of human capabilities — all senses, all forms of movement, all forms of understanding — instead of straining a few and atrophying the rest.

This talk suggests how each of the human activities in which thought is externalized (conversing, presenting, reading, writing, etc) can be redesigned around such representations.


Art by David Hellman.
Bret Victor -- "

[Some notes from Boris Anthony:

"Those of you who know my "book hack", Bret talks about exactly what motivates my explorations starting at 20:45 in "

"From a different angle, btwn 20:00-29:00 Bret explains how "IoT" is totally changing everything
@timoreilly @moia" ]
bretvictor  towatch  interactiondesign  davidhellman  hiroshiishii  softrobotics  robots  robotics  kenperlin  jeromebruner  howardgardner  kieranegan  edwinhutchins  andyclark  jjgibson  embodiedcognition  cognition  writing  math  mathematics  infographic  visualization  communication  graphics  graphicdesign  design  representation  humans  understanding  howwelearn  howwethink  media  digital  dynamism  movement  conversation  presentation  reading  howweread  howwewrite  chalktalk  otherlab  3dprinting  3d  materials  physical  tangibility  depth  learning  canon  ui  informationdesign  infographics  maps  mapping  data  thinking  thoughts  numbers  algebra  arithmetic  notation  williamplayfair  cartography  gestures  placevalue  periodictable  michaelfaraday  jamesclerkmaxell  ideas  print  printing  leibniz  humanism  humanerepresentation  icons  visual  aural  kinesthetic  spatial  tactile  symbols  iot  internetofthings  programming  computers  screens  computation  computing  coding  modeling  exploration  via:robertogreco  reasoning  rhetoric  gerrysussman  environments  scale  virtualization 
march 2015 by robertogreco
perception is controlled hallucination‏ | synthetic_zero
[embedded video:

link to .pdf:
"How do questions concerning consciousness and phenomenal experience relate to, or interface with, questions concerning plans, knowledge and intentions? Visual perceptual experience, we shall argue, is fixed by an agent's direct unmediated knowledge concerning her poise (or apparent poise) over a currently enabled action space: a matrix of possibilities for pursuing and accomplishing one's intentional actions, goals and projects. If this is correct, the links between planning, intention and perceptual experience are tight, while (contrary to some recent accounts invoking the notion of ‘sensorimotor expectations’) the links between embodied activity and perceptual experience, though real, are indirect."

another embedded video: ]
perception  hallucination  2015  consciousness  cognition  imagination  understanding  simulation  andyclark  learning  howwelearn  context  prediction  approximation  inference 
january 2015 by robertogreco

Copy this bookmark:

to read