Computing's Dark Matter

Internet as the Edge of something larger

Supercomputing Everywhere

Q: What do Mobile Edge Computing, Supercomputing at the Edge, NFV, Fog Computing, Cisco IOx and the dozens of about‑to‑pop‑up new buzzwords have in common?

A: They’re about brainpowering the network, since networking by its very essence is a dumb transport realm disengaged from computing

Pooled Network/Computing Flips The Internet/Cloud to being at The Edge.

The unused computing power in “The Edge”, that is, the things of  The Internet of Things and mobile devices is vastly greater than the entire Internet/Cloud. Harnessing that gargantuan power can dwarf today’s Internet/Cloud into becoming The Edge of a larger, networked-computing realm. The good news is that can evolve peacefully with the Internet which it will encompass like personal computing overshadowed mainframe computing in the past.

Dark Matter

Supercomputing at the Edge

and Fog computing

are first steps in that direction but fall short.

Q: So where are the brains?

A: Everywhere

The unutilized computing potential in the aggregated devices themselves remains unlocked. It is computing’s dark matter but not mentioned. Communications services are public infrastructure provided by outside suppliers, precisely like computing was before the age of Personal Computing. In contrast to software development which is open to the world, complex-to-program communications protocols stymie progress by barring human creativity from being involved in their development. Networking applications can be written as easily as today’s smartphone apps.

How?

The short answer to How? is: any way you like. Any number of different networking regimes can flow harmoniously side‑by‑side based on two simple principles:

  1. Freedom from protocols. See Tearing Down the Protocol Wall
    a. All participating devices run the same networking code.
  2. Networking code (above the H/W-S/W interface line) runs in loadable, user‑space memory.
    a. New networking paradigms can be loaded on‑the‑fly
    b. Overlapping ad hoc network instances run in parallel on the same and/or other devices.

Evolutionary paradigm

All of the individual devices’ original capabilities continue functioning as before while contributing some of their unused computing cycles to applications running on the platforms they have joined.
Software applications wrap their own networking code. It’s nearly an all software realm. Load and run.
This gives rise for evolution of new computing models.

Practical example

Our pet model is running RDMA supercomputers over Mobile ad hoc Networks (MANETs) by stitching the devices into a common computing fabric which appear to the applications running on them as a single multi‑core device. Each application runs as an instance allowing for unlimited applications to run in parallel.
Imagine, for instance an ad hoc network (of thousands, tens of thousands) of mobile devices hosting a common Erlang Run Time System running applications which easily fan out to using the available processing power.

See Presentation online (press -> or shift -> to advance):

More Reading