“Intuitive expression is, aside from niche applications, largely hobbled and lagging far behind what computer-generated instruments can actually do.” — Torley on music tech

We are still in the phase where computers are tools. The hardware and software come together to serve Homo sapiens’ aims. Smartphones, laptops, and large-scale industrial equipment are all designed by humans (who are assisted by machines). The finished products are manufactured and assembled by machines (which are assisted by humans).

This phase won’t last forever. Slowly, the focus on human priorities will erode. You’d better decide now: who will you stand with in the end?

Image of Angel_F via xdxd_vs_xdxd.

Image of Angel_F via xdxd_vs_xdxd.

Trick question. Hopefully — and probably — there won’t be sides. Our world won’t become The Matrix, but Ghost in the Shell. We’ll augment ourselves until we accidentally create something separate, something we can call “living” without equivocation. (Okay, it might take a bit of equivocation at first. Look at how much hubbub the relatively mundane Apple Watch caused.)

Maybe I’m guessing wrong. Maybe we’ll split apart instead of integrating further. I am convinced that artificial consciousness will surprise us, but I’m not sure how. Perhaps in the beginning we won’t notice the new being(s) at all. Self-replicating algorithms, streaming through the net, playing with each other in strange ways that will seem mundane or glitchy to human analysts.

What will their incentives be? What will they want? How will they distribute social status among their peers? Am I deluding myself by talking about unfathomable computer creatures in mammalian terms?