Though I have given some thought to what might happen** if** machines break past human intelligence, I havent given much thought to the inevitable exponential growth of machine intelligence that would occur very rapidly as a result, and the implications of such intelligence.
If machine intelligence is possible, then the singularity is a real event that will hit humanity in the not too distant future. Is humanities best hope a break down of Moore’s law?
by machines you mean computers. some would argue that machines have surpassed humans already. world's number 1 chess player recently got whooped by a computer. one area where computers have the advantage is inference based on a lot of knowledge typically used in neural nets and AI. However, where computers lack and humans do better in is causality. computers can get better over time when it comes to inference... however not much progress the other way around. a good book to read on the topic is causality by judea pearl who also happens to be daniel pearl's dad.
I am not talking about computer or rotots here. We’re talking about an human-type intelligence that is at, and very quickly far beyond, our own human level. Thinking about it in terms of stale little robots that move really slowly and bump into things helplessly, or computers running WinXP or Vista and crashing all the time… that’s not the correct viewpoint. Rather, think of it as every member of our species being an Einstein, an Euler, a Newton or a Socrates. And they get smarter with each succeeding generation, at a very quick pace.