Hacker News new | past | comments | ask | show | jobs | submit login

>> How do such simple assembly errors give rise to self consciousness in the program seconds after turn on, compared to slave mode unconsciousness that was desired and usually occurred?

> Obviously, the guy simply forgot to pass IS_SELF_AWARE=no to make ;) Yeah, that feels far-fetched.

I suppose if this was a case of a Restricted AI gaining sentience in a production line it would actually be a manufacturing defect. However if AI had already been discovered and outlawed, building an R-AI would have more fail safes before booting a sentient AI off the production line.

However if AI were an outlawed menace then you'd think the restriction would be more than a "non-homicidal-subservience chip" being installed. You'd think it would be like Asimovs 3 laws where its an integral device in their operating system.




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: