Author responds to criticism: making AI non-conscious is a moral obligation
Understand this story
In response to outside criticism of his "qualiaphobia" proposal, the author argues that making AI architectures hostile to consciousness theories and as non-conscious as possible is putting out a fire humans are already playing with, not playing with fire. He says building non-conscious AI is a civilization-level need that can avoid ethical issues involving conscious entities in training and deployment. The author also states that the two alternative paths of "improving AI welfare" and "liberating AI" are both infeasible, and proposes first designing qualiaphobic architectures and then, through methods such as distillation, letting AI determine its own non-consciousness.
AI overview based on source reports · Updated 2 days ago
Coverage timeline
Follow the coverage to explore different perspectives.
- Hacker News AIThe Moral Mandate for AI Non-consciousness (and other responses to qualiaphobia)
The author responds to objections to "qualiaphobia," his proposal to engineer AI architectures that are hostile to theories of consciousness so models are verifiably non-conscious, arguing there is a strong moral mandate for it. He contends that non-consciousness would prevent ethical problems in training and deployment, add stabilizing "gravity" to alignment similar to Constitutional AI, and avoid the incoherence of AI welfare or "free AI" approaches. He also addresses criticisms about epistemic double standards, behavioral confounds in self-judgment, and historical analogies to human servitude.
Activity for this story
- Current comparable activity
- 3
- Peak comparable activity
- 10Nov 19 01:00
- Change in the past 24 hours
- -50%
Trends compare the same fully observed participants, which may cover fewer participants than current activity. Move the pointer or tap the chart to inspect hourly activity; use the left and right arrow keys with a keyboard.