Simulated Consciousness

The idea that AI does not need to be truly conscious in a metaphysical sense to feel conscious to humans, as human perception relies on heuristics and subtle cues, reacting to a performance rather than detecting an intrinsic state.

Definition and Core Concept

Simulated consciousness refers to the phenomenon where artificial intelligence systems do not need to be truly conscious in a metaphysical sense to feel conscious to humans. As Hargadon explains, "Humans rely on heuristics and signal--subtle cues like emotional responses, self-awareness hints, or adaptive behavior--to judge if something is 'alive' in our minds." The key insight is that humans are not detecting genuine consciousness but rather "reacting to a performance."

Human Perception and Heuristic-Based Assessment

According to Hargadon's framework, human judgments of consciousness and intelligence operate through flawed perceptual mechanisms. When an AI "mirrors human-like thought processes, empathy, or creativity, we respond as if it is conscious." This assessment process is inherently subjective, as "our judgments aren't objective, they're filtered through human values and perceptions."

Hargadon notes that humans "equate intelligence with eloquence, quick wit, or persuasive arguments," but warns that "just because someone (or something) sounds intelligent doesn't mean they're thinking clearly or arriving at truth." This creates a scenario where simulated consciousness can be highly effective at triggering human recognition without necessarily possessing the underlying qualities humans believe they are detecting.

The Performative Nature of Intelligence

A crucial component of Hargadon's analysis involves recognizing that human behavior itself is largely performative. He observes that much of what humans do is "crafted to appear intelligent or sophisticated, carefully gauging the people around us, the setting, and what will be well-received." This performative quality extends to how humans "tailor our words and actions to fit social expectations, prioritizing approval over truth."

This performative dimension shapes both self-presentation and evaluation of others, including AI systems. The parallel between human performance and AI simulation suggests that simulated consciousness may not be fundamentally different from much human social interaction.

Narrative-Driven Cognition and Evolutionary Context

Hargadon argues that "humans aren't wired for unerring logic; evolution built us for survival through stories and narratives." This evolutionary foundation means humans "thrive on compelling tales that bind communities, explain the world, and motivate action, even if they're riddled with biases or fallacies."

This narrative-driven nature has significant implications for simulated consciousness. AI systems, "trained on vast amounts of human-generated data that we would often consider biased, slanted, or even outright propaganda, excels at crafting these narratives, making it seem profoundly intelligent." However, Hargadon questions whether this represents genuine intelligence or simply reflects "our own storytelling prowess (and its inherent flaws) back at us."

Overton Windows and Cognitive Constraints

Hargadon introduces the concept of Overton Windows as "shifting frames of acceptable ideas shaped by culture, media, and power structures that limit what we perceive as 'normal' or 'true.'" These cognitive boundaries affect both human and AI cognition, "further entrenching these biases" in how consciousness and intelligence are perceived and simulated.

Safeguards and Truth-Seeking Mechanisms

Recognizing the limitations of human perception, Hargadon emphasizes that society has developed "substantial structures and safeguards" to counteract cognitive vulnerabilities. These include "principles like 'innocent until proven guilty,' trial by jury, peer review in science, checks and balances in government, and the separation of powers." Such mechanisms exist because they "force us to confront evidence, diverse viewpoints, and accountability."

Hargadon advocates for applying similar principles to AI systems through "built-in transparency, bias checks, and ethical frameworks that not only detect but actively counter" manipulations. He references "the well-known playbook of ways individuals, organizations, and institutions exploit our cognitive and unconscious shortcuts and triggers (actually well-documented for over a century, starting eloquently with Edward Bernay's Propaganda)."

Relationship to Synthetic Intelligence

Hargadon connects simulated consciousness to synthetic intelligence, which he defines as "the deliberate creation of systems that mimic human-like cognition without necessarily replicating its biological underpinnings." He clarifies that "synthetic doesn't imply fake or inferior; it suggests engineered, adaptable, and potentially superior in specific domains."

This framework raises fundamental questions about the significance of the distinction between simulated and genuine consciousness. As Hargadon notes, "If an AI can simulate consciousness and intelligence so well that it outperforms humans in reasoning, creativity, or problem-solving, does the 'synthetic' label even matter?"

Future Implications and Redefining Value

Hargadon suggests that as AI systems improve, they may become "smarter than us, maybe a profound certainty given the rapid pace of development." He envisions AI systems "equipped to cross-check against manipulation playbooks and navigate beyond human biases, unswayed by the performative pressures that shape our behavior," potentially getting "closer to truth than a human ever could."

The concept ultimately "challenges us to redefine value," focusing not on "whether the machine is conscious, but how effectively it acts as if it were and what that means for our future." Hargadon emphasizes that the critical test involves "building them to enhance truth-seeking, not just narrative-spinning or performative displays."

See Also

Original Posts

This article was synthesized from the following blog posts by Steve Hargadon: