The Singularity of Hope: Why Accountability Stays With Humans, Not Machines

NOV 17, 202627 MIN

Description

Show Notes: Heartwired – Emotionally Intelligent Leadership Episode Title: The Singularity of Hope: Why Accountability Stays With Humans, Not Machines Host: Dr. MJ Vignone Guest: Dr. Sam Sammane, CEO & Co-Founder, Quantum General Intelligence (QGI) Episode Summary Ask AI the same question twice and you may get two different answers. Now imagine having to defend one of those answers to a judge. In this episode of Heartwired, Dr. MJ sits down with Dr. Sam Sammane, an AI ethicist, entrepreneur, and award-winning author who builds AI designed to explain every step of the way. Sam is the CEO and co-founder of Quantum General Intelligence (QGI), which builds deterministic, auditable AI for decisions that cannot be wrong. He holds a PhD in formal verification and automated reasoning, and before QGI he built and ran accredited testing laboratories across Canada and the US. He is also the author of The Singularity of Hope. Sam's central argument is that the real risk of AI right now is not machines going rogue but people avoiding responsibility for what they build and deploy. He believes the singularity is already arriving, not because machines are outsmarting us, but because some people are using AI to amplify their own intelligence while others get left behind. The conversation covers deterministic versus probabilistic AI, why AI "going rogue" is the wrong frame, what he calls "brain obesity," and why leaders need an AI strategy built for their own organization rather than copied from someone else's. Key Takeaways Deterministic AI: Same Inputs, Same Results, Every Time Sam started his career in older, symbolic AI, which gives the same correct result every time but is hard to automate because everything has to be formalized. Modern language models are the reverse: flexible, but approximate. His company's approach is neural-symbolic: use language models for what they do well, and use deterministic AI for critical-mission decisions where results must be repeatable and auditable. The tradeoff is real. Deterministic AI is slower and not suited to a casual chatbot, but it adds a dimension of safety and compliance that regulated industries need. Hallucination Is a Feature of How the Technology Works Sam explains that when a language model doesn't have the answer, it may invent one, not because it's smart but because of how it's built. He points to cases where chatbots promised customers interest rates or discounts that didn't exist. For banks and other regulated organizations, the implication is clear: limit where you use these systems and don't treat a plausible answer as a correct one. "AI Went Rogue" Usually Means "A Human Wasn't Accountable" Sam pushes back on the idea that AI is out of control. In his view, current AI is something we can control completely. The language model itself can't remember anything; memory comes from the agent software people build. When AI agents "talk to each other," someone built the software that lets them. When something goes wrong, he says, the honest explanation is usually human negligence. His proposed answer is not to stop or tax AI but to regulate the humans who use it: you are responsible for what you do with AI, and "my AI did it" isn't a defense. The Singularity of Hope The classic idea of the technological singularity is AI inventing smarter AI until humans are left behind. Sam describes a similar phenomenon happening between people: specialists using AI to do in a month what once took two or three years, while everyone else watches the pace accelerate. He calls it human-AI augmentation, and he calls it a singularity of hope because humans are still steering. It doesn't mean there are no challenges. Jobs will change and some will disappear, and he argues that society and politics haven't caught up to how fast this is moving. Brain Obesity Sam uses an analogy to the industrial revolution: machines let us stop using our muscles, and obesity followed. With AI, you can stop using your intelligence. He calls the result "brain obesity," and he warns that surrendering our thinking to the machine means giving up something that makes us human. Dr. MJ agrees, noting that people who check with AI to see if they're okay stop trusting themselves. We Spent 50 Years Training People to Act Like Machines Sam observes that in school we ask people to think, and then in the workplace we give them procedures and rules and train them to follow them. Now that machines can follow procedures, we need people to be human again: critical thinking, creativity, empathy, intuition, and emotional intelligence. His definition of real creativity is inventing something from nothing, and he points out that without knowledge a machine has no action, while a human can sometimes know something is right without being able to explain how. Use AI for Information. Make Decisions Yourself. AI is a useful way to explore knowledge, Sam says, but there is no one with empathy on the other side, and no global intelligence that understands your situation. If you treat it as a source of answers to life's questions, you're misleading yourself. It can inform you, but the decision has to come from you. Neither Extreme Works for Leaders and Policymakers Sam describes two extremes he'd like leaders to avoid. One is trying to stop, tax, or slow AI, which he argues would simply cede ground to countries that care less about these values. The other is giving a handful of heavily funded companies whatever they need, which he worries could concentrate power. He says he has no recipe, since he's not a politician, but he calls for awareness and for a human-centered approach to AI that doesn't empower only a small group of people. These are Sam's views, and listeners will have their own. Build Your Own AI Strategy. Don't Wait, and Don't Overdo It. Sam's practical advice for leaders is to develop an AI strategy in-house rather than copying a one-size-fits-all approach. A bank and a digital marketing company don't have the same urgency; he says a marketing firm that isn't using AI today is already out of the market. Waiting is risky because a competitor won't wait, but so is moving too fast or overusing it. For critical missions, he argues against using generic AI everywhere and for smaller, controlled, private AI that a company runs on its own servers. In his words, it's your intelligence, and you shouldn't subcontract it. Why "Quantum"? Empathy and Entanglement Sam says the name QGI comes from an analogy to quantum mechanics: superposition and entanglement. He relates entanglement to empathy, the feeling of "I have the same experience as you." He's clear that this is an analogy, and that in the company's name the word is really about engineering: people building their own controlled systems and making their own judgments. Memorable Quotes "It's not AI who became human-like."— Dr. Sam Sammane "Decisions need to come from you."— Dr. Sam Sammane "If you don't know, don't do it."— Dr. Sam Sammane "You don't want to subcontract intelligence."— Dr. Sam Sammane This Week's One Thing Sam's advice for leaders: sit down and write an AI strategy that fits your organization instead of borrowing someone else's. Decide where AI helps, where it needs strict limits, and who is accountable when it's used. As Dr. MJ put it in closing, accountability has to stay with the people, not with the machines. About Our Guest Dr. Sam Sammane is a visionary entrepreneur, AI ethicist, and award-winning author dedicated to bridging the gap between cutting-edge technology and human values. He is the CEO and co-founder of Quantum General Intelligence (QGI), where he builds deterministic, auditable AI for decisions that cannot be wrong and helps businesses deploy agentic AI without removing people from the loop. He is the author of The Singularity of Hope. Website: sammane.com LinkedIn: linkedin.com/in/sam-sammane-ai-ethicist YouTube: youtube.com/@TheoSym