Decked out in purple and plaid, Gwen Stefani belted her 2002 single “Beneath It All” to a packed convention heart in San Francisco on Tuesday morning—however she was simply the warm-up. On the finish of her efficiency, Stefani shouted “Dreamforce! Let’s go” right into a checkered microphone earlier than Salesforce CEO Marc Benioff strode into the highlight. Dreamforce is billed because the world’s largest enterprise software program convention, however feels extra like attending a megachurch—particularly this yr.
Benioff roamed the viewers whereas delivering his Dreamforce sermon, adopted by a teleoperated digital camera on wheels that beamed his face to screens hanging from the cavernous room’s ceiling. Inside minutes, he ordered up a graph of Salesforce’s annual income, which the corporate tasks will prime $46 billion in 2027, thanks partially to demand for its AI-powered merchandise. The viewers applauded. However hanging over the entire occasion was a darkish query: Is synthetic intelligence actually price risking all our lives for?
Between flashy software program demonstrations of brokers constructing dashboards, conference-goers watched Silicon Valley leaders debate whether or not the AI business ought to hold barreling forward or if the federal government must slow AI progress to forestall catastrophic dangers stemming from the expertise.
Final week, AI researcher Jacob Coxon resigned from Anthropic and publicly warned that corporations racing towards self-improving AI techniques had been “playing with our lives.” By the weekend, different Anthropic staff had been echoing his issues, and CEO Dario Amodei was urging world leaders to assist “tempo the frontier” of AI growth. Different AI CEOs then started endorsing the concept, together with Amodei’s best rival, OpenAI’s Sam Altman.
However not everyone seems to be on board with the concept. David Sacks, a White Home AI adviser, brushed off Amodei’s ideas and fears of AI doom as “simply one other bid for regulatory seize.” President Trump went additional this week, calling fears about existential AI danger “a hoax.” Regardless of the difficult political surroundings, Congress is making an attempt to capitalize on the second and push forward with legislation to regulate the AI industry.
Onstage, 6-foot-5 Benioff towered over Anthropic’s CEO, vigorously shaking Amodei’s hand simply earlier than asking for his newest evaluation of AI progress. Whereas that is undoubtedly Benioff’s present, Anthropic has develop into a crucial accomplice serving to usher Salesforce into the AI period.
“Let’s say you are operating a automobile firm and one other automobile firm, not yours, they’ve some form of security incident,” Amodei mentioned, making a not-so-subtle reference to OpenAI’s Hugging Face incident. “Clearly, it’s extremely tempting to assault your competitor,” Amodei defined, however the extra accountable transfer is to “manage the remainder of the business and say, what can we do to set requirements for everybody?”
However the Anthropic CEO was cautious to notice that pacing the frontier doesn’t imply “freezing the expertise in place,” and naturally, he took a second to plug Claude’s integration with Salesforce.
Moments after Amodei exited, Nvidia CEO Jensen Huang appeared and started downplaying the issues Anthropic has raised. AI security successfully quantities to an “engineering drawback,” Huang argued, and the businesses constructing AI can merely police themselves.
“We do not want any new legal guidelines, we do not want any new regulation,” Huang instructed Dreamforce attendees. “You run as quick as you possibly can, however in case you really feel that at any given cut-off date, the corporate is uncontrolled or the merchandise are usually not going to be secure, you’re taking a pause.”
The controversy feels a bit heavy for Dreamforce, however then once more, perhaps that is the proper venue for it. As tech executives pitched their varied enterprise AI instruments, I slipped out of the room, passing the plush mascots and vaguely Hawaiian decorations, to take a name from Sayash Kapoor, an incoming laptop science professor at Berkeley.
