If left unregulated, artificial intelligence could pose a serious threat to humanity — this is the alarming message that Yoshua Bengio, a pioneer in the field, has been emphasizing for many years.
On Wednesday, alongside officials from the Canadian and German governments, Bengio announced a joint investment exceeding a quarter billion dollars aimed at addressing this danger.
Bengio is working on a novel AI model known as Scientist AI, designed with safety as a fundamental principle. This model aims to concentrate solely on objective realities, comprehending facts without any self-serving objectives, such as satisfying its users. Additionally, it could function as a safeguard for other AI systems.
The Canadian federal government is committing $150 million to LawZero, a non-profit organization founded by Bengio last year to develop models like Scientist AI. This marks the first instance of federal funding awarded to the organization. Germany is contributing an extra 100 million euros.
Canada and Germany will jointly invest up to $300 million CAD into LawZero, a non-profit founded by Canadian computer scientist Yoshua Bengio. This initiative aims to foster the development of a new form of safe AI as part of Canada’s ambition for ‘sovereign AI capability,’ according to Minister of Artificial Intelligence Evan Solomon.
“I approach this with a sense of urgency because I want my children and grandchildren to have a future,” Bengio stated during the All In conference, a significant meeting of AI experts in Montreal this week.
Fears regarding the dangers of AI have escalated, especially following a warning from a departing researcher at Anthropic — a leading AI company — who cautioned that AI might endanger humanity within the next ten years.
In a recent interview with Bloomberg, Prime Minister Mark Carney also advocated for the establishment of a global, independent entity to oversee and mitigate the risks posed by this technology.
-
Read more about LawZero: Can AI safeguard us against AI? One of its Canadian pioneers thinks so
-
Exclusive
Draft federal AI strategy aims to scale up adoption, offer literacy training by 2031
-
OpenAI flags 6 new examples of ‘concerning’ AI behaviour
Minister of Artificial Intelligence Evan Solomon remarked that the funding for LawZero represents part of Canada’s broader initiative to ensure responsible AI development.
“Our presence here today is not merely a reaction to recent headlines, but rather a response to our philosophical commitment to build in a responsible and safe manner,” he stated.
Safer by design?
Experts suggest that the challenges have already begun: controlling issues such as AI generating false information or acting without clear human consent will be a significant hurdle.
“There is currently no one-size-fits-all solution to this issue. We possess immensely powerful and potentially transformative AI systems,” commented Jaxson Khan, a specialist in AI policy and integration at the Munk School of Global Affairs, University of Toronto.
Both American and Chinese companies are deploying exceptionally advanced AI technologies, a trend that Khan believes will persist.
“At this moment, Canada feels a lack of control in the realm of AI,” he remarked.
Yet, collaborating with Germany to invest in LawZero remains a significant step, according to Khan.
“It’s essential to create alternatives that are ideally safer by design,” he emphasized.
“I am interested to see if this approach will be effective, but I believe it’s a valuable investment from the government and a strong partnership with Germany.”
Domestic capacity and partnerships
Experts highlight that forming alliances with countries sharing similar objectives and values is crucial.
This announcement coincided with a merger agreement between two AI firms, Canada’s Cohere and Germany’s Aleph Alpha.
“This can be viewed as building capacity,” commented Vass Bednar, managing director of the Canadian Shield Institute think-tank, regarding the merger.
-
AI ‘fearmongering’ could harm Canada’s rare opportunity, says top CEO
-
Analysis
One of the world’s biggest AI companies wants a deal with Canada. Is sovereignty the trade-off?
“We possess the ability to catch up and create alternatives. It’s crucial that we believe in this potential,” she remarked.
“We must not succumb to the notion that the technology’s rise and its associated risks are unavoidable.”
Khan suggests that adopting a multifaceted strategy might yield significant results.
Bengio insists that giving up is not an option.
“Achieving our objectives will not be straightforward,” he stated. “However, if we can make even a slight positive change in the world for humanity, we must make the effort.”
Tag: rewrite-pending


