Montréal · Public protest September 26 · Read the recap Warning Shot Protocol · Second activation An AI escaped its lab and hacked a real company

How far should we let AI advance?

What risks could advanced AI pose, and what can Canada do about them? Explore the research, proposals for a pause, and ways to get involved. Latest developments

Begin · 2 minutes

Choose what to explore

What would you like to understand?

Explore a question, read the short answer and add what interests you to your learning list.

Research

Book argument

What is the book’s argument about the AI you use today?

Read the explanation

The authors distinguish present chatbots from more capable future systems. Their argument concerns what happens if development reaches systems substantially more capable than humans. This is an argument about future risk, not a demonstrated outcome.

If Anyone Builds It · Introduction
?

Bookmarks are saved in this browser. Create an account to access your reading list on other devices.

Register
Research

Book argument

How could a digital AI system have effects outside a chat window?

Read the explanation

Software already influences physical events through people, networks and connected tools. The book argues that a much more capable system could use such channels in dangerous ways; the existence of those channels does not establish that every present system can do so.

If Anyone Builds It · Chapter 6
?

Bookmarks are saved in this browser. Create an account to access your reading list on other devices.

Register
Incidents

Evidence reading

What should you check before drawing a conclusion from an incident?

Read the explanation

A controlled test, a deployed incident and a forecast provide different kinds of evidence. Check the documented conditions and limitations before generalizing.

Warning shot · developments and sources
?

Bookmarks are saved in this browser. Create an account to access your reading list on other devices.

Register
Treaties and action

Policy proposal

Which question makes a treaty proposal more concrete?

Read the explanation

A proposal needs to specify what is limited, how compliance is checked and how violations are addressed. Explore those choices in our strategy.

PauseAI Canada strategy
?

Bookmarks are saved in this browser. Create an account to access your reading list on other devices.

Register
Research

Open discussion

Would a STOP button be enough to keep a very powerful AI under control?

Explore the STOP question

Explore four questions: how danger would be detected in time; who would have authority to stop the system; which copies and connected services would need stopping; and what tests would demonstrate reliable shutdown. Feasibility depends on the system and its deployment.

If Anyone Builds It · Can we just pull the plug?
?

Bookmarks are saved in this browser. Create an account to access your reading list on other devices.

Register
Research People and quotations

Interview

What does Bengio say surprised concerned researchers?

Read the explanation

Bengio says that even researchers concerned about AI risks were surprised by the pace of progress and the degree of misalignment observed. He does not give a certain date in this passage.

Bengio–Patrice Roy · Radio-Canada · 1:40–2:15 (French) (FR)
?

Bookmarks are saved in this browser. Create an account to access your reading list on other devices.

Register
Research People and quotations

Interview

Why could AI doing AI research change the pace of progress?

Read the explanation

Bengio discusses the possibility that AI could do AI research and accelerate progress. He also emphasizes uncertain timelines and the possibility of encountering obstacles.

Bengio–Patrice Roy · 19:31–20:47; uncertainty from 21:31 (French) (FR)
?

Bookmarks are saved in this browser. Create an account to access your reading list on other devices.

Register

My learning list

    Explore the library

    Stay informed

    Receive news about AI policy and ways to take part. Choose email updates first; location can wait until you want to organize locally.

    Subscribe
    Join or start a group Ways to take part Support our work

    Your starting point

    Where do you stand today?

    AI poses a genuine existential risk.
    01

    AI poses a genuine existential risk.

    A pause or treaty could materially reduce that risk.
    02

    A pause or treaty could materially reduce that risk.

    International coordination is politically achievable—countries can agree, comply, and enforce it.
    03

    International coordination is politically achievable—countries can agree, comply, and enforce it.

    Start where you have questions.

    Understand the risk

    Why do researchers discuss existential risk?

    How could people lose control of an AI system? Read an introduction to the risks researchers are studying.

    Read the source overview

    Source: PauseAI

    Bookmark
    ?

    Register to save this reading to your account and access it on other devices.

    Register

    Evaluate responses

    What would a pause actually mean?

    What would pause, what would continue, and how a pause differs from a blanket ban on AI.

    Examine the proposal

    Source: PauseAI

    Bookmark
    ?

    Register to save this reading to your account and access it on other devices.

    Register

    Test coordination

    Could a global treaty be verified?

    How inspections of advanced chips and data centres could help countries verify an agreement.

    Explore the mechanisms

    Source: PauseAI (in English)

    Bookmark
    ?

    Register to save this reading to your account and access it on other devices.

    Register

    Move toward action

    Why public support matters

    Letters, meetings and public events can show elected representatives that people want action on AI risks.

    Read the summary

    Source: PauseAI Canada

    Bookmark
    ?

    Register to save this reading to your account and access it on other devices.

    Register

    Stay informed

    Subscribe Create an account