Back

AI integration

The Notion AI data breach exposed chats. What did you paste?

The Notion AI data breach exposed AI chat transcripts from under 1% of workspaces. What happened, and what to change this week.

A person in a white mask sitting at a laptop in a dark room lit blue

An office manager pastes a client's payroll login into an AI chat box. In the Notion AI data breach, chats like that one were reached at a company Notion used, and Notion is telling customers to treat them as exposed.

If anyone in your business types into an AI tool, what they typed is kept somewhere. This week is the week to find out where.

A break-in at Fireworks AI reached Notion AI chats

Fireworks AI runs AI models for other software companies. Notion used it for part of Notion AI, including Insights, a feature that sorts how a workspace uses the AI, Notion's security advisory says.

Fireworks was broken into twice in October. The second time, on October 24, the attacker came in through a separate cloud company that hosted Fireworks' development machines, Fireworks' incident bulletin says.

Fireworks ties the attacks to a group that steals access to AI models and sells it for money. The trade has a name, LLMJacking.

What Notion says happened, day by day

On the evening of November 2, Fireworks told Notion that attackers had reached a small set of data. Notion found only test data. On November 3 it cut its systems off from Fireworks, and on November 4 it deleted all its data there.

On November 6, Fireworks came back: customer data may have been reached too. It confirmed which data on November 8, and Notion contacted the affected customers on November 9.

On November 11, Notion shut off Notion API keys it found inside the exposed messages. On November 12 it reported keys for other software to the companies that issued them, and SecurityWeek reported the breach that morning.

What was in the exposed chats

The exposed data is Notion AI chat transcripts from fewer than 1% of Notion workspaces. Notion has not said how many customers that is.

Notion's help page for customers lists what a transcript holds:

  • the full text of what people typed, including any names, emails or API keys
  • the full text of what the AI wrote back, which can include pieces of pages it read
  • text a person highlighted on a page to ask about

Most transcripts had nothing tying them to a person, a company or a workspace. Notion says no other feature was affected, and Insights is switched off while it investigates.

A chat box feels like talking. It is writing, and someone keeps the paper.

One bookkeeping office and one pasted login

Take a bookkeeping office in Schuylkill Haven that keeps its client notes in Notion. On a busy Thursday, the office manager asks Notion AI why a client's payroll report will not load, and pastes the client's portal login to show the error.

Nobody in the office thinks of that chat as a document. It feels like asking the person at the next desk. The chat is saved, and Notion says chats like it were sent to Fireworks for the Insights feature.

If Notion's email reaches that office on November 9, the login is in the file. The owner changes the client's password, calls the client, and watches the inbox for anything using the client's name.

What to do about the Notion AI data breach this week

If your business uses Notion, start here:

  • Look for an email from Notion around November 9. Notion says if it has not contacted you, it has not found your workspace affected and no action is needed now.
  • If it has, the workspace owner can download the exposed chats from the help menu, under Security incident review, and read them.
  • Change any password, API key or login anyone pasted into Notion AI. Start with the ones that reach money or customer records.
  • Watch for emails that use names from those chats, most of all any about this breach that ask for a login.

Then ask the same question of every AI tool in the office, in writing: which outside companies get what we type? Notion's answer included Fireworks AI.

A Freeborn Digital agent keeps the data in your own system

Freeborn Digital builds AI agents into the software a business already uses. It is hosted where the owner chooses, on their own servers or by Freeborn Digital. The data stays in the system built for them and is used for nothing else.

For the Schuylkill Haven office, the agent that answers payroll questions reaches the payroll portal through its own access, set by its role. It sees only what that job needs, so nobody pastes a login into a chat to get help.

Every action the agent takes is logged with what it did, when, and what changed. The owner holds the accounts and the keys, can remove Freeborn Digital's access at any time, and picks which actions wait for a person, like emails to clients.

How an agent reads what comes in and decides what to do is told in the post on what an AI agent is for small business. Freeborn Digital builds this as AI agents, installs it, and keeps it running.

Questions about the Notion AI data breach

Was my Notion workspace part of the breach?

Notion contacted affected workspaces on November 9 and says fewer than 1% were hit. If you have no message from Notion, it has not found your workspace affected and says no action is needed now.

Should my business stop using Notion AI?

Notion says only the chat data used for Insights was affected, and it no longer sends that work to Fireworks. The bigger question is what your staff types into any AI tool. Keep passwords and client logins out of every chat.

What is LLMJacking?

Breaking into a company that runs AI models and selling the stolen access to the models. Fireworks ties the group behind its breach to this trade, and says the group does it for money.

Does an AI agent need my passwords?

It needs access to the software it works in, given by role, so it sees only what its job needs. You hold the accounts, you can remove access at any time, and every action it takes is logged.

The office manager only wanted a payroll report to load. Find out this week where your office's chats went. For an agent that works inside your own software, tell Freeborn Digital the job at freeborndigital.com/start or 570-617-7655.

Want this for your business?

Start a Project

Start a project

Tell Freeborn Digital what slows you down. You'll see what to build first.

You do not need a specification. A few lines about your business and the work that eats your week is enough to start.

  • Compatible with all systems and software, in any industry
  • Your software and your data stay yours
  • Installed inside the tools you already use

Prefer call? 570-617-7655

Prefer text? 570-617-7655

Prefer email? riley@freeborndigital.com

Where are you starting?

What are you interested in? (pick any)

Freeborn Digital replies by email. Your details are used only to answer you. Privacy policy

Received

Freeborn Digital reads it and replies by email.

Common questions

Questions about the blog

What is the Freeborn Digital blog about?

The three things Freeborn Digital builds: AI integration, custom software and custom websites. Each post explains one of them the way a business owner would ask about it.

Who writes it?

Freeborn Digital. The posts come from its own builds and from the questions business owners ask before they start a project.

Can I ask for a topic?

Yes. Send the question through the form on this page or by email, and it goes on the list.

Can I share a post?

Share the link anywhere. The text and images belong to Freeborn Digital LLC, so copying them somewhere else needs written permission.

I read something here and want it for my business. Where do I start?

The Start a Project form on this page. A few lines about your business and what slows you down is enough. Freeborn Digital reads it and emails you to set a call.

What happens after I start a project?

Freeborn Digital reads it and emails you to set a call. On the call you walk through how the business runs and what eats the week, and the first build is mapped. Then Freeborn Digital builds it, installs it, and keeps it running.

Start with AI Integration, Custom Software, or Custom Websites.

Start a Project