An office manager pastes a client's payroll login into an AI chat box. In the Notion AI data breach, chats like that one were reached at a company Notion used, and Notion is telling customers to treat them as exposed.
If anyone in your business types into an AI tool, what they typed is kept somewhere. This week is the week to find out where.
A break-in at Fireworks AI reached Notion AI chats
Fireworks AI runs AI models for other software companies. Notion used it for part of Notion AI, including Insights, a feature that sorts how a workspace uses the AI, Notion's security advisory says.
Fireworks was broken into twice in October. The second time, on October 24, the attacker came in through a separate cloud company that hosted Fireworks' development machines, Fireworks' incident bulletin says.
Fireworks ties the attacks to a group that steals access to AI models and sells it for money. The trade has a name, LLMJacking.
What Notion says happened, day by day
On the evening of November 2, Fireworks told Notion that attackers had reached a small set of data. Notion found only test data. On November 3 it cut its systems off from Fireworks, and on November 4 it deleted all its data there.
On November 6, Fireworks came back: customer data may have been reached too. It confirmed which data on November 8, and Notion contacted the affected customers on November 9.
On November 11, Notion shut off Notion API keys it found inside the exposed messages. On November 12 it reported keys for other software to the companies that issued them, and SecurityWeek reported the breach that morning.
What was in the exposed chats
The exposed data is Notion AI chat transcripts from fewer than 1% of Notion workspaces. Notion has not said how many customers that is.
Notion's help page for customers lists what a transcript holds:
- the full text of what people typed, including any names, emails or API keys
- the full text of what the AI wrote back, which can include pieces of pages it read
- text a person highlighted on a page to ask about
Most transcripts had nothing tying them to a person, a company or a workspace. Notion says no other feature was affected, and Insights is switched off while it investigates.
A chat box feels like talking. It is writing, and someone keeps the paper.
One bookkeeping office and one pasted login
Take a bookkeeping office in Schuylkill Haven that keeps its client notes in Notion. On a busy Thursday, the office manager asks Notion AI why a client's payroll report will not load, and pastes the client's portal login to show the error.
Nobody in the office thinks of that chat as a document. It feels like asking the person at the next desk. The chat is saved, and Notion says chats like it were sent to Fireworks for the Insights feature.
If Notion's email reaches that office on November 9, the login is in the file. The owner changes the client's password, calls the client, and watches the inbox for anything using the client's name.
What to do about the Notion AI data breach this week
If your business uses Notion, start here:
- Look for an email from Notion around November 9. Notion says if it has not contacted you, it has not found your workspace affected and no action is needed now.
- If it has, the workspace owner can download the exposed chats from the help menu, under Security incident review, and read them.
- Change any password, API key or login anyone pasted into Notion AI. Start with the ones that reach money or customer records.
- Watch for emails that use names from those chats, most of all any about this breach that ask for a login.
Then ask the same question of every AI tool in the office, in writing: which outside companies get what we type? Notion's answer included Fireworks AI.
A Freeborn Digital agent keeps the data in your own system
Freeborn Digital builds AI agents into the software a business already uses. It is hosted where the owner chooses, on their own servers or by Freeborn Digital. The data stays in the system built for them and is used for nothing else.
For the Schuylkill Haven office, the agent that answers payroll questions reaches the payroll portal through its own access, set by its role. It sees only what that job needs, so nobody pastes a login into a chat to get help.
Every action the agent takes is logged with what it did, when, and what changed. The owner holds the accounts and the keys, can remove Freeborn Digital's access at any time, and picks which actions wait for a person, like emails to clients.
How an agent reads what comes in and decides what to do is told in the post on what an AI agent is for small business. Freeborn Digital builds this as AI agents, installs it, and keeps it running.
Questions about the Notion AI data breach
Was my Notion workspace part of the breach?
Notion contacted affected workspaces on November 9 and says fewer than 1% were hit. If you have no message from Notion, it has not found your workspace affected and says no action is needed now.
Should my business stop using Notion AI?
Notion says only the chat data used for Insights was affected, and it no longer sends that work to Fireworks. The bigger question is what your staff types into any AI tool. Keep passwords and client logins out of every chat.
What is LLMJacking?
Breaking into a company that runs AI models and selling the stolen access to the models. Fireworks ties the group behind its breach to this trade, and says the group does it for money.
Does an AI agent need my passwords?
It needs access to the software it works in, given by role, so it sees only what its job needs. You hold the accounts, you can remove access at any time, and every action it takes is logged.
The office manager only wanted a payroll report to load. Find out this week where your office's chats went. For an agent that works inside your own software, tell Freeborn Digital the job at freeborndigital.com/start or 570-617-7655.
Want this for your business?
Start a Project