My Data, Recipes & Export

Every run is saved automatically in My data, on your computer. Open it from the My data link at the top of the home screen.

My Data

The Data tab lists your datasets, newest first. Each card shows where the data came from, how many rows it has, and when it was saved.

CrawlPilot's My data screen with one dataset, "laptop - Walmart.com · list", and its Open, Download and Run again buttons
Every run is a card: open it, download it, or run it again.
ActionHow
OpenOpens the dataset in the full table, in a new tab
DownloadDownloads every row as CSV
Run againRepeats the run with the same settings, for example to check prices every week
Save as recipe and moreThe ⋮ menu on the card

Recipes

A recipe is a run you've saved so you can use it again, on the same page or on new URLs. To make one, open a card's ⋮ menu in Data, choose Save as recipe, and give it a name.

The Recipes tab with the ready-made ZARA and UNIQLO product-details recipes, each with a Run button
Ready-made recipes are listed even before your first run.
  • Run starts the recipe again. For a page recipe you can give it new URLs to read.
  • Rename a recipe from its card.
  • Each card shows the recipe's health (Healthy, Check or Broken), so you can spot one that has stopped working after a site changed.
  • Ready-made recipes, such as ZARA and UNIQLO product details, work without any setup.

The Data Table

Open a dataset (or click See your table after a run) to work with it in a full tab.

The data table of 45 Walmart laptops, 16 columns, with the Export menu open
Sort, filter, clean, then export.
  • Sort by clicking a column header. Filters narrows the rows.
  • Edit a cell by clicking it. Edits are saved and included in exports.
  • Each column header has buttons to transform, rename or delete the column. Merge Columns and Auto-type in the toolbar help clean up columns.
  • Source opens the page the data came from.

The table shows the first 2,000 rows. Exports always include every row.

Export

Click Export at the top right:

OptionWhat you get
Excel (.xlsx)A spreadsheet file
CSVA comma-separated file for any tool
JSONAn array of rows
JSON to a schema…JSON shaped to a structure you define
Send to Google SheetsRows sent to a sheet you own, kept up to date as new rows arrive. Connect it in Settings
Webhook, Airtable, ZapierRows sent straight from your browser to the address you set in Settings

Datasets with article text (from Same details from many pages) can also be exported as Markdown files (.zip) or JSONL for LLMs.

Storage

All data lives in your browser's local database. Nothing is uploaded, and there's no cloud backup. Export the datasets you need to keep, and use Settings → Data & Storage to see how much space you're using and to clear old data automatically.