History & Data Table

History

The History tab shows every extraction job you've run — completed, running, paused, or failed.

What You Can Do

ActionHow
View job detailsSee source URL, timestamp, item count, and tool used
View dataOpen the data table for any completed job
Re-run a jobClick Re-run to repeat a job with the same configuration
Stop a running jobClick Stop on any in-progress job
Delete a jobClick the delete icon — removes the job record and all its rows

Job Statuses

StatusMeaning
RunningExtraction is actively in progress
CompletedAll data collected successfully
PausedExtraction was stopped manually; data collected so far is saved
FailedJob encountered an error that could not be recovered

Re-Running Jobs

Re-running repeats the extraction with the same selectors, pagination settings, and configuration. This is useful for:

  • Weekly price monitoring on the same category page
  • Refreshing a dataset when the source page updates
  • Retrying a failed job after fixing the underlying issue

New rows are appended to the existing dataset. Duplicates are automatically filtered out at the database level, so re-running is safe and won't create double entries.


Data Table

The Data Table opens in a new tab for a full-screen data management experience. Access it by clicking View Data from History or after any extraction.

Grid View

Data appears in a spreadsheet-style grid with:

  • Column headers matching your extraction schema (Title, Price, URL, etc.)
  • Sortable columns — click any header to sort ascending/descending
  • Filterable columns — type in the column filter input to narrow rows
  • Row count shown in the bottom status bar

Editing Data

  • Edit a cell: Click any cell to enter edit mode, type your change, press Enter to save
  • Delete a row: Click the row's delete icon on the right side

Changes save immediately to local IndexedDB.

Merging Datasets

If you ran multiple extraction jobs on different pages of the same site, you can combine them:

  1. 02
    Open the Data Table for one job.
  2. 04
    Click Merge Dataset.
  3. 06
    Select another job from the dropdown.
  4. 08
    Rows from both jobs are combined into one table. Duplicate rows are filtered automatically.

Exporting Data

Click Export CSV to download all visible rows as a .csv file.

  • The filename is crawlpilot-[job-name]-[date].csv
  • All columns in the current schema are included
  • Filtered rows are excluded from the export (only what's visible is exported)
Pro Tip
To export everything, clear all column filters before clicking Export CSV.

Storage

All data lives in your browser's IndexedDB. There is no cloud backup. To avoid losing data:

  • Export CSV regularly for important datasets
  • Use Settings → Storage Management to monitor usage and set retention policies