AutomationFlowsWeb Scraping › Automated Airspace Snapshot Pipeline

Automated Airspace Snapshot Pipeline

Original n8n title: Airspace Snapshot Pipeline

Airspace Snapshot Pipeline. Uses httpRequest, writeBinaryFile. Scheduled trigger; 11 nodes.

Cron / scheduled trigger★★★★☆ complexity11 nodesHTTP RequestWrite Binary File
Web Scraping Trigger: Cron / scheduled Nodes: 11 Complexity: ★★★★☆ Added:

The workflow JSON

Copy or download the full n8n JSON below. Paste it into a new n8n workflow, add your credentials, activate. Full import guide →

Download .json
{
  "name": "Airspace Snapshot Pipeline",
  "active": true,
  "settings": {
    "timezone": "UTC"
  },
  "nodes": [
    {
      "parameters": {
        "triggerTimes": [
          {
            "mode": "everyMinute",
            "minutes": 1
          }
        ]
      },
      "id": "Cron",
      "name": "Cron Trigger",
      "type": "n8n-nodes-base.cron",
      "typeVersion": 1,
      "position": [
        250,
        300
      ]
    },
    {
      "parameters": {
        "method": "GET",
        "url": "https://opensky-network.org/api/states/all",
        "queryParameters": [
          {
            "name": "lamin",
            "value": "40"
          },
          {
            "name": "lomin",
            "value": "-75"
          },
          {
            "name": "lamax",
            "value": "42"
          },
          {
            "name": "lomax",
            "value": "-72"
          }
        ],
        "responseFormat": "json",
        "options": {
          "retryOnFail": true,
          "maxAttempts": 3
        }
      },
      "id": "OpenSky",
      "name": "OpenSky Request",
      "type": "n8n-nodes-base.httpRequest",
      "typeVersion": 4,
      "position": [
        500,
        300
      ]
    },
    {
      "parameters": {
        "functionCode": "const fieldMap = [\n  ['icao24', 0],\n  ['callsign', 1],\n  ['origin_country', 2],\n  ['time_position', 3],\n  ['last_contact', 4],\n  ['longitude', 5],\n  ['latitude', 6],\n  ['baro_altitude', 7],\n  ['on_ground', 8],\n  ['velocity', 9],\n  ['true_track', 10],\n  ['vertical_rate', 11],\n  ['sensors', 12],\n  ['geo_altitude', 13],\n  ['squawk', 14],\n  ['spi', 15],\n  ['position_source', 16],\n  ['category', 17]\n];\nconst seen = new Map();\n(items[0].json.states || []).forEach(row => {\n  const doc = {};\n  fieldMap.forEach(([field, idx]) => { doc[field] = row[idx] ?? null; });\n  doc.heading = doc.true_track;\n  doc.altitude = doc.geo_altitude ?? doc.baro_altitude ?? null;\n  if (typeof doc.callsign === 'string') {\n    doc.callsign = doc.callsign.trim();\n  }\n  const key = doc.callsign || doc.icao24 || Math.random().toString();\n  if (!seen.has(key)) {\n    seen.set(key, doc);\n  }\n});\nreturn Array.from(seen.values()).map(state => ({ json: state }));"
      },
      "id": "Normalize",
      "name": "Normalize States",
      "type": "n8n-nodes-base.function",
      "typeVersion": 1,
      "position": [
        750,
        300
      ]
    },
    {
      "parameters": {
        "functionCode": "const region = 'region1';\nconst now = new Date().toISOString();\nconst snapshot = {\n  region,\n  last_updated: now,\n  bounds: { min_lat: 40, max_lat: 42, min_lon: -75, max_lon: -72 },\n  states: items.map(item => item.json)\n};\nreturn [{ json: snapshot }];"
      },
      "id": "Snapshot",
      "name": "Build Snapshot",
      "type": "n8n-nodes-base.function",
      "typeVersion": 1,
      "position": [
        1000,
        300
      ]
    },
    {
      "parameters": {
        "functionCode": "return items.map(item => ({ json: item.json, binary: { data: { data: Buffer.from(JSON.stringify(item.json, null, 2)).toString('base64'), mimeType: 'application/json' } } }));"
      },
      "id": "ToBinary",
      "name": "Snapshot To Binary",
      "type": "n8n-nodes-base.function",
      "typeVersion": 1,
      "position": [
        1250,
        300
      ]
    },
    {
      "parameters": {
        "fileName": "./data/snapshots/region1.json",
        "binaryData": true,
        "binaryPropertyName": "data"
      },
      "id": "WriteFile",
      "name": "Write Snapshot",
      "type": "n8n-nodes-base.writeBinaryFile",
      "typeVersion": 1,
      "position": [
        1500,
        300
      ]
    },
    {
      "parameters": {
        "functionCode": "const snapshot = items[0].json || {};\nconst region = snapshot.region || 'region1';\nconst detectionTime = snapshot.last_updated || new Date().toISOString();\nconst states = snapshot.states || [];\nconst alerts = [];\nconst normalizeCallsign = (value) => {\n  if (!value) { return 'UNKNOWN'; }\n  const trimmed = String(value).trim();\n  return trimmed || 'UNKNOWN';\n};\nconst slugify = (value) => normalizeCallsign(value).replace(/[^A-Z0-9]/gi, '').slice(0, 6) || 'UNK';\nconst pushAlert = (state, type, severity, message, details = {}) => {\n  const callsign = normalizeCallsign(state.callsign || state.icao24);\n  const idSuffix = String(alerts.length + 1).padStart(2, '0');\n  alerts.push({\n    id: `ALERT-${slugify(callsign)}-${type}-${idSuffix}`.toUpperCase(),\n    region,\n    callsign,\n    icao24: state.icao24 || null,\n    type,\n    severity,\n    message,\n    detected_at: detectionTime,\n    telemetry: {\n      altitude: state.geo_altitude ?? state.baro_altitude ?? null,\n      velocity: state.velocity ?? null,\n      on_ground: state.on_ground ?? null\n    },\n    details\n  });\n};\nstates.forEach(state => {\n  const velocity = typeof state.velocity === 'number' ? state.velocity : null;\n  if (velocity !== null && velocity > 280) {\n    pushAlert(state, 'HIGH_VELOCITY', 'high', `Velocity ${velocity.toFixed(0)} m/s exceeds threshold.`, { velocity });\n  }\n  const baro = typeof state.baro_altitude === 'number' ? state.baro_altitude : null;\n  if (baro !== null && baro < 300 && state.on_ground === false) {\n    pushAlert(state, 'LOW_ALTITUDE', 'medium', `Altitude ${Math.round(baro)} m while airborne.`, { altitude: baro });\n  }\n  const hasLatency = typeof state.last_contact === 'number' && typeof state.time_position === 'number';\n  if (hasLatency) {\n    const latency = state.last_contact - state.time_position;\n    if (latency > 45) {\n      pushAlert(state, 'STALE_TELEMETRY', 'medium', `Telemetry delayed by ${Math.round(latency)}s.`, { latency });\n    }\n  }\n  if (state.latitude == null || state.longitude == null) {\n    pushAlert(state, 'MISSING_POSITION', 'low', 'Missing latest latitude/longitude fix.');\n  }\n});\nreturn [{ json: { last_updated: detectionTime, alerts } }];"
      },
      "id": "Alerts",
      "name": "Detect Alerts",
      "type": "n8n-nodes-base.function",
      "typeVersion": 1,
      "position": [
        1000,
        520
      ]
    },
    {
      "parameters": {
        "functionCode": "return items.map(item => ({ json: item.json, binary: { data: { data: Buffer.from(JSON.stringify(item.json, null, 2)).toString('base64'), mimeType: 'application/json' } } }));"
      },
      "id": "AlertsBinary",
      "name": "Alerts To Binary",
      "type": "n8n-nodes-base.function",
      "typeVersion": 1,
      "position": [
        1250,
        520
      ]
    },
    {
      "parameters": {
        "fileName": "./data/alerts.json",
        "binaryData": true,
        "binaryPropertyName": "data"
      },
      "id": "WriteAlerts",
      "name": "Write Alerts",
      "type": "n8n-nodes-base.writeBinaryFile",
      "typeVersion": 1,
      "position": [
        1500,
        520
      ]
    },
    {
      "parameters": {
        "httpMethod": "GET",
        "path": "latest-region/:region",
        "options": {
          "responseContentType": "application/json"
        }
      },
      "id": "Webhook",
      "name": "Latest Snapshot Webhook",
      "type": "n8n-nodes-base.webhook",
      "typeVersion": 1,
      "position": [
        1000,
        650
      ]
    },
    {
      "parameters": {
        "functionCode": "const fs = require('fs');\nconst params = $json.params || {};\nconst region = (params.region || $json.query.region || 'region1').toLowerCase();\nconst path = `./data/snapshots/${region}.json`;\nif (!fs.existsSync(path)) {\n  return [{ json: { error: `region ${region} snapshot missing`, fallback: true } }];\n}\nconst payload = JSON.parse(fs.readFileSync(path, 'utf8'));\nreturn [{ json: payload }];"
      },
      "id": "ReadSnapshot",
      "name": "Read Snapshot",
      "type": "n8n-nodes-base.function",
      "typeVersion": 1,
      "position": [
        1250,
        650
      ]
    }
  ],
  "connections": {
    "Cron Trigger": {
      "main": [
        [
          {
            "node": "OpenSky Request",
            "type": "main",
            "index": 0
          }
        ]
      ]
    },
    "OpenSky Request": {
      "main": [
        [
          {
            "node": "Normalize States",
            "type": "main",
            "index": 0
          }
        ]
      ]
    },
    "Normalize States": {
      "main": [
        [
          {
            "node": "Build Snapshot",
            "type": "main",
            "index": 0
          }
        ]
      ]
    },
    "Build Snapshot": {
      "main": [
        [
          {
            "node": "Snapshot To Binary",
            "type": "main",
            "index": 0
          },
          {
            "node": "Detect Alerts",
            "type": "main",
            "index": 0
          }
        ]
      ]
    },
    "Snapshot To Binary": {
      "main": [
        [
          {
            "node": "Write Snapshot",
            "type": "main",
            "index": 0
          }
        ]
      ]
    },
    "Detect Alerts": {
      "main": [
        [
          {
            "node": "Alerts To Binary",
            "type": "main",
            "index": 0
          }
        ]
      ]
    },
    "Alerts To Binary": {
      "main": [
        [
          {
            "node": "Write Alerts",
            "type": "main",
            "index": 0
          }
        ]
      ]
    },
    "Latest Snapshot Webhook": {
      "main": [
        [
          {
            "node": "Read Snapshot",
            "type": "main",
            "index": 0
          }
        ]
      ]
    }
  }
}
Pro

For the full experience including quality scoring and batch install features for each workflow upgrade to Pro

About this workflow

Airspace Snapshot Pipeline. Uses httpRequest, writeBinaryFile. Scheduled trigger; 11 nodes.

Source: https://github.com/mtalal517/Airspace-Copilot/blob/26209165aa9ed5b95fb56ad22a5112e0217eeaf8/n8n/airspace_workflow.json — original creator credit. Request a take-down →

More Web Scraping workflows → · Browse all categories →

Related workflows

Workflows that share integrations, category, or trigger type with this one. All free to copy and import.

Web Scraping

Track Changes Of Product Prices. Uses htmlExtract, functionItem, httpRequest, writeBinaryFile. Scheduled trigger; 25 nodes.

Html Extract, Function Item, HTTP Request +5
Web Scraping

This workflow automatically tracks changes on specific websites, typically in e-commerce where you want to get information about price changes. Basic knowledge of HTML and JavaScript Execute Command n

Html Extract, Function Item, HTTP Request +5
Web Scraping

Testflow1. Uses httpRequest, readBinaryFiles, executeCommand, writeBinaryFile. Scheduled trigger; 11 nodes.

HTTP Request, Read Binary Files, Execute Command +1
Web Scraping

As n8n instances scale, teams often lose track of sub-workflows—who uses them, where they are referenced, and whether they can be safely updated. This leads to inefficiencies like unnecessary copies o

HTTP Request, n8n, N8N Trigger +1
Web Scraping

This workflow is an improvement of this workflow by Greg Brzezinka.

HTTP Request, Email Send, XML +1