AutomationFlowsWeb Scraping › Fetch Air Data to Backblaze B2

Fetch Air Data to Backblaze B2

Original n8n title: Openaq Airnow Gibs and Fetcher

OpenAQ-AirNow-GIBS-and-Fetcher. Uses httpRequest, s3, executeCommand. Scheduled trigger; 13 nodes.

Cron / scheduled trigger★★★★☆ complexity13 nodesHTTP RequestS3Execute Command
Web Scraping Trigger: Cron / scheduled Nodes: 13 Complexity: ★★★★☆ Added:

This workflow follows the Executecommand → HTTP Request recipe pattern — see all workflows that pair these two integrations.

The workflow JSON

Copy or download the full n8n JSON below. Paste it into a new n8n workflow, add your credentials, activate. Full import guide →

Download .json
{
  "name": "OpenAQ-AirNow-GIBS-and-Fetcher",
  "nodes": [
    {
      "parameters": {
        "triggerTimes": {
          "item": [
            {
              "hour": "*",
              "minute": "0",
              "second": "0"
            }
          ]
        }
      },
      "name": "Hourly Cron",
      "type": "n8n-nodes-base.cron",
      "typeVersion": 1,
      "position": [
        240,
        200
      ]
    },
    {
      "parameters": {
        "requestMethod": "GET",
        "url": "https://api.openaq.org/v3/measurements?country_id=162&parameter=pm25&limit=10000&date_from={{ $todayIso.split('T')[0] }}&date_to={{ $todayIso.split('T')[0] }}",
        "headerParameters": [
          {
            "name": "X-API-Key",
            "value": "{{$credentials.OPENAQ.key}}"
          }
        ],
        "responseFormat": "json"
      },
      "name": "Fetch OpenAQ",
      "type": "n8n-nodes-base.httpRequest",
      "typeVersion": 1,
      "position": [
        480,
        200
      ]
    },
    {
      "parameters": {
        "functionCode": "const results = items[0].json.results || [];\nreturn [{ json: { results } }];"
      },
      "name": "Normalize OpenAQ",
      "type": "n8n-nodes-base.function",
      "typeVersion": 1,
      "position": [
        720,
        200
      ]
    },
    {
      "parameters": {
        "operation": "upload",
        "resource": "file",
        "bucket": "<YOUR_BUCKET>",
        "binaryPropertyName": "data",
        "key": "raw/openaq/{{ $todayIso.split('T')[0] }}/openaq_{{ $now.toISOString().replace(/[:.]/g,'') }}.json"
      },
      "name": "Upload OpenAQ to B2",
      "type": "n8n-nodes-base.s3",
      "typeVersion": 1,
      "position": [
        980,
        200
      ],
      "credentials": {
        "s3Api": {
          "name": "<your credential>"
        }
      }
    },
    {
      "parameters": {
        "conditions": {
          "boolean": [
            {
              "value1": "={{ $json.results && $json.results.length > 0 }}",
              "operation": "isTrue"
            }
          ]
        }
      },
      "name": "Has OpenAQ Data?",
      "type": "n8n-nodes-base.if",
      "typeVersion": 1,
      "position": [
        1180,
        200
      ]
    },
    {
      "parameters": {
        "requestMethod": "GET",
        "url": "https://www.airnowapi.org/aq/observation/latLong/current/?format=application/json&latitude=30.0444&longitude=31.2357&distance=25&API_KEY={{ $credentials.AIRNOW.key }}",
        "responseFormat": "json"
      },
      "name": "Fetch AirNow (fallback)",
      "type": "n8n-nodes-base.httpRequest",
      "typeVersion": 1,
      "position": [
        1440,
        200
      ]
    },
    {
      "parameters": {
        "operation": "upload",
        "resource": "file",
        "bucket": "<YOUR_BUCKET>",
        "binaryPropertyName": "data",
        "key": "raw/airnow/{{ $todayIso.split('T')[0] }}/airnow_{{ $now.toISOString().replace(/[:.]/g,'') }}.json"
      },
      "name": "Upload AirNow to B2",
      "type": "n8n-nodes-base.s3",
      "typeVersion": 1,
      "position": [
        1680,
        200
      ],
      "credentials": {
        "s3Api": {
          "name": "<your credential>"
        }
      }
    },
    {
      "parameters": {
        "triggerTimes": {
          "item": [
            {
              "hour": "3",
              "minute": "0",
              "second": "0"
            }
          ]
        }
      },
      "name": "Daily Fetch Cron",
      "type": "n8n-nodes-base.cron",
      "typeVersion": 1,
      "position": [
        240,
        520
      ]
    },
    {
      "parameters": {
        "httpMethod": "POST",
        "path": "run-fetcher",
        "responseMode": "lastNode",
        "options": {}
      },
      "name": "Fetcher Webhook",
      "type": "n8n-nodes-base.webhook",
      "typeVersion": 1,
      "position": [
        480,
        520
      ]
    },
    {
      "parameters": {
        "command": "python /home/runner/airquality/scripts/cloud_fetcher_b2.py --date_from {{ $todayIso.split('T')[0] }} --date_to {{ $todayIso.split('T')[0] }}",
        "options": {}
      },
      "name": "Execute Fetcher",
      "type": "n8n-nodes-base.executeCommand",
      "typeVersion": 1,
      "position": [
        720,
        520
      ]
    },
    {
      "parameters": {
        "triggerTimes": {
          "item": [
            {
              "hour": "2",
              "minute": "0",
              "second": "0"
            }
          ]
        }
      },
      "name": "Daily GIBS Cron",
      "type": "n8n-nodes-base.cron",
      "typeVersion": 1,
      "position": [
        240,
        800
      ]
    },
    {
      "parameters": {
        "requestMethod": "GET",
        "url": "https://gibs.earthdata.nasa.gov/wmts/epsg3857/best/VIIRS_SNPP_NO2_Column_Density/default/{{ $todayIso.split('T')[0] }}/6/24/12.png",
        "responseFormat": "file"
      },
      "name": "Fetch GIBS Tile",
      "type": "n8n-nodes-base.httpRequest",
      "typeVersion": 1,
      "position": [
        480,
        800
      ]
    },
    {
      "parameters": {
        "operation": "upload",
        "resource": "file",
        "bucket": "<YOUR_BUCKET>",
        "binaryPropertyName": "data",
        "key": "raw/gibs/no2/{{ $todayIso.split('T')[0] }}/tile.png"
      },
      "name": "Upload GIBS to B2",
      "type": "n8n-nodes-base.s3",
      "typeVersion": 1,
      "position": [
        720,
        800
      ],
      "credentials": {
        "s3Api": {
          "name": "<your credential>"
        }
      }
    }
  ],
  "connections": {
    "Hourly Cron": {
      "main": [
        [
          {
            "node": "Fetch OpenAQ",
            "type": "main",
            "index": 0
          }
        ]
      ]
    },
    "Fetch OpenAQ": {
      "main": [
        [
          {
            "node": "Normalize OpenAQ",
            "type": "main",
            "index": 0
          }
        ]
      ]
    },
    "Normalize OpenAQ": {
      "main": [
        [
          {
            "node": "Upload OpenAQ to B2",
            "type": "main",
            "index": 0
          },
          {
            "node": "Has OpenAQ Data?",
            "type": "main",
            "index": 0
          }
        ]
      ]
    },
    "Has OpenAQ Data?": {
      "main": [
        [
          {
            "node": "Execute Fetcher",
            "type": "main",
            "index": 1
          },
          {
            "node": "Pass-through",
            "type": "main",
            "index": 0
          }
        ]
      ]
    },
    "Fetch AirNow (fallback)": {
      "main": [
        [
          {
            "node": "Upload AirNow to B2",
            "type": "main",
            "index": 0
          }
        ]
      ]
    },
    "Daily Fetch Cron": {
      "main": [
        [
          {
            "node": "Fetcher Webhook",
            "type": "main",
            "index": 0
          }
        ]
      ]
    },
    "Fetcher Webhook": {
      "main": [
        [
          {
            "node": "Execute Fetcher",
            "type": "main",
            "index": 0
          }
        ]
      ]
    },
    "Daily GIBS Cron": {
      "main": [
        [
          {
            "node": "Fetch GIBS Tile",
            "type": "main",
            "index": 0
          }
        ]
      ]
    },
    "Fetch GIBS Tile": {
      "main": [
        [
          {
            "node": "Upload GIBS to B2",
            "type": "main",
            "index": 0
          }
        ]
      ]
    }
  }
}

Credentials you'll need

Each integration node will prompt for credentials when you import. We strip credential IDs before publishing — you'll add your own.

Pro

For the full experience including quality scoring and batch install features for each workflow upgrade to Pro

About this workflow

OpenAQ-AirNow-GIBS-and-Fetcher. Uses httpRequest, s3, executeCommand. Scheduled trigger; 13 nodes.

Source: https://github.com/ArsanyOsama/Air-Sight/blob/ff2e21e712e38830895689dec13c65fdb6fc5f84/n8n/openaq_airnow_gibs.json — original creator credit. Request a take-down →

More Web Scraping workflows → · Browse all categories →

Related workflows

Workflows that share integrations, category, or trigger type with this one. All free to copy and import.

Web Scraping

Track Changes Of Product Prices. Uses htmlExtract, functionItem, httpRequest, writeBinaryFile. Scheduled trigger; 25 nodes.

Html Extract, Function Item, HTTP Request +5
Web Scraping

This workflow automatically tracks changes on specific websites, typically in e-commerce where you want to get information about price changes. Basic knowledge of HTML and JavaScript Execute Command n

Html Extract, Function Item, HTTP Request +5
Web Scraping

Track changes of product prices. Uses htmlExtract, functionItem, httpRequest, writeBinaryFile. Scheduled trigger; 25 nodes.

Html Extract, Function Item, HTTP Request +5
Web Scraping

main_flow. Uses readWriteFile, executeCommand, httpRequest. Scheduled trigger; 18 nodes.

Read Write File, Execute Command, HTTP Request
Web Scraping

respaldo_automatico. Uses dataTable, n8n-nodes-sshv2, httpRequest, readWriteFile. Scheduled trigger; 14 nodes.

Data Table, N8N Nodes Sshv2, HTTP Request +2