Scheduled Data Ingestion and Analytics

The workflow JSON

Copy or download the full n8n JSON below. Paste it into a new n8n workflow, add your credentials, activate. Full import guide →

{
  "name": "\ud83d\udcc5 Scheduled Ingestion + Analytics",
  "nodes": [
    {
      "parameters": {
        "triggerTimes": [
          {
            "cronExpression": "0 */1 * * *"
          }
        ]
      },
      "name": "Cron Trigger",
      "type": "n8n-nodes-base.cron",
      "typeVersion": 1,
      "position": [
        300,
        300
      ]
    },
    {
      "parameters": {
        "requestMethod": "POST",
        "url": "http://host.docker.internal:8002/ingest",
        "jsonParameters": true,
        "options": {
          "retryOnFail": true,
          "maxRetries": 3
        }
      },
      "name": "Trigger Ingestion",
      "type": "n8n-nodes-base.httpRequest",
      "typeVersion": 2,
      "position": [
        600,
        300
      ]
    },
    {
      "parameters": {
        "requestMethod": "POST",
        "url": "http://host.docker.internal:8003/analyze",
        "jsonParameters": true,
        "options": {
          "retryOnFail": true,
          "maxRetries": 3
        }
      },
      "name": "Run Analytics",
      "type": "n8n-nodes-base.httpRequest",
      "typeVersion": 2,
      "position": [
        900,
        300
      ]
    },
    {
      "parameters": {
        "text": "=Ingestion: {{ $input.all()[0].json.records_ingested }} records. Analytics: Avg {{ $input.all()[1].json.insights.average_value }}."
      },
      "name": "Console Log",
      "type": "n8n-nodes-base.set",
      "typeVersion": 1,
      "position": [
        1200,
        300
      ]
    }
  ],
  "connections": {
    "Cron Trigger": {
      "main": [
        [
          {
            "node": "Trigger Ingestion"
          }
        ]
      ]
    },
    "Trigger Ingestion": {
      "main": [
        [
          {
            "node": "Run Analytics"
          }
        ]
      ]
    },
    "Run Analytics": {
      "main": [
        [
          {
            "node": "Console Log"
          }
        ]
      ]
    }
  },
  "active": true,
  "settings": {}
}

About this workflow

📅 Scheduled Ingestion + Analytics. Uses httpRequest. Scheduled trigger; 4 nodes.

Source: https://github.com/vagulans/ai-platform/blob/965d60c2bd5d7380ee7c94d3f39799d877e0641d/n8n-workflows/01-ingest-and-analyze.json — original creator credit. Request a take-down →

More Web Scraping workflows → · Browse all categories →

Related workflows

Workflows that share integrations, category, or trigger type with this one. All free to copy and import.