AutomationFlowsWeb Scraping › Pipeline A

Pipeline A

Pipeline A. Uses httpRequest. Webhook trigger; 3 nodes.

Webhook trigger★★★★☆ complexity3 nodesHTTP Request
Web Scraping Trigger: Webhook Nodes: 3 Complexity: ★★★★☆ Added:

The workflow JSON

Copy or download the full n8n JSON below. Paste it into a new n8n workflow, add your credentials, activate. Full import guide →

Download .json
{
  "nodes": [
    {
      "parameters": {
        "path": "webhook-demo",
        "httpMethod": "POST"
      },
      "id": "WebhookDemo",
      "type": "n8n-nodes-base.webhook",
      "typeVersion": 1,
      "position": [
        240,
        120
      ]
    },
    {
      "parameters": {
        "command": "python3",
        "functionCode": "import sys, subprocess, os, json\n\n# Expected payload:\n# { \"account_id\": \"demo_001\", \"transcript_path\": \"data/demo/demo_001.txt\" }\npayload = $json\naccount_id = payload[\"account_id\"]\ntranscript_path = payload[\"transcript_path\"]\n\n# Run extraction script\nresult = subprocess.run([\"scripts/extract_memo.py\", transcript_path, account_id], capture_output=True, text=True)\nif result.returncode != 0:\n    raise Exception(f\"Extraction failed: {result.stderr}\")\nmemo_json = result.stdout\n\n# Save memo JSON to output folder\nout_path = f\"outputs/accounts/{account_id}/v1/memo.json\"\nos.makedirs(os.path.dirname(out_path), exist_ok=True)\nwith open(out_path, \"w\") as f:\n    f.write(memo_json)\n\n# Render agent spec (v1)\nsubprocess.run([\"scripts/render_agent_spec.py\", out_path, \"v1\", f\"outputs/accounts/{account_id}/v1/agent_spec.yaml\"], check=True)\n\n# (Optional) create Asana task \u2013 use a tiny HTTP request node later\n\nreturn {\n  \"json\": {\n    \"status\": \"ok\",\n    \"account_id\": account_id,\n    \"memo_path\": out_path,\n    \"spec_path\": f\"outputs/accounts/{account_id}/v1/agent_spec.yaml\"\n  }\n}\n"
      },
      "name": "Run Demo Extraction",
      "type": "n8n-nodes-base.function",
      "typeVersion": 1,
      "position": [
        560,
        120
      ],
      "id": "RunDemoExtraction"
    },
    {
      "parameters": {},
      "name": "Asana Task (optional)",
      "type": "n8n-nodes-base.httpRequest",
      "typeVersion": 1,
      "position": [
        860,
        120
      ],
      "id": "CreateAsanaTask",
      "credentials": {
        "httpBasicAuth": "<your credential>"
      },
      "executeOnce": true,
      "notes": "If you want a task per account, fill in your Asana PAT and workspace/project IDs."
    }
  ],
  "connections": {
    "WebhookDemo": {
      "main": [
        [
          {
            "node": "Run Demo Extraction",
            "type": "main",
            "index": 0
          }
        ]
      ]
    },
    "Run Demo Extraction": {
      "main": [
        [
          {
            "node": "Create AsanaTask",
            "type": "main",
            "index": 0
          }
        ]
      ]
    }
  },
  "active": true,
  "settings": {},
  "id": "1"
}

Credentials you'll need

Each integration node will prompt for credentials when you import. We strip credential IDs before publishing — you'll add your own.

Pro

For the full experience including quality scoring and batch install features for each workflow upgrade to Pro

About this workflow

Pipeline A. Uses httpRequest. Webhook trigger; 3 nodes.

Source: https://github.com/Sree2k3/Clara_pipeline/blob/d6bd34d48edf49dd3273095b199aa028041fac41/workflows/pipeline_a.json — original creator credit. Request a take-down →

More Web Scraping workflows → · Browse all categories →

Related workflows

Workflows that share integrations, category, or trigger type with this one. All free to copy and import.

Web Scraping

This n8n template provides enterprise-level version control for your workflows using GitHub integration. Stop losing hours to broken workflows and manual exports – get proper commit history, visual di

n8n, Execute Workflow Trigger, HTTP Request +1
Web Scraping

This flow creates dummy files for every item added in your *Arrs (Radarr/Sonarr) with the tag .

HTTP Request, Ssh
Web Scraping

eek-Go v2 (Batch-Then-Review). Uses httpRequest. Webhook trigger; 75 nodes.

HTTP Request
Web Scraping

This workflow receives webhook requests from a content calendar and uses the X API v2 to publish text posts, threads, image/video posts, and polls, as well as delete existing posts and run a credentia

HTTP Request
Web Scraping

This workflow acts as a central API gateway for all technical indicator agents in the Binance Spot Market Quant AI system. It listens for incoming webhook requests and dynamically routes them to the c

HTTP Request