AutomationFlowsGeneral › Job Scraping Scheduler

Job Scraping Scheduler

Job Scraping Scheduler. Uses scheduleTrigger, httpRequest, mongoDb. Scheduled trigger; 5 nodes.

Cron / scheduled trigger★★★★☆ complexity5 nodesHttp RequestMongo Db
General Trigger: Cron / scheduled Nodes: 5 Complexity: ★★★★☆

The workflow JSON

Copy or download the full n8n JSON below. Paste it into a new n8n workflow, add your credentials, activate. Full import guide →

Download .json
{
  "name": "Job Scraping Scheduler",
  "nodes": [
    {
      "parameters": {
        "rule": {
          "interval": [
            {
              "field": "hours",
              "hoursInterval": 6
            }
          ]
        }
      },
      "name": "Schedule Trigger",
      "type": "n8n-nodes-base.scheduleTrigger",
      "typeVersion": 1,
      "position": [
        250,
        300
      ]
    },
    {
      "parameters": {
        "url": "http://localhost:5000/api/jobs",
        "authentication": "genericCredentialType",
        "genericAuthType": "httpHeaderAuth",
        "options": {}
      },
      "name": "Fetch Jobs To Scrape",
      "type": "n8n-nodes-base.httpRequest",
      "typeVersion": 3,
      "position": [
        450,
        300
      ]
    },
    {
      "parameters": {
        "url": "=http://localhost:5000/api/jobs/scrape",
        "method": "POST",
        "authentication": "genericCredentialType",
        "genericAuthType": "httpHeaderAuth",
        "jsonParameters": true,
        "options": {},
        "bodyParametersJson": "={{ {\"url\": $json.url} }}"
      },
      "name": "Scrape Job",
      "type": "n8n-nodes-base.httpRequest",
      "typeVersion": 3,
      "position": [
        650,
        300
      ]
    },
    {
      "parameters": {
        "operation": "insert",
        "collection": "job_scrape_logs",
        "fields": "jobId,status,scrapedAt",
        "options": {}
      },
      "name": "Save to MongoDB",
      "type": "n8n-nodes-base.mongoDb",
      "typeVersion": 1,
      "position": [
        850,
        300
      ]
    },
    {
      "parameters": {
        "url": "http://localhost:5000/webhook/notify-user",
        "method": "POST",
        "jsonParameters": true,
        "options": {},
        "bodyParametersJson": "={{ {\"userId\": $json.userId, \"message\": \"Job scraped successfully\", \"jobTitle\": $json.title} }}"
      },
      "name": "Notify User",
      "type": "n8n-nodes-base.httpRequest",
      "typeVersion": 3,
      "position": [
        1050,
        300
      ]
    }
  ],
  "connections": {
    "Schedule Trigger": {
      "main": [
        [
          {
            "node": "Fetch Jobs To Scrape",
            "type": "main",
            "index": 0
          }
        ]
      ]
    },
    "Fetch Jobs To Scrape": {
      "main": [
        [
          {
            "node": "Scrape Job",
            "type": "main",
            "index": 0
          }
        ]
      ]
    },
    "Scrape Job": {
      "main": [
        [
          {
            "node": "Save to MongoDB",
            "type": "main",
            "index": 0
          }
        ]
      ]
    },
    "Save to MongoDB": {
      "main": [
        [
          {
            "node": "Notify User",
            "type": "main",
            "index": 0
          }
        ]
      ]
    }
  }
}

About this workflow

Job Scraping Scheduler. Uses scheduleTrigger, httpRequest, mongoDb. Scheduled trigger; 5 nodes.

Source: https://github.com/VEDESH18/AI_Autointern/blob/73444cd3d27bbb7f1542ddfa3d8837184f7781fc/n8n-workflows/job_scrape.json — original creator credit. Request a take-down →

More General workflows → · Browse all categories →