AutomationFlowsWeb Scraping › Weekly AI Trends Analysis via HTTP Requests

Weekly AI Trends Analysis via HTTP Requests

Original n8n title: AI Pulse — Weekly Trends

AI Pulse — Weekly Trends. Uses httpRequest. Scheduled trigger; 6 nodes.

Cron / scheduled trigger★★★★☆ complexity6 nodesHTTP Request
Web Scraping Trigger: Cron / scheduled Nodes: 6 Complexity: ★★★★☆ Added:

The workflow JSON

Copy or download the full n8n JSON below. Paste it into a new n8n workflow, add your credentials, activate. Full import guide →

Download .json
{
  "name": "AI Pulse \u2014 Weekly Trends",
  "nodes": [
    {
      "parameters": {
        "rule": {
          "interval": [
            {
              "field": "weeks",
              "triggerAtHour": 20
            }
          ]
        }
      },
      "type": "n8n-nodes-base.scheduleTrigger",
      "typeVersion": 1.3,
      "position": [
        0,
        0
      ],
      "id": "5ddac95a-d2c3-459c-9267-55070123b74a",
      "name": "Schedule Trigger"
    },
    {
      "parameters": {
        "method": "POST",
        "url": "http://host.docker.internal:11434/api/generate",
        "sendBody": true,
        "contentType": "raw",
        "rawContentType": "application/json",
        "body": "{\"model\": \"mistral\", \"prompt\": \"\", \"stream\": false, \"keep_alive\": 0}",
        "options": {}
      },
      "type": "n8n-nodes-base.httpRequest",
      "typeVersion": 4.4,
      "position": [
        208,
        0
      ],
      "id": "da7d3ddf-46c8-4f9e-9e57-ece27804fabc",
      "name": "Free Memory",
      "onError": "continueRegularOutput"
    },
    {
      "parameters": {
        "language": "pythonNative",
        "pythonCode": "import sqlite3\nimport json as json_lib\n\ndb_path = \"/data/ai-pulse/ai-pulse.db\"\nconn = sqlite3.connect(db_path)\nconn.row_factory = sqlite3.Row\ncursor = conn.cursor()\n\ncursor.execute(\"\"\"\n    SELECT id, title, source_name, category, summary, relevance_score, importance\n    FROM articles\n    WHERE importance >= 4\n    AND ingested_at >= datetime('now', '-7 days')\n    ORDER BY importance DESC, relevance_score DESC\n    LIMIT 40\n\"\"\")\nrows = cursor.fetchall()\nconn.close()\n\nif not rows:\n    return [{\"json\": {\"status\": \"no_articles\", \"count\": 0, \"prompt_body\": \"\"}}]\n\narticles_text = \"\"\narticle_ids = []\nfor row in rows:\n    r = dict(row)\n    article_ids.append(r['id'])\n    summary = r.get('summary') or r.get('title', '')\n    articles_text += (\n        f\"- [{r.get('category', 'general')}] {r.get('title', 'Untitled')} \"\n        f\"(Source: {r.get('source_name', 'Unknown')}, \"\n        f\"Importance: {r.get('importance', 0)}/5)\\n\"\n        f\"  Summary: {summary}\\n\\n\"\n    )\n\nprompt = (\n    \"You are a technology trend analyst. Below are the top-rated AI articles \"\n    \"from this week, curated for a Software Engineer interested in AI dev tools, \"\n    \"agentic workflows, context engineering, and SDLC automation.\\n\\n\"\n    f\"{articles_text}\\n\"\n    \"Identify 3-5 emerging patterns or trends from these articles. \"\n    \"For each trend, explain what is happening, cite which articles support it, \"\n    \"and predict where this trend is heading.\\n\\n\"\n    \"Return ONLY valid JSON, no other text:\\n\"\n    \"{\\\"trends\\\": [{\\\"trend_name\\\": \\\"<short name>\\\", \\\"description\\\": \\\"<2-3 sentences>\\\", \"\n    \"\\\"evidence_article_ids\\\": [<list of article IDs>], \"\n    \"\\\"prediction\\\": \\\"<where this is heading>\\\"}]}\"\n)\n\nbody = json_lib.dumps({\n    \"model\": \"llama3:8b\",\n    \"prompt\": prompt,\n    \"stream\": False,\n    \"keep_alive\": \"5m\"\n})\n\nreturn [{\"json\": {\"status\": \"ready\", \"count\": len(rows), \"article_ids\": json_lib.dumps(article_ids), \"request_body\": body}}]"
      },
      "type": "n8n-nodes-base.code",
      "typeVersion": 2,
      "position": [
        416,
        0
      ],
      "id": "b1295411-3b3a-4845-b930-0f14f994af84",
      "name": "Fetch Top Articles"
    },
    {
      "parameters": {
        "conditions": {
          "options": {
            "caseSensitive": true,
            "leftValue": "",
            "typeValidation": "strict",
            "version": 3
          },
          "conditions": [
            {
              "id": "38f6f3a2-37b8-4ca4-823e-2b288050e348",
              "leftValue": "={{ $json.status }}",
              "rightValue": "ready",
              "operator": {
                "type": "string",
                "operation": "equals",
                "name": "filter.operator.equals"
              }
            }
          ],
          "combinator": "and"
        },
        "options": {}
      },
      "type": "n8n-nodes-base.if",
      "typeVersion": 2.3,
      "position": [
        624,
        0
      ],
      "id": "83f717f2-2524-4a59-b31e-c8cb7f512eae",
      "name": "Has Articles?"
    },
    {
      "parameters": {
        "method": "POST",
        "url": "http://host.docker.internal:11434/api/generate",
        "sendBody": true,
        "contentType": "raw",
        "rawContentType": "application/json",
        "body": "={{ $('Fetch Top Articles').item.json.request_body }}",
        "options": {
          "timeout": 300000
        }
      },
      "type": "n8n-nodes-base.httpRequest",
      "typeVersion": 4.4,
      "position": [
        832,
        -96
      ],
      "id": "8fb4cab8-aa47-4186-a509-d0d59c10c11e",
      "name": "Ollama Trend Analysis",
      "onError": "continueRegularOutput"
    },
    {
      "parameters": {
        "language": "pythonNative",
        "pythonCode": "import sqlite3\nimport json as json_lib\nfrom datetime import datetime, timedelta\n\ndb_path = \"/data/ai-pulse/ai-pulse.db\"\n\nitems = _items\nstored = 0\nstatus = \"failed\"\n\nfor item in items:\n    data = item['json'] if 'json' in item else item\n    response_text = str(data.get('response', ''))\n\n    try:\n        clean = response_text.strip()\n        start = clean.find('{')\n        end = clean.rfind('}') + 1\n        if start >= 0 and end > start:\n            parsed = json_lib.loads(clean[start:end])\n            trends = parsed.get('trends', [])\n\n            today = datetime.now()\n            monday = today - timedelta(days=today.weekday())\n            week_start = monday.strftime('%Y-%m-%d')\n\n            conn = sqlite3.connect(db_path)\n            cursor = conn.cursor()\n\n            cursor.execute(\"DELETE FROM weekly_trends WHERE week_start = ?\", (week_start,))\n\n            for trend in trends:\n                trend_name = str(trend.get('trend_name', 'Unknown'))\n                description = str(trend.get('description', ''))\n                evidence = json_lib.dumps(trend.get('evidence_article_ids', []))\n                prediction = str(trend.get('prediction', ''))\n\n                cursor.execute(\"\"\"\n                    INSERT INTO weekly_trends (week_start, trend_name, description, evidence, prediction)\n                    VALUES (?, ?, ?, ?, ?)\n                \"\"\", (week_start, trend_name, description, evidence, prediction))\n                stored += 1\n\n            conn.commit()\n            conn.close()\n            status = \"success\"\n    except:\n        status = \"parse_error\"\n\nreturn [{\"json\": {\"status\": status, \"trends_stored\": stored}}]"
      },
      "type": "n8n-nodes-base.code",
      "typeVersion": 2,
      "position": [
        1040,
        -96
      ],
      "id": "58382d3d-9c92-49e7-8a04-28d83492b871",
      "name": "Store Weekly Trends"
    }
  ],
  "connections": {
    "Schedule Trigger": {
      "main": [
        [
          {
            "node": "Free Memory",
            "type": "main",
            "index": 0
          }
        ]
      ]
    },
    "Free Memory": {
      "main": [
        [
          {
            "node": "Fetch Top Articles",
            "type": "main",
            "index": 0
          }
        ]
      ]
    },
    "Fetch Top Articles": {
      "main": [
        [
          {
            "node": "Has Articles?",
            "type": "main",
            "index": 0
          }
        ]
      ]
    },
    "Has Articles?": {
      "main": [
        [
          {
            "node": "Ollama Trend Analysis",
            "type": "main",
            "index": 0
          }
        ]
      ]
    },
    "Ollama Trend Analysis": {
      "main": [
        [
          {
            "node": "Store Weekly Trends",
            "type": "main",
            "index": 0
          }
        ]
      ]
    }
  },
  "active": true,
  "settings": {
    "executionOrder": "v1",
    "binaryMode": "separate",
    "availableInMCP": false
  },
  "versionId": "7e68774b-f7c5-4565-9eb1-7672bb9c8e61",
  "id": "y4vQDeivtAk1BLML",
  "tags": []
}
Pro

For the full experience including quality scoring and batch install features for each workflow upgrade to Pro

About this workflow

AI Pulse — Weekly Trends. Uses httpRequest. Scheduled trigger; 6 nodes.

Source: https://github.com/sh3lan93/ai-pulse/blob/b616cb8446522055bc8679b9f6c03b08b07c1441/n8n-workflows/04-weekly-trends.json — original creator credit. Request a take-down →

More Web Scraping workflows → · Browse all categories →

Related workflows

Workflows that share integrations, category, or trigger type with this one. All free to copy and import.

Web Scraping

Birthday Automation - Production (Fixed). Uses stopAndError, httpRequest, emailSend, bannerbear. Scheduled trigger; 86 nodes.

Stop And Error, HTTP Request, Email Send +1
Web Scraping

This template runs two scheduled workflows to govern Microsoft Entra ID (Azure AD) guest accounts by detecting stale users via Microsoft Graph, staging deletions in SharePoint with a 72-hour window, n

Microsoft SharePoint, Microsoft Teams, Microsoft Entra +1
Web Scraping

Jira-Allure-Auto-Qa. Uses httpRequest, jira. Scheduled trigger; 68 nodes.

HTTP Request, Jira
Web Scraping

Spotify-Sync-Surrealdb-V1. Uses httpRequest, n8n-nodes-surrealdb, spotify. Scheduled trigger; 62 nodes.

HTTP Request, N8N Nodes Surrealdb, Spotify
Web Scraping

As n8n instances scale, teams often lose track of sub-workflows—who uses them, where they are referenced, and whether they can be safely updated. This leads to inefficiencies like unnecessary copies o

HTTP Request, n8n, N8N Trigger +1