{ "name": "16 - Source Quality Gate & Health Score", "active": false, "nodes": [ { "parameters": { "content": "## WF16 \u2014 Source Quality Gate & Health Score\n\nRun-level + source-level health BEFORE report generation. **No Claude / Apify / Firecrawl.** Reads live_source_runs + raw_market_records (+ registry/queues), computes quality_score / quality_status / report_eligible / llm_eligible / quality_flags, writes the **source_health** tab, and emits a Final Summary.\n\n**fixture_self_test=true** (default): runs the 3 demo cases (healthy / degraded / quarantined) with no sheet reads, $0. Set false + write_result=true (with creds) for real runs.\n\nWF10/WF12 must consult source_health.report_eligible before including a run as production intelligence.", "height": 320, "width": 420 }, "id": "overview_note", "name": "Overview Note RU", "type": "n8n-nodes-base.stickyNote", "typeVersion": 1, "position": [ -360, -40 ] }, { "parameters": {}, "id": "manual_start", "name": "Manual Start", "type": "n8n-nodes-base.manualTrigger", "typeVersion": 1, "position": [ 160, 200 ] }, { "parameters": { "jsCode": "// WF16 config. NO external API (no Claude/Apify/Firecrawl). Reads sheets + computes run health -> source_health.\n// fixture_self_test=true (default) runs the 3 demo cases offline ($0, no creds) so import+run works immediately.\n// Operator sets fixture_self_test=false + write_result=true (with spreadsheet creds) to evaluate real runs.\nfunction pad(n){return String(n).padStart(2,'0');}\nfunction moscowIsoNow(){var m=new Date(Date.now()+10800000);return m.toISOString().replace('Z','+03:00');}\nfunction stampNow(){var m=new Date(Date.now()+10800000);return m.getUTCFullYear()+pad(m.getUTCMonth()+1)+pad(m.getUTCDate())+'_'+pad(m.getUTCHours())+pad(m.getUTCMinutes())+pad(m.getUTCSeconds());}\nvar stamp=stampNow();\nvar __cfg = {\n workflow:'16 - Source Quality Gate & Health Score',\n fixture_self_test:true,\n source_run_id_filter:'',\n agent_request_id_filter:'',\n source_family_filter:'',\n platform_filter:'',\n freshness_window_days:30,\n allow_degraded_report:false,\n write_result:false,\n dry_run:true,\n spreadsheet_id_placeholder:'PASTE_SPREADSHEET_ID',\n taxonomy_version:'semantic-v2.0',\n quality_rule_version:'qrule-v1.0',\n run_id:'wf16_'+stamp,\n generated_at:moscowIsoNow(),\n note:'WF16 quality gate. fixture_self_test=true => 3 demo runs (healthy/degraded/quarantined), no sheet reads, $0. Set false to read live_source_runs + raw_market_records (+ registry/queues) filtered by source_run_id_filter/agent_request_id_filter and compute real source_health. write_result=true appends to the source_health tab (needs creds). Default report_eligible policy: live healthy=eligible; degraded excluded unless allow_degraded_report=true (adds report_quality_warning); fixture/manual_test/quarantined/no_data=never eligible. NO external API calls, no Claude.'\n};\n\nvar __agentIn=(typeof $json==='object'&&$json)?$json:{};\nfunction __ov(ck,ik){var k=ik||ck;var v=__agentIn[k];if(v!==undefined&&v!==null&&v!=='')__cfg[ck]=v;}\n__ov('source_run_id_filter','source_run_id');\n__ov('agent_request_id_filter','agent_request_id');\n__ov('platform_filter','platform_filter');\n__ov('source_family_filter','source_family_filter');\n__ov('freshness_window_days','freshness_window_days');\n__ov('fixture_self_test','fixture_self_test');\n__ov('write_result','write_result'); // agent runs persist source_health so WF10/WF12 can gate (WF16-WRITE-001)\nif(__agentIn.data_mode&&__agentIn.data_mode!=='fixture'){__cfg.fixture_self_test=false;}\nreturn [{ json: __cfg }];\n" }, "id": "set_wf16_config", "name": "Set WF16 Config", "type": "n8n-nodes-base.code", "typeVersion": 2, "position": [ 380, 200 ] }, { "parameters": { "conditions": { "options": { "caseSensitive": true, "leftValue": "", "typeValidation": "loose" }, "conditions": [ { "id": "c1", "leftValue": "={{ $json.fixture_self_test }}", "rightValue": true, "operator": { "type": "boolean", "operation": "true", "singleValue": true } } ], "combinator": "and" } }, "id": "if_self_test", "name": "IF Self-Test?", "type": "n8n-nodes-base.if", "typeVersion": 2, "position": [ 620, 200 ] }, { "parameters": { "jsCode": "// Self-test: 3 deterministic run-bundles demonstrating healthy / degraded / quarantined. No sheet reads, $0.\n// FIXTURE-TIME-001: a FIXED published_at silently rots. Once it aged past the 30-day freshness window this\n// self-test began reporting stale_source and its expected scores drifted (healthy 100->90, degraded 67->62)\n// with no code change. Anchor the fixture to NOW so the self-test is deterministic whenever it runs.\nvar FIXTURE_FRESH_AT=new Date(Date.now()-5*86400000).toISOString().replace('Z','+03:00');\nfunction rec(o){return Object.assign({structurally_valid:true,unique:true,exact_evidence_url:true,report_candidate:true,published_at:FIXTURE_FRESH_AT},o||{});}\nfunction many(n,o){var a=[];for(var i=0;i" } }, "id": "read_live_source_runs", "name": "Read live_source_runs", "type": "n8n-nodes-base.googleSheets", "typeVersion": 4, "position": [ 860, 320 ], "retryOnFail": true, "maxTries": 3, "waitBetweenTries": 5000 }, { "parameters": { "authentication": "serviceAccount", "operation": "read", "documentId": { "__rl": true, "value": "={{ $env.MS_SPREADSHEET_ID || \"PASTE_SPREADSHEET_ID\" }}", "mode": "id" }, "sheetName": { "__rl": true, "value": "raw_market_records", "mode": "name" }, "options": {} }, "credentials": { "googleApi": { "name": "" } }, "id": "read_raw_market_records", "name": "Read raw_market_records", "type": "n8n-nodes-base.googleSheets", "typeVersion": 4, "position": [ 860, 460 ], "retryOnFail": true, "maxTries": 3, "waitBetweenTries": 5000 }, { "parameters": { "authentication": "serviceAccount", "operation": "read", "documentId": { "__rl": true, "value": "={{ $env.MS_SPREADSHEET_ID || \"PASTE_SPREADSHEET_ID\" }}", "mode": "id" }, "sheetName": { "__rl": true, "value": "market_record_registry", "mode": "name" }, "options": {} }, "credentials": { "googleApi": { "name": "" } }, "id": "read_market_record_registry", "name": "Read market_record_registry", "type": "n8n-nodes-base.googleSheets", "typeVersion": 4, "position": [ 860, 600 ], "retryOnFail": true, "maxTries": 3, "waitBetweenTries": 5000 }, { "parameters": { "jsCode": "// LIVE assembly: read live_source_runs + raw_market_records (+ registry/queues), group records by source_run_id,\n// normalize each row into a quality descriptor, emit one run-bundle per run. Deterministic, NO external API.\nfunction str(v){return v==null?'':String(v).trim();}\nfunction low(v){return str(v).toLowerCase();}\n// SCOPE-STRICT-001: per-source run ids are '::' and legacy rows may carry only the\n// bare agent_request_id \u2014 the run filter must match the request FAMILY, never require strict equality.\nfunction runFamilyMatch(rid,f){rid=String(rid==null?'':rid).trim();f=String(f==null?'':f).trim();if(!f)return true;if(!rid)return false;return rid===f||rid.indexOf(f+'::')===0||f.indexOf(rid+'::')===0;}\n// \u00a72.3 Sheets boolean fidelity: explicit TRUE/FALSE/strings/empty preserved (mirrors n8n/lib/lineage.coerceSheetBool).\nfunction cbool(v,d){if(v===true||v===false)return v;var s=low(v);if(s==='')return d;if(s==='true'||s==='yes'||s==='1')return true;if(s==='false'||s==='no'||s==='0')return false;return d;}\nfunction readNode(name){ try{ return $(name).all().map(function(i){return i.json;}).filter(Boolean); }catch(e){ return []; } }\nfunction detectPlaceholder(t){ t=str(t); if(!t)return false; if(/\u0435\u0449[\u0435\u0451]\\s*\\d+\\s*\u0444\u043e\u0442\u043e/i.test(t))return true; if(/^\\s*\\+?\\d+\\s*\u0444\u043e\u0442\u043e\\s*$/i.test(t))return true; return false; }\nfunction detectSysEvent(t){ t=str(t); return /channel name was changed to|\u043a\u0430\u043d\u0430\u043b \u043f\u0435\u0440\u0435\u0438\u043c\u0435\u043d\u043e\u0432\u0430\u043d|(\u0441\u043c\u0435\u043d\u0438\u043b|\u0438\u0437\u043c\u0435\u043d\u0438\u043b)\\s+\u043d\u0430\u0437\u0432\u0430\u043d\u0438\u0435\\s+\u043a\u0430\u043d\u0430\u043b\u0430|(\u0441\u043c\u0435\u043d\u0438\u043b|\u0438\u0437\u043c\u0435\u043d\u0438\u043b|\u043e\u0431\u043d\u043e\u0432\u0438\u043b)\\s+\u0444\u043e\u0442\u043e\\s+\u043a\u0430\u043d\u0430\u043b\u0430/i.test(t); }\nvar cfg=$('Set WF16 Config').first().json;\nvar runIdF=str(cfg.source_run_id_filter);\nvar reqF=str(cfg.agent_request_id_filter);\nvar famF=low(cfg.source_family_filter);\nvar platF=low(cfg.platform_filter);\nvar runsRows=readNode('Read live_source_runs');\nvar raw=readNode('Read raw_market_records');\nvar registry=readNode('Read market_record_registry');\n// registry dedup_status lookup by record_id/dedup_key\nvar dedupByKey={};\nregistry.forEach(function(g){ var k=str(g.dedup_key)||str(g.record_id); if(k)dedupByKey[k]=low(g.dedup_status||'unique'); });\n// group raw rows by source_run_id (fall back to agent_request_id)\nvar groups={};\nraw.forEach(function(r){\n var rid=str(r.source_run_id)||str(r.run_id)||str(r.agent_request_id);\n if(!rid)return;\n if(!runFamilyMatch(rid,runIdF))return;\n if(reqF && str(r.agent_request_id)!==reqF)return;\n (groups[rid]=groups[rid]||[]).push(r);\n});\nfunction normalize(r){\n var rth=low(r.record_type_hint);\n var title=str(r.title||r.offer_text);\n var text=str(r.text_context||r.description);\n var svc=low(r.service_hint||r.service_primary||r.normalized_service_type);\n var placeholder=detectPlaceholder(title);\n var sysev=detectSysEvent(text)||rth==='system_event';\n var dedup=low(r.dedup_status)|| dedupByKey[str(r.dedup_key)] || dedupByKey[str(r.record_id)] || 'unique';\n var ttype=low(r.touchpoint_type);\n var detailReq=(r.detail_fetch_required===true||low(r.detail_fetch_required)==='true');\n var isDetail=(r.is_detail===true||low(r.is_detail)==='true');\n var qflagsStr=low(r.quality_flags);\n var skipR=low(r.skip_reason);\n var searchCard=placeholder||ttype==='search_card'||rth==='source_candidate'||detailReq||qflagsStr.indexOf('search_card')>=0||qflagsStr.indexOf('no_detail_record')>=0||skipR==='detail_enrichment_required'||(r.is_detail!==undefined&&!isDetail&&(ttype==='search_card'||rth==='source_candidate'));\n var isDuplicate=(dedup==='duplicate'||dedup==='duplicate_in_registry'||dedup==='duplicate_in_batch'||dedup.indexOf('duplicate')===0);\n var _ev=r.exact_evidence_url; var hasEvidence;\n if(_ev===true||low(_ev)==='true')hasEvidence=true;\n else if(_ev===false||low(_ev)==='false')hasEvidence=false;\n else hasEvidence=(!searchCard)&&(str(r.post_url)!==''||str(r.listing_url)!==''||str(r.source_url)!=='');\n var hardSkip=(r.hard_skip===true||low(r.hard_skip)==='true');\n var irr=(rth==='irrelevant'||rth==='irrelevant_live_false_positive'||rth==='irrelevant_source');\n var pending=(low(r.review_status)==='pending'||low(r.parse_method)==='deterministic_uncertain_no_llm');\n var generic=(low(r.interest_topic)==='competitor channel ad copy')||(low(r.offer_text)===''&&rth==='competitor_activity');\n var reportCand=!placeholder&&!sysev&&!irr&&!hardSkip&&!pending&&!searchCard&&dedup==='unique';\n return {\n structurally_valid:(cbool(r.is_valid_listing,true)!==false)&&(str(r.record_id)!==''||str(r.dedup_key)!==''),\n unique:dedup==='unique'&&!isDuplicate, duplicate:isDuplicate,\n hard_skipped:hardSkip||sysev, irrelevant:irr, report_candidate:reportCand,\n search_card:searchCard, degraded:(low(r.quality_status)==='degraded'||r.degraded===true),\n placeholder_title:placeholder,\n missing_description:(text.length<30),\n missing_seller_identity:(str(r.profile_name)===''&&str(r.competitor_name)===''&&str(r.author_handle)===''&&str(r.seller_name)===''),\n missing_published_at:(str(r.published_at)===''),\n exact_evidence_url:hasEvidence,\n unknown_service:(svc===''||svc==='unknown'),\n generic_offer:generic, system_event:sysev, pending_review:pending,\n published_at:str(r.published_at)\n };\n}\nvar out=[];\nObject.keys(groups).forEach(function(rid){\n var _grp=groups[rid]||[];\n var _reqId=str((_grp[0]||{}).agent_request_id);\n var runRow=runsRows.filter(function(x){return (str(x.source_run_id)||str(x.run_id))===rid;})[0]\n ||(_reqId?runsRows.filter(function(x){return str(x.agent_request_id)===_reqId||str(x.run_id)===_reqId;})[0]:null)\n ||{};\n if(famF && low(runRow.source_family)!==famF) return;\n if(platF && low(runRow.platform)!==platF) return;\n var records=groups[rid].map(normalize);\n var run=Object.assign({source_run_id:rid,data_mode:low(runRow.mode)===''?'live':(low(runRow.mode)||'live')},runRow,{source_run_id:rid});\n if(run.data_mode===undefined||run.data_mode==='') run.data_mode='live';\n out.push({json:{is_run_bundle:true, run:run, records:records}});\n});\nif(out.length===0){\n // SOURCE-REUSE-001: a pure-reuse run writes NO raw records ON PURPOSE \u2014 WF04 already appended an inherited\n // source_health row for it (health of the ORIGINAL collection). Scoring \"0 fresh records\" here would emit an\n // excluded row that overwrites the inherited one in the last-wins eligibility index and re-break reuse at WF10.\n var __rrun=null;\n if(runIdF||reqF){\n __rrun=runsRows.filter(function(x){return runFamilyMatch(str(x.source_run_id)||str(x.run_id),runIdF)&&low(x.mode)==='reuse';})[0]\n ||(reqF?runsRows.filter(function(x){return str(x.agent_request_id)===reqF&&low(x.mode)==='reuse';})[0]:null);\n }\n if(__rrun){\n out.push({json:{is_run_bundle:true, reuse_skip:true, run:{source_run_id:str(__rrun.source_run_id)||str(__rrun.run_id),data_mode:'live',mode:'reuse',items_received:0}, records:[]}});\n } else {\n out.push({json:{is_run_bundle:true, run:{source_run_id:runIdF||'none',data_mode:'live',items_received:0}, records:[]}});\n }\n}\nreturn out;\n" }, "id": "assemble_run_bundles", "name": "Assemble Run Bundles", "type": "n8n-nodes-base.code", "typeVersion": 2, "position": [ 1100, 460 ] }, { "parameters": { "jsCode": "// WF16 scoring node. Embedded MIRROR of n8n/lib/quality_gate.js computeRunHealth (drift-proof: the offline\n// harness runs THIS jsCode and asserts equality with the library). NO external API. Reads $input run-bundles.\nvar QRULE_VERSION='qrule-v1.0';\nvar CRITICAL_FLAGS=['semantic_validation_failed','system_event_contamination','no_detail_records','search_cards_only','broken_brand','approval_gate_missing','no_compatible_baseline'];\nfunction num(v,d){var n=Number(v);return isNaN(n)?(d==null?0:d):n;}\nfunction rate(n,d){d=num(d);return d>0?(num(n)/d):0;}\nfunction pct(x){return Math.round(x*1000)/10;}\nfunction computeRunHealth(run,records,cfg){\n run=run||{};records=records||[];cfg=cfg||{};\n var win=num(cfg.freshness_window_days,30);\n var nowMs=cfg.now_iso?Date.parse(cfg.now_iso):Date.now();\n var data_mode=String(run.data_mode||cfg.data_mode||'live').toLowerCase();\n var total=records.length;\n var search_card=0;\n var detail_records=0;\n var structurally_valid=0,invalid=0,unique=0,duplicate=0,hard_skipped=0,irrelevant=0,report_candidate=0,placeholder=0,missing_desc=0,missing_id=0,missing_pub=0,has_evidence_url=0,unknown_service=0,generic_offer=0,parse_failure=0,repaired=0,fallback=0,raw_md_fallback=0,degraded=0,pending=0,sysevent=0,stale=0,fresh_known=0;\n var newest=null,oldest=null;\n for(var i=0;inewest)newest=p; if(oldest===null||p0&&stale===fresh_known&&fresh_known>0)flags.push('stale_source');\n if(total>0&&placeholder===total)flags.push('placeholder_titles'); else if(placeholder>0)flags.push('placeholder_titles');\n if(total>0&&report_candidate===0&&((search_card>0&&(search_card+irrelevant+hard_skipped)>=total)||(placeholder+missing_desc)>=total))flags.push('search_cards_only');\n if(total>0&&detail_records===0&&hard_skipped=60)flags.push('missing_seller_identity');\n if(rates.missing_description_rate>=60)flags.push('missing_descriptions');\n if(rates.missing_published_at_rate>=60)flags.push('missing_published_at');\n if(rates.exact_evidence_url_rate<100&&total>0)flags.push('missing_exact_evidence_url');\n if(rates.unknown_service_rate>=50)flags.push('high_unknown_service_rate');\n if(rates.generic_offer_rate>=50)flags.push('high_generic_offer_rate');\n if(rates.repair_rate>=40)flags.push('high_repair_rate');\n if(fallback>0)flags.push('deterministic_fallback');\n if(raw_md_fallback>0)flags.push('raw_markdown_fallback');\n if(run.broken_brand===true)flags.push('broken_brand');\n if(run.taxonomy_drift===true||(unknown_service>0&&rates.unknown_service_rate>=50))flags.push('taxonomy_drift');\n if(sysevent>0)flags.push('system_event_contamination');\n if(pending>0)flags.push('pending_review');\n if(num(run.semantic_validation_failed_count)>0)flags.push('semantic_validation_failed');\n var source_cost_status=String(run.source_cost_status||(num(run.external_calls)>0?'unknown':'not_applicable')).toLowerCase();\n var llm_cost_status=String(run.llm_cost_status||(num(run.llm_calls)>0?'unknown':'not_applicable')).toLowerCase();\n if(source_cost_status==='unknown'||llm_cost_status==='unknown')flags.push('cost_unknown');\n if(run.approval_gate_missing===true)flags.push('approval_gate_missing');\n if(noData)flags.push('no_compatible_baseline');\n var d_transport; if(noData)d_transport=0; else if(run.transport_failed===true)d_transport=5; else d_transport=15;\n var d_structural=noData?0:Math.round(rate(structurally_valid,total)*20);\n var semFactor=1; semFactor-=rate(parse_failure,total)*0.5; semFactor-=Math.max(0,rate(repaired,total)-0.2)*0.5;\n semFactor-=rate(unknown_service,total)*0.3; semFactor-=rate(generic_offer,total)*0.3; semFactor-=rate(sysevent,total)*0.6; semFactor-=rate(pending,total)*0.3;\n if(semFactor<0)semFactor=0; var d_semantic=noData?0:Math.round(semFactor*25);\n var evFactor=rate(has_evidence_url,total)*0.4+(1-rate(placeholder,total))*0.3+(1-rate(missing_desc,total))*0.3;\n if(evFactor<0)evFactor=0; if(evFactor>1)evFactor=1; var d_evidence=noData?0:Math.round(evFactor*20);\n var d_freshness=(fresh_known===0)?(noData?0:5):Math.round((1-rate(stale,fresh_known))*10);\n var d_cost=10; if(source_cost_status==='unknown')d_cost-=4; if(llm_cost_status==='unknown')d_cost-=3; if(run.approval_gate_missing===true)d_cost-=3; if(d_cost<0)d_cost=0;\n var quality_score=noData?0:(d_transport+d_structural+d_semantic+d_evidence+d_freshness+d_cost);\n var hasCritical=flags.some(function(f){return CRITICAL_FLAGS.indexOf(f)>=0;});\n var quality_status;\n if(noData)quality_status='quarantined'; else if(hasCritical||quality_score<50)quality_status='quarantined'; else if(quality_score>=80)quality_status='healthy'; else quality_status='degraded';\n var isProd=(data_mode==='live');\n var report_eligible=isProd&&quality_status!=='quarantined'&&!noData;\n if(quality_status==='degraded'){ report_eligible=isProd&&cfg.allow_degraded_report===true; if(report_eligible)flags.push('report_quality_warning'); }\n var llm_eligible=!noData&&quality_status!=='quarantined'&&unique>0;\n if(unique===0||(irrelevant+hard_skipped)>=total)llm_eligible=false;\n if(total>0&&pending===total){ report_eligible=false; llm_eligible=false; }\n var operator_next_action;\n if(noData)operator_next_action='No data: re-run the source connector with a valid allowlist/run filter before any report. Do NOT treat as a baseline.';\n else if(quality_status==='quarantined')operator_next_action='QUARANTINED: exclude from stakeholder report. Investigate critical flags ('+flags.filter(function(f){return CRITICAL_FLAGS.indexOf(f)>=0;}).join(', ')+'). Fix source/enrichment, then re-run.';\n else if(quality_status==='degraded')operator_next_action='DEGRADED: excluded from report by default. Enable allow_degraded_report only with a visible TEST/QUALITY warning, or improve evidence/freshness and re-run.';\n else operator_next_action='HEALTHY: eligible for stakeholder intelligence and (where unique>0) LLM analysis.';\n return {\n quality_evaluation_id:'qhealth_'+String(cfg.source_run_id||run.run_id||run.source_run_id||'run')+'_'+(cfg.stamp||''),\n evaluated_at:cfg.now_iso||new Date().toISOString(),\n source_run_id:run.source_run_id||run.run_id||cfg.source_run_id||'',\n agent_request_id:run.agent_request_id||cfg.agent_request_id||'',\n workflow:run.workflow||'', source_family:run.source_family||'', platform:run.platform||'',\n source_key:run.source_key||run.source_allowlist||'', data_mode:data_mode, items_received:items_received,\n structurally_valid_items:structurally_valid, invalid_items:invalid, unique_items:unique, duplicate_items:duplicate,\n hard_skipped_items:hard_skipped, irrelevant_items:irrelevant, report_candidate_items:report_candidate,\n newest_published_at:newest?new Date(newest).toISOString():'', oldest_published_at:oldest?new Date(oldest).toISOString():'',\n source_staleness_days:newest?Math.floor((nowMs-newest)/86400000):null,\n external_calls:num(run.external_calls), llm_calls:num(run.llm_calls),\n actual_source_cost_usd:(source_cost_status==='known')?num(run.actual_source_cost_usd):null,\n actual_llm_cost_usd:(llm_cost_status==='known')?num(run.actual_llm_cost_usd):null,\n source_cost_status:source_cost_status, llm_cost_status:llm_cost_status,\n cost_per_unique_record:(llm_cost_status==='known'&&unique>0)?Math.round((num(run.actual_llm_cost_usd)/unique)*10000)/10000:null,\n dimension_scores:{transport:d_transport,structural:d_structural,semantic:d_semantic,evidence:d_evidence,freshness:d_freshness,observability_cost:d_cost},\n quality_score:quality_score, quality_status:quality_status, report_eligible:report_eligible, llm_eligible:llm_eligible,\n quality_flags:Array.from(new Set(flags)), operator_next_action:operator_next_action,\n taxonomy_version:cfg.taxonomy_version||'semantic-v2.0', quality_rule_version:QRULE_VERSION, rates:rates\n };\n}\nfunction pad(n){return String(n).padStart(2,'0');}\nfunction stampNow(){var m=new Date(Date.now()+10800000);return m.getUTCFullYear()+pad(m.getUTCMonth()+1)+pad(m.getUTCDate())+'_'+pad(m.getUTCHours())+pad(m.getUTCMinutes())+pad(m.getUTCSeconds());}\nfunction moscowIsoNow(){var m=new Date(Date.now()+10800000);return m.toISOString().replace('Z','+03:00');}\nvar cfg0=$('Set WF16 Config').first().json;\nvar stamp=stampNow();\nvar baseCfg={ now_iso:moscowIsoNow(), stamp:stamp, freshness_window_days:Number(cfg0.freshness_window_days)||30, allow_degraded_report:cfg0.allow_degraded_report===true, taxonomy_version:cfg0.taxonomy_version||'semantic-v2.0' };\nvar bundles=$input.all().map(function(i){return i.json;}).filter(function(b){return b&&b.is_run_bundle;});\nvar out=[];\nfor(var i=0;i strings\n var row=Object.assign({}, h, {\n quality_flags:(h.quality_flags||[]).join('; '),\n dimension_scores:JSON.stringify(h.dimension_scores),\n notes:''\n });\n // promote key rates as columns\n Object.keys(h.rates||{}).forEach(function(k){ row[k]=h.rates[k]; });\n delete row.rates;\n out.push({json:row});\n}\nreturn out;\n" }, "id": "build_source_health", "name": "Build Source Health", "type": "n8n-nodes-base.code", "typeVersion": 2, "position": [ 1340, 200 ] }, { "parameters": { "conditions": { "options": { "caseSensitive": true, "leftValue": "", "typeValidation": "loose" }, "conditions": [ { "id": "w1", "leftValue": "={{ $('Set WF16 Config').first().json.write_result }}", "rightValue": true, "operator": { "type": "boolean", "operation": "true", "singleValue": true } }, { "id": "w2", "leftValue": "={{ $json.skip_write === true }}", "rightValue": false, "operator": { "type": "boolean", "operation": "false", "singleValue": true } } ], "combinator": "and" } }, "id": "if_write", "name": "IF Write Result?", "type": "n8n-nodes-base.if", "typeVersion": 2, "position": [ 1560, 200 ] }, { "parameters": { "authentication": "serviceAccount", "operation": "append", "documentId": { "__rl": true, "value": "={{ $env.MS_SPREADSHEET_ID || \"PASTE_SPREADSHEET_ID\" }}", "mode": "id" }, "sheetName": { "__rl": true, "value": "source_health", "mode": "name" }, "options": {}, "columns": { "mappingMode": "autoMapInputData", "value": {}, "matchingColumns": [], "schema": [] } }, "credentials": { "googleApi": { "name": "" } }, "id": "append_source_health", "name": "Append source_health", "type": "n8n-nodes-base.googleSheets", "typeVersion": 4.5, "position": [ 1780, 120 ], "retryOnFail": true, "maxTries": 3, "waitBetweenTries": 5000 }, { "parameters": { "jsCode": "// WF16 Final Summary Output (\u00a77.6). Aggregates evaluated runs; flags which are report/llm eligible. NO external API.\nfunction str(v){return v==null?'':String(v).trim();}\nvar cfg=$('Set WF16 Config').first().json;\nvar rows=[];\ntry{ rows=$('Build Source Health').all().map(function(i){return i.json;}); }catch(e){ rows=[]; }\nvar runs=rows.map(function(r){ return {\n source_run_id:r.source_run_id, data_mode:r.data_mode, workflow:r.workflow, platform:r.platform,\n quality_score:r.quality_score, quality_status:r.quality_status,\n report_eligible:r.report_eligible, llm_eligible:r.llm_eligible,\n unique_items:r.unique_items, report_candidate_items:r.report_candidate_items,\n source_cost_status:r.source_cost_status, llm_cost_status:r.llm_cost_status,\n key_rates:{structurally_valid_rate:r.structurally_valid_rate, exact_evidence_url_rate:r.exact_evidence_url_rate, repair_rate:r.repair_rate, unknown_service_rate:r.unknown_service_rate, stale_rate:r.stale_rate},\n quality_flags:r.quality_flags, operator_next_action:r.operator_next_action\n};});\nvar counts={healthy:0,degraded:0,quarantined:0};\nruns.forEach(function(r){ counts[r.quality_status]=(counts[r.quality_status]||0)+1; });\nvar report_eligible_runs=runs.filter(function(r){return r.report_eligible;}).map(function(r){return r.source_run_id;});\nreturn [{ json: {\n workflow:'16 - Source Quality Gate & Health Score',\n run_id:cfg.run_id||'', generated_at:cfg.generated_at||'',\n fixture_self_test:cfg.fixture_self_test===true,\n write_result:cfg.write_result===true,\n external_calls:0, llm_calls:0, actual_cost_usd:0, cost_status:'not_applicable',\n evaluated_runs:runs.length, status_counts:counts,\n report_eligible_runs:report_eligible_runs,\n runs:runs,\n next_action:(cfg.write_result===true?'source_health rows appended. WF10/WF12 must consult source_health.report_eligible before including a run in stakeholder intelligence.':'DRY-RUN (write_result=false): review runs above; set write_result=true + creds to persist source_health. Quarantined/degraded/fixture runs are excluded from reports by default.')\n}}];\n" }, "id": "final_summary_output", "name": "Final Summary Output", "type": "n8n-nodes-base.code", "typeVersion": 2, "position": [ 1780, 320 ] }, { "parameters": { "inputSource": "workflowInputs", "workflowInputs": { "values": [ { "name": "agent_request_id", "type": "string" }, { "name": "source_run_id", "type": "string" }, { "name": "workflow_run_id", "type": "string" }, { "name": "data_mode", "type": "string" }, { "name": "platform_filter", "type": "string" }, { "name": "source_family_filter", "type": "string" }, { "name": "freshness_window_days", "type": "string" }, { "name": "fixture_self_test", "type": "string" }, { "name": "write_result", "type": "string" } ] } }, "type": "n8n-nodes-base.executeWorkflowTrigger", "typeVersion": 1.1, "position": [ 160, 400 ], "id": "wf16-subtrig", "name": "When Called by Agent" } ], "connections": { "Manual Start": { "main": [ [ { "node": "Set WF16 Config", "type": "main", "index": 0 } ] ] }, "Set WF16 Config": { "main": [ [ { "node": "IF Self-Test?", "type": "main", "index": 0 } ] ] }, "IF Self-Test?": { "main": [ [ { "node": "Build Fixture Runs", "type": "main", "index": 0 } ], [ { "node": "Read live_source_runs", "type": "main", "index": 0 } ] ] }, "Build Fixture Runs": { "main": [ [ { "node": "Build Source Health", "type": "main", "index": 0 } ] ] }, "Read live_source_runs": { "main": [ [ { "node": "Read raw_market_records", "type": "main", "index": 0 } ] ] }, "Read raw_market_records": { "main": [ [ { "node": "Read market_record_registry", "type": "main", "index": 0 } ] ] }, "Read market_record_registry": { "main": [ [ { "node": "Assemble Run Bundles", "type": "main", "index": 0 } ] ] }, "Assemble Run Bundles": { "main": [ [ { "node": "Build Source Health", "type": "main", "index": 0 } ] ] }, "Build Source Health": { "main": [ [ { "node": "IF Write Result?", "type": "main", "index": 0 } ] ] }, "IF Write Result?": { "main": [ [ { "node": "Append source_health", "type": "main", "index": 0 } ], [ { "node": "Final Summary Output", "type": "main", "index": 0 } ] ] }, "Append source_health": { "main": [ [ { "node": "Final Summary Output", "type": "main", "index": 0 } ] ] }, "When Called by Agent": { "main": [ [ { "node": "Set WF16 Config", "type": "main", "index": 0 } ] ] } }, "settings": { "executionOrder": "v1" }, "versionId": "wf16-v001-source-quality-gate-stagec", "meta": { "templateCredsSetupCompleted": false }, "tags": [] }