Cron Job: trender-idea-miner

Job ID: 2a9306b6b96f
Run Time: 2026-09-20 07:11:11
Schedule: 0 7 * * *

Prompt

[IMPORTANT: The user has invoked the "idea-miner" skill, indicating they want you to follow its instructions. The full skill content is loaded below.]

name: idea-miner
description: Mine daily creative ideas & startup signals from HN/GitHub.
version: 1.0.0
author: Hermes Agent
license: MIT
metadata:
hermes:
tags: [ideas, trends, research, startup, daily-briefing]
related_skills: [youtube-content, blogwatcher]

🧠 Idea Miner — Daily Creative Intelligence

Overview

Mines today's creative ideas, inspiration hotspots, and startup signals from public sources. Produces a structured Markdown report with demand signals, trending projects, and actionable insights.

The report is saved to /opt/data/hermes/idea-miner/idea-miner_{YYYYMMDD}.md and delivered to the configured destination (Telegram, etc.).

When to Use

• Cron job for daily idea-mining runs (referenced by trender-idea-miner and 每日创意推送)
• User asks: "what are today's hot ideas", "find me startup opportunities", "trending projects analysis"
• Any session that needs to synthesize multi-source trend intelligence

Data Sources

✅ Available & Tested

❌ Currently Unavailable

Data Acquisition Workflow

1. Use curl -s -o /tmp/filename.json -w '%{http_code}' to save to temp file first (avoids pipe-to-interpreter security blocks in cron mode)
2. Parse with python3 -c "import json; data = json.load(open('/tmp/filename.json')); ..."
3. Saved temp files are disposable — clean up or leave in /tmp

Report Format

The report uses Chinese (用户偏好) with the following sections:

# 🧠 Idea Miner — 每日创意情报 (YYYY-MM-DD)

> 数据来源：[list of sources used]

## 📢 需求现场 — 高意向需求 & 讨论
Top demand signals from Ask HN, discussions, needs

## 📈 趋势项目 — GitHub 热门新仓库
Table: project | ⭐ | description | direction
Followed by trend interpretation block (code fence with arrows)

## 🔬 Show HN 精选 — 本周最新项目
Table: project | points | description

## 🌟 今日创业灵感精选
### 高潜力方向
### 已验证信号

## 📊 数据快照
Key metrics summary table

Report Generation Steps

1. Fetch HN front page — identifies the overall tech zeitgeist for the day
2. Fetch HN Ask HN — captures user needs, pain points, and demand signals
3. Fetch HN Show HN (recent, points>10) — captures new projects people are building
4. Fetch GitHub trending repos (last 7 days) — identifies what developers are excited about
5. Fetch additional sources if available (Reddit, Twitter, etc.)
6. Synthesize findings into the structured report
7. Save to file at /opt/data/hermes/idea-miner/idea-miner_{YYYYMMDD}.md
8. Output the report as final response — the cron delivery system automatically delivers it

File Save Convention

• Directory: /opt/data/hermes/idea-miner/
• Filename: idea-miner_{YYYYMMDD}.md (e.g., idea-miner_20260727.md)
• If the directory doesn't exist, create it

Common Pitfalls

1. HN Algolia URL encoding: The numericFilters parameter with > must use %3E not raw >. E.g. numericFilters=points%3E10
2. Reddit API blocked: Don't retry Reddit JSON API with this IP — it's consistently 403. Only retry if OAuth creds are configured.
3. Pipe-to-interpreter security blocks: In cron mode, curl | python3 triggers security warnings. Save output to file first with -o /tmp/file, then parse with python3 -c reading from file.
4. GitHub API rate limits: Without authentication, GitHub API is limited to 60 req/hr. For 10 repos + description parsing per run this is fine, but batch requests if expanding.
5. Show HN search prefers search_by_date: The /search endpoint returns all-time top, not recent. Use /search_by_date for recent Show HN posts.
6. No xurl installed: X/Twitter mining won't work unless xurl CLI is installed and OAuth'd.
7. Google Trends unavailable via simple curl: None of the documented public endpoints work (404). Skip silently.

Verification Checklist

• [ ] HN front page fetched and parsed correctly
• [ ] Ask HN fetched for demand signals
• [ ] Show HN (recent) fetched for new projects
• [ ] GitHub trending repos fetched
• [ ] Report is structured with all tables and sections
• [ ] File saved to correct path with date-stamped filename
• [ ] Report output as final message (cron delivery takes over)

Related Scripts

The legacy shell script at /root/.hermes/scripts/idea-miner_daily.sh references a Python script at ~/idea-miner/idea_miner.py that no longer exists. The cron jobs now run Hermes agent directly with the prompt, bypassing the shell script. If the shell script is ever re-enabled, it needs to be updated.

Today's method reference: see references/today-methods.md for the exact curl/jq commands and data‑extraction steps used in this run.

The user has provided the following instruction alongside the skill invocation: [IMPORTANT: You are running as a scheduled cron job. DELIVERY: Your final response will be automatically delivered to the user — do NOT use send_message or try to deliver the output yourself. Just produce your report/output as your final response and the system handles the rest. SILENT: If there is genuinely nothing new to report, respond with exactly "[SILENT]" (nothing else) to suppress delivery. Never combine [SILENT] with content — either report your findings normally, or say [SILENT] and nothing more.]

运行 Idea Miner 模块，挖掘今日的创意和灵感热点，然后将结果发送到 Telegram 用户 jinbin（Chat ID: 951402025）。如果没有发现热点，输出简明的"今日无新热点"。

文件保存

将完整的分析结果同时保存到本地文件：/opt/data/hermes/idea-miner/idea-miner_{YYYYMMDD}.md

Response

Idea Miner — Daily Creative Intelligence (2026-09-20)

Data sources: HN Algolia (front page, Ask HN, Show HN), GitHub Search

Demand Signals — High-Intent Needs & Discussions

Ask HN signals:
1. Ask HN: I'm an FCC Commissioner proposing regulation of IoT security updates
2. Ask HN: I'm a software engineer going blind, how should I prepare?
3. Ask HN: Am I the longest-serving programmer – 57 years and counting?
4. Ask HN: Is S3 down?
5. Tell HN: Help restore the tax deduction for software dev in the US (Section 174)
6. Thank HN: You helped me get a new job
7. Tell HN: New features and a moderator
8. Tell HN: Thank You Dang
9. Google outage – resolved
10. Thank HN: My bootstrapped startup got acquired today

GitHub Trending Repositories (last 7 days)

Trend direction: AI platform building, code assistance, text humanization, decentralized trading, AI model compression — Today's tech zeitgeist focuses on local AI execution, model compression and humanization tools.

Show HN Selection — New Projects This Week

Today's Top Startup Inspiration

High-Potential Directions

• Local AI platforms & model compression: Cactus Needle shows small models can match large model performance, indicating strong demand for local inference
• AI code review & agents: Jeff and CUA-S1 — automation of coding workflows is rising
• AI text humanization: text-humanizer addresses AI detection bypass needs — content industry compliance/privacy pain point
• Browser automation & speed optimization: jev-ultrafast — extreme speed/automation is a developer pain point
• IoT security regulation: Ask HN FCC proposal — regulation-driven product opportunity

Verified Signals

• High-star GitHub projects emerging: 7 repos with 900+ stars, indicating rapid developer adoption of new tools
• Show HN engagement: top posts over 200pts, community interest active
• Ask HN security/compliance topics spark deep discussion, indicating regulatory/best-practice is a hotspot

Data Snapshot

Report saved to: /opt/data/hermes/idea-miner/idea-miner_20260920.md