Cron Job: trender-idea-miner
Job ID: 2a9306b6b96f
Run Time: 2026-07-30 07:02:49
Schedule: 0 7 * * *
Prompt
[IMPORTANT: The user has invoked the "idea-miner" skill, indicating they want you to follow its instructions. The full skill content is loaded below.]
name: idea-miner
description: Mine daily creative ideas & startup signals from HN/GitHub.
version: 1.0.0
author: Hermes Agent
license: MIT
metadata:
hermes:
tags: [ideas, trends, research, startup, daily-briefing]
related_skills: [youtube-content, blogwatcher]
🧠 Idea Miner — Daily Creative Intelligence
Overview
Mines today's creative ideas, inspiration hotspots, and startup signals from public sources. Produces a structured Markdown report with demand signals, trending projects, and actionable insights.
The report is saved to /opt/data/hermes/idea-miner/idea-miner_{YYYYMMDD}.md and delivered to the configured destination (Telegram, etc.).
When to Use
- Cron job for daily idea-mining runs (referenced by
trender-idea-minerand每日创意推送) - User asks: "what are today's hot ideas", "find me startup opportunities", "trending projects analysis"
- Any session that needs to synthesize multi-source trend intelligence
Data Sources
✅ Available & Tested
| Source | API Endpoint | Notes |
|---|---|---|
| HN Algolia (front page) | https://hn.algolia.com/api/v1/search?tags=front_page&hitsPerPage=20 |
Returns top stories with points |
| HN Algolia (Ask HN) | https://hn.algolia.com/api/v1/search?tags=ask_hn&hitsPerPage=15 |
Good for demand/need signals |
| HN Algolia (Show HN recent) | https://hn.algolia.com/api/v1/search_by_date?tags=show_hn&numericFilters=points%3E10&hitsPerPage=12 |
URL-encode > as %3E |
| HN Firebase (item detail) | https://hacker-news.firebaseio.com/v0/item/{ID}.json |
Individual story metadata |
| GitHub Search (new repos) | https://api.github.com/search/repositories?q=stars:%3E100+created:%3E{YYYY-MM-DD}&sort=stars&order=desc&per_page=10 |
Header: Accept: application/vnd.github.v3+json, User-Agent: HermesAgent/1.0 |
❌ Currently Unavailable
| Source | Issue |
|---|---|
Reddit JSON API (old.reddit.com, www.reddit.com) |
Blocked by Reddit (403 "whoa there, pardner") — needs OAuth credentials |
| Reddit pullpush.io (public archive) | Returns empty results from this IP |
| Google Trends RSS | Endpoint trends.google.com/trendingsearches/daily/rss?geo=US returns 404 |
| Google Trends API | trends.google.com/trends/api/dailytrends returns 404 |
| X/Twitter via xurl | xurl CLI not installed on this VPS |
Data Acquisition Workflow
- Use
curl -s -o /tmp/filename.json -w '%{http_code}'to save to temp file first (avoids pipe-to-interpreter security blocks in cron mode) - Parse with
python3 -c "import json; data = json.load(open('/tmp/filename.json')); ..." - Saved temp files are disposable — clean up or leave in /tmp
Report Format
The report uses Chinese (用户偏好) with the following sections:
# 🧠 Idea Miner — 每日创意情报 (YYYY-MM-DD)
> 数据来源:[list of sources used]
## 📢 需求现场 — 高意向需求 & 讨论
Top demand signals from Ask HN, discussions, needs
## 📈 趋势项目 — GitHub 热门新仓库
Table: project | ⭐ | description | direction
Followed by trend interpretation block (code fence with arrows)
## 🔬 Show HN 精选 — 本周最新项目
Table: project | points | description
## 🌟 今日创业灵感精选
### 高潜力方向
### 已验证信号
## 📊 数据快照
Key metrics summary table
Report Generation Steps
- Fetch HN front page — identifies the overall tech zeitgeist for the day
- Fetch HN Ask HN — captures user needs, pain points, and demand signals
- Fetch HN Show HN (recent, points>10) — captures new projects people are building
- Fetch GitHub trending repos (last 7 days) — identifies what developers are excited about
- Fetch additional sources if available (Reddit, Twitter, etc.)
- Synthesize findings into the structured report
- Save to file at
/opt/data/hermes/idea-miner/idea-miner_{YYYYMMDD}.md - Output the report as final response — the cron delivery system automatically delivers it
File Save Convention
- Directory:
/opt/data/hermes/idea-miner/ - Filename:
idea-miner_{YYYYMMDD}.md(e.g.,idea-miner_20260727.md) - If the directory doesn't exist, create it
Common Pitfalls
- HN Algolia URL encoding: The
numericFiltersparameter with>must use%3Enot raw>. E.g.numericFilters=points%3E10 - Reddit API blocked: Don't retry Reddit JSON API with this IP — it's consistently 403. Only retry if OAuth creds are configured.
- Pipe-to-interpreter security blocks: In cron mode,
curl | python3triggers security warnings. Save output to file first with-o /tmp/file, then parse withpython3 -creading from file. - GitHub API rate limits: Without authentication, GitHub API is limited to 60 req/hr. For 10 repos + description parsing per run this is fine, but batch requests if expanding.
- Show HN search prefers
search_by_date: The/searchendpoint returns all-time top, not recent. Use/search_by_datefor recent Show HN posts. - No xurl installed: X/Twitter mining won't work unless xurl CLI is installed and OAuth'd.
- Google Trends unavailable via simple curl: None of the documented public endpoints work (404). Skip silently.
Verification Checklist
- [ ] HN front page fetched and parsed correctly
- [ ] Ask HN fetched for demand signals
- [ ] Show HN (recent) fetched for new projects
- [ ] GitHub trending repos fetched
- [ ] Report is structured with all tables and sections
- [ ] File saved to correct path with date-stamped filename
- [ ] Report output as final message (cron delivery takes over)
Related Scripts
The legacy shell script at /root/.hermes/scripts/idea-miner_daily.sh references a Python script at ~/idea-miner/idea_miner.py that no longer exists. The cron jobs now run Hermes agent directly with the prompt, bypassing the shell script. If the shell script is ever re-enabled, it needs to be updated.
The user has provided the following instruction alongside the skill invocation: [IMPORTANT: You are running as a scheduled cron job. DELIVERY: Your final response will be automatically delivered to the user — do NOT use send_message or try to deliver the output yourself. Just produce your report/output as your final response and the system handles the rest. SILENT: If there is genuinely nothing new to report, respond with exactly "[SILENT]" (nothing else) to suppress delivery. Never combine [SILENT] with content — either report your findings normally, or say [SILENT] and nothing more.]
运行 Idea Miner 模块,挖掘今日的创意和灵感热点,然后将结果发送到 Telegram 用户 jinbin(Chat ID: 951402025)。如果没有发现热点,输出简明的"今日无新热点"。
文件保存
将完整的分析结果同时保存到本地文件:/opt/data/hermes/idea-miner/idea-miner_{YYYYMMDD}.md
Response
已保存至 /opt/data/hermes/idea-miner/idea-miner_20260730.md (5,068 bytes)。
以下是完整报告输出:
🧠 Idea Miner — 每日创意情报 (2026-07-30)
数据来源:HN Front Page, Ask HN, Show HN, GitHub Search (7日新星项目)
📢 需求现场 — 高意向需求 & 讨论
| # | 话题 | ⬆ | 💬 | 信号类型 |
|---|---|---|---|---|
| 1 | I'm an FCC Commissioner proposing regulation of IoT security updates | 3387 | 925 | 🏛 政策监管需求 |
| 2 | I'm a software engineer going blind, how should I prepare? | 3270 | 473 | ♿ 无障碍工具缺口 |
| 3 | Am I the longest-serving programmer – 57 years and counting? | 2634 | 531 | 🧓 老龄开发者社区 |
| 4 | Is S3 down? | 2589 | 1055 | ☁️ 云服务依赖风险 |
| 5 | Help restore the tax deduction for software dev in the US (Section 174) | 2439 | 907 | 💰 开发成本政策 |
| 6 | AI's top startups are barely publishing their research | 366 | 200 | 🔒 AI研究封闭化 |
| 7 | A.I. companies are recruiting electricians and carpenters by the thousands | 268 | 324 | 🏗 AI基建人才潮 |
洞察:
- 🔥 IoT安全更新监管 — FCC委员直接在HN征集意见,政策窗口期
- ⚠️ S3/云服务单点故障焦虑 — 1055条评论,多云/自托管方案持续需求
- 💡 AI研究封闭化趋势 — "AI透明度审计"方向有机会
📈 趋势项目 — GitHub 热门新仓库 (近7天)
| 项目 | ⭐ | 方向 |
|---|---|---|
| MoonshotAI/Kimi-K3 | 6659 | 🤖 开源前沿模型 |
| mshumer/Claude-of-Duty | 2290 | 🎮 AI游戏生成 |
| digimata/quill | 1686 | 📝 macOS转录工具 |
| mikiarlo3/ai-copywriter | 1050 | ✍️ AI营销文案 |
| VictorTaelin/OptMem | 885 | 🧠 Agent永久记忆 |
| MoonshotAI/MoonEP | 879 | ⚡ 训练基础设施 |
| xikhar/persona | 592 | 🗣 实时语音AI |
| mikehasa/agentacct | 534 | 💰 Agent审计面板 |
趋势:
开源模型(Kimi-K3 6.7K⭐) → AI游戏生成(2.3K⭐)
↓
Agent基础设施: 记忆(OptMem) + 审计(agentacct) + 协作(merge-queue)
= Agent DevOps工具链成型
↓
垂直场景: 转录(Quill) + 语音(persona) + 文案(ai-copywriter) 仍有蓝海
🔬 Show HN 精选
| 项目 | ⬆ | 亮点 |
|---|---|---|
| turbo-fieldfare | 736 | 2GB RAM跑Gemma 4 26B |
| CheapFoodMap | 177 | $10以下餐厅地图 |
| Qwen Scribe | 81 | Apple Silicon本地转录 |
| Bullshit Detector | 62 | Agent自动fact-check |
| Kedge | 58 | 可fork VM快照+全球SQLite |
| Claude Code Merge Queue | 30 | 多Agent并行合并 |
🌟 今日创业灵感精选
- Agent DevOps 工具链 ⭐⭐⭐ — 记忆+审计+协作同周爆火,整合平台空白
- 本地AI推理优化 ⭐⭐⭐ — 2GB跑26B模型,隐私优先AI产品窗口
- IoT安全合规 ⭐⭐ — FCC监管窗口期,to-B SaaS机会
- AI信息验证 ⭐⭐ — Agent原生fact-check,可嵌入RAG管线
✅ 已验证信号: Kimi-K3开源(6.7K⭐)、Claude-of-Duty AI游戏可行、Agent记忆是刚需(OptMem 885⭐)
📊 数据快照: 15条Front + 10条Ask HN + 10条Show HN + 10个GitHub项目 | 最热3387⬆ | 核心:Agent DevOps, 本地推理, IoT安全, AI游戏
Generated by Idea Miner @ 2026-07-30