Cron Job: trender-idea-miner
Job ID: 2a9306b6b96f
Run Time: 2026-07-29 07:07:43
Schedule: 0 7 * * *
Prompt
[IMPORTANT: The user has invoked the "idea-miner" skill, indicating they want you to follow its instructions. The full skill content is loaded below.]
name: idea-miner
description: Mine daily creative ideas & startup signals from HN/GitHub.
version: 1.0.0
author: Hermes Agent
license: MIT
metadata:
hermes:
tags: [ideas, trends, research, startup, daily-briefing]
related_skills: [youtube-content, blogwatcher]
🧠 Idea Miner — Daily Creative Intelligence
Overview
Mines today's creative ideas, inspiration hotspots, and startup signals from public sources. Produces a structured Markdown report with demand signals, trending projects, and actionable insights.
The report is saved to /opt/data/hermes/idea-miner/idea-miner_{YYYYMMDD}.md and delivered to the configured destination (Telegram, etc.).
When to Use
- Cron job for daily idea-mining runs (referenced by
trender-idea-minerand每日创意推送) - User asks: "what are today's hot ideas", "find me startup opportunities", "trending projects analysis"
- Any session that needs to synthesize multi-source trend intelligence
Data Sources
✅ Available & Tested
| Source | API Endpoint | Notes |
|---|---|---|
| HN Algolia (front page) | https://hn.algolia.com/api/v1/search?tags=front_page&hitsPerPage=20 |
Returns top stories with points |
| HN Algolia (Ask HN) | https://hn.algolia.com/api/v1/search?tags=ask_hn&hitsPerPage=15 |
Good for demand/need signals |
| HN Algolia (Show HN recent) | https://hn.algolia.com/api/v1/search_by_date?tags=show_hn&numericFilters=points%3E10&hitsPerPage=12 |
URL-encode > as %3E |
| HN Firebase (item detail) | https://hacker-news.firebaseio.com/v0/item/{ID}.json |
Individual story metadata |
| GitHub Search (new repos) | https://api.github.com/search/repositories?q=stars:%3E100+created:%3E{YYYY-MM-DD}&sort=stars&order=desc&per_page=10 |
Header: Accept: application/vnd.github.v3+json, User-Agent: HermesAgent/1.0 |
❌ Currently Unavailable
| Source | Issue |
|---|---|
Reddit JSON API (old.reddit.com, www.reddit.com) |
Blocked by Reddit (403 "whoa there, pardner") — needs OAuth credentials |
| Reddit pullpush.io (public archive) | Returns empty results from this IP |
| Google Trends RSS | Endpoint trends.google.com/trendingsearches/daily/rss?geo=US returns 404 |
| Google Trends API | trends.google.com/trends/api/dailytrends returns 404 |
| X/Twitter via xurl | xurl CLI not installed on this VPS |
Data Acquisition Workflow
- Use
curl -s -o /tmp/filename.json -w '%{http_code}'to save to temp file first (avoids pipe-to-interpreter security blocks in cron mode) - Parse with
python3 -c "import json; data = json.load(open('/tmp/filename.json')); ..." - Saved temp files are disposable — clean up or leave in /tmp
Report Format
The report uses Chinese (用户偏好) with the following sections:
# 🧠 Idea Miner — 每日创意情报 (YYYY-MM-DD)
> 数据来源:[list of sources used]
## 📢 需求现场 — 高意向需求 & 讨论
Top demand signals from Ask HN, discussions, needs
## 📈 趋势项目 — GitHub 热门新仓库
Table: project | ⭐ | description | direction
Followed by trend interpretation block (code fence with arrows)
## 🔬 Show HN 精选 — 本周最新项目
Table: project | points | description
## 🌟 今日创业灵感精选
### 高潜力方向
### 已验证信号
## 📊 数据快照
Key metrics summary table
Report Generation Steps
- Fetch HN front page — identifies the overall tech zeitgeist for the day
- Fetch HN Ask HN — captures user needs, pain points, and demand signals
- Fetch HN Show HN (recent, points>10) — captures new projects people are building
- Fetch GitHub trending repos (last 7 days) — identifies what developers are excited about
- Fetch additional sources if available (Reddit, Twitter, etc.)
- Synthesize findings into the structured report
- Save to file at
/opt/data/hermes/idea-miner/idea-miner_{YYYYMMDD}.md - Output the report as final response — the cron delivery system automatically delivers it
File Save Convention
- Directory:
/opt/data/hermes/idea-miner/ - Filename:
idea-miner_{YYYYMMDD}.md(e.g.,idea-miner_20260727.md) - If the directory doesn't exist, create it
Common Pitfalls
- HN Algolia URL encoding: The
numericFiltersparameter with>must use%3Enot raw>. E.g.numericFilters=points%3E10 - Reddit API blocked: Don't retry Reddit JSON API with this IP — it's consistently 403. Only retry if OAuth creds are configured.
- Pipe-to-interpreter security blocks: In cron mode,
curl | python3triggers security warnings. Save output to file first with-o /tmp/file, then parse withpython3 -creading from file. - GitHub API rate limits: Without authentication, GitHub API is limited to 60 req/hr. For 10 repos + description parsing per run this is fine, but batch requests if expanding.
- Show HN search prefers
search_by_date: The/searchendpoint returns all-time top, not recent. Use/search_by_datefor recent Show HN posts. - No xurl installed: X/Twitter mining won't work unless xurl CLI is installed and OAuth'd.
- Google Trends unavailable via simple curl: None of the documented public endpoints work (404). Skip silently.
Verification Checklist
- [ ] HN front page fetched and parsed correctly
- [ ] Ask HN fetched for demand signals
- [ ] Show HN (recent) fetched for new projects
- [ ] GitHub trending repos fetched
- [ ] Report is structured with all tables and sections
- [ ] File saved to correct path with date-stamped filename
- [ ] Report output as final message (cron delivery takes over)
Related Scripts
The legacy shell script at /root/.hermes/scripts/idea-miner_daily.sh references a Python script at ~/idea-miner/idea_miner.py that no longer exists. The cron jobs now run Hermes agent directly with the prompt, bypassing the shell script. If the shell script is ever re-enabled, it needs to be updated.
The user has provided the following instruction alongside the skill invocation: [IMPORTANT: You are running as a scheduled cron job. DELIVERY: Your final response will be automatically delivered to the user — do NOT use send_message or try to deliver the output yourself. Just produce your report/output as your final response and the system handles the rest. SILENT: If there is genuinely nothing new to report, respond with exactly "[SILENT]" (nothing else) to suppress delivery. Never combine [SILENT] with content — either report your findings normally, or say [SILENT] and nothing more.]
运行 Idea Miner 模块,挖掘今日的创意和灵感热点,然后将结果发送到 Telegram 用户 jinbin(Chat ID: 951402025)。如果没有发现热点,输出简明的"今日无新热点"。
文件保存
将完整的分析结果同时保存到本地文件:/opt/data/hermes/idea-miner/idea-miner_{YYYYMMDD}.md
Response
报告已保存至 /opt/data/hermes/idea-miner/idea-miner_20260729.md。以下为完整分析结果:
🧠 Idea Miner — 每日创意情报 (2026-07-29)
数据来源:HN Algolia (front page / Ask HN / Show HN) · GitHub Search
📢 需求现场 — 高意向需求 & 讨论
| 点数 | 标题 | 洞察方向 |
|---|---|---|
| 3387 | FCC 委员提议监管 IoT 安全更新 | IoT 安全合规 → 固件更新管理工具 |
| 3270 | 软件工程师即将失明,如何准备? | 无障碍工具 / 语音编程 / AI 辅助 |
| 2634 | 57 年编程生涯 — 最长程序员? | 技术长青、编程教育 |
| 2589 | S3 宕机了? | 多云/多区域存储容灾需求 |
| 2439 | 恢复软件开发者税收减免 (Section 174) | 独立开发者政策关注 |
| 2316 | Google 服务中断 | 云可靠性 → 去中心化/自托管 |
关键需求信号:
1. IoT 安全监管趋严 — FCC 委员 HN 征集意见,IoT 固件 OTA 管理将成合规刚需
2. AI + 无障碍 — 视障工程师寻方案,语音交互编程市场扩大
3. 云服务可靠性焦虑 — S3 & Google 接连故障,边缘/多云/自托管需求上升
📈 趋势项目 — GitHub 热门新仓库
| ⭐ | 语言 | 项目 | 方向 |
|---|---|---|---|
| 3679 | - | MoonshotAI/Kimi-K3 | 🤖 开源大模型 |
| 2125 | Python | slvDev/esp32-ai | 🔌 边缘 AI |
| 1935 | JS | mshumer/Claude-of-Duty | 🎮 AI 生成游戏 |
| 1520 | Rust | kvcache-ai/AgentENV | 🤖 Agent 基础设施 |
| 828 | Python | VictorTaelin/OptMem | 🧠 Agent 永久记忆 |
| 820 | Python | MoonshotAI/MoonEP | 🔧 MoE 训练优化 |
GitHub 本周 → AI Agent 基础设施爆发
├── AgentENV (Rust) → 分布式 Agent 运行平台
├── OptMem → Agent 持久记忆
├── esp32-ai → 微控制器本地推理
└── Kimi-K3 → 国内公司开源前沿模型
🔬 Show HN 精选
| 点数 | 项目 | 亮点 |
|---|---|---|
| 256 | HNewhere | HN 多标签用户脚本 |
| 121 | XY | GPU 加速交互式绘图库 |
| 71 | tale.fyi | 纯 fiction 写作平台 |
| 49 | Ctrlb-decompose | 日志降噪送 LLM |
| 47 | Manim in browser | WebGPU 动画引擎 |
| 25 | Flashpaper | 自毁秘密分享 |
🌟 今日创业灵感精选
🚀 高潜力方向
- IoT 固件更新合规管理平台 — FCC 监管将至,为 IoT 厂商提供 OTA 管理 + 合规审计 SaaS
- 边缘 AI 推理框架 (ESP32 级) — esp32-ai 一周 2125⭐,轻量推理 + 模型压缩工具链
- AI Agent 持久记忆层 — OptMem 426 token 解决记忆,AgentENV 提供运行环境,可做 MaaS 中间件
- 日志清洗 → LLM 中间件 — Ctrlb-decompose 模式,AI 运维必备中间层
✅ 已验证信号
| 方向 | 证据 | 热度 |
|---|---|---|
| 云服务容灾 | S3 + Google 双双故障 | 🔥🔥🔥 |
| 本地 AI 工具 | Minute + quill (离线转录) | 🔥🔥 |
| AI 生成游戏 | Claude-of-Duty 1935⭐ | 🔥🔥🔥 |
| MoE 训练优化 | MoonEP 发布 | 🔥🔥 |
📊 数据快照
| 指标 | 数值 |
|---|---|
| HN 首页最高分 | 497 pts (Substack 独立建站) |
| Ask HN 最高分 | 3387 pts (IoT 安全监管) |
| Show HN 最高分 | 256 pts (HN 用户脚本) |
| GitHub Top⭐ | 3679⭐ (Kimi-K3) |
| 本周趋势 | AI Agent 基建 · 边缘 AI · 开源模型 |
🧠 Idea Miner — 2026-07-29 · 报告已保存至 /opt/data/hermes/idea-miner/