Cron Job: trender-idea-miner
Job ID: 2a9306b6b96f
Run Time: 2026-07-28 07:01:53
Schedule: 0 7 * * *
Prompt
[IMPORTANT: The user has invoked the "idea-miner" skill, indicating they want you to follow its instructions. The full skill content is loaded below.]
name: idea-miner
description: Mine daily creative ideas & startup signals from HN/GitHub.
version: 1.0.0
author: Hermes Agent
license: MIT
metadata:
hermes:
tags: [ideas, trends, research, startup, daily-briefing]
related_skills: [youtube-content, blogwatcher]
🧠 Idea Miner — Daily Creative Intelligence
Overview
Mines today's creative ideas, inspiration hotspots, and startup signals from public sources. Produces a structured Markdown report with demand signals, trending projects, and actionable insights.
The report is saved to /opt/data/hermes/idea-miner/idea-miner_{YYYYMMDD}.md and delivered to the configured destination (Telegram, etc.).
When to Use
- Cron job for daily idea-mining runs (referenced by
trender-idea-minerand每日创意推送) - User asks: "what are today's hot ideas", "find me startup opportunities", "trending projects analysis"
- Any session that needs to synthesize multi-source trend intelligence
Data Sources
✅ Available & Tested
| Source | API Endpoint | Notes |
|---|---|---|
| HN Algolia (front page) | https://hn.algolia.com/api/v1/search?tags=front_page&hitsPerPage=20 |
Returns top stories with points |
| HN Algolia (Ask HN) | https://hn.algolia.com/api/v1/search?tags=ask_hn&hitsPerPage=15 |
Good for demand/need signals |
| HN Algolia (Show HN recent) | https://hn.algolia.com/api/v1/search_by_date?tags=show_hn&numericFilters=points%3E10&hitsPerPage=12 |
URL-encode > as %3E |
| HN Firebase (item detail) | https://hacker-news.firebaseio.com/v0/item/{ID}.json |
Individual story metadata |
| GitHub Search (new repos) | https://api.github.com/search/repositories?q=stars:%3E100+created:%3E{YYYY-MM-DD}&sort=stars&order=desc&per_page=10 |
Header: Accept: application/vnd.github.v3+json, User-Agent: HermesAgent/1.0 |
❌ Currently Unavailable
| Source | Issue |
|---|---|
Reddit JSON API (old.reddit.com, www.reddit.com) |
Blocked by Reddit (403 "whoa there, pardner") — needs OAuth credentials |
| Reddit pullpush.io (public archive) | Returns empty results from this IP |
| Google Trends RSS | Endpoint trends.google.com/trendingsearches/daily/rss?geo=US returns 404 |
| Google Trends API | trends.google.com/trends/api/dailytrends returns 404 |
| X/Twitter via xurl | xurl CLI not installed on this VPS |
Data Acquisition Workflow
- Use
curl -s -o /tmp/filename.json -w '%{http_code}'to save to temp file first (avoids pipe-to-interpreter security blocks in cron mode) - Parse with
python3 -c "import json; data = json.load(open('/tmp/filename.json')); ..." - Saved temp files are disposable — clean up or leave in /tmp
Report Format
The report uses Chinese (用户偏好) with the following sections:
# 🧠 Idea Miner — 每日创意情报 (YYYY-MM-DD)
> 数据来源:[list of sources used]
## 📢 需求现场 — 高意向需求 & 讨论
Top demand signals from Ask HN, discussions, needs
## 📈 趋势项目 — GitHub 热门新仓库
Table: project | ⭐ | description | direction
Followed by trend interpretation block (code fence with arrows)
## 🔬 Show HN 精选 — 本周最新项目
Table: project | points | description
## 🌟 今日创业灵感精选
### 高潜力方向
### 已验证信号
## 📊 数据快照
Key metrics summary table
Report Generation Steps
- Fetch HN front page — identifies the overall tech zeitgeist for the day
- Fetch HN Ask HN — captures user needs, pain points, and demand signals
- Fetch HN Show HN (recent, points>10) — captures new projects people are building
- Fetch GitHub trending repos (last 7 days) — identifies what developers are excited about
- Fetch additional sources if available (Reddit, Twitter, etc.)
- Synthesize findings into the structured report
- Save to file at
/opt/data/hermes/idea-miner/idea-miner_{YYYYMMDD}.md - Output the report as final response — the cron delivery system automatically delivers it
File Save Convention
- Directory:
/opt/data/hermes/idea-miner/ - Filename:
idea-miner_{YYYYMMDD}.md(e.g.,idea-miner_20260727.md) - If the directory doesn't exist, create it
Common Pitfalls
- HN Algolia URL encoding: The
numericFiltersparameter with>must use%3Enot raw>. E.g.numericFilters=points%3E10 - Reddit API blocked: Don't retry Reddit JSON API with this IP — it's consistently 403. Only retry if OAuth creds are configured.
- Pipe-to-interpreter security blocks: In cron mode,
curl | python3triggers security warnings. Save output to file first with-o /tmp/file, then parse withpython3 -creading from file. - GitHub API rate limits: Without authentication, GitHub API is limited to 60 req/hr. For 10 repos + description parsing per run this is fine, but batch requests if expanding.
- Show HN search prefers
search_by_date: The/searchendpoint returns all-time top, not recent. Use/search_by_datefor recent Show HN posts. - No xurl installed: X/Twitter mining won't work unless xurl CLI is installed and OAuth'd.
- Google Trends unavailable via simple curl: None of the documented public endpoints work (404). Skip silently.
Verification Checklist
- [ ] HN front page fetched and parsed correctly
- [ ] Ask HN fetched for demand signals
- [ ] Show HN (recent) fetched for new projects
- [ ] GitHub trending repos fetched
- [ ] Report is structured with all tables and sections
- [ ] File saved to correct path with date-stamped filename
- [ ] Report output as final message (cron delivery takes over)
Related Scripts
The legacy shell script at /root/.hermes/scripts/idea-miner_daily.sh references a Python script at ~/idea-miner/idea_miner.py that no longer exists. The cron jobs now run Hermes agent directly with the prompt, bypassing the shell script. If the shell script is ever re-enabled, it needs to be updated.
The user has provided the following instruction alongside the skill invocation: [IMPORTANT: You are running as a scheduled cron job. DELIVERY: Your final response will be automatically delivered to the user — do NOT use send_message or try to deliver the output yourself. Just produce your report/output as your final response and the system handles the rest. SILENT: If there is genuinely nothing new to report, respond with exactly "[SILENT]" (nothing else) to suppress delivery. Never combine [SILENT] with content — either report your findings normally, or say [SILENT] and nothing more.]
运行 Idea Miner 模块,挖掘今日的创意和灵感热点,然后将结果发送到 Telegram 用户 jinbin(Chat ID: 951402025)。如果没有发现热点,输出简明的"今日无新热点"。
文件保存
将完整的分析结果同时保存到本地文件:/opt/data/hermes/idea-miner/idea-miner_{YYYYMMDD}.md
Response
报告已生成并保存至 /opt/data/hermes/idea-miner/idea-miner_20260728.md。
🧠 Idea Miner — 每日创意情报 (2026-07-28)
数据来源:HN Algolia (Front Page, Ask HN, Show HN) · GitHub Trending (过去7天)
📢 需求现场 — 高意向需求 & 讨论
| 热度 | 话题 | 看点 |
|---|---|---|
| 🔥26pts | Internet is no longer accessible? | 网络访问异常讨论 |
| 🔥26pts | BMW shows in-car ads for Spiderman | 车载广告引发众怒 → 去广告工具机会 |
| 🏗️10pts | What apps are you building? | 社区正在构建什么 |
| 🔒10pts | Security implications of running projects | 开源项目安全焦虑 → 沙箱运行需求 |
| 💊3pts | LLMs to chemically redesign old drugs | AI+药物化学再设计 |
| 🤖2pts | Messaging platform for agents to communicate | 自托管 Agent 通信平台需求 |
核心洞察:车载广告拦截工具、Agent 通信中间件、安全沙箱运行环境是今日最明显的未满足需求。
📈 趋势项目 — GitHub 热门新仓库
| # | 项目 | ⭐ | 方向 |
|---|---|---|---|
| 1 | MoonshotAI/Kimi-K3 | 2389 | 开源前沿模型 |
| 2 | vercel-labs/scriptc | 1890 | TypeScript 原生编译器 |
| 3 | slvDev/esp32-ai | 1830 | ESP32 边缘 AI |
| 4 | mshumer/Claude-of-Duty | 1084 | 单提示词生成 FPS |
| 5 | kvcache-ai/AgentENV | 1058 | Rust 分布式 Agent 平台 |
| 6 | makecindy/cindy | 916 | 开源 AI Agent |
| 7 | VictorTaelin/OptMem | 671 | Agent 永久记忆(426 token) |
| 8 | MoonshotAI/MoonEP | 626 | MoE 专家并行库 |
趋势流向:AI Agent 生态全线爆发 → 基础模型(Kimi-K3)→ Agent 基础设施(AgentENV, cindy, OptMem)→ 边缘部署(esp32-ai)
🔬 Show HN 精选
| 项目 | Pts | 亮点 |
|---|---|---|
| FeyNoBg — 自动抠图 | 102 | 背景移除模型+训练库 |
| Let's Seal — 自托管文档签名 | 83 | Let's Encrypt 模式做签名 |
| Yap — macOS 离线语音听写 | 51 | 无模型下载的本地语音输入 |
| ReScript — Descript 开源替代 | 37 | 1 周末构建的音视频编辑平替 |
| World Model Optimizer | 44 | 半价部署前沿模型 |
🌟 今日创业灵感精选
高潜力方向 🚀
- 车载去广告工具 — BMW 车内广告引发热议,Pi-hole 车载版需求真实
- Agent 记忆中间件 — OptMem 426 token 方案验证了轻量路径
- 离线语音听写 — Yap 51pts,隐私敏感场景持续增长
- 免费文档签名基础设施 — Let's Seal 83pts,诚信用的自托管方案
已验证信号 ✅
- Kimi-K3 开源(2389⭐) → 基于开源模型的垂直 SaaS 机会
- esp32-ai(1830⭐) → IoT+AI 边缘需求真实快速增长
- $500 RL fine-tune 9B 模型打败前沿模型 → SMB AI 定制化进入可行区间
📊 数据快照
| 指标 | 值 |
|---|---|
| HN 首页最高分 | 754pts (Anthropic 开源权重立场) |
| GitHub 趋势新库(>100⭐) | 79 个 |
| Top1 项目 | Kimi-K3 (2389⭐) |
| 今日关键词 | AI Agent > 开源模型 > 边缘AI > 安全 |