Cron Job: trender-idea-miner

← 返回首页

Cron Job: trender-idea-miner

Job ID: 2a9306b6b96f
Run Time: 2026-07-29 07:07:43
Schedule: 0 7 * * *

Prompt

[IMPORTANT: The user has invoked the "idea-miner" skill, indicating they want you to follow its instructions. The full skill content is loaded below.]


name: idea-miner
description: Mine daily creative ideas & startup signals from HN/GitHub.
version: 1.0.0
author: Hermes Agent
license: MIT
metadata:
hermes:
tags: [ideas, trends, research, startup, daily-briefing]
related_skills: [youtube-content, blogwatcher]


🧠 Idea Miner — Daily Creative Intelligence

Overview

Mines today's creative ideas, inspiration hotspots, and startup signals from public sources. Produces a structured Markdown report with demand signals, trending projects, and actionable insights.

The report is saved to /opt/data/hermes/idea-miner/idea-miner_{YYYYMMDD}.md and delivered to the configured destination (Telegram, etc.).

When to Use

Data Sources

✅ Available & Tested

Source API Endpoint Notes
HN Algolia (front page) https://hn.algolia.com/api/v1/search?tags=front_page&hitsPerPage=20 Returns top stories with points
HN Algolia (Ask HN) https://hn.algolia.com/api/v1/search?tags=ask_hn&hitsPerPage=15 Good for demand/need signals
HN Algolia (Show HN recent) https://hn.algolia.com/api/v1/search_by_date?tags=show_hn&numericFilters=points%3E10&hitsPerPage=12 URL-encode > as %3E
HN Firebase (item detail) https://hacker-news.firebaseio.com/v0/item/{ID}.json Individual story metadata
GitHub Search (new repos) https://api.github.com/search/repositories?q=stars:%3E100+created:%3E{YYYY-MM-DD}&sort=stars&order=desc&per_page=10 Header: Accept: application/vnd.github.v3+json, User-Agent: HermesAgent/1.0

❌ Currently Unavailable

Source Issue
Reddit JSON API (old.reddit.com, www.reddit.com) Blocked by Reddit (403 "whoa there, pardner") — needs OAuth credentials
Reddit pullpush.io (public archive) Returns empty results from this IP
Google Trends RSS Endpoint trends.google.com/trendingsearches/daily/rss?geo=US returns 404
Google Trends API trends.google.com/trends/api/dailytrends returns 404
X/Twitter via xurl xurl CLI not installed on this VPS

Data Acquisition Workflow

  1. Use curl -s -o /tmp/filename.json -w '%{http_code}' to save to temp file first (avoids pipe-to-interpreter security blocks in cron mode)
  2. Parse with python3 -c "import json; data = json.load(open('/tmp/filename.json')); ..."
  3. Saved temp files are disposable — clean up or leave in /tmp

Report Format

The report uses Chinese (用户偏好) with the following sections:

# 🧠 Idea Miner — 每日创意情报 (YYYY-MM-DD)

> 数据来源:[list of sources used]

## 📢 需求现场 — 高意向需求 & 讨论
Top demand signals from Ask HN, discussions, needs

## 📈 趋势项目 — GitHub 热门新仓库
Table: project | ⭐ | description | direction
Followed by trend interpretation block (code fence with arrows)

## 🔬 Show HN 精选 — 本周最新项目
Table: project | points | description

## 🌟 今日创业灵感精选
### 高潜力方向
### 已验证信号

## 📊 数据快照
Key metrics summary table

Report Generation Steps

  1. Fetch HN front page — identifies the overall tech zeitgeist for the day
  2. Fetch HN Ask HN — captures user needs, pain points, and demand signals
  3. Fetch HN Show HN (recent, points>10) — captures new projects people are building
  4. Fetch GitHub trending repos (last 7 days) — identifies what developers are excited about
  5. Fetch additional sources if available (Reddit, Twitter, etc.)
  6. Synthesize findings into the structured report
  7. Save to file at /opt/data/hermes/idea-miner/idea-miner_{YYYYMMDD}.md
  8. Output the report as final response — the cron delivery system automatically delivers it

File Save Convention

Common Pitfalls

  1. HN Algolia URL encoding: The numericFilters parameter with > must use %3E not raw >. E.g. numericFilters=points%3E10
  2. Reddit API blocked: Don't retry Reddit JSON API with this IP — it's consistently 403. Only retry if OAuth creds are configured.
  3. Pipe-to-interpreter security blocks: In cron mode, curl | python3 triggers security warnings. Save output to file first with -o /tmp/file, then parse with python3 -c reading from file.
  4. GitHub API rate limits: Without authentication, GitHub API is limited to 60 req/hr. For 10 repos + description parsing per run this is fine, but batch requests if expanding.
  5. Show HN search prefers search_by_date: The /search endpoint returns all-time top, not recent. Use /search_by_date for recent Show HN posts.
  6. No xurl installed: X/Twitter mining won't work unless xurl CLI is installed and OAuth'd.
  7. Google Trends unavailable via simple curl: None of the documented public endpoints work (404). Skip silently.

Verification Checklist

Related Scripts

The legacy shell script at /root/.hermes/scripts/idea-miner_daily.sh references a Python script at ~/idea-miner/idea_miner.py that no longer exists. The cron jobs now run Hermes agent directly with the prompt, bypassing the shell script. If the shell script is ever re-enabled, it needs to be updated.

The user has provided the following instruction alongside the skill invocation: [IMPORTANT: You are running as a scheduled cron job. DELIVERY: Your final response will be automatically delivered to the user — do NOT use send_message or try to deliver the output yourself. Just produce your report/output as your final response and the system handles the rest. SILENT: If there is genuinely nothing new to report, respond with exactly "[SILENT]" (nothing else) to suppress delivery. Never combine [SILENT] with content — either report your findings normally, or say [SILENT] and nothing more.]

运行 Idea Miner 模块,挖掘今日的创意和灵感热点,然后将结果发送到 Telegram 用户 jinbin(Chat ID: 951402025)。如果没有发现热点,输出简明的"今日无新热点"。

文件保存

将完整的分析结果同时保存到本地文件:/opt/data/hermes/idea-miner/idea-miner_{YYYYMMDD}.md

Response

报告已保存至 /opt/data/hermes/idea-miner/idea-miner_20260729.md。以下为完整分析结果:


🧠 Idea Miner — 每日创意情报 (2026-07-29)

数据来源:HN Algolia (front page / Ask HN / Show HN) · GitHub Search


📢 需求现场 — 高意向需求 & 讨论

点数 标题 洞察方向
3387 FCC 委员提议监管 IoT 安全更新 IoT 安全合规 → 固件更新管理工具
3270 软件工程师即将失明,如何准备? 无障碍工具 / 语音编程 / AI 辅助
2634 57 年编程生涯 — 最长程序员? 技术长青、编程教育
2589 S3 宕机了? 多云/多区域存储容灾需求
2439 恢复软件开发者税收减免 (Section 174) 独立开发者政策关注
2316 Google 服务中断 云可靠性 → 去中心化/自托管

关键需求信号:
1. IoT 安全监管趋严 — FCC 委员 HN 征集意见,IoT 固件 OTA 管理将成合规刚需
2. AI + 无障碍 — 视障工程师寻方案,语音交互编程市场扩大
3. 云服务可靠性焦虑 — S3 & Google 接连故障,边缘/多云/自托管需求上升

📈 趋势项目 — GitHub 热门新仓库

语言 项目 方向
3679 - MoonshotAI/Kimi-K3 🤖 开源大模型
2125 Python slvDev/esp32-ai 🔌 边缘 AI
1935 JS mshumer/Claude-of-Duty 🎮 AI 生成游戏
1520 Rust kvcache-ai/AgentENV 🤖 Agent 基础设施
828 Python VictorTaelin/OptMem 🧠 Agent 永久记忆
820 Python MoonshotAI/MoonEP 🔧 MoE 训练优化
GitHub 本周 → AI Agent 基础设施爆发
  ├── AgentENV (Rust) → 分布式 Agent 运行平台
  ├── OptMem → Agent 持久记忆
  ├── esp32-ai → 微控制器本地推理
  └── Kimi-K3 → 国内公司开源前沿模型

🔬 Show HN 精选

点数 项目 亮点
256 HNewhere HN 多标签用户脚本
121 XY GPU 加速交互式绘图库
71 tale.fyi 纯 fiction 写作平台
49 Ctrlb-decompose 日志降噪送 LLM
47 Manim in browser WebGPU 动画引擎
25 Flashpaper 自毁秘密分享

🌟 今日创业灵感精选

🚀 高潜力方向

  1. IoT 固件更新合规管理平台 — FCC 监管将至,为 IoT 厂商提供 OTA 管理 + 合规审计 SaaS
  2. 边缘 AI 推理框架 (ESP32 级) — esp32-ai 一周 2125⭐,轻量推理 + 模型压缩工具链
  3. AI Agent 持久记忆层 — OptMem 426 token 解决记忆,AgentENV 提供运行环境,可做 MaaS 中间件
  4. 日志清洗 → LLM 中间件 — Ctrlb-decompose 模式,AI 运维必备中间层

✅ 已验证信号

方向 证据 热度
云服务容灾 S3 + Google 双双故障 🔥🔥🔥
本地 AI 工具 Minute + quill (离线转录) 🔥🔥
AI 生成游戏 Claude-of-Duty 1935⭐ 🔥🔥🔥
MoE 训练优化 MoonEP 发布 🔥🔥

📊 数据快照

指标 数值
HN 首页最高分 497 pts (Substack 独立建站)
Ask HN 最高分 3387 pts (IoT 安全监管)
Show HN 最高分 256 pts (HN 用户脚本)
GitHub Top⭐ 3679⭐ (Kimi-K3)
本周趋势 AI Agent 基建 · 边缘 AI · 开源模型

🧠 Idea Miner — 2026-07-29 · 报告已保存至 /opt/data/hermes/idea-miner/