Cron Job: trender-idea-miner

← 返回首页

Cron Job: trender-idea-miner

Job ID: 2a9306b6b96f
Run Time: 2026-07-28 07:01:53
Schedule: 0 7 * * *

Prompt

[IMPORTANT: The user has invoked the "idea-miner" skill, indicating they want you to follow its instructions. The full skill content is loaded below.]


name: idea-miner
description: Mine daily creative ideas & startup signals from HN/GitHub.
version: 1.0.0
author: Hermes Agent
license: MIT
metadata:
hermes:
tags: [ideas, trends, research, startup, daily-briefing]
related_skills: [youtube-content, blogwatcher]


🧠 Idea Miner — Daily Creative Intelligence

Overview

Mines today's creative ideas, inspiration hotspots, and startup signals from public sources. Produces a structured Markdown report with demand signals, trending projects, and actionable insights.

The report is saved to /opt/data/hermes/idea-miner/idea-miner_{YYYYMMDD}.md and delivered to the configured destination (Telegram, etc.).

When to Use

Data Sources

✅ Available & Tested

Source API Endpoint Notes
HN Algolia (front page) https://hn.algolia.com/api/v1/search?tags=front_page&hitsPerPage=20 Returns top stories with points
HN Algolia (Ask HN) https://hn.algolia.com/api/v1/search?tags=ask_hn&hitsPerPage=15 Good for demand/need signals
HN Algolia (Show HN recent) https://hn.algolia.com/api/v1/search_by_date?tags=show_hn&numericFilters=points%3E10&hitsPerPage=12 URL-encode > as %3E
HN Firebase (item detail) https://hacker-news.firebaseio.com/v0/item/{ID}.json Individual story metadata
GitHub Search (new repos) https://api.github.com/search/repositories?q=stars:%3E100+created:%3E{YYYY-MM-DD}&sort=stars&order=desc&per_page=10 Header: Accept: application/vnd.github.v3+json, User-Agent: HermesAgent/1.0

❌ Currently Unavailable

Source Issue
Reddit JSON API (old.reddit.com, www.reddit.com) Blocked by Reddit (403 "whoa there, pardner") — needs OAuth credentials
Reddit pullpush.io (public archive) Returns empty results from this IP
Google Trends RSS Endpoint trends.google.com/trendingsearches/daily/rss?geo=US returns 404
Google Trends API trends.google.com/trends/api/dailytrends returns 404
X/Twitter via xurl xurl CLI not installed on this VPS

Data Acquisition Workflow

  1. Use curl -s -o /tmp/filename.json -w '%{http_code}' to save to temp file first (avoids pipe-to-interpreter security blocks in cron mode)
  2. Parse with python3 -c "import json; data = json.load(open('/tmp/filename.json')); ..."
  3. Saved temp files are disposable — clean up or leave in /tmp

Report Format

The report uses Chinese (用户偏好) with the following sections:

# 🧠 Idea Miner — 每日创意情报 (YYYY-MM-DD)

> 数据来源:[list of sources used]

## 📢 需求现场 — 高意向需求 & 讨论
Top demand signals from Ask HN, discussions, needs

## 📈 趋势项目 — GitHub 热门新仓库
Table: project | ⭐ | description | direction
Followed by trend interpretation block (code fence with arrows)

## 🔬 Show HN 精选 — 本周最新项目
Table: project | points | description

## 🌟 今日创业灵感精选
### 高潜力方向
### 已验证信号

## 📊 数据快照
Key metrics summary table

Report Generation Steps

  1. Fetch HN front page — identifies the overall tech zeitgeist for the day
  2. Fetch HN Ask HN — captures user needs, pain points, and demand signals
  3. Fetch HN Show HN (recent, points>10) — captures new projects people are building
  4. Fetch GitHub trending repos (last 7 days) — identifies what developers are excited about
  5. Fetch additional sources if available (Reddit, Twitter, etc.)
  6. Synthesize findings into the structured report
  7. Save to file at /opt/data/hermes/idea-miner/idea-miner_{YYYYMMDD}.md
  8. Output the report as final response — the cron delivery system automatically delivers it

File Save Convention

Common Pitfalls

  1. HN Algolia URL encoding: The numericFilters parameter with > must use %3E not raw >. E.g. numericFilters=points%3E10
  2. Reddit API blocked: Don't retry Reddit JSON API with this IP — it's consistently 403. Only retry if OAuth creds are configured.
  3. Pipe-to-interpreter security blocks: In cron mode, curl | python3 triggers security warnings. Save output to file first with -o /tmp/file, then parse with python3 -c reading from file.
  4. GitHub API rate limits: Without authentication, GitHub API is limited to 60 req/hr. For 10 repos + description parsing per run this is fine, but batch requests if expanding.
  5. Show HN search prefers search_by_date: The /search endpoint returns all-time top, not recent. Use /search_by_date for recent Show HN posts.
  6. No xurl installed: X/Twitter mining won't work unless xurl CLI is installed and OAuth'd.
  7. Google Trends unavailable via simple curl: None of the documented public endpoints work (404). Skip silently.

Verification Checklist

Related Scripts

The legacy shell script at /root/.hermes/scripts/idea-miner_daily.sh references a Python script at ~/idea-miner/idea_miner.py that no longer exists. The cron jobs now run Hermes agent directly with the prompt, bypassing the shell script. If the shell script is ever re-enabled, it needs to be updated.

The user has provided the following instruction alongside the skill invocation: [IMPORTANT: You are running as a scheduled cron job. DELIVERY: Your final response will be automatically delivered to the user — do NOT use send_message or try to deliver the output yourself. Just produce your report/output as your final response and the system handles the rest. SILENT: If there is genuinely nothing new to report, respond with exactly "[SILENT]" (nothing else) to suppress delivery. Never combine [SILENT] with content — either report your findings normally, or say [SILENT] and nothing more.]

运行 Idea Miner 模块,挖掘今日的创意和灵感热点,然后将结果发送到 Telegram 用户 jinbin(Chat ID: 951402025)。如果没有发现热点,输出简明的"今日无新热点"。

文件保存

将完整的分析结果同时保存到本地文件:/opt/data/hermes/idea-miner/idea-miner_{YYYYMMDD}.md

Response

报告已生成并保存至 /opt/data/hermes/idea-miner/idea-miner_20260728.md


🧠 Idea Miner — 每日创意情报 (2026-07-28)

数据来源:HN Algolia (Front Page, Ask HN, Show HN) · GitHub Trending (过去7天)


📢 需求现场 — 高意向需求 & 讨论

热度 话题 看点
🔥26pts Internet is no longer accessible? 网络访问异常讨论
🔥26pts BMW shows in-car ads for Spiderman 车载广告引发众怒 → 去广告工具机会
🏗️10pts What apps are you building? 社区正在构建什么
🔒10pts Security implications of running projects 开源项目安全焦虑 → 沙箱运行需求
💊3pts LLMs to chemically redesign old drugs AI+药物化学再设计
🤖2pts Messaging platform for agents to communicate 自托管 Agent 通信平台需求

核心洞察:车载广告拦截工具、Agent 通信中间件、安全沙箱运行环境是今日最明显的未满足需求。


📈 趋势项目 — GitHub 热门新仓库

# 项目 方向
1 MoonshotAI/Kimi-K3 2389 开源前沿模型
2 vercel-labs/scriptc 1890 TypeScript 原生编译器
3 slvDev/esp32-ai 1830 ESP32 边缘 AI
4 mshumer/Claude-of-Duty 1084 单提示词生成 FPS
5 kvcache-ai/AgentENV 1058 Rust 分布式 Agent 平台
6 makecindy/cindy 916 开源 AI Agent
7 VictorTaelin/OptMem 671 Agent 永久记忆(426 token)
8 MoonshotAI/MoonEP 626 MoE 专家并行库

趋势流向:AI Agent 生态全线爆发 → 基础模型(Kimi-K3)→ Agent 基础设施(AgentENV, cindy, OptMem)→ 边缘部署(esp32-ai)


🔬 Show HN 精选

项目 Pts 亮点
FeyNoBg — 自动抠图 102 背景移除模型+训练库
Let's Seal — 自托管文档签名 83 Let's Encrypt 模式做签名
Yap — macOS 离线语音听写 51 无模型下载的本地语音输入
ReScript — Descript 开源替代 37 1 周末构建的音视频编辑平替
World Model Optimizer 44 半价部署前沿模型

🌟 今日创业灵感精选

高潜力方向 🚀
- 车载去广告工具 — BMW 车内广告引发热议,Pi-hole 车载版需求真实
- Agent 记忆中间件 — OptMem 426 token 方案验证了轻量路径
- 离线语音听写 — Yap 51pts,隐私敏感场景持续增长
- 免费文档签名基础设施 — Let's Seal 83pts,诚信用的自托管方案

已验证信号 ✅
- Kimi-K3 开源(2389⭐) → 基于开源模型的垂直 SaaS 机会
- esp32-ai(1830⭐) → IoT+AI 边缘需求真实快速增长
- $500 RL fine-tune 9B 模型打败前沿模型 → SMB AI 定制化进入可行区间


📊 数据快照

指标
HN 首页最高分 754pts (Anthropic 开源权重立场)
GitHub 趋势新库(>100⭐) 79 个
Top1 项目 Kimi-K3 (2389⭐)
今日关键词 AI Agent > 开源模型 > 边缘AI > 安全