https://apify.com/mick-johnson/topic-radar Skip to content Apify logoApify logo Get started Log in * Product Back Promotion image background Start here! Get data with ready-made web scrapers for popular websites Browse 13,983 Actors Apify platform + Apify Store Pre-built web scraping tools + Actors Build and run serverless programs + Integrations Connect with apps and services + MCP Give your AI access to Actors Anti-blocking + Anti-blocking Scrape without getting blocked + Proxy Rotate scraper IP addresses Open source + Crawlee Web scraping and crawling library * Solutions Back Promotion image background MCP server configuration Configure your Apify MCP server with Actors and tools for seamless integration with MCP clients. Start building Web data for + Enterprise + Startups + Universities + Nonprofits Use cases + Data for generative AI + Data for AI agents + Lead generation + Market research + View more - Consulting + Apify Professional Services + Apify Partners * Developers Back + Documentation Full reference for the Apify platform Get started + Code templates Python, JavaScript, and TypeScript + Web scraping academy Courses for beginners and experts + Monetize your code Publish your scrapers and get paid Learn + API reference + CLI + SDK + MCP + Crawlee Promotion image background Earn from your code $596k paid out in December. Many developers earn $3k+ every month. Start earning now * Resources Back + Help and support Advice and answers about Apify + Actor ideas Get inspired to build Actors + Changelog See what's new on Apify + Customer stories Find out how others use Apify Company + About Apify + Contact us + Blog + Live events + Partners + Jobs We're hiring! Promotion image background Join our Discord Talk to scraping experts * Pricing * Contact sales Topic Radar avatar Topic Radar Pricing Pay per usage Try for free Go to Apify Store Topic Radar Topic Radar mick-johnson/topic-radar Try for free Ask questions about this Actor Track any topic across the internet and get aggregated, ranked results from multiple sources in one place. Perfect for market research, competitive intelligence, trend monitoring, content creation, and staying updated on any subject. Pricing Pay per usage Rating 5.0 (1) Developer mick johnson mick johnson Maintained by Community Actor stats 1 Bookmarked 2 Total users 0 Monthly active users 8 hours ago Last modified Categories News Integrations Other Share README Input Pricing API Reviews Issues TopicRadar - AI Research Assistant Track any topic across the internet and get aggregated, ranked results from multiple sources in one place. Perfect for market research, competitive intelligence, trend monitoring, content creation, and staying updated on any subject. Features * Trending Topics: One-click access to curated trending topics in AI/ML, Startups, Development, and Research * Multi-Source Aggregation: Search across 7 reliable platforms: Hacker News, GitHub, arXiv, StackOverflow, Lobste.rs, Papers with Code, Semantic Scholar * Smart Ranking: Relevance-based, engagement-based, recency-based, or balanced ranking strategies * Intelligent Deduplication: Automatically removes duplicate content across sources * Rich Metadata: Engagement metrics, publication dates, authors, and more * Multiple Output Formats: JSON datasets or formatted Markdown reports * [?] Fast & Parallel: Fetches from all sources simultaneously for quick results * [?] Highly Configurable: Filter by time range, engagement threshold, and more Quick Start Trending Topics (One-Click) The easiest way to get started - just select a trending category: { "searchMode": "trending-ai" } Available trending modes: * trending-ai: AI agents, LLMs, GPT-4, Claude, machine learning, neural networks * trending-startup: YC companies, startup funding, SaaS, bootstrapping, venture capital * trending-dev: React, TypeScript, Rust, Kubernetes, DevOps, microservices * trending-research: quantum computing, climate tech, biotech, fusion energy, CRISPR Custom Topics Example Or define your own topics to track: { "searchMode": "custom", "topics": ["AI agents", "machine learning"], "sources": ["hackernews", "github", "arxiv", "stackoverflow", "lobsters", "paperswithcode", "semanticscholar"], "timeRange": "7d", "rankingStrategy": "balanced" } This will search for content about "AI agents" and "machine learning" from the last 7 days across all 7 sources, returning results ranked by a balanced algorithm. Advanced Example { "searchMode": "custom", "topics": ["climate tech", "carbon capture", "renewable energy"], "sources": ["hackernews", "github", "arxiv"], "timeRange": "30d", "maxResultsPerSource": 50, "rankingStrategy": "relevance", "minEngagementThreshold": 10, "includeSnippets": true, "outputFormat": "both" } Use Cases 1. Quick Trend Check Use trending topics for instant insights: { "searchMode": "trending-startup" } 2. Market Research Track competitors, industry trends, and emerging technologies: { "searchMode": "custom", "topics": ["your-competitor-name", "industry-trend"], "sources": ["hackernews", "github"], "timeRange": "7d" } 3. Content Creation Find trending topics and popular discussions for content ideas: { "searchMode": "trending-dev", "rankingStrategy": "engagement" } 4. Academic Research Discover recent papers and discussions in your field: { "searchMode": "custom", "topics": ["machine learning", "neural networks"], "sources": ["arxiv", "github"], "timeRange": "30d" } 5. Weekly Tech Digest Get a weekly overview of what's trending: { "searchMode": "trending-ai", "timeRange": "7d", "minEngagementThreshold": 20 } [?][?] Input Configuration Parameter Type Required Default Description Search mode: searchMode string No "trending-ai" trending categories or "custom" Keywords or topics array Only if - phrases to custom track (1-10 items) sources array No All 5 sources Content sources to search Time period: timeRange string No "7d" "24h", "7d", or "30d" Maximum results maxResultsPerSource integer No 25 per source (5-100) Ranking method: "relevance", rankingStrategy string No "balanced" "engagement", "recent", or "balanced" Minimum minEngagementThreshold integer No 5 engagement score to include results Include content includeSnippets boolean No true preview snippets Output format: outputFormat string No "json" "json", "markdown", or "both" Available Sources TopicRadar aggregates from 7 reliable platforms with official APIs: * hackernews: Hacker News stories and discussions - Tech news and startup content * github: GitHub repositories - Open source projects and code * arxiv: arXiv research papers - Academic publications and scientific research * stackoverflow: StackOverflow questions - Programming Q&A and technical discussions * lobsters: Lobste.rs - Tech-focused community discussions * paperswithcode: ML research papers with code implementations * semanticscholar: Academic paper search engine with citation data All sources use official APIs and are optimized for consistent performance and reliability. Ranking Strategies * relevance: Best keyword matches and topic alignment * engagement: Most upvotes, comments, and reactions * recent: Newest content first * balanced: Combination of all factors (recommended) Output Format JSON Dataset Each result includes: { "title": "Article or post title", "url": "https://example.com/article", "source": "hackernews", "author": "username", "publishedDate": "2026-01-15T10:30:00.000Z", "snippet": "Preview text from the content...", "relevanceScore": 85.5, "engagementMetrics": { "upvotes": 234, "comments": 56, "points": 234 }, "matchedTopics": ["AI agents", "LLM"], "metadata": { // Source-specific metadata } } Markdown Report If outputFormat is set to "markdown" or "both", a formatted report will be saved to the Key-Value Store as report.md, including: * Top 10 results with full details * Results grouped by source * Results grouped by topic * Summary statistics Tips for Best Results 1. Be Specific with Topics: Use specific keywords rather than generic terms + Good: "React Server Components", "GPT-4 API" + Too broad: "programming", "AI" 2. Choose Relevant Sources: Different sources have different audiences + Dev content: hackernews, github, stackoverflow + Academic: arxiv, github + Tech discussions: hackernews, lobsters 3. Adjust Time Range: Balance freshness vs. quantity + Breaking news: 24h + Weekly trends: 7d + Deep research: 30d 4. Filter Noise: Use minEngagementThreshold to focus on quality + Popular content only: Set to 20-50 + Include emerging content: Set to 5-10 + Everything: Set to 0 5. Optimize Costs: Limit maxResultsPerSource if you want faster, cheaper runs + Quick scan: 10-15 per source + Thorough research: 50-100 per source Advanced Usage Schedule Regular Monitoring Use Apify's scheduling feature to run TopicRadar daily or weekly: 1. Configure your input 2. Go to Actor Settings - Schedule 3. Set up cron schedule (e.g., 0 9 * * 1 for every Monday at 9 AM) Integrate with Other Tools Use Apify's webhooks to send results to: * Slack/Discord for team notifications * Google Sheets for tracking over time * Your own API for custom processing * Email for digest reports Add GitHub Token for Better Rate Limits If you're searching GitHub heavily, add your GitHub personal access token: 1. Go to Actor Settings - Environment Variables 2. Add GITHUB_TOKEN with your token 3. This increases rate limit from 60 to 5,000 requests/hour Performance & Costs * Runtime: Typically 30-90 seconds depending on sources and result count * Memory: ~256MB (standard Actor) * API Calls: All sources use free public APIs (except GitHub without token) * Cost: Minimal - mostly platform compute time Optimization Tips * Use fewer sources for faster runs * Lower maxResultsPerSource for cost savings * Set appropriate minEngagementThreshold to filter noise * Use timeRange: "24h" for quick daily scans Quality & Reliability * Robust error handling - individual source failures won't crash the Actor * Rate limiting protection - respects API limits automatically * Deduplication - smart URL normalization and content matching * Validated input/output schemas - ensures data quality * Comprehensive logging - easy debugging and monitoring Troubleshooting "No results found" * Try broader keywords * Increase timeRange to 30d * Lower minEngagementThreshold to 0 * Check if topics are spelled correctly "GitHub rate limit exceeded" * Add GITHUB_TOKEN environment variable * Reduce number of topics * Remove github from sources temporarily "Actor timeout" * Reduce maxResultsPerSource * Use fewer sources * Split topics across multiple runs Changelog v1.0.0 (2026-01-20) * Trending Topics feature with 4 curated categories * Multi-source aggregation (5 reliable sources) * Multiple ranking strategies * Markdown report generation * Smart deduplication * [?] Optimized for reliability and performance Support Need help or have suggestions? * Open an issue on GitHub * Contact: mick.jae.johnson@gmail.com * Check the Apify Actor documentation License Apache 2.0 --------------------------------------------------------------------- Built with [?] for the Apify $1M Challenge Happy researching! NEW - Broader Appeal Sources: * techmeme: Tech news aggregator - what industry leaders are reading * phnews: Product Hunt daily trending products and launches * + + o o o + o o o o o + o o + o o + + o o o + o + + o o o + o + + You might also like Competitor Content Radar avatar Competitor Content Radar intelligence-automation/competitor-content-radar Monitor competitor websites and detect new pages, content updates, and topic shifts with AI-powered analysis. Get intelligent summaries, webhook notifications, and track changes over time. Perfect for SEO teams, content strategists, and competitive intelligence. User avatar intelligence automation 2 5.0 (1) Tech News Article Scraper avatar Tech News Article Scraper inquisitive_sarangi/news-article-scraper Tech News Article Scraper is a simple yet powerful tool to extract news articles from a variety of popular news websites. Supported The Verge, CNET, Wired, TechCrunch, Ars Technica, Tech Radar, Engadget User avatar API Master 79 Tiktok Scraper (Pay Per Result) avatar Tiktok Scraper (Pay Per Result) apidojo/tiktok-scraper Extract TikTok profiles, videos, hashtags, comments at 600 posts/sec. No proxy, 98% success rate. Scrape music, locations & user data with query builder. Export JSON/CSV, API integration. Perfect for influencer discovery, lead gen, market research. $0.30 per 1K posts. User avatar API Dojo 4K 4.8 (16) Bloomberg News Scraper avatar Bloomberg News Scraper romy/bloomberg-news-scraper Bloomberg News Scraper is an advanced scraper that allows you to access and extract content from Bloomberg News, even for articles that usually require a subscription. This scraper uses bypass techniques to circumvent the "Subscribe now for uninterrupted access" restriction imposed by Bloomberg. User avatar Romy 248 5.0 (1) Leboncoin Scraper (API) Pro avatar Leboncoin Scraper (API) Pro clearpath/leboncoin-api Leboncoin.fr Scraper (API): Extract French classified ads for market research, price monitoring & competitive analysis. Location-based search, category filtering, business intelligence. Optimized for efficient data extraction across France. [?] User avatar ClearPath 189 3.1 (3) Bing Search Scraper avatar Bing Search Scraper powerful_bachelor/bing-search-scraper Bing Search Scraper: Efficiently extract and analyze Bing search results for SEO, market research, and trend analysis. Get URLs, titles, descriptions, keywords, news, videos, and more in JSON, CSV, or Excel formats. Transform data into actionable insights effortlessly! User avatar Powerful Bachelor 46 3.0 (1) SubReddit Post Scraper avatar SubReddit Post Scraper agentx/subreddit-post-scraper Discover the ultimate tool for Reddit data extraction! Our Subreddit Scraper 2025 lets you gather posts, comments, and insights from any subreddit at scale. User avatar AgentX 15 5.0 (1) Fast TikTok Scraper API | Influencer Data & Analytics API avatar Fast TikTok Scraper API | Influencer Data & Analytics API apidojo/tiktok-scraper-api TikTok Scraper API - fast TikTok data extraction for videos, profiles, hashtags, music, locations and search. 200 posts/sec, 98% success rate. $0.006/query with 10-20 posts FREE, then $0.0003/post. No login, proxies or API keys needed; JSON/CSV output for analytics. User avatar API Dojo 7 Newegg Product Details Scraper avatar Newegg Product Details Scraper ecomscrape/newegg-product-details-scraper Newegg.com Product Scraper automates extraction of comprehensive product specifications, pricing, inventory, and technical details from one of North America's largest electronics retailers. Perfect for price monitoring, competitor analysis, and product research. EC ecomscrape 2 Reddit Community Post avatar Reddit Community Post cheapget/reddit-community-post Extract Reddit posts from any subreddit with complete metadata: titles, content, authors, votes, timestamps, and full comment threads with hierarchical reply structure. User avatar CheapGET 1 Instagram Comments Scraper (Pay Per Result) avatar Instagram Comments Scraper (Pay Per Result) apidojo/instagram-comments-scraper The Instagram Comments Scraper is the perfect tool for extracting comments from Instagram posts quickly and affordably. Priced at just $0.50 per 1,000 comments, it offers impressive speeds, processing 100 to 200 comments per second! User avatar API Dojo 1.3K 4.1 (15) Product * Apify Store * Integrations * Proxy * MCP * Crawlee Developers * Documentation * Code templates * API reference * Get paid on Apify Consulting * Professional Services * Apify Partners Support * Help & Support * Submit your ideas * Forum Spotlight * APIs * What is web scraping? * Best web scraping tools * Python web scraping libraries * Scrapers Company * About Apify * Contact us * Events * Blog * Become an affiliate * Customer stories * Changelog * JobsWe're hiring! * Brand * Impressum Apify logo Socials * * * * * * Security * GDPR image * SOC2 image Reviews * GetApp Apify user reviews image * Software Advice Apify reviews image * Capterra Apify user reviews image * G2 Apify user reviews image * TrustRadius Apify user reviews image * Crozdesk Apify user reviews image Loading status... Terms of Use Privacy Policy Cookie Policy Cookies (c) 2026 Apify