Scraping Sources
Manage where mentions are scraped from
| Source | Type | Actor / URL | Status | |
|---|---|---|---|---|
| 📘 Facebook BD | Active | |||
| 📰 Daily Sun | NEWS_BD | Active | ||
| 📰 Prothom Alo | NEWS_BD | Active | ||
| 📰 The Daily Star | NEWS_BD | Active | ||
| 📰 bdnews24 | NEWS_BD | Active | ||
| 🐦 Twitter BD | Active | |||
| 📺 YouTube BD | YOUTUBE | Active |
Architecture Note
BD News sites (Prothom Alo, Daily Star, bdnews24) — scraped with Nokogiri, free, no API key needed.
Social media (Facebook, YouTube, Twitter) — scraped via Apify actors. Set
Sentiment — Gemini Flash (primary, free 15 RPM) → GPT-4o mini (fallback). Set
Social media (Facebook, YouTube, Twitter) — scraped via Apify actors. Set
APIFY_API_TOKEN in your .env.Sentiment — Gemini Flash (primary, free 15 RPM) → GPT-4o mini (fallback). Set
GEMINI_API_KEY.