Startups Tracker System

Build Parvenu API integration & Google Sheets data enricher (update_enriched_data.py)

Query Parvenu API (/company_search), integrate deep web research, and sync back to Google Sheets Enriched Data tab.

Develop Google Sheets startup discovery & fetch pipeline (fetch_new_startups.py)

Create fetch_new_startups.py to fetch and extract new startups from Google Sheets into structured JSON.

Build Streamlit interactive dashboard UI (app.py)

Interactive dashboard displaying Startup Trends, Job Market Analytics, and Correlation Insights with Plotly charts.

Develop core analytics engine (analyzer.py)

Calculate funding distributions, AI vs Non-AI classification, and correlation between funding and hiring rate.

Build unified multi-source data loader (data_loader.py)

Load and merge CSVs/TXTs across funded startups, job postings, and normalize company locations.

Implement smart jobs deduplication engine (sync_jobs.py)

Deduplicate incoming job postings prioritizing URL and Title/Company/Location, generating master_jobs.csv.

Build master continuous background pipeline & scheduler (run_pipeline.py)

Continuous background runner executing startup fetching, jobs deduplication, BetaList sync, and FreeC enrichment on a configurable loop.

Implement centralized environment loader (env_loader.py)

Standardized, robust loading of environment credentials from .env.txt across all modules.

Build AgentMail client for founder outreach & inbox management (agentmail_client.py)

Connect to AgentMail API (jessica_haden@agentmail.to), inspect inbox, and compose/send personalized founder outreach.

Develop BetaList early-stage launches loader & cache (betalist_loader.py)

Fetch early-stage launches from BetaList Google Sheet, normalize founder contacts and emails, and cache to betalist_startups.csv.

Implement automated startup intelligence pipeline (enrich_with_freesea.py)

Automate deep startup research via FreeC, extracting founders, product models, tech stack, and funding context.

Build FreeC web search & markdown page extractor client (freesea_client.py)

Connect to FreeC API (/v1/search and /v1/fetch) for quota-free web intelligence and automated markdown page extraction.

End-to-end browser validation of all 6 dashboard modules

Validate 944 funded startups, 1,490 job postings across 360 companies, and 17 BetaList launches with full UI responsiveness.

Integrate BetaList, FreeC, and AgentMail tabs into Streamlit dashboard (app.py)

Expand dashboard from 3 to 6 tabs: adding BetaList Launches, FreeC Startup Intelligence, and AgentMail Outreach Hub.

Build multi-source founder extraction engine (export_founders_today.py)

Extract founders across Startup Gallery, BetaList, and Product Hunt with verified personal LinkedIn URLs and emails.

Build outreach completion logger & cross-batch deduplicator (mark_outreach_done.py)

Log outreach completion, sync with Google Sheets (Today's Founder Outreach and Outreach History), and update persistent outreach_history.csv to prevent duplicate contacts.

Implement dynamic quota balancing & backfilling (7 Gallery, 7 BetaList, 6 Product Hunt)

Dynamic quota allocation ensuring exactly 20 distinct, high-signal founders extracted each daily run.

Implement automated LinkedIn connection sequence engine

Automate sending personalized LinkedIn connection requests to daily extracted founders using browser automation or LinkedIn API.

Implement automated multi-step email drip sequence via AgentMail

Schedule follow-up email cadence for non-responsive founders with AI-tailored value propositions.

Add real-time webhook listener for incoming founder replies in AgentMail

Ingest inbound email replies, parse sentiment/intent, and notify via Telegram/dashboard.

Dockerize Startups Tracker System and streamline container orchestration

Create production Dockerfile and docker-compose.yml running both Streamlit dashboard and continuous pipeline background daemon.

Deploy Streamlit dashboard and continuous pipeline to cloud infrastructure

Host interactive dashboard and configure persistent volume mounts for CSV databases.

Configure automated health checks and alert notifications

Monitor Google Sheets connectivity, FreeC rate limits, and pipeline execution logs with automated alert dispatching.