SurgeFlow Screening Methodology
How we source, clean, enrich, and score 17,000+ stocks across 6 global markets daily. Platform v2.0.0 · Ratio Schema v1.1.0.
Market Data Sources
Each market is sourced from a specialized provider optimized for coverage, latency, and reliability. Data is ingested daily after each market close.
| Market | Source | Type | Refresh Timing |
|---|---|---|---|
| United States | FMP | batch quotes + historical | daily 16:05 ET |
| Japan | J-Quants | daily_quotes API | daily 15:00 JST + 60min |
| China | Tushare | pro.daily() | daily 15:00 CST + 2h |
| United Kingdom | FMP | historical per-ticker | daily 16:30 GMT + 1h |
| India | FMP | historical per-ticker | daily 15:30 IST + 1.5h |
| Hong Kong | Tushare | pro.hk_daily() | daily 16:00 HKT + 2h |
Fundamental Data
Fundamental data is refreshed weekly (Sunday) from multiple sources: FMP (US/UK/IN), J-Quants (JP), Tushare (CN/HK), Yahoo Finance (revenue fallback).
Enrichment Pipeline
- 1.shares_out: 4-step validation (backfill → cross-check inflated → fix deflated → final gate)
- 2.sectors: GICS-normalized (US SIC→GICS, JP TSE33→GICS, CN Tushare L2→GICS)
- 3.revenue: Yahoo Finance fallback for financial institutions where FMP understates
- 4.micro-cap quarantine: fundamentals NA'd if market_cap < $7M USD
Ratio Definitions
All ratios are computed as yield-style metrics (higher = cheaper/better) for consistent cross-market comparison.
| Ratio | Definition |
|---|---|
| ep | net_income / market_cap (higher = cheaper) |
| sp | revenue / market_cap (higher = cheaper) |
| bp | total_equity / market_cap (higher = cheaper) |
| cfop | cfo / market_cap (higher = better) |
| dividend_yield | dividends_paid / market_cap (higher = better) |
| profit_margin | net_income / revenue |
| revenue_growth | YoY revenue change from fund_hist |
Quality Labels
Every stock receives a quality label based on the completeness and consistency of its fundamental ratios.
Exclusion Criteria
The following categories are excluded from the screening universe to maintain data integrity.
Whale / Institutional Holdings
Institutional fund holdings are tracked from regulatory filings across three major markets.
Macro & Economic Data
Macro indicators power the economic dashboard with real-time market indices, FX rates, and forecasts.