Monitor Global Population Indicators

NY.GDP.MKTP.CD reports GDP in current US dollars. It is useful for nominal market scale, not real growth across long periods. For growth, use a constant-price or growth-rate series and state which one you chose.

Use the World Bank Indicators Scraper to make that search reproducible. Save the exact filters and result cap as a Task rather than editing a one-off query every time.

Turn the search into a decision

Choose indicators before countries. A market-sizing table usually needs population, GDP per capita, and internet adoption, but each has different update lag. Record the latest available year per series rather than pretending all values share one date.

Create explicit inclusion columns such as is_in_scope, owner, and review_reason. Keep them in a derived table, not in the raw source rows. This makes it possible to rerun qualification rules without losing the original evidence.

Sample ten included and ten excluded records. If exclusions are caused by missing upstream fields, do not silently treat those fields as false. Put them in a review queue or document the assumption.

Refresh without creating duplicates

The record key is country_code plus indicator_code plus year. Upsert on that key and record the collection timestamp separately. A recurring workflow should distinguish a newly published record from an older record whose metadata changed.

Coverage and release lag vary by series and country. Missing is not zero. Preserve null rows when auditing coverage, read the indicator definition, and never combine series until units and methodology are compatible.

The practical payoff is a smaller, explainable queue. The source query finds candidates; the qualification layer decides which candidates deserve attention. Mixing those two jobs into one opaque keyword search makes both harder to audit.