Fix French topo data when using APIs
Fix name issue for French higher education
Bugfix: correct dtypes and columns for population
Fix call to _gen_epci and update INSEE idBank
Bugfix for CSV in _read_file
Initialize BDTOPO/RPG independently, remove unreliable test
Initialize parcels (RPG) for France, extended RPG support
* initialize RPG data with topography
* use this data in `get_local_parcels` if available
* use same function to load BDTOPO and RPG data
* add `com_level` argument to `get_epci` to have `insee_com` at
the right level (either city or municipal neighbourhood) for
Paris, Lyon, and Marseille
Speedup get_admin_boundaries, bugfix French EPCIs
Bugfix: support for French EPCI level
New features:
* Move all French data to specific folder
* Minor improvement and refactoring of `get_local_buildings`
* Add topography file to:
- generate topographic data (`gen_topographic_data`)
- obtain buildings over an area (`get_buildings`)
Maintenance:
* Improved unzipping (extract a subset of all files in an archive)
* Add total duration to progress bar
Improved demographic data and reliability for France
New data functions:
* new `countries/FRA/fra_data.py` file
* `gen_demographic_data` calling all new functions
* `get_esr_data` and `get_school_data` for education
* various functions to handle INSEE data
* pynsee is now entirely optional
Changed util functions:
* `autosave_and_load` to further benefit from parquet
* `save_file_progress` replaces `_download_progress_bar`
* `_download_progress_bar` uses buffer to limit intermediate files
Maintenance:
* move _cachedir and _datadir to `utils/data_download.py`
* move geonames to parquet file
* switch `gen_admin` to `gen_admin_data`
Data initialization, country-dependent data storage
- added `initialize_country_data` function to `countries` module
- move country features into specific file
- cleanup data generation code (`_gen_file` and `gen_admin`)
- split geonames and gadm code
- add `columns` argument to `get_geonames`
- store data for each country in a specific folder given by its alpha 3 ISO code
- support more recent pint
France-specific changes:
- major speedup for French admin4/5 level generation
- correct population data (use PMUN instead of PTOT)
Maintenance: support recent numpy, geopandas and geopf
Switch to np.nan
Use ``union_all`` instead of ``unary_union``
Use geoplateforme URLs for French data
Fix EPCI insee_com entries
Use `name` for EPCI, minor cleanups, update for French parcels
Update level4 for France and add `get_epci`
Bugfix: admin 4/5 generation for FRA
Moved to src layout and add lxml in requirements
Fix French local_buildings with random CRS, add ground area, refresh progress bars