Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update environment after linopy PR #1276

Open
wants to merge 77 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
77 commits
Select commit Hold shift + click to select a range
747441f
docs(contributor): contrib-readme-action has updated readme
github-actions[bot] Oct 30, 2024
d6afd52
Update PyPSA & enable linopy (#1167)
ekatef Nov 4, 2024
bb95325
Enable linopy - power model (#1169)
ekatef Nov 5, 2024
5c48d60
Get back CI for Windows
ekatef Nov 5, 2024
35517e9
Update environment
ekatef Nov 5, 2024
c71c538
Add H2 carrier if not exists
yerbol-akhmetov Oct 15, 2024
b40e643
Add battery carrier if not exists only
yerbol-akhmetov Oct 15, 2024
fc11c02
use H2 in both AC and DC buses in h2_hc_conversions function
yerbol-akhmetov Oct 22, 2024
38f6090
use AC and DC based H2 to make parameters of m.add consistent shape
yerbol-akhmetov Oct 22, 2024
8c9077e
add release notes
yerbol-akhmetov Oct 30, 2024
5f52c50
docs(contributor): contrib-readme-action has updated readme (#1162)
github-actions[bot] Oct 31, 2024
763fb32
Update PyPSA & enable linopy (#1167)
ekatef Nov 4, 2024
994804a
Enable linopy - power model (#1169)
ekatef Nov 5, 2024
0d3ebdf
Get back CI for Windows
ekatef Nov 5, 2024
34b6168
Update environment
ekatef Nov 5, 2024
268851b
revise implementation to accomodate linopy for sec
GbotemiB Nov 7, 2024
82d9f10
Merge branch 'pypsa_linopy_update' into linopy-sec
GbotemiB Nov 13, 2024
9fcee64
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Nov 13, 2024
08bd2bd
Update PyPSA version
ekatef Nov 15, 2024
fe025fc
Merge remote-tracking branch 'upstream/main' into pypsa_linopy_update
ekatef Nov 18, 2024
6e892ea
Merge branch 'pypsa_linopy_update' into linopy-sec
GbotemiB Nov 18, 2024
5264e62
Lift a version restriction
ekatef Nov 19, 2024
cedfda8
Enable augmented network
ekatef Nov 19, 2024
f61058a
Add a requirement to update countrycode
ekatef Nov 20, 2024
fdacd80
Merge branch 'pypsa_linopy_update' into linopy-sec
GbotemiB Nov 20, 2024
c5a4764
Use an installation from the source for countrycode
ekatef Nov 20, 2024
acc9431
Remove redundand initialisation
ekatef Nov 20, 2024
04065eb
Switch on extra functionality
ekatef Nov 20, 2024
dc4dba3
Fix grouping in add_res_constraints
ekatef Nov 20, 2024
25a9b55
Add missed import
ekatef Nov 20, 2024
876a5f8
Merge branch 'main' into pypsa_linopy_update
ekatef Nov 20, 2024
b6343e2
Fix refuse aligning dimensions
ekatef Nov 20, 2024
129db46
Improve naming
ekatef Nov 20, 2024
200a954
Merge remote-tracking branch 'upstream/pypsa_linopy_update' into pyps…
ekatef Nov 20, 2024
6770144
Remove outdated n.variables
ekatef Nov 20, 2024
aa92c9a
adjust warning for h2_cap
GbotemiB Nov 21, 2024
1ba8d94
revert wildcards rules
GbotemiB Nov 21, 2024
e909f3d
remove comment for .variables
GbotemiB Nov 21, 2024
b0d9cb7
Merge branch 'pypsa_linopy_update' into linopy-sec
GbotemiB Nov 21, 2024
92c931b
Merge pull request #1182 from GbotemiB/linopy-sec
ekatef Nov 21, 2024
0cd0fb5
Merge branch 'main' into pypsa_linopy_update
ekatef Dec 20, 2024
ffdf4a4
Remove outdated dependency hint
ekatef Dec 20, 2024
95d7a29
Update comments
ekatef Dec 20, 2024
ff939d4
Add a docstring
ekatef Dec 20, 2024
8172112
Update the release notes
ekatef Dec 20, 2024
6ca4177
Update scripts/solve_network.py
ekatef Dec 20, 2024
75b60ca
Merge branch 'main' of https://github.com/pypsa-meets-earth/pypsa-ear…
ekatef Dec 21, 2024
eafc486
Add a workflow to update environments in PR
ekatef Dec 21, 2024
2678af3
Merge branch 'main' into pypsa_linopy_update
ekatef Dec 21, 2024
3ff85e7
[github-actions.ci] Update pinned envs (#1253)
github-actions[bot] Dec 21, 2024
36f45f0
Remove an outdated dependency
ekatef Dec 21, 2024
25f6d73
Remove a redundand workflow
ekatef Dec 21, 2024
cad2731
Merge remote-tracking branch 'upstream/pypsa_linopy_update' into pyps…
ekatef Dec 21, 2024
0f1d8ce
Get back CI for Windows
ekatef Dec 22, 2024
1d507dc
Merge branch 'main' into pypsa_linopy_update
ekatef Dec 22, 2024
00f98ba
Add env fix
davide-f Dec 23, 2024
255aa60
Squashed commit of the following:
davide-f Dec 23, 2024
b1f530b
Fixes to adapt to geopandas >=1
davide-f Dec 23, 2024
a6674b8
Merge remote-tracking branch 'origin/fix_env' into test_linopy_latest…
davide-f Dec 23, 2024
9dcfd1e
Minor refactoring
ekatef Dec 24, 2024
82e431f
Replace merge functions
ekatef Dec 24, 2024
5a7efce
Merge main into pypsa_linopy_update
ekatef Dec 24, 2024
d6b3659
Add a TODO
ekatef Dec 24, 2024
9c612f0
Merge remote-tracking branch 'upstream/pypsa_linopy_update' into test…
davide-f Dec 24, 2024
c0ca3cf
Merge branch 'main' into fix_env
davide-f Dec 24, 2024
89c180b
Update text check_config_version
davide-f Dec 24, 2024
d3382a2
Revise sjoin to gpd 1.0 and drop unused variables
davide-f Dec 24, 2024
c337918
Merge remote-tracking branch 'origin/fix_env' into test_linopy_latest…
davide-f Dec 24, 2024
e4386fc
Fix typo
ekatef Dec 24, 2024
2ee49f3
Merge pypsa-earth/main into pypsa_linopy_update
ekatef Dec 27, 2024
4b05b02
Update configuration strategies
ekatef Dec 27, 2024
da1cfab
Merge remote-tracking branch 'upstream/pypsa_linopy_update' into test…
davide-f Jan 2, 2025
d463de7
Unify save_to_geojson definition
davide-f Jan 2, 2025
38ac5ea
Move tsam installation to conda
davide-f Jan 3, 2025
b4e7d56
Merge branch 'main' into test_linopy_latest_gpd
davide-f Jan 4, 2025
2d5d4c1
Add release_note
davide-f Jan 5, 2025
88ff219
Restore conda installation fake-useragent
davide-f Jan 7, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .github/workflows/test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -31,8 +31,8 @@ jobs:
env_file: envs/linux-pinned.yaml
- os: macos
env_file: envs/macos-pinned.yaml
# - os: windows
# env_file: envs/windows-pinned.yaml
- os: windows
env_file: envs/windows-pinned.yaml

defaults:
run:
Expand Down
3 changes: 3 additions & 0 deletions Snakefile
Original file line number Diff line number Diff line change
Expand Up @@ -564,6 +564,7 @@ rule add_electricity:

rule simplify_network:
params:
aggregation_strategies=config["cluster_options"]["aggregation_strategies"],
renewable=config["renewable"],
geo_crs=config["crs"]["geo_crs"],
cluster_options=config["cluster_options"],
Expand Down Expand Up @@ -606,6 +607,7 @@ if config["augmented_line_connection"].get("add_to_snakefile", False) == True:

rule cluster_network:
params:
aggregation_strategies=config["cluster_options"]["aggregation_strategies"],
build_shape_options=config["build_shape_options"],
electricity=config["electricity"],
costs=config["costs"],
Expand Down Expand Up @@ -691,6 +693,7 @@ if config["augmented_line_connection"].get("add_to_snakefile", False) == False:

rule cluster_network:
params:
aggregation_strategies=config["cluster_options"]["aggregation_strategies"],
build_shape_options=config["build_shape_options"],
electricity=config["electricity"],
costs=config["costs"],
Expand Down
1 change: 1 addition & 0 deletions config.default.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -99,6 +99,7 @@ cluster_options:
p_nom_max: sum
p_nom_min: sum
p_min_pu: mean
p_max_pu: weighted_average
marginal_cost: mean
committable: any
ramp_limit_up: max
Expand Down
5 changes: 5 additions & 0 deletions doc/release_notes.rst
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,10 @@ This part of documentation collects descriptive release notes to capture the mai

**New Features and Major Changes**

* Support of Linopy for Power and Sector-Coupled Modelling and latest PyPSA version `PR #1172 <https://github.com/pypsa-meets-earth/pypsa-earth/pull/1172>`__

* Update workflow to geopandas >= 1.0 `PR #1276 <https://github.com/pypsa-meets-earth/pypsa-earth/pull/1276>`__


**Minor Changes and bug-fixing**

Expand Down Expand Up @@ -142,6 +146,7 @@ PyPSA-Earth 0.4.0

* Add an option to use csv format for custom demand imports. `PR #995 <https://github.com/pypsa-meets-earth/pypsa-earth/pull/995>`__


**Minor Changes and bug-fixing**

* Minor bug-fixing to run the cluster wildcard min `PR #1019 <https://github.com/pypsa-meets-earth/pypsa-earth/pull/1019>`__
Expand Down
13 changes: 7 additions & 6 deletions envs/environment.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,8 @@ dependencies:
- pip
- mamba # esp for windows build

- pypsa>=0.24, <0.25
- pypsa>=0.25
# - atlite>=0.2.4 # until https://github.com/PyPSA/atlite/issues/244 is not merged
- dask
# currently the packages are being installed with pip
# need to move back to conda once the issues will be resolved
Expand All @@ -28,13 +29,14 @@ dependencies:
- memory_profiler
- ruamel.yaml<=0.17.26
- pytables
- pyscipopt # added to compy with the quadratic objective requirement of the clustering script
- lxml
- numpy
# starting from 1.3.5 numpoly requires numpy>2.0 which leads to issues
- numpoly<=1.3.4
- pandas
- geopandas>=0.11.0, <=0.14.3
- fiona!=1.8.22, <1.10.0
- geopandas>=1
- fiona>=1.10
- xarray>=2023.11.0, <2023.12.0
- netcdf4
- networkx
Expand All @@ -49,6 +51,8 @@ dependencies:
- pyogrio
- numba
- py7zr
- tsam>=1.1.0
- fake_useragent

# Keep in conda environment when calling ipython
- ipython
Expand Down Expand Up @@ -80,11 +84,8 @@ dependencies:

# Default solver for tests (required for CI)
- glpk
- ipopt
- gurobi

- pip:
- git+https://github.com/davide-f/google-drive-downloader@master # google drive with fix for virus scan
- tsam>=1.1.0
- chaospy # lastest version only available on pip
- fake_useragent
20 changes: 12 additions & 8 deletions envs/linux-pinned.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -92,6 +92,7 @@ dependencies:
- contourpy=1.3.1
- country_converter=1.2
- cpp-expected=1.1.0
- cppad=20240000.7
- cycler=0.12.1
- cyrus-sasl=2.1.27
- cytoolz=1.0.1
Expand All @@ -118,8 +119,9 @@ dependencies:
- exceptiongroup=1.2.2
- executing=2.1.0
- expat=2.6.4
- fake-useragent==2.0.3
- filelock=3.16.1
- fiona=1.9.6
- fiona=1.10.1
- fmt=11.0.2
- folium=0.19.2
- font-ttf-dejavu-sans-mono=2.37
Expand All @@ -140,8 +142,8 @@ dependencies:
- gdk-pixbuf=2.42.12
- geographiclib=2.0
- geojson-rewind=1.1.0
- geopandas=0.14.3
- geopandas-base=0.14.3
- geopandas=1.0.1
- geopandas-base=1.0.1
- geopy=2.4.1
- geos=3.13.0
- geotiff=1.7.3
Expand Down Expand Up @@ -350,6 +352,7 @@ dependencies:
- metis=5.1.0
- minizip=4.0.7
- mistune=3.0.2
- mpfr=4.2.1
- mpg123=1.32.9
- msgpack-python=1.1.0
- multipledispatch=0.6.0
Expand Down Expand Up @@ -432,13 +435,14 @@ dependencies:
- pydoe2=1.3.0
- pygments=2.18.0
- pyogrio=0.10.0
- pyomo=6.8.2
- pyomo=6.6.1
- pyparsing=3.2.0
- pyppmd=1.1.0
- pyproj=3.7.0
- pypsa=0.24.0
- pypsa=0.28.0
- pyqt=5.15.9
- pyqt5-sip=12.12.2
- pyscipopt=5.2.1
- pyshp=2.3.1
- pysocks=1.7.1
- pytables=3.10.1
Expand Down Expand Up @@ -469,11 +473,11 @@ dependencies:
- rfc3986-validator=0.1.1
- rioxarray=0.17.0
- rpds-py=0.22.3
- rtree=1.3.0
- ruamel.yaml=0.17.26
- ruamel.yaml.clib=0.2.8
- s2n=1.5.10
- scikit-learn=1.6.0
- scip=9.2.0
- scipy=1.14.1
- seaborn=0.13.2
- seaborn-base=0.13.2
Expand All @@ -497,6 +501,7 @@ dependencies:
- statsmodels=0.14.4
- stopit=1.1.2
- tabulate=0.9.0
- tbb=2022.0.0
- tblib=3.0.0
- terminado=0.18.1
- texttable=1.7.0
Expand All @@ -512,6 +517,7 @@ dependencies:
- tornado=6.4.2
- tqdm=4.67.1
- traitlets=5.14.3
- tsam=2.3.6
- types-python-dateutil=2.9.0.20241206
- typing-extensions=4.12.2
- typing_extensions=4.12.2
Expand Down Expand Up @@ -569,8 +575,6 @@ dependencies:
- zstd=1.5.6
- pip:
- chaospy==4.3.17
- fake-useragent==2.0.3
- googledrivedownloader==0.4
- highspy==1.9.0
- tsam==2.3.6
prefix: /usr/share/miniconda/envs/pypsa-earth
22 changes: 13 additions & 9 deletions envs/macos-pinned.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -89,6 +89,7 @@ dependencies:
- contourpy=1.3.1
- country_converter=1.2
- cpp-expected=1.1.0
- cppad=20240000.7
- cycler=0.12.1
- cyrus-sasl=2.1.27
- cytoolz=1.0.1
Expand All @@ -113,8 +114,9 @@ dependencies:
- et_xmlfile=2.0.0
- exceptiongroup=1.2.2
- executing=2.1.0
- fake-useragent==2.0.3
- filelock=3.16.1
- fiona=1.9.6
- fiona=1.10.1
- fmt=11.0.2
- folium=0.19.2
- font-ttf-dejavu-sans-mono=2.37
Expand All @@ -135,8 +137,8 @@ dependencies:
- gdk-pixbuf=2.42.12
- geographiclib=2.0
- geojson-rewind=1.1.0
- geopandas=0.14.3
- geopandas-base=0.14.3
- geopandas=1.0.1
- geopandas-base=1.0.1
- geopy=2.4.1
- geos=3.13.0
- geotiff=1.7.3
Expand Down Expand Up @@ -243,6 +245,7 @@ dependencies:
- libgoogle-cloud=2.32.0
- libgoogle-cloud-storage=2.32.0
- libgrpc=1.67.1
- libhwloc=2.11.2
- libiconv=1.17
- libintl=0.22.5
- libjpeg-turbo=3.0.0
Expand Down Expand Up @@ -303,6 +306,7 @@ dependencies:
- metis=5.1.0
- minizip=4.0.7
- mistune=3.0.2
- mpfr=4.2.1
- msgpack-python=1.1.0
- multipledispatch=0.6.0
- multiurl=0.3.3
Expand Down Expand Up @@ -382,11 +386,12 @@ dependencies:
- pyobjc-core=10.3.2
- pyobjc-framework-cocoa=10.3.2
- pyogrio=0.10.0
- pyomo=6.8.2
- pyomo=6.6.1
- pyparsing=3.2.0
- pyppmd=1.1.0
- pyproj=3.7.0
- pypsa=0.24.0
- pypsa=0.28.0
- pyscipopt=5.2.1
- pyshp=2.3.1
- pysocks=1.7.1
- pytables=3.10.1
Expand Down Expand Up @@ -416,10 +421,10 @@ dependencies:
- rfc3986-validator=0.1.1
- rioxarray=0.17.0
- rpds-py=0.22.3
- rtree=1.3.0
- ruamel.yaml=0.17.26
- ruamel.yaml.clib=0.2.8
- scikit-learn=1.6.0
- scip=9.2.0
- scipy=1.14.1
- seaborn=0.13.2
- seaborn-base=0.13.2
Expand All @@ -442,6 +447,7 @@ dependencies:
- statsmodels=0.14.4
- stopit=1.1.2
- tabulate=0.9.0
- tbb=2022.0.0
- tblib=3.0.0
- terminado=0.18.1
- texttable=1.7.0
Expand All @@ -456,6 +462,7 @@ dependencies:
- tornado=6.4.2
- tqdm=4.67.1
- traitlets=5.14.3
- tsam=2.3.6
- types-python-dateutil=2.9.0.20241206
- typing-extensions=4.12.2
- typing_extensions=4.12.2
Expand All @@ -480,7 +487,6 @@ dependencies:
- xarray=2023.11.0
- xerces-c=3.2.5
- xlrd=2.0.1
- xorg-libxau=1.0.12
- xorg-libxdmcp=1.1.5
- xyzservices=2024.9.0
- yaml=0.2.5
Expand All @@ -496,8 +502,6 @@ dependencies:
- zstd=1.5.6
- pip:
- chaospy==4.3.17
- fake-useragent==2.0.3
- googledrivedownloader==0.4
- highspy==1.9.0
- tsam==2.3.6
prefix: /Users/runner/miniconda3/envs/pypsa-earth
Loading
Loading