You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When loading a GeoParquet file to Postgres with ogr2ogr, the error noted in title is emitted.
The translation seems to work fine - the output feature count in the target db matches the source file and the schema is as expected.
$ ogr2ogr -f PostgreSQL "PG:$DATABASE_URL" -nln whse_basemapping.transport_line -overwrite /vsis3/bcfishpass/whse_basemapping.transport_line.parquet whse_basemapping.transport_line --debug ON
HTTP: libcurl/8.4.0 (SecureTransport) LibreSSL/3.3.6 zlib/1.2.12 nghttp2/1.58.0
S3: Downloading 0-16383 (https://bcfishpass.s3.amazonaws.com/whse_basemapping.transport_line.parquet)...
S3: Got response_code=206
S3: Downloading 655458304-655460280 (https://bcfishpass.s3.amazonaws.com/whse_basemapping.transport_line.parquet)...
S3: Got response_code=206
S3: Downloading 655392768-655458303 (https://bcfishpass.s3.amazonaws.com/whse_basemapping.transport_line.parquet)...
S3: Got response_code=206
S3: Downloading 655360000-655392767 (https://bcfishpass.s3.amazonaws.com/whse_basemapping.transport_line.parquet)...
S3: Got response_code=206
PARQUET: geo = {"primary_column": "geometry", "columns": {"geometry": {"encoding": "WKB", "crs": {"$schema": "https://proj.org/schemas/v0.7/projjson.schema.json", "type": "ProjectedCRS", "name": "NAD83 / BC Albers", "base_crs": {"name": "NAD83", "datum": {"type": "GeodeticReferenceFrame", "name": "North American Datum 1983", "ellipsoid": {"name": "GRS 1980", "semi_major_axis": 6378137, "inverse_flattening": 298.257222101}}, "coordinate_system": {"subtype": "ellipsoidal", "axis": [{"name": "Geodetic latitude", "abbreviation": "Lat", "direction": "north", "unit": "degree"}, {"name": "Geodetic longitude", "abbreviation": "Lon", "direction": "east", "unit": "degree"}]}, "id": {"authority": "EPSG", "code": 4269}}, "conversion": {"name": "British Columbia Albers", "method": {"name": "Albers Equal Area", "id": {"authority": "EPSG", "code": 9822}}, "parameters": [{"name": "Latitude of false origin", "value": 45, "unit": "degree", "id": {"authority": "EPSG", "code": 8821}}, {"name": "Longitude of false origin", "value": -126, "unit": "degree", "id": {"authority": "EPSG", "code": 8822}}, {"name": "Latitude of 1st standard parallel", "value": 50, "unit": "degree", "id": {"authority": "EPSG", "code": 8823}}, {"name": "Latitude of 2nd standard parallel", "value": 58.5, "unit": "degree", "id": {"authority": "EPSG", "code": 8824}}, {"name": "Easting at false origin", "value": 1000000, "unit": "metre", "id": {"authority": "EPSG", "code": 8826}}, {"name": "Northing at false origin", "value": 0, "unit": "metre", "id": {"authority": "EPSG", "code": 8827}}]}, "coordinate_system": {"subtype": "Cartesian", "axis": [{"name": "Easting", "abbreviation": "E", "direction": "east", "unit": "metre"}, {"name": "Northing", "abbreviation": "N", "direction": "north", "unit": "metre"}]}, "scope": "Province-wide spatial data management.", "area": "Canada - British Columbia.", "bbox": {"south_latitude": 48.25, "west_longitude": -139.04, "north_latitude": 60.01, "east_longitude": -114.08}, "id": {"authority": "EPSG", "code": 3005}}, "geometry_types": ["LineString", "MultiLineString"], "bbox": [336279.1480168255, 369185.7570022164, 1874557.6820168253, 1717288.8370022164]}}, "version": "1.0.0", "creator": {"library": "geopandas", "version": "0.14.3"}}
PARQUET: Compression (of first column): snappy
GDAL: GDALOpen(/vsis3/bcfishpass/whse_basemapping.transport_line.parquet, this=0x13c737360) succeeds as Parquet.
PG: Client encoding: 'UTF8'
PG: PostGIS schema: 'public'
PG: Modifying search_path from "$user", public to '',"$user", public
PG: PostgreSQL version string : 'PostgreSQL 14.10 (Homebrew) on aarch64-apple-darwin23.0.0, compiled by Apple clang version 15.0.0 (clang-1500.0.40.1), 64-bit'
PG: PostGIS version string : '3.4 USE_GEOS=1 USE_PROJ=1 USE_STATS=1'
GDAL: GDALOpen(PG:postgresql://postgres@localhost:5432/postgis, this=0x13d023200) succeeds as PostgreSQL.
PG: Could not retrieve table oid for transport_line
PG: Could not retrieve table oid for transport_line
ERROR 1: fieldDesc[13].nIdx < 0 not expected
PG: LaunderName('OBJECTID') -> 'objectid'
etc
Versions and provenance
GDAL is from Homebrew.
$ ogrinfo --version
GDAL 3.8.4, released 2024/02/08
GeoParquet file was created with Geopandas v.0.14.3 using the to_parquet function, run on a Docker image based on ghcr.io/osgeo/gdal:ubuntu-full-3.8.4.
Additional context
No response
The text was updated successfully, but these errors were encountered:
The error message was caused by Parquet column of type NULL. I don''t want to know why such horrible stuff is permitted... Anyway will be fixed per #9647. You may also add --config OGR2OGR_USE_ARROW_API NO to avoid the error message
rouault
added a commit
to rouault/gdal
that referenced
this issue
Apr 14, 2024
What is the bug?
When loading a GeoParquet file to Postgres with ogr2ogr, the error noted in title is emitted.
The translation seems to work fine - the output feature count in the target db matches the source file and the schema is as expected.
gdal/ogr/ogrsf_frmts/arrow_common/ograrrowlayer.hpp
Line 4371 in 801b1c8
Steps to reproduce the issue
Versions and provenance
GDAL is from Homebrew.
GeoParquet file was created with Geopandas v.0.14.3 using the
to_parquet
function, run on a Docker image based onghcr.io/osgeo/gdal:ubuntu-full-3.8.4
.Additional context
No response
The text was updated successfully, but these errors were encountered: