Data Type Error Returned when Rasterizing Data - ValueError: shape values dtype must be one of: int16, int32, uint8, uint16, uint32, float32, float64 #52

lwasser · 2020-12-26T22:34:34Z

lwasser
Dec 26, 2020

I managed to pull together some data to help recreate this issue:

2020-data.zip

I've been able to determine that it's only some of the data that are causing this issue. I've tried

searching for missing or empty geometry
checking the dtype of individual points - it always is a float.
simplifying the data using df.simplify()
just for kicks subsetting to ensure it wasn't simply too many lines being processed.

The data plot and seem otherwise ok. I'm open to trying other things i'm just not sure what to try next!

import geopandas as gpd
from geocube.api.core import make_geocube

# Open the data attached to this issue
trails = gpd.read_file("strava_data_2020.shp")

# So the issue is specific to the data 0-61 rows - the code below fails with a dtype issue
trails_raster = make_geocube(vector_data=trails.iloc[:60], 
                    measurements=["activity_i"],
                    resolution=(res, -res))

# This seems to work 
trails_raster = make_geocube(vector_data=trails.iloc[62:400], 
                    measurements=["activity_i"],
                    resolution=(res, -res))
# This fails
trails_raster = make_geocube(vector_data=trails.iloc[61:400], 
                    measurements=["activity_i"],
                    resolution=(res, -res))

The error:

---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-165-af8d9935e1ea> in <module>
      1 # Convert data to raster
      2 # so hte issue is specific to the data 0-61 rows
----> 3 trails_raster = make_geocube(vector_data=trails.iloc[:60], 
      4                     measurements=["activity_i"],
      5                     resolution=(res, -res))

~/anaconda3/envs/earth-analytics-python/lib/python3.8/site-packages/geocube/api/core.py in make_geocube(vector_data, measurements, datetime_measurements, output_crs, resolution, align, geom, like, fill, group_by, interpolate_na_method, categorical_enums, rasterize_function)
     84     geobox_maker = GeoBoxMaker(output_crs, resolution, align, geom, like)
     85 
---> 86     return VectorToCube(
     87         vector_data=vector_data,
     88         geobox_maker=geobox_maker,

~/anaconda3/envs/earth-analytics-python/lib/python3.8/site-packages/geocube/vector_to_cube.py in make_geocube(self, measurements, datetime_measurements, group_by, interpolate_na_method, rasterize_function)
    156                 pass
    157 
--> 158         return self._get_dataset(
    159             vector_data, measurements, group_by, interpolate_na_method
    160         )

~/anaconda3/envs/earth-analytics-python/lib/python3.8/site-packages/geocube/vector_to_cube.py in _get_dataset(self, vector_data, measurements, group_by, interpolate_na_method)
    229                 )
    230             else:
--> 231                 grid_array = self._get_grid(
    232                     vector_data[[measurement, "geometry"]], measurement
    233                 )

~/anaconda3/envs/earth-analytics-python/lib/python3.8/site-packages/geocube/vector_to_cube.py in _get_grid(self, dataframe, measurement_name)
    329             self.fill if str(dataframe[measurement_name].dtype) != "category" else -1
    330         )
--> 331         image_data = self.rasterize_function(
    332             geometry_array=dataframe.geometry,
    333             data_values=_format_series_data(dataframe[measurement_name]).values,

~/anaconda3/envs/earth-analytics-python/lib/python3.8/site-packages/geocube/rasterize.py in rasterize_image(geometry_array, data_values, geobox, fill, merge_alg, filter_nan, all_touched, **ignored_kwargs)
     76                 data_values, geometry_array
     77             )
---> 78         image = rasterio.features.rasterize(
     79             zip(geometry_array.apply(mapping).values, data_values),
     80             out_shape=(geobox.height, geobox.width),

~/anaconda3/envs/earth-analytics-python/lib/python3.8/site-packages/rasterio/env.py in wrapper(*args, **kwds)
    383         else:
    384             with Env.from_defaults():
--> 385                 return f(*args, **kwds)
    386     return wrapper
    387 

~/anaconda3/envs/earth-analytics-python/lib/python3.8/site-packages/rasterio/features.py in rasterize(shapes, out_shape, fill, out, transform, all_touched, merge_alg, default_value, dtype)
    318 
    319     if not validate_dtype(shape_values, valid_dtypes):
--> 320         raise ValueError(format_invalid_dtype('shape values'))
    321 
    322     if dtype is None:

ValueError: shape values dtype must be one of: int16, int32, uint8, uint16, uint32, float32, float64

just in case - my environment

# Name                    Version                   Build  Channel
access                    1.1.1                      py_0    conda-forge
affine                    2.3.0                      py_0    conda-forge
aiofiles                  0.6.0                    pypi_0    pypi
alembic                   1.4.3              pyh9f0ad1d_0    conda-forge
amqp                      5.0.2              pyhd8ed1ab_0    conda-forge
aniso8601                 7.0.0                    pypi_0    pypi
ansiwrap                  0.8.4                      py_0    conda-forge
apispec                   4.0.0                    pypi_0    pypi
apistar                   0.7.2                    pypi_0    pypi
appdirs                   1.4.4              pyh9f0ad1d_0    conda-forge
appnope                   0.1.0           py38h32f6830_1002    conda-forge
argon2-cffi               20.1.0           py38h4d0b108_2    conda-forge
arrow                     0.17.0                   pypi_0    pypi
async_generator           1.10                       py_0    conda-forge
attrs                     20.2.0             pyh9f0ad1d_0    conda-forge
autopep8                  1.5.4              pyh9f0ad1d_0    conda-forge
backcall                  0.2.0              pyh9f0ad1d_0    conda-forge
backports                 1.0                        py_2    conda-forge
backports.functools_lru_cache 1.6.1                      py_0    conda-forge
bcrypt                    3.2.0            py38h4d0b108_1    conda-forge
beautifulsoup4            4.9.3              pyhb0f4dca_0    conda-forge
billiard                  3.6.3.0          py38h4d0b108_2    conda-forge
black                     20.8b1                     py_1    conda-forge
bleach                    3.2.1              pyh9f0ad1d_0    conda-forge
blinker                   1.4                        py_1    conda-forge
blosc                     1.20.1               hb1e8313_0    conda-forge
bokeh                     2.2.3            py38h50d1736_0    conda-forge
boost-cpp                 1.74.0               he5d75e3_0    conda-forge
branca                    0.4.1                      py_0    conda-forge
brotli                    1.0.9                hb1e8313_2    conda-forge
brunsli                   0.1                  hb1e8313_0    conda-forge
bs4                       4.9.3                         0    conda-forge
bzip2                     1.0.8                haf1e3a3_3    conda-forge
c-ares                    1.16.1               haf1e3a3_3    conda-forge
ca-certificates           2020.12.5            h033912b_0    conda-forge
cachetools                4.1.1                      py_0    conda-forge
cairo                     1.16.0            h360c52f_1006    conda-forge
cartopy                   0.18.0           py38h3cbed64_4    conda-forge
celery                    5.0.2              pyhd8ed1ab_0    conda-forge
certifi                   2020.12.5        py38h50d1736_0    conda-forge
cffi                      1.14.3           py38h9edaa1b_1    conda-forge
cfitsio                   3.470                h4472c5d_7    conda-forge
cftime                    1.2.1            py38h174b24a_1    conda-forge
chardet                   3.0.4           py38h5347e94_1008    conda-forge
charls                    2.1.0                h4a8c4bd_2    conda-forge
chroma-py                 0.1.0.dev1                 py_0    conda-forge
click                     7.1.2              pyh9f0ad1d_0    conda-forge
click-didyoumean          0.0.3              pyh8c360ce_0    conda-forge
click-plugins             1.1.1                      py_0    conda-forge
click-repl                0.1.6                      py_0    conda-forge
cligj                     0.7.0                      py_0    conda-forge
cloudpickle               1.6.0                      py_0    conda-forge
colour                    0.1.5                      py_0    conda-forge
contextily                1.0.1                      py_0    conda-forge
coverage                  5.3              py38h4d0b108_1    conda-forge
cryptography              3.1.1            py38h52adbb4_0    conda-forge
curl                      7.71.1               hcb81553_8    conda-forge
cycler                    0.10.0                     py_2    conda-forge
cytoolz                   0.11.0           py38h4d0b108_1    conda-forge
dask                      2.30.0                     py_0    conda-forge
dask-core                 2.30.0                     py_0    conda-forge
dataclasses               0.7                pyhb2cacf7_7    conda-forge
datacube                  1.8.3                      py_1    conda-forge
dbus                      1.13.6               h1730f81_1    conda-forge
decorator                 4.4.2                      py_0    conda-forge
defusedxml                0.6.0                      py_0    conda-forge
descartes                 1.1.0                      py_4    conda-forge
distributed               2.30.1           py38h50d1736_0    conda-forge
docopt                    0.6.2                    pypi_0    pypi
earthpy                   0.9.2                      py_0    conda-forge
entrypoints               0.3             py38h32f6830_1002    conda-forge
esda                      2.3.1                      py_0    conda-forge
expat                     2.2.9                hb1e8313_2    conda-forge
fastapi                   0.63.0                   pypi_0    pypi
fastcache                 1.1.0            py38h4d0b108_2    conda-forge
fiona                     1.8.17           py38hcfd527e_1    conda-forge
flask                     1.1.2                    pypi_0    pypi
folium                    0.11.0                     py_0    conda-forge
fontconfig                2.13.1            h79c0d67_1002    conda-forge
freetype                  2.10.4               ha233b18_0    conda-forge
freexl                    1.0.5             h0b31af3_1002    conda-forge
fsspec                    0.8.5              pyhd8ed1ab_0    conda-forge
future                    0.18.2           py38h32f6830_2    conda-forge
fuzzywuzzy                0.17.0                     py_0    conda-forge
gdal                      3.1.3            py38hdf98abe_1    conda-forge
geocoder                  1.38.1                     py_1    conda-forge
geocube                   0.0.14             pyhd8ed1ab_1    conda-forge
geographiclib             1.50                       py_0    conda-forge
geojson                   2.5.0                      py_0    conda-forge
geopandas                 0.8.1                      py_0    conda-forge
geopy                     2.0.0              pyh9f0ad1d_0    conda-forge
geos                      3.8.1                h4a8c4bd_0    conda-forge
geotiff                   1.6.0                hc1004f4_3    conda-forge
gettext                   0.19.8.1          haf92f58_1004    conda-forge
giddy                     2.3.3                      py_0    conda-forge
giflib                    5.2.1                h0b31af3_2    conda-forge
glib                      2.66.2               hb1e8313_0    conda-forge
gmp                       6.2.0                hb1e8313_3    conda-forge
gmpy2                     2.1.0b1          py38h113ecfb_1    conda-forge
graphene                  2.1.8                    pypi_0    pypi
graphql-core              2.3.2                    pypi_0    pypi
graphql-relay             2.0.1                    pypi_0    pypi
graphql-server-core       2.0.0                    pypi_0    pypi
h11                       0.9.0                    pypi_0    pypi
hdf4                      4.2.13            h84186c3_1003    conda-forge
hdf5                      1.10.6          nompi_h2ccf146_1110    conda-forge
heapdict                  1.0.1                      py_0    conda-forge
hide-code                 0.6.0                    pypi_0    pypi
httptools                 0.0.13                   pypi_0    pypi
hydrofunctions            0.1.7                      py_1    conda-forge
icu                       67.1                 hb1e8313_0    conda-forge
idna                      2.10               pyh9f0ad1d_0    conda-forge
imagecodecs               2020.5.30        py38h5c28ed5_4    conda-forge
imageio                   2.9.0                      py_0    conda-forge
importlib-metadata        2.0.0                      py_1    conda-forge
importlib_metadata        2.0.0                         1    conda-forge
inequality                1.0.0                      py_0    conda-forge
iniconfig                 1.1.1              pyh9f0ad1d_0    conda-forge
ipykernel                 5.3.4            py38h1cdfbd6_1    conda-forge
ipython                   7.18.1           py38h1cdfbd6_1    conda-forge
ipython_genutils          0.2.0                      py_1    conda-forge
ipywidgets                7.5.1              pyh9f0ad1d_1    conda-forge
itsdangerous              1.1.0                    pypi_0    pypi
jedi                      0.17.2           py38h32f6830_1    conda-forge
jinja2                    2.11.2             pyh9f0ad1d_0    conda-forge
joblib                    0.17.0                     py_0    conda-forge
jpeg                      9d                   h0b31af3_0    conda-forge
json-c                    0.13.1            h575e443_1002    conda-forge
json5                     0.9.5              pyh9f0ad1d_0    conda-forge
jsonschema                3.2.0                      py_2    conda-forge
jupyter                   1.0.0                    pypi_0    pypi
jupyter_client            6.1.7                      py_0    conda-forge
jupyter_console           6.2.0                      py_0    conda-forge
jupyter_contrib_core      0.3.3                      py_2    conda-forge
jupyter_contrib_nbextensions 0.5.1            py38h32f6830_1    conda-forge
jupyter_core              4.6.3            py38h32f6830_2    conda-forge
jupyter_highlight_selected_word 0.2.0           py38h32f6830_1002    conda-forge
jupyter_latex_envs        1.4.6           py38h32f6830_1001    conda-forge
jupyter_nbextensions_configurator 0.4.1            py38h32f6830_2    conda-forge
jupyterlab                2.2.9                      py_0    conda-forge
jupyterlab_pygments       0.1.2              pyh9f0ad1d_0    conda-forge
jupyterlab_server         1.2.0                      py_0    conda-forge
jxrlib                    1.1                  h0b31af3_2    conda-forge
kealib                    1.4.13               h40102fb_1    conda-forge
kiwisolver                1.2.0            py38h02bb52f_1    conda-forge
kombu                     5.0.2            py38h50d1736_1    conda-forge
krb5                      1.17.1               h75d18d8_3    conda-forge
lark-parser               0.11.1             pyhd3deb0d_0    conda-forge
lcms2                     2.11                 h174193d_0    conda-forge
lerc                      2.2                  hb1e8313_0    conda-forge
libaec                    1.0.4                h4a8c4bd_1    conda-forge
libblas                   3.8.0               17_openblas    conda-forge
libcblas                  3.8.0               17_openblas    conda-forge
libclang                  10.0.1          default_hf57f61e_1    conda-forge
libcurl                   7.71.1               h9bf37e3_8    conda-forge
libcxx                    11.0.0               h439d374_0    conda-forge
libdap4                   3.20.6               h993cace_1    conda-forge
libedit                   3.1.20191231         h0678c8f_2    conda-forge
libev                     4.33                 haf1e3a3_1    conda-forge
libffi                    3.2.1             hb1e8313_1007    conda-forge
libgdal                   3.1.3                hd7bf8dc_1    conda-forge
libgfortran               5.0.0               h7cc5361_13    conda-forge
libgfortran5              9.3.0               h7cc5361_13    conda-forge
libglib                   2.66.2               hdb5fb44_0    conda-forge
libiconv                  1.16                 haf1e3a3_0    conda-forge
libkml                    1.3.0             h8ca2c65_1012    conda-forge
liblapack                 3.8.0               17_openblas    conda-forge
libllvm10                 10.0.1               h009f743_3    conda-forge
libnetcdf                 4.7.4           nompi_h4844aed_106    conda-forge
libnghttp2                1.41.0               h7580e61_2    conda-forge
libopenblas               0.3.10          openmp_h54245bb_5    conda-forge
libpng                    1.6.37               hb0a8c7a_2    conda-forge
libpq                     12.3                 haa216e0_2    conda-forge
libpysal                  4.3.0                      py_0    conda-forge
libsodium                 1.0.18               haf1e3a3_1    conda-forge
libspatialindex           1.9.3                h4a8c4bd_3    conda-forge
libspatialite             5.0.0                hc85de81_0    conda-forge
libssh2                   1.9.0                h8a08a2b_5    conda-forge
libtiff                   4.1.0                h2ae36a8_6    conda-forge
libwebp-base              1.1.0                h0b31af3_3    conda-forge
libxml2                   2.9.10               h2c6e4a5_2    conda-forge
libxslt                   1.1.33               h29b7fa6_1    conda-forge
libzopfli                 1.0.3                h4a8c4bd_0    conda-forge
llvm-openmp               11.0.0               h73239a0_1    conda-forge
llvmlite                  0.34.0           py38h3707e27_2    conda-forge
locket                    0.2.0                      py_2    conda-forge
loguru                    0.5.3                    pypi_0    pypi
lxml                      4.6.1            py38h4828f51_0    conda-forge
lz4-c                     1.9.2                hb1e8313_3    conda-forge
mako                      1.1.3              pyh9f0ad1d_0    conda-forge
mapboxgl                  0.10.2                     py_1    conda-forge
mapclassify               2.3.0                      py_0    conda-forge
markupsafe                1.1.1            py38h94c058a_2    conda-forge
marshmallow               3.10.0                   pypi_0    pypi
matplotcheck              0.1.2                      py_1    conda-forge
matplotlib                3.3.2            py38h32f6830_1    conda-forge
matplotlib-base           3.3.2            py38had0acaf_1    conda-forge
mercantile                1.1.6              pyh9f0ad1d_0    conda-forge
mgwr                      2.1.2                      py_0    conda-forge
mistune                   0.8.4           py38h4d0b108_1002    conda-forge
mock                      4.0.2            py38h32f6830_1    conda-forge
more-itertools            8.5.0                      py_0    conda-forge
mpc                       1.1.0             ha57cd0f_1009    conda-forge
mpfr                      4.0.2                h72d8aaf_1    conda-forge
mpmath                    1.1.0                      py_0    conda-forge
msgpack-python            1.0.2            py38hd9c93a9_0    conda-forge
munch                     2.5.0                      py_0    conda-forge
mypy_extensions           0.4.3            py38h32f6830_2    conda-forge
mysql-common              8.0.21                        2    conda-forge
mysql-libs                8.0.21               hfb8f7af_2    conda-forge
nbclean                   0.3.2              pyh5ca1d4c_0    conda-forge
nbclient                  0.5.1                      py_0    conda-forge
nbconvert                 5.6.1                    pypi_0    pypi
nbformat                  5.0.8                      py_0    conda-forge
nbgrader                  0.6.1            py38h32f6830_0    conda-forge
nbresuse                  0.4.0              pyhd8ed1ab_0    conda-forge
nc-time-axis              1.2.0                      py_1    conda-forge
ncurses                   6.2                  hb1e8313_2    conda-forge
nest-asyncio              1.4.1                      py_0    conda-forge
netcdf4                   1.5.4           nompi_py38he235a2f_103    conda-forge
networkx                  2.5                        py_0    conda-forge
nltk                      3.4.4                      py_0    conda-forge
nose                      1.3.7                   py_1006    conda-forge
notebook                  6.1.4            py38h32f6830_1    conda-forge
nspr                      4.29                 hb1e8313_1    conda-forge
nss                       3.47                 hc0980d9_0    conda-forge
numba                     0.51.2           py38h6be0db6_0    conda-forge
numexpr                   2.7.1            py38h6be0db6_3    conda-forge
numpy                     1.19.2           py38ha98150c_1    conda-forge
oauthlib                  3.0.1                      py_0    conda-forge
olefile                   0.46               pyh9f0ad1d_1    conda-forge
openjpeg                  2.3.1                h254dc36_3    conda-forge
openssl                   1.1.1i               h35c211d_0    conda-forge
packaging                 20.4               pyh9f0ad1d_0    conda-forge
pandas                    1.1.3            py38h48ddb8e_2    conda-forge
pandoc                    2.11.0.4             h22f3db7_0    conda-forge
pandocfilters             1.4.2                      py_1    conda-forge
papermill                 2.2.0                      py_1    conda-forge
paramiko                  2.7.2              pyh9f0ad1d_0    conda-forge
parso                     0.7.1              pyh9f0ad1d_0    conda-forge
partd                     1.1.0                      py_0    conda-forge
pathspec                  0.8.0              pyh9f0ad1d_0    conda-forge
patsy                     0.5.1                      py_0    conda-forge
pcre                      8.44                 hb1e8313_0    conda-forge
pdfkit                    0.6.1                    pypi_0    pypi
pexpect                   4.8.0              pyh9f0ad1d_2    conda-forge
pickleshare               0.7.5                   py_1003    conda-forge
pillow                    8.0.1            py38hef457fe_0    conda-forge
pip                       20.2.4                     py_0    conda-forge
pixman                    0.38.0            h01d97ff_1003    conda-forge
plotly                    4.14.1             pyhd3deb0d_0    conda-forge
pluggy                    0.13.1           py38h5347e94_3    conda-forge
pointpats                 2.2.0                      py_0    conda-forge
pooch                     1.2.0                      py_0    conda-forge
poppler                   0.89.0               h3232a60_1    conda-forge
poppler-data              0.4.10                        0    conda-forge
postgresql                12.3                 hb1f69c7_2    conda-forge
proj                      7.1.1                h45baca5_3    conda-forge
prometheus_client         0.8.0              pyh9f0ad1d_0    conda-forge
promise                   2.3                      pypi_0    pypi
prompt-toolkit            3.0.8                      py_0    conda-forge
prompt_toolkit            3.0.8                         0    conda-forge
psutil                    5.8.0            py38h5406a74_0    conda-forge
psycopg2                  2.8.6            py38h6b4ec92_1    conda-forge
ptyprocess                0.6.0                   py_1001    conda-forge
py                        1.9.0              pyh9f0ad1d_0    conda-forge
pycodestyle               2.6.0              pyh9f0ad1d_0    conda-forge
pycparser                 2.20               pyh9f0ad1d_2    conda-forge
pydantic                  1.7.3                    pypi_0    pypi
pygments                  2.7.1                      py_0    conda-forge
pyjwt                     1.7.1                      py_0    conda-forge
pynacl                    1.4.0            py38h4d0b108_2    conda-forge
pyopenssl                 19.1.0                     py_1    conda-forge
pyparsing                 2.4.7              pyh9f0ad1d_0    conda-forge
pyproj                    2.6.1.post1      py38h4367d1d_3    conda-forge
pyqt                      5.12.3           py38hca2ab18_4    conda-forge
pyqt5-sip                 4.19.18                  pypi_0    pypi
pyqtchart                 5.12                     pypi_0    pypi
pyqtwebengine             5.12.1                   pypi_0    pypi
pyrsistent                0.17.3           py38h4d0b108_1    conda-forge
pysal                     2.3.0                      py_0    conda-forge
pyshp                     2.1.2              pyh9f0ad1d_0    conda-forge
pysocks                   1.7.1            py38h5347e94_2    conda-forge
pytables                  3.6.1            py38h4e4ac5c_3    conda-forge
pytest                    6.1.1            py38h5347e94_1    conda-forge
pytest-cov                2.10.1             pyh9f0ad1d_0    conda-forge
python                    3.8.6           hcfdab8c_0_cpython    conda-forge
python-dateutil           2.8.0                      py_0    conda-forge
python-editor             1.0.4                      py_0    conda-forge
python-levenshtein        0.12.0          py38h4d0b108_1004    conda-forge
python-multipart          0.0.5                    pypi_0    pypi
python_abi                3.8                      1_cp38    conda-forge
pytz                      2020.1             pyh9f0ad1d_0    conda-forge
pywavelets                1.1.1            py38h174b24a_3    conda-forge
pyyaml                    5.3.1            py38h94c058a_1    conda-forge
pyzmq                     19.0.2           py38h2c785a9_2    conda-forge
qt                        5.12.9               h717870c_0    conda-forge
qtconsole                 4.7.7              pyh9f0ad1d_0    conda-forge
qtpy                      1.9.0                      py_0    conda-forge
quantecon                 0.4.8                    py38_0  
rasterio                  1.1.7            py38hcfd527e_1    conda-forge
rasterstats               0.14.0                     py_0    conda-forge
ratelim                   0.1.6                      py_2    conda-forge
readline                  8.0                  h0678c8f_2    conda-forge
redis-py                  3.5.3              pyh9f0ad1d_0    conda-forge
regex                     2020.10.23       py38h4d0b108_0    conda-forge
regionmask                0.6.1                      py_1    conda-forge
requests                  2.24.0             pyh9f0ad1d_0    conda-forge
requests-oauthlib         1.3.0              pyh9f0ad1d_0    conda-forge
requests-toolbelt         0.9.1                    pypi_0    pypi
responder                 2.0.5                    pypi_0    pypi
retrying                  1.3.3                      py_2    conda-forge
rfc3986                   1.4.0                    pypi_0    pypi
rioxarray                 0.1.0                      py_0    conda-forge
rtree                     0.9.4            py38h08f867b_1    conda-forge
rx                        1.6.1                    pypi_0    pypi
scikit-image              0.17.2           py38h6be0db6_3    conda-forge
scikit-learn              0.23.2           py38hc63f23e_1    conda-forge
scipy                     1.5.2            py38h9bd2513_2    conda-forge
seaborn                   0.11.0                        0    conda-forge
seaborn-base              0.11.0                     py_0    conda-forge
segregation               1.3.0                      py_0    conda-forge
send2trash                1.5.0                      py_0    conda-forge
setuptools                49.6.0           py38h5347e94_2    conda-forge
shapely                   1.7.1            py38h8918236_1    conda-forge
simplejson                3.17.2           py38h4d0b108_1    conda-forge
six                       1.15.0             pyh9f0ad1d_0    conda-forge
snappy                    1.1.8                hb1e8313_3    conda-forge
snuggs                    1.4.7                      py_0    conda-forge
sortedcontainers          2.3.0              pyhd8ed1ab_0    conda-forge
soupsieve                 2.0.1                      py_1    conda-forge
spaghetti                 1.5.2                      py_0    conda-forge
spglm                     1.0.8                      py_0    conda-forge
spint                     1.0.6                      py_0    conda-forge
splot                     1.1.3                      py_0    conda-forge
spreg                     1.1.2.post1                py_0    conda-forge
spvcm                     0.3.0                      py_0    conda-forge
sqlalchemy                1.3.20           py38h4d0b108_0    conda-forge
sqlite                    3.33.0               h960bd1c_1    conda-forge
sshtunnel                 0.3.1              pyhd8ed1ab_0    conda-forge
starlette                 0.13.6                   pypi_0    pypi
statsmodels               0.12.0           py38h174b24a_1    conda-forge
stravalib                 0.10.2                   pypi_0    pypi
sympy                     1.6.2            py38h32f6830_1    conda-forge
tblib                     1.6.0                      py_0    conda-forge
tenacity                  6.2.0                      py_1    conda-forge
terminado                 0.9.1            py38h32f6830_1    conda-forge
testpath                  0.4.4                      py_0    conda-forge
textblob                  0.15.3                     py_0    conda-forge
textwrap3                 0.9.2                      py_0    conda-forge
threadpoolctl             2.1.0              pyh5ca1d4c_0    conda-forge
tifffile                  2020.10.1                  py_0    conda-forge
tiledb                    2.1.2                h73727fa_0    conda-forge
tk                        8.6.10               hb0a8c7a_1    conda-forge
tobler                    0.4.0                      py_0    conda-forge
toml                      0.10.1             pyh9f0ad1d_0    conda-forge
toolz                     0.11.1                     py_0    conda-forge
tornado                   6.0.4            py38h4d0b108_2    conda-forge
tqdm                      4.50.2             pyh9f0ad1d_0    conda-forge
traitlets                 4.3.3                    pypi_0    pypi
tweepy                    3.9.0              pyh9f0ad1d_0    conda-forge
typed-ast                 1.4.1            py38h0b31af3_0    conda-forge
typesystem                0.2.4                    pypi_0    pypi
typing_extensions         3.7.4.3                    py_0    conda-forge
tzcode                    2020a                h0b31af3_0    conda-forge
units                     0.7                      pypi_0    pypi
urllib3                   1.24.3                     py_1    conda-forge
uvicorn                   0.10.9                   pypi_0    pypi
uvloop                    0.14.0                   pypi_0    pypi
vine                      5.0.0              pyhd8ed1ab_1    conda-forge
wcwidth                   0.2.5              pyh9f0ad1d_2    conda-forge
webencodings              0.5.1                      py_1    conda-forge
websockets                8.1                      pypi_0    pypi
werkzeug                  1.0.1                    pypi_0    pypi
wheel                     0.35.1             pyh9f0ad1d_0    conda-forge
whitenoise                5.2.0                    pypi_0    pypi
widgetsnbextension        3.5.1            py38h32f6830_4    conda-forge
xarray                    0.16.1                     py_0    conda-forge
xerces-c                  3.2.3                h0a0444a_1    conda-forge
xz                        5.2.5                haf1e3a3_1    conda-forge
yaml                      0.2.5                haf1e3a3_0    conda-forge
zeromq                    4.3.3                hb1e8313_2    conda-forge
zfp                       0.5.5                hb1e8313_4    conda-forge
zict                      2.0.0                      py_0    conda-forge
zipp                      3.3.1                      py_0    conda-forge
zlib                      1.2.11            h7795811_1010    conda-forge
zstd                      1.4.5                h289c70a_2    conda-forge

Thank you for any suggestions!

Answered by snowman2

Dec 28, 2020

From what I can tell, you have run into this issue: rasterio/rasterio#2072

trails.activity_i.dtype

Output:

dtype('int64')

After doing this:

trails["activity_i"] = trails.activity_i.astype("float64")

The process succeeded.

View full answer

snowman2 · 2020-12-28T14:28:06Z

snowman2
Dec 28, 2020
Maintainer

From what I can tell, you have run into this issue: rasterio/rasterio#2072

trails.activity_i.dtype

Output:

dtype('int64')

After doing this:

trails["activity_i"] = trails.activity_i.astype("float64")

The process succeeded.

0 replies

lwasser · 2020-12-28T16:32:47Z

lwasser
Dec 28, 2020
Author

@snowman2 oh wow -- it was the activity_i column! i was spending all of my time on the LineString objects and hadn't considered the z value (activity_id) would cause the issue. THANK YOU. Next time i will need to think more outside of the box!

2 replies

snowman2 Dec 28, 2020
Maintainer

No worries. That is the path I originally started down. It wasn't until I looked into the rasterio code here that I changed course. I think this is an issue that will help others that stumble upon this.

lwasser Dec 28, 2020
Author

I see it now in that dtype function you are linking to! Again much appreciated. I do hope this helps others!

RichardScottOZ · 2023-03-23T03:21:46Z

RichardScottOZ
Mar 23, 2023

Yes, I just ran into something like this by the looks.

0 replies

AlexanderJuestel · 2023-11-24T14:45:06Z

AlexanderJuestel
Nov 24, 2023

Hello @lwasser,

This may not be directly related to this very old issue but I stumbled upon it and just wanted to add a solution for changing the dtype of a rasterio dataset. Maybe it is useful for someone else finding this issue :)

with rasterio.open('input.tif') as src:

    band1 = src.read(1)
    resband = np.uint16(band1)

    m = src.meta
    m['count'] = 1
    m['dtype'] = 'uint16'
    
    with rasterio.open('output.tif','w',**m) as dst:
        dst.write(resband, 1)

Adapted from https://gis.stackexchange.com/questions/433411/changing-band-datatype-to-uint64-using-rasterio

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Data Type Error Returned when Rasterizing Data - ValueError: shape values dtype must be one of: int16, int32, uint8, uint16, uint32, float32, float64 #52

{{title}}

Replies: 4 comments 2 replies

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

Data Type Error Returned when Rasterizing Data - ValueError: shape values dtype must be one of: int16, int32, uint8, uint16, uint32, float32, float64 #52

lwasser Dec 26, 2020

Replies: 4 comments · 2 replies

snowman2 Dec 28, 2020 Maintainer

lwasser Dec 28, 2020 Author

snowman2 Dec 28, 2020 Maintainer

lwasser Dec 28, 2020 Author

RichardScottOZ Mar 23, 2023

AlexanderJuestel Nov 24, 2023

lwasser
Dec 26, 2020

Replies: 4 comments 2 replies

snowman2
Dec 28, 2020
Maintainer

lwasser
Dec 28, 2020
Author

snowman2 Dec 28, 2020
Maintainer

lwasser Dec 28, 2020
Author

RichardScottOZ
Mar 23, 2023

AlexanderJuestel
Nov 24, 2023