Update yanked version of minimum requests requirement

[albertvillanova]

Update yanked version of minimum requests requirement.

Version 2.32.1 was yanked: https://pypi.org/project/requests/2.32.1/

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[github-actions]

Show benchmarks

PyArrow==8.0.0

Show updated benchmarks!

Benchmark: benchmark_array_xd.json

metric	read_batch_formatted_as_numpy after write_array2d	read_batch_formatted_as_numpy after write_flattened_sequence	read_batch_formatted_as_numpy after write_nested_sequence	read_batch_unformated after write_array2d	read_batch_unformated after write_flattened_sequence	read_batch_unformated after write_nested_sequence	read_col_formatted_as_numpy after write_array2d	read_col_formatted_as_numpy after write_flattened_sequence	read_col_formatted_as_numpy after write_nested_sequence	read_col_unformated after write_array2d	read_col_unformated after write_flattened_sequence	read_col_unformated after write_nested_sequence	read_formatted_as_numpy after write_array2d	read_formatted_as_numpy after write_flattened_sequence	read_formatted_as_numpy after write_nested_sequence	read_unformated after write_array2d	read_unformated after write_flattened_sequence	read_unformated after write_nested_sequence	write_array2d	write_flattened_sequence	write_nested_sequence
new / old (diff)	0.005725 / 0.011353 (-0.005627)	0.003788 / 0.011008 (-0.007220)	0.063059 / 0.038508 (0.024551)	0.031364 / 0.023109 (0.008255)	0.259209 / 0.275898 (-0.016689)	0.278805 / 0.323480 (-0.044675)	0.003032 / 0.007986 (-0.004953)	0.002633 / 0.004328 (-0.001696)	0.049804 / 0.004250 (0.045554)	0.046717 / 0.037052 (0.009665)	0.267246 / 0.258489 (0.008757)	0.299271 / 0.293841 (0.005430)	0.027687 / 0.128546 (-0.100860)	0.010524 / 0.075646 (-0.065123)	0.201736 / 0.419271 (-0.217536)	0.036192 / 0.043533 (-0.007341)	0.264492 / 0.255139 (0.009353)	0.280809 / 0.283200 (-0.002391)	0.018187 / 0.141683 (-0.123496)	1.170751 / 1.452155 (-0.281404)	1.223450 / 1.492716 (-0.269266)

Benchmark: benchmark_getitem_100B.json

metric	get_batch_of_1024_random_rows	get_batch_of_1024_rows	get_first_row	get_last_row
new / old (diff)	0.096610 / 0.018006 (0.078604)	0.297122 / 0.000490 (0.296632)	0.000211 / 0.000200 (0.000011)	0.000046 / 0.000054 (-0.000008)

Benchmark: benchmark_indices_mapping.json

metric	select	shard	shuffle	sort	train_test_split
new / old (diff)	0.018380 / 0.037411 (-0.019031)	0.062214 / 0.014526 (0.047688)	0.075833 / 0.176557 (-0.100723)	0.121825 / 0.737135 (-0.615310)	0.075475 / 0.296338 (-0.220864)

Benchmark: benchmark_iterating.json

metric	read 5000	read 50000	read_batch 50000 10	read_batch 50000 100	read_batch 50000 1000	read_formatted numpy 5000	read_formatted pandas 5000	read_formatted tensorflow 5000	read_formatted torch 5000	read_formatted_batch numpy 5000 10	read_formatted_batch numpy 5000 1000	shuffled read 5000	shuffled read 50000	shuffled read_batch 50000 10	shuffled read_batch 50000 100	shuffled read_batch 50000 1000	shuffled read_formatted numpy 5000	shuffled read_formatted_batch numpy 5000 10	shuffled read_formatted_batch numpy 5000 1000
new / old (diff)	0.275601 / 0.215209 (0.060392)	2.698014 / 2.077655 (0.620359)	1.434043 / 1.504120 (-0.070077)	1.313217 / 1.541195 (-0.227978)	1.339014 / 1.468490 (-0.129476)	0.566703 / 4.584777 (-4.018074)	2.367794 / 3.745712 (-1.377918)	2.660787 / 5.269862 (-2.609074)	1.738503 / 4.565676 (-2.827174)	0.061693 / 0.424275 (-0.362582)	0.004978 / 0.007607 (-0.002629)	0.334719 / 0.226044 (0.108675)	3.300889 / 2.268929 (1.031960)	1.764493 / 55.444624 (-53.680131)	1.475956 / 6.876477 (-5.400521)	1.635988 / 2.142072 (-0.506084)	0.643906 / 4.805227 (-4.161321)	0.118002 / 6.500664 (-6.382662)	0.042593 / 0.075469 (-0.032876)

Benchmark: benchmark_map_filter.json

metric	filter	map fast-tokenizer batched	map identity	map identity batched	map no-op batched	map no-op batched numpy	map no-op batched pandas	map no-op batched pytorch	map no-op batched tensorflow
new / old (diff)	0.953511 / 1.841788 (-0.888276)	11.489727 / 8.074308 (3.415419)	9.775017 / 10.191392 (-0.416375)	0.139864 / 0.680424 (-0.540560)	0.014219 / 0.534201 (-0.519982)	0.284389 / 0.579283 (-0.294894)	0.264250 / 0.434364 (-0.170113)	0.323471 / 0.540337 (-0.216866)	0.415189 / 1.386936 (-0.971747)

PyArrow==latest

Show updated benchmarks!

Benchmark: benchmark_array_xd.json

metric	read_batch_formatted_as_numpy after write_array2d	read_batch_formatted_as_numpy after write_flattened_sequence	read_batch_formatted_as_numpy after write_nested_sequence	read_batch_unformated after write_array2d	read_batch_unformated after write_flattened_sequence	read_batch_unformated after write_nested_sequence	read_col_formatted_as_numpy after write_array2d	read_col_formatted_as_numpy after write_flattened_sequence	read_col_formatted_as_numpy after write_nested_sequence	read_col_unformated after write_array2d	read_col_unformated after write_flattened_sequence	read_col_unformated after write_nested_sequence	read_formatted_as_numpy after write_array2d	read_formatted_as_numpy after write_flattened_sequence	read_formatted_as_numpy after write_nested_sequence	read_unformated after write_array2d	read_unformated after write_flattened_sequence	read_unformated after write_nested_sequence	write_array2d	write_flattened_sequence	write_nested_sequence
new / old (diff)	0.005437 / 0.011353 (-0.005916)	0.003710 / 0.011008 (-0.007298)	0.049940 / 0.038508 (0.011432)	0.032565 / 0.023109 (0.009456)	0.266374 / 0.275898 (-0.009524)	0.288069 / 0.323480 (-0.035411)	0.004140 / 0.007986 (-0.003845)	0.002669 / 0.004328 (-0.001660)	0.049646 / 0.004250 (0.045395)	0.040926 / 0.037052 (0.003874)	0.278805 / 0.258489 (0.020316)	0.311396 / 0.293841 (0.017555)	0.029363 / 0.128546 (-0.099183)	0.010260 / 0.075646 (-0.065386)	0.058222 / 0.419271 (-0.361049)	0.033063 / 0.043533 (-0.010470)	0.266798 / 0.255139 (0.011659)	0.283091 / 0.283200 (-0.000109)	0.017904 / 0.141683 (-0.123779)	1.139531 / 1.452155 (-0.312624)	1.163909 / 1.492716 (-0.328808)

Benchmark: benchmark_getitem_100B.json

metric	get_batch_of_1024_random_rows	get_batch_of_1024_rows	get_first_row	get_last_row
new / old (diff)	0.089063 / 0.018006 (0.071057)	0.296757 / 0.000490 (0.296268)	0.000202 / 0.000200 (0.000002)	0.000054 / 0.000054 (-0.000001)

Benchmark: benchmark_indices_mapping.json

metric	select	shard	shuffle	sort	train_test_split
new / old (diff)	0.022843 / 0.037411 (-0.014568)	0.076032 / 0.014526 (0.061507)	0.087545 / 0.176557 (-0.089012)	0.128870 / 0.737135 (-0.608266)	0.089359 / 0.296338 (-0.206980)

Benchmark: benchmark_iterating.json

metric	read 5000	read 50000	read_batch 50000 10	read_batch 50000 100	read_batch 50000 1000	read_formatted numpy 5000	read_formatted pandas 5000	read_formatted tensorflow 5000	read_formatted torch 5000	read_formatted_batch numpy 5000 10	read_formatted_batch numpy 5000 1000	shuffled read 5000	shuffled read 50000	shuffled read_batch 50000 10	shuffled read_batch 50000 100	shuffled read_batch 50000 1000	shuffled read_formatted numpy 5000	shuffled read_formatted_batch numpy 5000 10	shuffled read_formatted_batch numpy 5000 1000
new / old (diff)	0.285213 / 0.215209 (0.070004)	2.854950 / 2.077655 (0.777295)	1.539311 / 1.504120 (0.035191)	1.413753 / 1.541195 (-0.127442)	1.440819 / 1.468490 (-0.027671)	0.564734 / 4.584777 (-4.020043)	0.944924 / 3.745712 (-2.800788)	2.703612 / 5.269862 (-2.566249)	1.749429 / 4.565676 (-2.816247)	0.063239 / 0.424275 (-0.361036)	0.005024 / 0.007607 (-0.002583)	0.340866 / 0.226044 (0.114821)	3.359511 / 2.268929 (1.090582)	1.895794 / 55.444624 (-53.548831)	1.606613 / 6.876477 (-5.269864)	1.756539 / 2.142072 (-0.385533)	0.646553 / 4.805227 (-4.158675)	0.121278 / 6.500664 (-6.379386)	0.041066 / 0.075469 (-0.034403)

Benchmark: benchmark_map_filter.json

metric	filter	map fast-tokenizer batched	map identity	map identity batched	map no-op batched	map no-op batched numpy	map no-op batched pandas	map no-op batched pytorch	map no-op batched tensorflow
new / old (diff)	1.005548 / 1.841788 (-0.836240)	12.080103 / 8.074308 (4.005794)	10.444822 / 10.191392 (0.253430)	0.145024 / 0.680424 (-0.535400)	0.015287 / 0.534201 (-0.518914)	0.288567 / 0.579283 (-0.290716)	0.118034 / 0.434364 (-0.316330)	0.333474 / 0.540337 (-0.206864)	0.421716 / 1.386936 (-0.965220)

[pingsutw]

@albertvillanova could I ask why we should use latest requests here? we are using docker and datasets in the same time. However, docker requires requests<2.32.0.

[albertvillanova]

Hi @pingsutw,

We updated the minimum required requests version for security reasons: https://www.cve.org/CVERecord?id=CVE-2024-35195

• affected versions < 2.32.0

Latest version of docker should normally support requests >= 2.32.0: https://github.com/docker/docker-py/releases/tag/7.1.0

Fixed an issue due to an update in the requests package breaking docker-py by applying the psf/requests#6710

• Fix for requests 2.32 docker/docker-py#3257

I guess you need to update your docker library as well:

pip install -U docker

[pingsutw]

I guess you need to update your docker library as well:

Thank you! it works for me 👍