Skip to content

Commit

Permalink
Borro validación de downloadURL en scraping
Browse files Browse the repository at this point in the history
Ya se hace en django_datajsonar, paso previo
requerido a correr la indexación
  • Loading branch information
lucaslavandeira committed Sep 5, 2018
1 parent 3ed2884 commit 74ff2f3
Showing 1 changed file with 0 additions and 6 deletions.
6 changes: 0 additions & 6 deletions series_tiempo_ar_api/libs/indexing/scraping.py
Original file line number Diff line number Diff line change
Expand Up @@ -27,12 +27,6 @@ def run(self, distribution, catalog):
"""
distribution_id = distribution.get(IDENTIFIER)
url = distribution.get(DOWNLOAD_URL)
if not self.read_local:
if not url or requests.head(url).status_code != 200:
msg = u'{} {}'.format(strings.INVALID_DISTRIBUTION_URL,
distribution_id)
raise ValueError(msg)

# Fix a pandas fallando en lectura de URLs no ascii
url = url.encode('UTF-8')
url = urllib.parse.quote(url, safe='/:')
Expand Down

0 comments on commit 74ff2f3

Please sign in to comment.