Dependency unsuccessful :Cannot run until dependency "./supports/supports-2026" is successfully executed
Pipeline ID: supports/all
Pipeline ID: supports/by-payment-year
dump.to_sql
ERROR :Traceback (most recent call last):
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1965, in _exec_single_context
ERROR :self.dialect.do_execute(
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/default.py", line 921, in do_execute
ERROR :cursor.execute(statement, parameters)
ERROR :psycopg2.errors
ERROR :.
ERROR :InternalError_
ERROR ::
ERROR :could not open relation with OID 508906367
ERROR :The above exception was the direct cause of the following exception:
ERROR :Traceback (most recent call last):
ERROR :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/dump/to_sql.py", line 15, in <module>
ERROR :spew_flow(flow(ctx.parameters), ctx)
ERROR :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
ERROR :spew(self.datapackage, self.resource_iterator, stats=self.stats)
ERROR :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 68, in spew
ERROR :for res in resources_iterator:
ERROR :File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 68, in <genexpr>
ERROR :res_iter = (it if isinstance(it, ResourceWrapper) else ResourceWrapper(res, it)
ERROR :File "/usr/local/lib/python3.9/site-packages/dataflows/processors/dumpers/dumper_base.py", line 82, in process_resources
ERROR :ret = self.process_resource(
ERROR :File "/usr/local/lib/python3.9/site-packages/dataflows/processors/dumpers/to_sql.py", line 108, in process_resource
ERROR :storage.delete('')
ERROR :File "/usr/local/lib/python3.9/site-packages/tableschema_sql/storage.py", line 183, in delete
ERROR :self.__reflect()
ERROR :File "/usr/local/lib/python3.9/site-packages/tableschema_sql/storage.py", line 278, in __reflect
ERROR :self.__metadata.reflect(only=only, bind=self.__engine)
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/sql/schema.py", line 5752, in reflect
ERROR :_reflect_info = insp._get_reflection_info(
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/reflection.py", line 2018, in _get_reflection_info
ERROR :check_constraints=run(
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/reflection.py", line 1994, in run
ERROR :res = meth(filter_names=_fn, **kw)
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/reflection.py", line 1457, in get_multi_check_constraints
ERROR :self.dialect.get_multi_check_constraints(
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/dialects/postgresql/base.py", line 4677, in get_multi_check_constraints
ERROR :result = connection.execute(query, params)
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1412, in execute
ERROR :return meth(
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/sql/elements.py", line 483, in _execute_on_connection
ERROR :return connection._execute_clauseelement(
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1635, in _execute_clauseelement
ERROR :ret = self._execute_context(
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1844, in _execute_context
ERROR :return self._exec_single_context(
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1984, in _exec_single_context
ERROR :self._handle_dbapi_exception(
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 2339, in _handle_dbapi_exception
ERROR :raise sqlalchemy_exception.with_traceback(exc_info[2]) from e
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1965, in _exec_single_context
ERROR :self.dialect.do_execute(
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/default.py", line 921, in do_execute
ERROR :cursor.execute(statement, parameters)
ERROR :sqlalchemy.exc
ERROR :.
ERROR :InternalError
ERROR ::
ERROR :(psycopg2.errors.InternalError_) could not open relation with OID 508906367
[SQL: SELECT pg_catalog.pg_class.relname, pg_catalog.pg_constraint.conname, CASE WHEN (pg_catalog.pg_constraint.oid IS NOT NULL) THEN pg_catalog.pg_get_constraintdef(pg_catalog.pg_constraint.oid, %(pg_get_constraintdef_1)s) END AS anon_1, pg_catalog.pg_description.description
FROM pg_catalog.pg_class LEFT OUTER JOIN pg_catalog.pg_constraint ON pg_catalog.pg_class.oid = pg_catalog.pg_constraint.conrelid AND pg_catalog.pg_constraint.contype = %(contype_1)s LEFT OUTER JOIN pg_catalog.pg_description ON pg_catalog.pg_description.objoid = pg_catalog.pg_constraint.oid JOIN pg_catalog.pg_namespace ON pg_catalog.pg_namespace.oid = pg_catalog.pg_class.relnamespace
WHERE pg_catalog.pg_class.relkind = ANY (ARRAY[%(param_1)s, %(param_2)s, %(param_3)s]) AND pg_catalog.pg_table_is_visible(pg_catalog.pg_class.oid) AND pg_catalog.pg_namespace.nspname != %(nspname_1)s ORDER BY pg_catalog.pg_class.relname, pg_catalog.pg_constraint.conname]
[parameters: {'pg_get_constraintdef_1': True, 'contype_1': 'c', 'param_1': 'r', 'param_2': 'p', 'param_3': 'f', 'nspname_1': 'pg_catalog'}]
(Background on this error at: https://sqlalche.me/e/20/2j85)
Pipeline ID: supports/by-request-year
sample
Traceback (most recent call last):
File "/datapackage_pipelines_budgetkey/processors/sample.py", line 11, in <module>
res_name = parameters.get('resource', datapackage['resources'][0]['name'])
IndexError: list index out of range
Pipeline ID: supports/criteria/support-criteria
Pipeline ID: supports/criteria/support-criteria-doj
Pipeline ID: supports/supports-2004
Pipeline ID: supports/supports-2005
Pipeline ID: supports/supports-2006
Pipeline ID: supports/supports-2007
Pipeline ID: supports/supports-2008
Pipeline ID: supports/supports-2009
Pipeline ID: supports/supports-2010
Pipeline ID: supports/supports-2011
Pipeline ID: supports/supports-2012
Pipeline ID: supports/supports-2013
Pipeline ID: supports/supports-2014
Pipeline ID: supports/supports-2015
Pipeline ID: supports/supports-2016
Pipeline ID: supports/supports-2017
Pipeline ID: supports/supports-2018
Pipeline ID: supports/supports-2019
Pipeline ID: supports/supports-2020
Pipeline ID: supports/supports-2021
Pipeline ID: supports/supports-2022
flow
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
DF.load(wrapper(year), format='csv',
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
return scraper(gcd, year)
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
chart = get_chart(driver)
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 30, in get_chart
frame = WebDriverWait(driver, 121).until(
File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x612ecdcfa199 <unknown>
WARNING :FAILED to teardown google-chrome
Pipeline ID: supports/supports-2023
flow
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
DF.load(wrapper(year), format='csv',
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
return scraper(gcd, year)
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
chart = get_chart(driver)
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 30, in get_chart
frame = WebDriverWait(driver, 121).until(
File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x62a48e68a199 <unknown>
WARNING :FAILED to teardown google-chrome
Pipeline ID: supports/supports-2024
flow
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
DF.load(wrapper(year), format='csv',
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
return scraper(gcd, year)
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
chart = get_chart(driver)
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 30, in get_chart
frame = WebDriverWait(driver, 121).until(
File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x59142f16a199 <unknown>
WARNING :FAILED to teardown google-chrome
Pipeline ID: supports/supports-2025
flow
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
DF.load(wrapper(year), format='csv',
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
return scraper(gcd, year)
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
chart = get_chart(driver)
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 30, in get_chart
frame = WebDriverWait(driver, 121).until(
File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x61462c514199 <unknown>
WARNING :FAILED to teardown google-chrome
Pipeline ID: supports/supports-2026
Pipeline ID: supports/supports-by-entity
Pipeline ID: supports/with-entities
Pipeline ID: supports/with-keys
Dependency unsuccessful :Cannot run until dependency "./supports/supports-2026" is successfully executed
Pipeline ID: supports/all
dump.to_sql
ERROR :Traceback (most recent call last):
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1965, in _exec_single_context
ERROR :self.dialect.do_execute(
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/default.py", line 921, in do_execute
ERROR :cursor.execute(statement, parameters)
ERROR :psycopg2.errors
ERROR :.
ERROR :InternalError_
ERROR ::
ERROR :could not open relation with OID 508906367
ERROR :The above exception was the direct cause of the following exception:
ERROR :Traceback (most recent call last):
ERROR :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/dump/to_sql.py", line 15, in <module>
ERROR :spew_flow(flow(ctx.parameters), ctx)
ERROR :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
ERROR :spew(self.datapackage, self.resource_iterator, stats=self.stats)
ERROR :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 68, in spew
ERROR :for res in resources_iterator:
ERROR :File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 68, in <genexpr>
ERROR :res_iter = (it if isinstance(it, ResourceWrapper) else ResourceWrapper(res, it)
ERROR :File "/usr/local/lib/python3.9/site-packages/dataflows/processors/dumpers/dumper_base.py", line 82, in process_resources
ERROR :ret = self.process_resource(
ERROR :File "/usr/local/lib/python3.9/site-packages/dataflows/processors/dumpers/to_sql.py", line 108, in process_resource
ERROR :storage.delete('')
ERROR :File "/usr/local/lib/python3.9/site-packages/tableschema_sql/storage.py", line 183, in delete
ERROR :self.__reflect()
ERROR :File "/usr/local/lib/python3.9/site-packages/tableschema_sql/storage.py", line 278, in __reflect
ERROR :self.__metadata.reflect(only=only, bind=self.__engine)
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/sql/schema.py", line 5752, in reflect
ERROR :_reflect_info = insp._get_reflection_info(
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/reflection.py", line 2018, in _get_reflection_info
ERROR :check_constraints=run(
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/reflection.py", line 1994, in run
ERROR :res = meth(filter_names=_fn, **kw)
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/reflection.py", line 1457, in get_multi_check_constraints
ERROR :self.dialect.get_multi_check_constraints(
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/dialects/postgresql/base.py", line 4677, in get_multi_check_constraints
ERROR :result = connection.execute(query, params)
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1412, in execute
ERROR :return meth(
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/sql/elements.py", line 483, in _execute_on_connection
ERROR :return connection._execute_clauseelement(
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1635, in _execute_clauseelement
ERROR :ret = self._execute_context(
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1844, in _execute_context
ERROR :return self._exec_single_context(
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1984, in _exec_single_context
ERROR :self._handle_dbapi_exception(
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 2339, in _handle_dbapi_exception
ERROR :raise sqlalchemy_exception.with_traceback(exc_info[2]) from e
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1965, in _exec_single_context
ERROR :self.dialect.do_execute(
ERROR :File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/default.py", line 921, in do_execute
ERROR :cursor.execute(statement, parameters)
ERROR :sqlalchemy.exc
ERROR :.
ERROR :InternalError
ERROR ::
ERROR :(psycopg2.errors.InternalError_) could not open relation with OID 508906367
[SQL: SELECT pg_catalog.pg_class.relname, pg_catalog.pg_constraint.conname, CASE WHEN (pg_catalog.pg_constraint.oid IS NOT NULL) THEN pg_catalog.pg_get_constraintdef(pg_catalog.pg_constraint.oid, %(pg_get_constraintdef_1)s) END AS anon_1, pg_catalog.pg_description.description
FROM pg_catalog.pg_class LEFT OUTER JOIN pg_catalog.pg_constraint ON pg_catalog.pg_class.oid = pg_catalog.pg_constraint.conrelid AND pg_catalog.pg_constraint.contype = %(contype_1)s LEFT OUTER JOIN pg_catalog.pg_description ON pg_catalog.pg_description.objoid = pg_catalog.pg_constraint.oid JOIN pg_catalog.pg_namespace ON pg_catalog.pg_namespace.oid = pg_catalog.pg_class.relnamespace
WHERE pg_catalog.pg_class.relkind = ANY (ARRAY[%(param_1)s, %(param_2)s, %(param_3)s]) AND pg_catalog.pg_table_is_visible(pg_catalog.pg_class.oid) AND pg_catalog.pg_namespace.nspname != %(nspname_1)s ORDER BY pg_catalog.pg_class.relname, pg_catalog.pg_constraint.conname]
[parameters: {'pg_get_constraintdef_1': True, 'contype_1': 'c', 'param_1': 'r', 'param_2': 'p', 'param_3': 'f', 'nspname_1': 'pg_catalog'}]
(Background on this error at: https://sqlalche.me/e/20/2j85)
Pipeline ID: supports/by-request-year
sample
Traceback (most recent call last):
File "/datapackage_pipelines_budgetkey/processors/sample.py", line 11, in <module>
res_name = parameters.get('resource', datapackage['resources'][0]['name'])
IndexError: list index out of range
Pipeline ID: supports/criteria/support-criteria
flow
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
DF.load(wrapper(year), format='csv',
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
return scraper(gcd, year)
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
chart = get_chart(driver)
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 30, in get_chart
frame = WebDriverWait(driver, 121).until(
File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x612ecdcfa199 <unknown>
WARNING :FAILED to teardown google-chrome
Pipeline ID: supports/supports-2023
flow
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
DF.load(wrapper(year), format='csv',
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
return scraper(gcd, year)
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
chart = get_chart(driver)
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 30, in get_chart
frame = WebDriverWait(driver, 121).until(
File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x62a48e68a199 <unknown>
WARNING :FAILED to teardown google-chrome
Pipeline ID: supports/supports-2024
flow
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
DF.load(wrapper(year), format='csv',
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
return scraper(gcd, year)
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
chart = get_chart(driver)
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 30, in get_chart
frame = WebDriverWait(driver, 121).until(
File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x59142f16a199 <unknown>
WARNING :FAILED to teardown google-chrome
Pipeline ID: supports/supports-2025
flow
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
DF.load(wrapper(year), format='csv',
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
return scraper(gcd, year)
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
chart = get_chart(driver)
File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 30, in get_chart
frame = WebDriverWait(driver, 121).until(
File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x61462c514199 <unknown>
WARNING :FAILED to teardown google-chrome
Pipeline ID: supports/supports-2026
Pipeline ID: supports/by-payment-year
Pipeline ID: supports/criteria/support-criteria-doj
Pipeline ID: supports/supports-2004
Pipeline ID: supports/supports-2005
Pipeline ID: supports/supports-2006
Pipeline ID: supports/supports-2007
Pipeline ID: supports/supports-2008
Pipeline ID: supports/supports-2009
Pipeline ID: supports/supports-2010
Pipeline ID: supports/supports-2011
Pipeline ID: supports/supports-2012
Pipeline ID: supports/supports-2013
Pipeline ID: supports/supports-2014
Pipeline ID: supports/supports-2015
Pipeline ID: supports/supports-2016
Pipeline ID: supports/supports-2017
Pipeline ID: supports/supports-2018
Pipeline ID: supports/supports-2019
Pipeline ID: supports/supports-2020
Pipeline ID: supports/supports-2021
Pipeline ID: supports/supports-2022
Pipeline ID: supports/supports-by-entity
Pipeline ID: supports/with-entities
Pipeline ID: supports/with-keys