Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./maya/maya-notification-parse-updates'] From ./maya/maya-complete-notification-list :['From ./maya/maya-notification-parse-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./maya/scrape-maya-notification-list" is successfully executed']]
Pipeline ID: maya/maya-bonds-and-options-holdings-changes
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./maya/maya-notification-parse-updates'] From ./maya/maya-complete-notification-list :['From ./maya/maya-notification-parse-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./maya/scrape-maya-notification-list" is successfully executed']]
Pipeline ID: maya/maya-company-director-appointments
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./maya/maya-notification-parse-updates'] From ./maya/maya-complete-notification-list :['From ./maya/maya-notification-parse-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./maya/scrape-maya-notification-list" is successfully executed']]
Pipeline ID: maya/maya-company-officer-list
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./maya/maya-notification-parse-updates'] From ./maya/maya-complete-notification-list :['From ./maya/maya-notification-parse-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./maya/scrape-maya-notification-list" is successfully executed']]
Pipeline ID: maya/maya-company-stakeholder-list
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./maya/maya-notification-parse-updates'] From ./maya/maya-complete-notification-list :['From ./maya/maya-notification-parse-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./maya/scrape-maya-notification-list" is successfully executed']]
Pipeline ID: maya/maya-company-vip-appointments
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-notification-parse-updates From ./maya/maya-notification-parse-updates :['Dependency unsuccessful', 'Cannot run until dependency "./maya/scrape-maya-notification-list" is successfully executed']
Pipeline ID: maya/maya-complete-notification-list
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./maya/maya-notification-parse-updates'] From ./maya/maya-complete-notification-list :['From ./maya/maya-notification-parse-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./maya/scrape-maya-notification-list" is successfully executed']]
Pipeline ID: maya/maya-holdings-changes
Dependency unsuccessful :Cannot run until dependency "./maya/scrape-maya-notification-list" is successfully executed
Pipeline ID: maya/maya-notification-parse-updates
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./maya/maya-notification-parse-updates'] From ./maya/maya-complete-notification-list :['From ./maya/maya-notification-parse-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./maya/scrape-maya-notification-list" is successfully executed']]
Pipeline ID: maya/maya-reported-academic-degrees
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./maya/maya-notification-parse-updates'] From ./maya/maya-complete-notification-list :['From ./maya/maya-notification-parse-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./maya/scrape-maya-notification-list" is successfully executed']]
Pipeline ID: maya/maya-reported-work-record
Dependency unsuccessful :Cannot run until dependency "./maya/scrape-maya-tase-companies" is successfully executed
Pipeline ID: maya/maya-tase-companies-current-management
flow
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
self.datapackage = self.process_datapackage(self.datapackage)
File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 112, in process_datapackage
raise self.exc
File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 60, in describe
sample = list(itertools.islice(self.iterable, self.SAMPLE_SIZE))
File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 89, in handle_iterable
for x in self.iterable:
File "/datapackage_pipelines_budgetkey/pipelines/maya/scrape_maya_notification_list.py", line 153, in scrape_maya_notification_list
first_date, last_date = get_existing_records()
File "/datapackage_pipelines_budgetkey/pipelines/maya/scrape_maya_notification_list.py", line 31, in get_existing_records
rs = con.execute(text("SELECT min(date), max(date) FROM maya_notifications where parser_version=:v"), v=PARSER_VERSION)
TypeError: execute() got an unexpected keyword argument 'v'
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
spew_flow(flow, ctx)
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
datastream = flow.datastream()
File "/usr/local/lib/python3.9/site-packages/dataflows/base/flow.py", line 19, in datastream
return self._chain(ds)._process()
File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
datastream = self.source._process()
File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
datastream = self.source._process()
File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
self.raise_exception(exception)
File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor iterable_loader in position #9: execute() got an unexpected keyword argument 'v'
Pipeline ID: maya/scrape-maya-notification-list
dump_to_path
ERROR :Data Package validation error: Descriptor validation error: [] is too short at "schema/fields" in descriptor and at "properties/schema/properties/fields/minItems" in profile
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/dump_to_path.py", line 22, in <module>
with ingest() as ctx:
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 186, in ingest
params, datapackage, resource_iterator = _ingest(debug=debug)
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 44, in _ingest
datapackage, resource_iterator, dependency_dp = process_input(sys.stdin, validate, debug)
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/input_processor.py", line 88, in process_input
datapackage.validate(dp_to_validate)
File "/usr/local/lib/python3.9/site-packages/datapackage/validate.py", line 28, in validate
Package(descriptor, strict=True)
File "/usr/local/lib/python3.9/site-packages/datapackage/package.py", line 126, in __init__
self.__build()
File "/usr/local/lib/python3.9/site-packages/datapackage/package.py", line 534, in __build
updated_resource = Resource(descriptor,
File "/usr/local/lib/python3.9/site-packages/datapackage/resource.py", line 90, in __init__
self.__build()
File "/usr/local/lib/python3.9/site-packages/datapackage/resource.py", line 648, in __build
raise exception
File "/usr/local/lib/python3.9/site-packages/datapackage/resource.py", line 643, in __build
self.__profile.validate(self.__current_descriptor)
File "/usr/local/lib/python3.9/site-packages/datapackage/profile.py", line 89, in validate
raise exceptions.ValidationError(message, errors=errors)
datapackage.exceptions.ValidationError: There are 1 validation errors (see exception.errors)
Pipeline ID: maya/scrape-maya-tase-companies
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./maya/maya-notification-parse-updates'] From ./maya/maya-complete-notification-list :['From ./maya/maya-notification-parse-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./maya/scrape-maya-notification-list" is successfully executed']]
Pipeline ID: maya/maya-bonds-and-options-holdings-changes
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./maya/maya-notification-parse-updates'] From ./maya/maya-complete-notification-list :['From ./maya/maya-notification-parse-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./maya/scrape-maya-notification-list" is successfully executed']]
Pipeline ID: maya/maya-company-director-appointments
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./maya/maya-notification-parse-updates'] From ./maya/maya-complete-notification-list :['From ./maya/maya-notification-parse-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./maya/scrape-maya-notification-list" is successfully executed']]
Pipeline ID: maya/maya-company-officer-list
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./maya/maya-notification-parse-updates'] From ./maya/maya-complete-notification-list :['From ./maya/maya-notification-parse-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./maya/scrape-maya-notification-list" is successfully executed']]
Pipeline ID: maya/maya-company-stakeholder-list
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./maya/maya-notification-parse-updates'] From ./maya/maya-complete-notification-list :['From ./maya/maya-notification-parse-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./maya/scrape-maya-notification-list" is successfully executed']]
Pipeline ID: maya/maya-company-vip-appointments
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-notification-parse-updates From ./maya/maya-notification-parse-updates :['Dependency unsuccessful', 'Cannot run until dependency "./maya/scrape-maya-notification-list" is successfully executed']
Pipeline ID: maya/maya-complete-notification-list
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./maya/maya-notification-parse-updates'] From ./maya/maya-complete-notification-list :['From ./maya/maya-notification-parse-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./maya/scrape-maya-notification-list" is successfully executed']]
Pipeline ID: maya/maya-holdings-changes
Dependency unsuccessful :Cannot run until dependency "./maya/scrape-maya-notification-list" is successfully executed
Pipeline ID: maya/maya-notification-parse-updates
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./maya/maya-notification-parse-updates'] From ./maya/maya-complete-notification-list :['From ./maya/maya-notification-parse-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./maya/scrape-maya-notification-list" is successfully executed']]
Pipeline ID: maya/maya-reported-academic-degrees
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./maya/maya-notification-parse-updates'] From ./maya/maya-complete-notification-list :['From ./maya/maya-notification-parse-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./maya/scrape-maya-notification-list" is successfully executed']]
Pipeline ID: maya/maya-reported-work-record
Dependency unsuccessful :Cannot run until dependency "./maya/scrape-maya-tase-companies" is successfully executed
Pipeline ID: maya/maya-tase-companies-current-management
flow
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
self.datapackage = self.process_datapackage(self.datapackage)
File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 112, in process_datapackage
raise self.exc
File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 60, in describe
sample = list(itertools.islice(self.iterable, self.SAMPLE_SIZE))
File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 89, in handle_iterable
for x in self.iterable:
File "/datapackage_pipelines_budgetkey/pipelines/maya/scrape_maya_notification_list.py", line 153, in scrape_maya_notification_list
first_date, last_date = get_existing_records()
File "/datapackage_pipelines_budgetkey/pipelines/maya/scrape_maya_notification_list.py", line 31, in get_existing_records
rs = con.execute(text("SELECT min(date), max(date) FROM maya_notifications where parser_version=:v"), v=PARSER_VERSION)
TypeError: execute() got an unexpected keyword argument 'v'
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
spew_flow(flow, ctx)
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
datastream = flow.datastream()
File "/usr/local/lib/python3.9/site-packages/dataflows/base/flow.py", line 19, in datastream
return self._chain(ds)._process()
File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
datastream = self.source._process()
File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
datastream = self.source._process()
File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
self.raise_exception(exception)
File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor iterable_loader in position #9: execute() got an unexpected keyword argument 'v'
Pipeline ID: maya/scrape-maya-notification-list
dump_to_path
ERROR :Data Package validation error: Descriptor validation error: [] is too short at "schema/fields" in descriptor and at "properties/schema/properties/fields/minItems" in profile
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/dump_to_path.py", line 22, in <module>
with ingest() as ctx:
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 186, in ingest
params, datapackage, resource_iterator = _ingest(debug=debug)
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 44, in _ingest
datapackage, resource_iterator, dependency_dp = process_input(sys.stdin, validate, debug)
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/input_processor.py", line 88, in process_input
datapackage.validate(dp_to_validate)
File "/usr/local/lib/python3.9/site-packages/datapackage/validate.py", line 28, in validate
Package(descriptor, strict=True)
File "/usr/local/lib/python3.9/site-packages/datapackage/package.py", line 126, in __init__
self.__build()
File "/usr/local/lib/python3.9/site-packages/datapackage/package.py", line 534, in __build
updated_resource = Resource(descriptor,
File "/usr/local/lib/python3.9/site-packages/datapackage/resource.py", line 90, in __init__
self.__build()
File "/usr/local/lib/python3.9/site-packages/datapackage/resource.py", line 648, in __build
raise exception
File "/usr/local/lib/python3.9/site-packages/datapackage/resource.py", line 643, in __build
self.__profile.validate(self.__current_descriptor)
File "/usr/local/lib/python3.9/site-packages/datapackage/profile.py", line 89, in validate
raise exceptions.ValidationError(message, errors=errors)
datapackage.exceptions.ValidationError: There are 1 validation errors (see exception.errors)
Pipeline ID: maya/scrape-maya-tase-companies