Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']
Pipeline ID: maya/maya-bonds-and-options-holdings-changes
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']
Pipeline ID: maya/maya-company-director-appointments
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']
Pipeline ID: maya/maya-company-officer-list
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']
Pipeline ID: maya/maya-company-stakeholder-list
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']
Pipeline ID: maya/maya-company-vip-appointments
Dependency unsuccessful :Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed
Pipeline ID: maya/maya-complete-notification-list
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']
Pipeline ID: maya/maya-holdings-changes
flow ERROR :Traceback (most recent call last): ERROR :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module> ERROR :spew_flow(flow, ctx) ERROR :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__ ERROR :spew(self.datapackage, self.resource_iterator, stats=self.stats) ERROR :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew ERROR :for rec in res: ERROR :File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource ERROR :yield from self.func(resource) ERROR :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_notification_parse_updates.py", line 91, in parse_notification ERROR :for row in rows: ERROR :File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource ERROR :yield from self.func(resource) ERROR :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_notification_parse_updates.py", line 66, in store_on_s3 ERROR :for row in rows: ERROR :File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource ERROR :yield from self.func(resource) ERROR :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_notification_parse_updates.py", line 111, in limiter ERROR :for row in rows: ERROR :File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource ERROR :yield from self.func(resource) ERROR :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_notification_parse_updates.py", line 101, in remove_already_parsed ERROR :all_existing_ids = get_all_existing_ids() ERROR :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_notification_parse_updates.py", line 32, in get_all_existing_ids ERROR :rows = engine.execute(text("SELECT s3_object_name FROM maya_notifications where parser_version=:v"), v=PARSER_VERSION) ERROR :TypeError ERROR :: ERROR :execute() got an unexpected keyword argument 'v'
Pipeline ID: maya/maya-notification-parse-updates
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']
Pipeline ID: maya/maya-reported-academic-degrees
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']
Pipeline ID: maya/maya-reported-work-record
Dependency unsuccessful :Cannot run until dependency "./maya/scrape-maya-tase-companies" is successfully executed
Pipeline ID: maya/maya-tase-companies-current-management
Pipeline ID: maya/scrape-maya-notification-list
dump_to_path ERROR :Data Package validation error: Descriptor validation error: [] is too short at "schema/fields" in descriptor and at "properties/schema/properties/fields/minItems" in profile Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/dump_to_path.py", line 22, in <module> with ingest() as ctx: File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 186, in ingest params, datapackage, resource_iterator = _ingest(debug=debug) File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 44, in _ingest datapackage, resource_iterator, dependency_dp = process_input(sys.stdin, validate, debug) File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/input_processor.py", line 88, in process_input datapackage.validate(dp_to_validate) File "/usr/local/lib/python3.9/site-packages/datapackage/validate.py", line 28, in validate Package(descriptor, strict=True) File "/usr/local/lib/python3.9/site-packages/datapackage/package.py", line 126, in __init__ self.__build() File "/usr/local/lib/python3.9/site-packages/datapackage/package.py", line 534, in __build updated_resource = Resource(descriptor, File "/usr/local/lib/python3.9/site-packages/datapackage/resource.py", line 90, in __init__ self.__build() File "/usr/local/lib/python3.9/site-packages/datapackage/resource.py", line 648, in __build raise exception File "/usr/local/lib/python3.9/site-packages/datapackage/resource.py", line 643, in __build self.__profile.validate(self.__current_descriptor) File "/usr/local/lib/python3.9/site-packages/datapackage/profile.py", line 89, in validate raise exceptions.ValidationError(message, errors=errors) datapackage.exceptions.ValidationError: There are 1 validation errors (see exception.errors)
Pipeline ID: maya/scrape-maya-tase-companies
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']
Pipeline ID: maya/maya-bonds-and-options-holdings-changes
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']
Pipeline ID: maya/maya-company-director-appointments
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']
Pipeline ID: maya/maya-company-officer-list
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']
Pipeline ID: maya/maya-company-stakeholder-list
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']
Pipeline ID: maya/maya-company-vip-appointments
Dependency unsuccessful :Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed
Pipeline ID: maya/maya-complete-notification-list
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']
Pipeline ID: maya/maya-holdings-changes
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']
Pipeline ID: maya/maya-reported-academic-degrees
Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']
Pipeline ID: maya/maya-reported-work-record
Dependency unsuccessful :Cannot run until dependency "./maya/scrape-maya-tase-companies" is successfully executed
Pipeline ID: maya/maya-tase-companies-current-management
flow ERROR :Traceback (most recent call last): ERROR :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module> ERROR :spew_flow(flow, ctx) ERROR :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__ ERROR :spew(self.datapackage, self.resource_iterator, stats=self.stats) ERROR :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew ERROR :for rec in res: ERROR :File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource ERROR :yield from self.func(resource) ERROR :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_notification_parse_updates.py", line 91, in parse_notification ERROR :for row in rows: ERROR :File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource ERROR :yield from self.func(resource) ERROR :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_notification_parse_updates.py", line 66, in store_on_s3 ERROR :for row in rows: ERROR :File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource ERROR :yield from self.func(resource) ERROR :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_notification_parse_updates.py", line 111, in limiter ERROR :for row in rows: ERROR :File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource ERROR :yield from self.func(resource) ERROR :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_notification_parse_updates.py", line 101, in remove_already_parsed ERROR :all_existing_ids = get_all_existing_ids() ERROR :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_notification_parse_updates.py", line 32, in get_all_existing_ids ERROR :rows = engine.execute(text("SELECT s3_object_name FROM maya_notifications where parser_version=:v"), v=PARSER_VERSION) ERROR :TypeError ERROR :: ERROR :execute() got an unexpected keyword argument 'v'
Pipeline ID: maya/maya-notification-parse-updates
dump_to_path ERROR :Data Package validation error: Descriptor validation error: [] is too short at "schema/fields" in descriptor and at "properties/schema/properties/fields/minItems" in profile Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/dump_to_path.py", line 22, in <module> with ingest() as ctx: File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 186, in ingest params, datapackage, resource_iterator = _ingest(debug=debug) File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 44, in _ingest datapackage, resource_iterator, dependency_dp = process_input(sys.stdin, validate, debug) File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/input_processor.py", line 88, in process_input datapackage.validate(dp_to_validate) File "/usr/local/lib/python3.9/site-packages/datapackage/validate.py", line 28, in validate Package(descriptor, strict=True) File "/usr/local/lib/python3.9/site-packages/datapackage/package.py", line 126, in __init__ self.__build() File "/usr/local/lib/python3.9/site-packages/datapackage/package.py", line 534, in __build updated_resource = Resource(descriptor, File "/usr/local/lib/python3.9/site-packages/datapackage/resource.py", line 90, in __init__ self.__build() File "/usr/local/lib/python3.9/site-packages/datapackage/resource.py", line 648, in __build raise exception File "/usr/local/lib/python3.9/site-packages/datapackage/resource.py", line 643, in __build self.__profile.validate(self.__current_descriptor) File "/usr/local/lib/python3.9/site-packages/datapackage/profile.py", line 89, in validate raise exceptions.ValidationError(message, errors=errors) datapackage.exceptions.ValidationError: There are 1 validation errors (see exception.errors)
Pipeline ID: maya/scrape-maya-tase-companies
Pipeline ID: maya/scrape-maya-notification-list