Last Run triggered by:

dirty-task-init

Last Run started at:

2025-11-29 21:26:27.846394

Last Completion:

2025-11-29 23:15:21.266360

Last Success:

2025-11-29 23:15:21.266360

Dependency unsuccessful :Cannot run until dependency "./procurement/spending/latest-contract-spending" is successfully executed

Pipeline ID: budgetkey/elasticsearch/index_contract_spending

Last Run triggered by:

scheduled

Last Run started at:

2025-12-01 02:57:46.958457

Last Completion:

2025-12-01 03:35:27.899862

Last Success:

2025-12-01 03:35:27.899862

Invalid dependency :Cannot run until dependency passes validation: ./entities/entities
From ./entities/entities :['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/spending/spending-by-entity']
From ./entities/entities :['From ./procurement/spending/spending-by-entity', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/spending/latest-contract-spending" is successfully executed']]
From ./entities/entities :['Invalid dependency', 'Cannot run until dependency passes validation: ./supports/supports-by-entity']
From ./entities/entities :['From ./supports/supports-by-entity', ['Dependency unsuccessful', 'Cannot run until dependency "./supports/with-entities" is successfully executed']]
From ./entities/entities :['Dependency unsuccessful', 'Cannot run until dependency "./entities/all" is successfully executed']

Pipeline ID: budgetkey/elasticsearch/index_entities

Last Run triggered by:

dirty-task-update

Last Run started at:

2025-12-15 12:17:00.973127

Last Completion:

2025-12-15 13:17:57.116033

Last Success:

None

dump_to_es
ERROR   :DUMP TO ES ERROR ApiError(413, 'None')
ERROR   :TB
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/processors/dump_to_es.py", line 146, in <module>
    spew_flow(flow(ctx.parameters), ctx)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
    spew(self.datapackage, self.resource_iterator, stats=self.stats)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/usr/local/lib/python3.9/site-packages/dataflows/processors/dumpers/dumper_base.py", line 69, in row_counter
    for row in iterator:
  File "/usr/local/lib/python3.9/site-packages/tableschema_elasticsearch/storage.py", line 226, in write
    for result, row in iter:
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 518, in streaming_bulk
    for data, (ok, info) in zip(
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 412, in _process_bulk_chunk
    yield from gen
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 346, in _process_bulk_chunk_error
    raise error
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 396, in _process_bulk_chunk
    resp = client.bulk(*args, operations=bulk_actions, **kwargs)  # type: ignore[arg-type]
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/utils.py", line 452, in wrapped
    return api(*args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/__init__.py", line 830, in bulk
    return self.perform_request(  # type: ignore[return-value]
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/_base.py", line 271, in perform_request
    response = self._perform_request(
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/_base.py", line 351, in _perform_request
    raise HTTP_EXCEPTIONS.get(meta.status, ApiError)(
elasticsearch.ApiError: ApiError(413, 'None')
ERROR   :Traceback (most recent call last):
ERROR   :File "/datapackage_pipelines_budgetkey/processors/dump_to_es.py", line 146, in <module>
ERROR   :spew_flow(flow(ctx.parameters), ctx)
ERROR   :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
ERROR   :spew(self.datapackage, self.resource_iterator, stats=self.stats)
ERROR   :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
ERROR   :for rec in res:
ERROR   :File "/usr/local/lib/python3.9/site-packages/dataflows/processors/dumpers/dumper_base.py", line 69, in row_counter
ERROR   :for row in iterator:
ERROR   :File "/usr/local/lib/python3.9/site-packages/tableschema_elasticsearch/storage.py", line 226, in write
ERROR   :for result, row in iter:
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 518, in streaming_bulk
ERROR   :for data, (ok, info) in zip(
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 412, in _process_bulk_chunk
ERROR   :yield from gen
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 346, in _process_bulk_chunk_error
ERROR   :raise error
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 396, in _process_bulk_chunk
ERROR   :resp = client.bulk(*args, operations=bulk_actions, **kwargs)  # type: ignore[arg-type]
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/utils.py", line 452, in wrapped
ERROR   :return api(*args, **kwargs)
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/__init__.py", line 830, in bulk
ERROR   :return self.perform_request(  # type: ignore[return-value]
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/_base.py", line 271, in perform_request
ERROR   :response = self._perform_request(
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/_base.py", line 351, in _perform_request
ERROR   :raise HTTP_EXCEPTIONS.get(meta.status, ApiError)(
ERROR   :elasticsearch
ERROR   :.
ERROR   :ApiError
ERROR   ::
ERROR   :ApiError(413, 'None')

Pipeline ID: budgetkey/elasticsearch/index_gov_decisions

Last Run triggered by:

None

Last Run started at:

None

Last Completion:

None

Last Success:

None

Invalid dependency :Cannot run until dependency passes validation: ./people/aggregated
From ./people/aggregated :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/all']
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/state_owned/state-owned-nominations" is successfully executed']]]
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/procurement/procurement-individuals']]
From ./people/aggregated :['From ./people/all', ['From ./people/procurement/procurement-individuals', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/spending/latest-contract-spending" is successfully executed']]]
From ./people/aggregated :['From ./people/all', ['Dependency unsuccessful', 'Cannot run until dependency "./people/political_candidates/election_candidates21" is successfully executed']]

Pipeline ID: budgetkey/elasticsearch/index_people

Last Run triggered by:

None

Last Run started at:

None

Last Completion:

None

Last Success:

None

Dependency unsuccessful :Cannot run until dependency "./supports/criteria/support-criteria" is successfully executed

Pipeline ID: budgetkey/elasticsearch/index_support_criteria

Last Run triggered by:

None

Last Run started at:

None

Last Completion:

None

Last Success:

None

Invalid dependency :Cannot run until dependency passes validation: ./budgetkey/elasticsearch/index_entities
From ./budgetkey/elasticsearch/index_entities :['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/entities']
From ./budgetkey/elasticsearch/index_entities :['From ./entities/entities', ['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/spending/spending-by-entity']]
From ./budgetkey/elasticsearch/index_entities :['From ./entities/entities', ['From ./procurement/spending/spending-by-entity', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/spending/latest-contract-spending" is successfully executed']]]
From ./budgetkey/elasticsearch/index_entities :['From ./entities/entities', ['Invalid dependency', 'Cannot run until dependency passes validation: ./supports/supports-by-entity']]
From ./budgetkey/elasticsearch/index_entities :['From ./entities/entities', ['From ./supports/supports-by-entity', ['Dependency unsuccessful', 'Cannot run until dependency "./supports/with-entities" is successfully executed']]]
From ./budgetkey/elasticsearch/index_entities :['From ./entities/entities', ['Dependency unsuccessful', 'Cannot run until dependency "./entities/all" is successfully executed']]
Invalid dependency :Cannot run until dependency passes validation: ./budgetkey/elasticsearch/index_contract_spending
From ./budgetkey/elasticsearch/index_contract_spending :['Dependency unsuccessful', 'Cannot run until dependency "./procurement/spending/latest-contract-spending" is successfully executed']
Dependency unsuccessful :Cannot run until dependency "./budgetkey/elasticsearch/index_gov_decisions" is successfully executed

Pipeline ID: budgetkey/elasticsearch/sitemaps