Pipeline ID: budgetkey/elasticsearch/index_activities
Pipeline ID: budgetkey/elasticsearch/index_budget
Dependency unsuccessful :Cannot run until dependency "./procurement/calls_for_bids/calls-for-bids-all" is successfully executed
Pipeline ID: budgetkey/elasticsearch/index_calls_for_bids
Pipeline ID: budgetkey/elasticsearch/index_contract_spending
Pipeline ID: budgetkey/elasticsearch/index_entities
dump_to_es
ERROR :DUMP TO ES ERROR ApiError(413, 'None')
ERROR :TB
Traceback (most recent call last):
File "/datapackage_pipelines_budgetkey/processors/dump_to_es.py", line 146, in <module>
spew_flow(flow(ctx.parameters), ctx)
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
spew(self.datapackage, self.resource_iterator, stats=self.stats)
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
for rec in res:
File "/usr/local/lib/python3.9/site-packages/dataflows/processors/dumpers/dumper_base.py", line 69, in row_counter
for row in iterator:
File "/usr/local/lib/python3.9/site-packages/tableschema_elasticsearch/storage.py", line 226, in write
for result, row in iter:
File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 518, in streaming_bulk
for data, (ok, info) in zip(
File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 412, in _process_bulk_chunk
yield from gen
File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 346, in _process_bulk_chunk_error
raise error
File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 396, in _process_bulk_chunk
resp = client.bulk(*args, operations=bulk_actions, **kwargs) # type: ignore[arg-type]
File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/utils.py", line 458, in wrapped
return api(*args, **kwargs)
File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/__init__.py", line 839, in bulk
return self.perform_request( # type: ignore[return-value]
File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/_base.py", line 271, in perform_request
response = self._perform_request(
File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/_base.py", line 351, in _perform_request
raise HTTP_EXCEPTIONS.get(meta.status, ApiError)(
elasticsearch.ApiError: ApiError(413, 'None')
ERROR :Traceback (most recent call last):
ERROR :File "/datapackage_pipelines_budgetkey/processors/dump_to_es.py", line 146, in <module>
ERROR :spew_flow(flow(ctx.parameters), ctx)
ERROR :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
ERROR :spew(self.datapackage, self.resource_iterator, stats=self.stats)
ERROR :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
ERROR :for rec in res:
ERROR :File "/usr/local/lib/python3.9/site-packages/dataflows/processors/dumpers/dumper_base.py", line 69, in row_counter
ERROR :for row in iterator:
ERROR :File "/usr/local/lib/python3.9/site-packages/tableschema_elasticsearch/storage.py", line 226, in write
ERROR :for result, row in iter:
ERROR :File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 518, in streaming_bulk
ERROR :for data, (ok, info) in zip(
ERROR :File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 412, in _process_bulk_chunk
ERROR :yield from gen
ERROR :File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 346, in _process_bulk_chunk_error
ERROR :raise error
ERROR :File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 396, in _process_bulk_chunk
ERROR :resp = client.bulk(*args, operations=bulk_actions, **kwargs) # type: ignore[arg-type]
ERROR :File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/utils.py", line 458, in wrapped
ERROR :return api(*args, **kwargs)
ERROR :File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/__init__.py", line 839, in bulk
ERROR :return self.perform_request( # type: ignore[return-value]
ERROR :File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/_base.py", line 271, in perform_request
ERROR :response = self._perform_request(
ERROR :File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/_base.py", line 351, in _perform_request
ERROR :raise HTTP_EXCEPTIONS.get(meta.status, ApiError)(
ERROR :elasticsearch
ERROR :.
ERROR :ApiError
ERROR ::
ERROR :ApiError(413, 'None')
Pipeline ID: budgetkey/elasticsearch/index_gov_decisions
Pipeline ID: budgetkey/elasticsearch/index_muni_budgets
Pipeline ID: budgetkey/elasticsearch/index_muni_tenders
Pipeline ID: budgetkey/elasticsearch/index_national_budget_changes
Invalid dependency :Cannot run until dependency passes validation: ./people/aggregated From ./people/aggregated :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/all'] From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']] From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed']]] From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]] From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]] From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]] From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]] From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]] From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]] From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]] From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]] From ./people/aggregated :['From ./people/all', ['Dependency unsuccessful', 'Cannot run until dependency "./people/political_candidates/election_candidates21" is successfully executed']]
Pipeline ID: budgetkey/elasticsearch/index_people
enrich_ngo_reports
Traceback (most recent call last):
File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/enrich_ngo_reports.py", line 93, in <module>
spew(dp, process_resources(res_iter))
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
for rec in res:
File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/enrich_ngo_reports.py", line 85, in process_resource
assert len(missing_foas) == 0, 'Missing foas:\n%s' % '\n'.join(missing_foas)
AssertionError: Missing foas:
אגודות סטודנטים
אגודות ספורט
איגודי ספורט
איגודים מקצועיים
איכות סביבה
ארגוני גג ותשתית בחברה האזרחית
ארגוני עובדים
ארגונים מקצועיים
בריאות והצלת חיים
בתי אבות
בתי כנסת
בתי-ספר תורניים
גני חיות וטבע
דת
דת (לדתות שאינן יהדות, אסלם או נצרות)
דת יהודית
דת מוסלמית
דת נוצרית
הכשרה ותעסוקה
הנצחה
הצלת חיים
השכלה גבוהה
התנדבות ומתנדבים
התנדבות וקרנות פילנטרופיות
חינוך, השכלה והכשרה מקצועית
טיפול במצבי אסון וחירום
ידידות בין עמים
יוצאי תפוצות
ישיבות וכוללים
מוזיאונים
מוסדות חינוך
מוסדות שיקום
מוסיקה
מועדונים חברתיים
מורשת והנצחה
מחקר, מדע וטכנולוגיה
מלגות לתלמידים ולסטודנטים
מעונות יום וחינוך קדם יסודי
מרכזים קהילתיים ומתנ״סים
סביבה ובעלי חיים
סיוע למוגבלים
סיוע לנזקקים
סיוע לנפגעי תקיפה מינית
סיוע משפטי
סמים
סנגור ושינוי חברתי ופוליטי
ספורט
ספרות ודפוס
פעילות חברתית
פעילות פוליטית
קהילה וחברה
קולנוע
קליטת עליה
קרנות (שמעבירות כספים לעמותות אחרות)
קשרים בינלאומיים
רווחת בעלי חיים
שיכון ופיתוח עירוני
שירותי רווחה
שמירת חירויות הפרט
תאטרון
תיירות
תכניות חינוכיות
תמיכה בחיילים ושוטרים
תקשורת
תרבות ואומנות
Pipeline ID: budgetkey/elasticsearch/index_reports
Dependency unsuccessful :Cannot run until dependency "./supports/criteria/support-criteria" is successfully executed
Pipeline ID: budgetkey/elasticsearch/index_support_criteria
Pipeline ID: budgetkey/elasticsearch/index_support_programs
Pipeline ID: budgetkey/elasticsearch/index_supports
Pipeline ID: budgetkey/elasticsearch/index_tenders
Pipeline ID: budgetkey/elasticsearch/index_units
Dependency unsuccessful :Cannot run until dependency "./budgetkey/elasticsearch/index_gov_decisions" is successfully executed
Pipeline ID: budgetkey/elasticsearch/sitemaps
Dependency unsuccessful :Cannot run until dependency "./procurement/calls_for_bids/calls-for-bids-all" is successfully executed
Pipeline ID: budgetkey/elasticsearch/index_calls_for_bids
Invalid dependency :Cannot run until dependency passes validation: ./people/aggregated From ./people/aggregated :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/all'] From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']] From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed']]] From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]] From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]] From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]] From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]] From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]] From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]] From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]] From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]] From ./people/aggregated :['From ./people/all', ['Dependency unsuccessful', 'Cannot run until dependency "./people/political_candidates/election_candidates21" is successfully executed']]
Pipeline ID: budgetkey/elasticsearch/index_people
Dependency unsuccessful :Cannot run until dependency "./supports/criteria/support-criteria" is successfully executed
Pipeline ID: budgetkey/elasticsearch/index_support_criteria
Dependency unsuccessful :Cannot run until dependency "./budgetkey/elasticsearch/index_gov_decisions" is successfully executed
Pipeline ID: budgetkey/elasticsearch/sitemaps
Pipeline ID: budgetkey/elasticsearch/index_entities
dump_to_es
ERROR :DUMP TO ES ERROR ApiError(413, 'None')
ERROR :TB
Traceback (most recent call last):
File "/datapackage_pipelines_budgetkey/processors/dump_to_es.py", line 146, in <module>
spew_flow(flow(ctx.parameters), ctx)
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
spew(self.datapackage, self.resource_iterator, stats=self.stats)
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
for rec in res:
File "/usr/local/lib/python3.9/site-packages/dataflows/processors/dumpers/dumper_base.py", line 69, in row_counter
for row in iterator:
File "/usr/local/lib/python3.9/site-packages/tableschema_elasticsearch/storage.py", line 226, in write
for result, row in iter:
File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 518, in streaming_bulk
for data, (ok, info) in zip(
File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 412, in _process_bulk_chunk
yield from gen
File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 346, in _process_bulk_chunk_error
raise error
File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 396, in _process_bulk_chunk
resp = client.bulk(*args, operations=bulk_actions, **kwargs) # type: ignore[arg-type]
File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/utils.py", line 458, in wrapped
return api(*args, **kwargs)
File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/__init__.py", line 839, in bulk
return self.perform_request( # type: ignore[return-value]
File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/_base.py", line 271, in perform_request
response = self._perform_request(
File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/_base.py", line 351, in _perform_request
raise HTTP_EXCEPTIONS.get(meta.status, ApiError)(
elasticsearch.ApiError: ApiError(413, 'None')
ERROR :Traceback (most recent call last):
ERROR :File "/datapackage_pipelines_budgetkey/processors/dump_to_es.py", line 146, in <module>
ERROR :spew_flow(flow(ctx.parameters), ctx)
ERROR :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
ERROR :spew(self.datapackage, self.resource_iterator, stats=self.stats)
ERROR :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
ERROR :for rec in res:
ERROR :File "/usr/local/lib/python3.9/site-packages/dataflows/processors/dumpers/dumper_base.py", line 69, in row_counter
ERROR :for row in iterator:
ERROR :File "/usr/local/lib/python3.9/site-packages/tableschema_elasticsearch/storage.py", line 226, in write
ERROR :for result, row in iter:
ERROR :File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 518, in streaming_bulk
ERROR :for data, (ok, info) in zip(
ERROR :File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 412, in _process_bulk_chunk
ERROR :yield from gen
ERROR :File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 346, in _process_bulk_chunk_error
ERROR :raise error
ERROR :File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 396, in _process_bulk_chunk
ERROR :resp = client.bulk(*args, operations=bulk_actions, **kwargs) # type: ignore[arg-type]
ERROR :File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/utils.py", line 458, in wrapped
ERROR :return api(*args, **kwargs)
ERROR :File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/__init__.py", line 839, in bulk
ERROR :return self.perform_request( # type: ignore[return-value]
ERROR :File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/_base.py", line 271, in perform_request
ERROR :response = self._perform_request(
ERROR :File "/usr/local/lib/python3.9/site-packages/elasticsearch/_sync/client/_base.py", line 351, in _perform_request
ERROR :raise HTTP_EXCEPTIONS.get(meta.status, ApiError)(
ERROR :elasticsearch
ERROR :.
ERROR :ApiError
ERROR ::
ERROR :ApiError(413, 'None')
Pipeline ID: budgetkey/elasticsearch/index_gov_decisions
enrich_ngo_reports
Traceback (most recent call last):
File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/enrich_ngo_reports.py", line 93, in <module>
spew(dp, process_resources(res_iter))
File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
for rec in res:
File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/enrich_ngo_reports.py", line 85, in process_resource
assert len(missing_foas) == 0, 'Missing foas:\n%s' % '\n'.join(missing_foas)
AssertionError: Missing foas:
אגודות סטודנטים
אגודות ספורט
איגודי ספורט
איגודים מקצועיים
איכות סביבה
ארגוני גג ותשתית בחברה האזרחית
ארגוני עובדים
ארגונים מקצועיים
בריאות והצלת חיים
בתי אבות
בתי כנסת
בתי-ספר תורניים
גני חיות וטבע
דת
דת (לדתות שאינן יהדות, אסלם או נצרות)
דת יהודית
דת מוסלמית
דת נוצרית
הכשרה ותעסוקה
הנצחה
הצלת חיים
השכלה גבוהה
התנדבות ומתנדבים
התנדבות וקרנות פילנטרופיות
חינוך, השכלה והכשרה מקצועית
טיפול במצבי אסון וחירום
ידידות בין עמים
יוצאי תפוצות
ישיבות וכוללים
מוזיאונים
מוסדות חינוך
מוסדות שיקום
מוסיקה
מועדונים חברתיים
מורשת והנצחה
מחקר, מדע וטכנולוגיה
מלגות לתלמידים ולסטודנטים
מעונות יום וחינוך קדם יסודי
מרכזים קהילתיים ומתנ״סים
סביבה ובעלי חיים
סיוע למוגבלים
סיוע לנזקקים
סיוע לנפגעי תקיפה מינית
סיוע משפטי
סמים
סנגור ושינוי חברתי ופוליטי
ספורט
ספרות ודפוס
פעילות חברתית
פעילות פוליטית
קהילה וחברה
קולנוע
קליטת עליה
קרנות (שמעבירות כספים לעמותות אחרות)
קשרים בינלאומיים
רווחת בעלי חיים
שיכון ופיתוח עירוני
שירותי רווחה
שמירת חירויות הפרט
תאטרון
תיירות
תכניות חינוכיות
תמיכה בחיילים ושוטרים
תקשורת
תרבות ואומנות
Pipeline ID: budgetkey/elasticsearch/index_reports
Pipeline ID: budgetkey/elasticsearch/index_activities
Pipeline ID: budgetkey/elasticsearch/index_budget
Pipeline ID: budgetkey/elasticsearch/index_contract_spending
Pipeline ID: budgetkey/elasticsearch/index_muni_budgets
Pipeline ID: budgetkey/elasticsearch/index_muni_tenders
Pipeline ID: budgetkey/elasticsearch/index_national_budget_changes
Pipeline ID: budgetkey/elasticsearch/index_support_programs
Pipeline ID: budgetkey/elasticsearch/index_supports
Pipeline ID: budgetkey/elasticsearch/index_tenders
Pipeline ID: budgetkey/elasticsearch/index_units