budget/municipal/fetcher
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-19 00:00:09.813556
Last Completion:
2025-05-19 00:06:53.812829
Last Success:
2025-05-19 00:06:53.812829

Pipeline ID: budget/municipal/fetcher

budget/national/changes/explanations/all
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:46:20.798375
Last Completion:
2025-04-27 07:49:18.724376
Last Success:
2025-04-27 07:49:18.724376

Pipeline ID: budget/national/changes/explanations/all

budget/national/changes/original/committee-zipfile
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-19 00:00:08.863541
Last Completion:
2025-05-19 00:00:11.430048
Last Success:
2025-05-19 00:00:11.430048

Pipeline ID: budget/national/changes/original/committee-zipfile

budget/national/changes/original/current-year-fixes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-16 01:43:50.430683
Last Completion:
2025-05-16 01:44:08.653364
Last Success:
2025-05-16 01:44:08.653364

Pipeline ID: budget/national/changes/original/current-year-fixes

budget/national/changes/original/national-budget-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-16 00:11:41.455507
Last Completion:
2025-05-16 00:14:00.651274
Last Success:
2025-05-16 00:14:00.651274

Pipeline ID: budget/national/changes/original/national-budget-changes

Changes, grouped by transaction_id, with explanations (national-budget-changes-aggregated)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-17 17:21:16.652104
Last Completion:
2025-05-17 17:35:11.044849
Last Success:
2025-05-17 17:35:11.044849

Pipeline ID: budget/national/changes/processed/national-budget-changes-aggregated

budget/national/changes/processed/transactions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-16 01:44:08.722355
Last Completion:
2025-05-16 05:25:55.452380
Last Success:
2025-05-16 05:25:55.452380

Pipeline ID: budget/national/changes/processed/transactions

National Yearly Budgets (national-budgets)
Succeeded

We get the data the Ministry of Finance publishes in data.gov.il every year. It comes in XLS format, with one row per TAKANA and phase (original, approved, executed). In this pipeline we create from each triplet a single row that has all the data.


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:47:00.392778
Last Completion:
2025-04-27 09:28:04.312636
Last Success:
2025-04-27 09:28:04.312636

Pipeline ID: budget/national/original/national-budgets

National Yearly Budgets - Processed (aggregated-yearly)
Succeeded

This pipeline joins the different phases of the budget (allocated, revised and executed). In the original file there's a separate row for each of the phases. We like it better as a single row with all phase info. Another thing this pipeline does is to rename the column titles - to more friendly English names. Also, it create rows for all hierarchies - where upper hierarchies (2, 4 & 6 digits) are plain aggregations of the 8-digit items they contain.


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 10:02:34.009359
Last Completion:
2025-04-27 11:45:26.290089
Last Success:
2025-04-27 11:45:26.290089

Pipeline ID: budget/national/processed/aggregated-yearly

budget/national/processed/category-explanations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:49:18.734713
Last Completion:
2025-04-27 07:49:19.587602
Last Success:
2025-04-27 07:49:19.587602

Pipeline ID: budget/national/processed/category-explanations

National Yearly Budgets - Joined with category-explanations (connected-items-explained)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 12:52:17.424867
Last Completion:
2025-04-27 12:58:16.618237
Last Success:
2025-04-27 12:58:16.618237

Pipeline ID: budget/national/processed/connected-items-explained

National Yearly Budgets - Connected Items (connected-national-budgets)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 12:27:17.216305
Last Completion:
2025-04-27 12:51:43.590911
Last Success:
2025-04-27 12:51:43.590911

Pipeline ID: budget/national/processed/connected-national-budgets

National Yearly Budgets - Just the total (item 00) (just-the-total)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 12:16:02.519690
Last Completion:
2025-04-27 12:22:26.397580
Last Success:
2025-04-27 12:22:26.397580

Pipeline ID: budget/national/processed/just-the-total

National Yearly Budgets - Main Item Names (roof-names)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 12:19:51.802520
Last Completion:
2025-04-27 12:27:17.211483
Last Success:
2025-04-27 12:27:17.211483

Pipeline ID: budget/national/processed/roof-names

National Yearly Budgets - With Extras (with-extras)
Succeeded

This pipeline joins the budget data to itself so that each item has a list of its immediate children.


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 11:45:26.701478
Last Completion:
2025-04-27 12:09:07.588986
Last Success:
2025-04-27 12:09:07.588986

Pipeline ID: budget/national/processed/with-extras

budgetkey/analysis/spending/publisher_entity_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-18 10:10:39.458582
Last Completion:
2025-05-18 10:38:37.629309
Last Success:
2025-05-18 10:38:37.629309

Pipeline ID: budgetkey/analysis/spending/publisher_entity_analysis

budgetkey/analysis/spending/publisher_foa_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-18 10:10:39.464059
Last Completion:
2025-05-18 10:13:12.123167
Last Success:
2025-05-18 10:13:12.123167

Pipeline ID: budgetkey/analysis/spending/publisher_foa_analysis

budgetkey/analysis/spending/united
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-18 10:00:01.374100
Last Completion:
2025-05-18 10:10:39.351346
Last Success:
2025-05-18 10:10:39.351346

Pipeline ID: budgetkey/analysis/spending/united

Main Page - Aggregated budget by functional classification (budget-functional-aggregates)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 11:45:26.908056
Last Completion:
2025-04-27 11:53:19.313975
Last Success:
2025-04-27 11:53:19.313975

Pipeline ID: budgetkey/budget-functional-aggregates

budgetkey/documents
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 11:53:19.710853
Last Completion:
2025-04-27 11:53:23.504632
Last Success:
2025-04-27 11:53:23.504632

Pipeline ID: budgetkey/documents

budgetkey/elasticsearch/index_activities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-19 00:09:41.151946
Last Completion:
2025-05-19 00:10:11.070271
Last Success:
2025-05-19 00:10:11.070271

Pipeline ID: budgetkey/elasticsearch/index_activities

budgetkey/elasticsearch/index_budget
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-18 01:05:24.521904
Last Completion:
2025-05-18 01:20:06.821183
Last Success:
2025-05-18 01:20:06.821183

Pipeline ID: budgetkey/elasticsearch/index_budget

budgetkey/elasticsearch/index_calls_for_bids
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./procurement/calls_for_bids/calls-for-bids-all
From ./procurement/calls_for_bids/calls-for-bids-all :['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-calls-for-bids']
From ./procurement/calls_for_bids/calls-for-bids-all :['From ./procurement/calls_for_bids/jobiz-calls-for-bids', ['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-all']]
From ./procurement/calls_for_bids/calls-for-bids-all :['From ./procurement/calls_for_bids/jobiz-calls-for-bids', ['From ./procurement/calls_for_bids/jobiz-all', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed']]]

Pipeline ID: budgetkey/elasticsearch/index_calls_for_bids

budgetkey/elasticsearch/index_contract_spending
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-18 00:50:55.221691
Last Completion:
2025-05-18 02:37:31.334926
Last Success:
2025-05-18 02:37:31.334926

Pipeline ID: budgetkey/elasticsearch/index_contract_spending

budgetkey/elasticsearch/index_entities
Running

Last Run triggered by:
scheduled
Last Run started at:
2025-05-19 05:19:51.015470
Last Completion:
Last Success:
2025-05-19 05:15:14.949860

Pipeline ID: budgetkey/elasticsearch/index_entities

budgetkey/elasticsearch/index_gov_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-18 12:12:56.590032
Last Completion:
2025-05-18 12:14:58.291542
Last Success:
2025-05-18 12:14:58.291542

Pipeline ID: budgetkey/elasticsearch/index_gov_decisions

budgetkey/elasticsearch/index_muni_budgets
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-19 00:21:53.857859
Last Completion:
2025-05-19 00:28:00.068465
Last Success:
2025-05-19 00:28:00.068465

Pipeline ID: budgetkey/elasticsearch/index_muni_budgets

budgetkey/elasticsearch/index_muni_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-19 00:06:55.648463
Last Completion:
2025-05-19 00:07:24.249477
Last Success:
2025-05-19 00:07:24.249477

Pipeline ID: budgetkey/elasticsearch/index_muni_tenders

budgetkey/elasticsearch/index_national_budget_changes
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-18 01:11:34.112936
Last Completion:
2025-05-18 01:14:58.012365
Last Success:
2025-05-18 01:14:58.012365

Pipeline ID: budgetkey/elasticsearch/index_national_budget_changes

budgetkey/elasticsearch/index_people
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/aggregated
From ./people/aggregated :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/all']
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/state_owned/state-owned-nominations" is successfully executed']]]
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/association_founders/association-founders']]
From ./people/aggregated :['From ./people/all', ['From ./people/association_founders/association-founders', ['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/associations/guidestar/guidestar']]]
From ./people/aggregated :['From ./people/all', ['From ./people/association_founders/association-founders', ['From ./entities/associations/guidestar/guidestar', ['Dependency unsuccessful', 'Cannot run until dependency "./entities/associations/guidestar/guidestar-scraper" is successfully executed']]]]
From ./people/aggregated :['From ./people/all', ['Dependency unsuccessful', 'Cannot run until dependency "./people/political_candidates/election_candidates21" is successfully executed']]

Pipeline ID: budgetkey/elasticsearch/index_people

budgetkey/elasticsearch/index_reports
Failed

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-05-19 04:38:02.248335
Last Completion:
2025-05-19 04:38:11.841969
Last Success:
2025-05-19 00:21:53.848786

make_ngo_report_income_lists
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/make_ngo_report_income_lists.py", line 107, in <module>
    spew(dp, process_resources(res_iter))
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/make_ngo_report_income_lists.py", line 75, in process_resource
    details['income_list{}'.format(suffix)] = make_income_list(
  File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/make_ngo_report_income_lists.py", line 45, in make_income_list
    results = [r._asdict() for r in results]
UnboundLocalError: local variable 'results' referenced before assignment

Pipeline ID: budgetkey/elasticsearch/index_reports

budgetkey/elasticsearch/index_support_criteria
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./supports/criteria/support-criteria" is successfully executed

Pipeline ID: budgetkey/elasticsearch/index_support_criteria

budgetkey/elasticsearch/index_supports
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-05-19 00:08:02.543089
Last Completion:
2025-05-19 00:46:11.917693
Last Success:
2025-05-19 00:46:11.917693

Pipeline ID: budgetkey/elasticsearch/index_supports

budgetkey/elasticsearch/index_tenders
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-05-19 00:11:31.969544
Last Completion:
2025-05-19 00:37:18.415505
Last Success:
2025-05-19 00:37:18.415505

Pipeline ID: budgetkey/elasticsearch/index_tenders

budgetkey/elasticsearch/index_units
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-19 00:07:09.440244
Last Completion:
2025-05-19 00:07:36.313723
Last Success:
2025-05-19 00:07:36.313723

Pipeline ID: budgetkey/elasticsearch/index_units

budgetkey/elasticsearch/sitemaps
Running

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-05-19 04:33:00.730131
Last Completion:
Last Success:
2025-05-19 03:17:08.128489

Pipeline ID: budgetkey/elasticsearch/sitemaps

Send periodic emails (emails)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-16 05:01:01.635529
Last Completion:
2025-05-17 06:14:23.737297
Last Success:
2025-05-17 06:14:23.737297

Pipeline ID: budgetkey/emails/emails

budgetkey/elasticsearch/index_calls_for_bids
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./procurement/calls_for_bids/calls-for-bids-all
From ./procurement/calls_for_bids/calls-for-bids-all :['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-calls-for-bids']
From ./procurement/calls_for_bids/calls-for-bids-all :['From ./procurement/calls_for_bids/jobiz-calls-for-bids', ['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-all']]
From ./procurement/calls_for_bids/calls-for-bids-all :['From ./procurement/calls_for_bids/jobiz-calls-for-bids', ['From ./procurement/calls_for_bids/jobiz-all', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed']]]

Pipeline ID: budgetkey/elasticsearch/index_calls_for_bids

budgetkey/elasticsearch/index_people
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/aggregated
From ./people/aggregated :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/all']
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/state_owned/state-owned-nominations" is successfully executed']]]
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/association_founders/association-founders']]
From ./people/aggregated :['From ./people/all', ['From ./people/association_founders/association-founders', ['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/associations/guidestar/guidestar']]]
From ./people/aggregated :['From ./people/all', ['From ./people/association_founders/association-founders', ['From ./entities/associations/guidestar/guidestar', ['Dependency unsuccessful', 'Cannot run until dependency "./entities/associations/guidestar/guidestar-scraper" is successfully executed']]]]
From ./people/aggregated :['From ./people/all', ['Dependency unsuccessful', 'Cannot run until dependency "./people/political_candidates/election_candidates21" is successfully executed']]

Pipeline ID: budgetkey/elasticsearch/index_people

budgetkey/elasticsearch/index_support_criteria
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./supports/criteria/support-criteria" is successfully executed

Pipeline ID: budgetkey/elasticsearch/index_support_criteria

budgetkey/elasticsearch/index_entities
Running

Last Run triggered by:
scheduled
Last Run started at:
2025-05-19 05:19:51.015470
Last Completion:
Last Success:
2025-05-19 05:15:14.949860

Pipeline ID: budgetkey/elasticsearch/index_entities

budgetkey/elasticsearch/sitemaps
Running

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-05-19 04:33:00.730131
Last Completion:
Last Success:
2025-05-19 03:17:08.128489

Pipeline ID: budgetkey/elasticsearch/sitemaps

budgetkey/elasticsearch/index_reports
Failed

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-05-19 04:38:02.248335
Last Completion:
2025-05-19 04:38:11.841969
Last Success:
2025-05-19 00:21:53.848786

make_ngo_report_income_lists
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/make_ngo_report_income_lists.py", line 107, in <module>
    spew(dp, process_resources(res_iter))
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/make_ngo_report_income_lists.py", line 75, in process_resource
    details['income_list{}'.format(suffix)] = make_income_list(
  File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/make_ngo_report_income_lists.py", line 45, in make_income_list
    results = [r._asdict() for r in results]
UnboundLocalError: local variable 'results' referenced before assignment

Pipeline ID: budgetkey/elasticsearch/index_reports

budget/municipal/fetcher
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-19 00:00:09.813556
Last Completion:
2025-05-19 00:06:53.812829
Last Success:
2025-05-19 00:06:53.812829

Pipeline ID: budget/municipal/fetcher

budget/national/changes/explanations/all
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:46:20.798375
Last Completion:
2025-04-27 07:49:18.724376
Last Success:
2025-04-27 07:49:18.724376

Pipeline ID: budget/national/changes/explanations/all

budget/national/changes/original/committee-zipfile
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-19 00:00:08.863541
Last Completion:
2025-05-19 00:00:11.430048
Last Success:
2025-05-19 00:00:11.430048

Pipeline ID: budget/national/changes/original/committee-zipfile

budget/national/changes/original/current-year-fixes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-16 01:43:50.430683
Last Completion:
2025-05-16 01:44:08.653364
Last Success:
2025-05-16 01:44:08.653364

Pipeline ID: budget/national/changes/original/current-year-fixes

budget/national/changes/original/national-budget-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-16 00:11:41.455507
Last Completion:
2025-05-16 00:14:00.651274
Last Success:
2025-05-16 00:14:00.651274

Pipeline ID: budget/national/changes/original/national-budget-changes

Changes, grouped by transaction_id, with explanations (national-budget-changes-aggregated)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-17 17:21:16.652104
Last Completion:
2025-05-17 17:35:11.044849
Last Success:
2025-05-17 17:35:11.044849

Pipeline ID: budget/national/changes/processed/national-budget-changes-aggregated

budget/national/changes/processed/transactions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-16 01:44:08.722355
Last Completion:
2025-05-16 05:25:55.452380
Last Success:
2025-05-16 05:25:55.452380

Pipeline ID: budget/national/changes/processed/transactions

National Yearly Budgets (national-budgets)
Succeeded

We get the data the Ministry of Finance publishes in data.gov.il every year. It comes in XLS format, with one row per TAKANA and phase (original, approved, executed). In this pipeline we create from each triplet a single row that has all the data.


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:47:00.392778
Last Completion:
2025-04-27 09:28:04.312636
Last Success:
2025-04-27 09:28:04.312636

Pipeline ID: budget/national/original/national-budgets

National Yearly Budgets - Processed (aggregated-yearly)
Succeeded

This pipeline joins the different phases of the budget (allocated, revised and executed). In the original file there's a separate row for each of the phases. We like it better as a single row with all phase info. Another thing this pipeline does is to rename the column titles - to more friendly English names. Also, it create rows for all hierarchies - where upper hierarchies (2, 4 & 6 digits) are plain aggregations of the 8-digit items they contain.


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 10:02:34.009359
Last Completion:
2025-04-27 11:45:26.290089
Last Success:
2025-04-27 11:45:26.290089

Pipeline ID: budget/national/processed/aggregated-yearly

budget/national/processed/category-explanations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:49:18.734713
Last Completion:
2025-04-27 07:49:19.587602
Last Success:
2025-04-27 07:49:19.587602

Pipeline ID: budget/national/processed/category-explanations

National Yearly Budgets - Joined with category-explanations (connected-items-explained)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 12:52:17.424867
Last Completion:
2025-04-27 12:58:16.618237
Last Success:
2025-04-27 12:58:16.618237

Pipeline ID: budget/national/processed/connected-items-explained

National Yearly Budgets - Connected Items (connected-national-budgets)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 12:27:17.216305
Last Completion:
2025-04-27 12:51:43.590911
Last Success:
2025-04-27 12:51:43.590911

Pipeline ID: budget/national/processed/connected-national-budgets

National Yearly Budgets - Just the total (item 00) (just-the-total)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 12:16:02.519690
Last Completion:
2025-04-27 12:22:26.397580
Last Success:
2025-04-27 12:22:26.397580

Pipeline ID: budget/national/processed/just-the-total

National Yearly Budgets - Main Item Names (roof-names)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 12:19:51.802520
Last Completion:
2025-04-27 12:27:17.211483
Last Success:
2025-04-27 12:27:17.211483

Pipeline ID: budget/national/processed/roof-names

National Yearly Budgets - With Extras (with-extras)
Succeeded

This pipeline joins the budget data to itself so that each item has a list of its immediate children.


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 11:45:26.701478
Last Completion:
2025-04-27 12:09:07.588986
Last Success:
2025-04-27 12:09:07.588986

Pipeline ID: budget/national/processed/with-extras

budgetkey/analysis/spending/publisher_entity_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-18 10:10:39.458582
Last Completion:
2025-05-18 10:38:37.629309
Last Success:
2025-05-18 10:38:37.629309

Pipeline ID: budgetkey/analysis/spending/publisher_entity_analysis

budgetkey/analysis/spending/publisher_foa_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-18 10:10:39.464059
Last Completion:
2025-05-18 10:13:12.123167
Last Success:
2025-05-18 10:13:12.123167

Pipeline ID: budgetkey/analysis/spending/publisher_foa_analysis

budgetkey/analysis/spending/united
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-18 10:00:01.374100
Last Completion:
2025-05-18 10:10:39.351346
Last Success:
2025-05-18 10:10:39.351346

Pipeline ID: budgetkey/analysis/spending/united

Main Page - Aggregated budget by functional classification (budget-functional-aggregates)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 11:45:26.908056
Last Completion:
2025-04-27 11:53:19.313975
Last Success:
2025-04-27 11:53:19.313975

Pipeline ID: budgetkey/budget-functional-aggregates

budgetkey/documents
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 11:53:19.710853
Last Completion:
2025-04-27 11:53:23.504632
Last Success:
2025-04-27 11:53:23.504632

Pipeline ID: budgetkey/documents

budgetkey/elasticsearch/index_activities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-19 00:09:41.151946
Last Completion:
2025-05-19 00:10:11.070271
Last Success:
2025-05-19 00:10:11.070271

Pipeline ID: budgetkey/elasticsearch/index_activities

budgetkey/elasticsearch/index_budget
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-18 01:05:24.521904
Last Completion:
2025-05-18 01:20:06.821183
Last Success:
2025-05-18 01:20:06.821183

Pipeline ID: budgetkey/elasticsearch/index_budget

budgetkey/elasticsearch/index_contract_spending
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-18 00:50:55.221691
Last Completion:
2025-05-18 02:37:31.334926
Last Success:
2025-05-18 02:37:31.334926

Pipeline ID: budgetkey/elasticsearch/index_contract_spending

budgetkey/elasticsearch/index_gov_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-18 12:12:56.590032
Last Completion:
2025-05-18 12:14:58.291542
Last Success:
2025-05-18 12:14:58.291542

Pipeline ID: budgetkey/elasticsearch/index_gov_decisions

budgetkey/elasticsearch/index_muni_budgets
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-19 00:21:53.857859
Last Completion:
2025-05-19 00:28:00.068465
Last Success:
2025-05-19 00:28:00.068465

Pipeline ID: budgetkey/elasticsearch/index_muni_budgets

budgetkey/elasticsearch/index_muni_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-19 00:06:55.648463
Last Completion:
2025-05-19 00:07:24.249477
Last Success:
2025-05-19 00:07:24.249477

Pipeline ID: budgetkey/elasticsearch/index_muni_tenders

budgetkey/elasticsearch/index_national_budget_changes
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-18 01:11:34.112936
Last Completion:
2025-05-18 01:14:58.012365
Last Success:
2025-05-18 01:14:58.012365

Pipeline ID: budgetkey/elasticsearch/index_national_budget_changes

budgetkey/elasticsearch/index_supports
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-05-19 00:08:02.543089
Last Completion:
2025-05-19 00:46:11.917693
Last Success:
2025-05-19 00:46:11.917693

Pipeline ID: budgetkey/elasticsearch/index_supports

budgetkey/elasticsearch/index_tenders
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-05-19 00:11:31.969544
Last Completion:
2025-05-19 00:37:18.415505
Last Success:
2025-05-19 00:37:18.415505

Pipeline ID: budgetkey/elasticsearch/index_tenders

budgetkey/elasticsearch/index_units
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-19 00:07:09.440244
Last Completion:
2025-05-19 00:07:36.313723
Last Success:
2025-05-19 00:07:36.313723

Pipeline ID: budgetkey/elasticsearch/index_units

Send periodic emails (emails)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-16 05:01:01.635529
Last Completion:
2025-05-17 06:14:23.737297
Last Success:
2025-05-17 06:14:23.737297

Pipeline ID: budgetkey/emails/emails