budget/municipal/fetcher
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-23 00:01:04.910854
Last Completion:
2025-03-23 00:16:02.197937
Last Success:
2025-03-23 00:16:02.197937

Pipeline ID: budget/municipal/fetcher

budget/national/changes/explanations/all
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:42:30.271348
Last Completion:
2025-01-12 07:45:55.696978
Last Success:
2025-01-12 07:45:55.696978

Pipeline ID: budget/national/changes/explanations/all

budget/national/changes/original/current-year-fixes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-21 01:18:29.021053
Last Completion:
2025-03-21 01:19:20.550909
Last Success:
2025-03-21 01:19:20.550909

Pipeline ID: budget/national/changes/original/current-year-fixes

budget/national/changes/original/national-budget-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-21 00:01:34.699166
Last Completion:
2025-03-21 00:04:35.887307
Last Success:
2025-03-21 00:04:35.887307

Pipeline ID: budget/national/changes/original/national-budget-changes

Changes, grouped by transaction_id, with explanations (national-budget-changes-aggregated)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-21 05:49:42.613027
Last Completion:
2025-03-21 05:52:07.624626
Last Success:
2025-03-21 05:52:07.624626

Pipeline ID: budget/national/changes/processed/national-budget-changes-aggregated

budget/national/changes/processed/transactions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-21 01:18:43.916691
Last Completion:
2025-03-21 05:49:42.247651
Last Success:
2025-03-21 05:49:42.247651

Pipeline ID: budget/national/changes/processed/transactions

National Yearly Budgets (national-budgets)
Succeeded

We get the data the Ministry of Finance publishes in data.gov.il every year. It comes in XLS format, with one row per TAKANA and phase (original, approved, executed). In this pipeline we create from each triplet a single row that has all the data.
Last Run triggered by:
dirty-task-init
Last Run started at:
2025-02-20 17:33:51.289252
Last Completion:
2025-02-20 18:29:14.613204
Last Success:
2025-02-20 18:29:14.613204

Pipeline ID: budget/national/original/national-budgets

National Yearly Budgets - Processed (aggregated-yearly)
Succeeded

This pipeline joins the different phases of the budget (allocated, revised and executed). In the original file there's a separate row for each of the phases. We like it better as a single row with all phase info. Another thing this pipeline does is to rename the column titles - to more friendly English names. Also, it create rows for all hierarchies - where upper hierarchies (2, 4 & 6 digits) are plain aggregations of the 8-digit items they contain.
Last Run triggered by:
dirty-task-init
Last Run started at:
2025-03-16 15:58:46.920942
Last Completion:
2025-03-16 17:27:41.222690
Last Success:
2025-03-16 17:27:41.222690

Pipeline ID: budget/national/processed/aggregated-yearly

budget/national/processed/category-explanations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:43:09.618503
Last Completion:
2025-01-12 07:43:10.527802
Last Success:
2025-01-12 07:43:10.527802

Pipeline ID: budget/national/processed/category-explanations

National Yearly Budgets - Joined with category-explanations (connected-items-explained)
Succeeded

This pipeline joins budget items that span across years.
Last Run triggered by:
dirty-task-init
Last Run started at:
2025-03-16 18:01:25.691584
Last Completion:
2025-03-16 18:05:00.201629
Last Success:
2025-03-16 18:05:00.201629

Pipeline ID: budget/national/processed/connected-items-explained

National Yearly Budgets - Connected Items (connected-national-budgets)
Succeeded

This pipeline joins budget items that span across years.
Last Run triggered by:
dirty-task-init
Last Run started at:
2025-03-16 17:43:55.099664
Last Completion:
2025-03-16 18:01:25.407945
Last Success:
2025-03-16 18:01:25.407945

Pipeline ID: budget/national/processed/connected-national-budgets

National Yearly Budgets - Just the total (item 00) (just-the-total)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-03-16 17:43:54.830714
Last Completion:
2025-03-16 17:49:52.395611
Last Success:
2025-03-16 17:49:52.395611

Pipeline ID: budget/national/processed/just-the-total

National Yearly Budgets - Main Item Names (roof-names)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-03-16 17:43:54.843772
Last Completion:
2025-03-16 17:49:52.515501
Last Success:
2025-03-16 17:49:52.515501

Pipeline ID: budget/national/processed/roof-names

National Yearly Budgets - With Extras (with-extras)
Succeeded

This pipeline joins the budget data to itself so that each item has a list of its immediate children.
Last Run triggered by:
dirty-task-init
Last Run started at:
2025-03-16 17:27:41.637143
Last Completion:
2025-03-16 17:43:54.753936
Last Success:
2025-03-16 17:43:54.753936

Pipeline ID: budget/national/processed/with-extras

budgetkey/analysis/spending/publisher_entity_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-23 10:10:53.248356
Last Completion:
2025-03-23 10:44:30.171085
Last Success:
2025-03-23 10:44:30.171085

Pipeline ID: budgetkey/analysis/spending/publisher_entity_analysis

budgetkey/analysis/spending/publisher_foa_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-23 10:10:53.253484
Last Completion:
2025-03-23 10:13:45.814032
Last Success:
2025-03-23 10:13:45.814032

Pipeline ID: budgetkey/analysis/spending/publisher_foa_analysis

budgetkey/analysis/spending/united
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-23 10:00:01.728526
Last Completion:
2025-03-23 10:10:53.017475
Last Success:
2025-03-23 10:10:53.017475

Pipeline ID: budgetkey/analysis/spending/united

Main Page - Aggregated budget by functional classification (budget-functional-aggregates)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-03-16 17:27:41.806210
Last Completion:
2025-03-16 17:33:23.098409
Last Success:
2025-03-16 17:33:23.098409

Pipeline ID: budgetkey/budget-functional-aggregates

budgetkey/documents
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-03-16 17:33:23.414028
Last Completion:
2025-03-16 17:33:26.191261
Last Success:
2025-03-16 17:33:26.191261

Pipeline ID: budgetkey/documents

budgetkey/elasticsearch/index_activities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-23 01:15:26.825330
Last Completion:
2025-03-23 01:16:07.993712
Last Success:
2025-03-23 01:16:07.993712

Pipeline ID: budgetkey/elasticsearch/index_activities

budgetkey/elasticsearch/index_budget
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-03-21 01:13:36.032209
Last Completion:
2025-03-21 01:45:40.899752
Last Success:
2025-03-21 01:45:40.899752

Pipeline ID: budgetkey/elasticsearch/index_budget

budgetkey/elasticsearch/index_calls_for_bids
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None
Invalid dependency :Cannot run until dependency passes validation: ./procurement/calls_for_bids/calls-for-bids-all
From ./procurement/calls_for_bids/calls-for-bids-all :['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-calls-for-bids']
From ./procurement/calls_for_bids/calls-for-bids-all :['From ./procurement/calls_for_bids/jobiz-calls-for-bids', ['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-all']]
From ./procurement/calls_for_bids/calls-for-bids-all :['From ./procurement/calls_for_bids/jobiz-calls-for-bids', ['From ./procurement/calls_for_bids/jobiz-all', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed']]]

Pipeline ID: budgetkey/elasticsearch/index_calls_for_bids

budgetkey/elasticsearch/index_contract_spending
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-03-23 05:28:01.494605
Last Completion:
2025-03-23 06:48:51.573700
Last Success:
2025-03-23 06:48:51.573700

Pipeline ID: budgetkey/elasticsearch/index_contract_spending

budgetkey/elasticsearch/index_entities
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-03-23 05:43:58.994295
Last Completion:
2025-03-23 06:24:36.204505
Last Success:
2025-03-23 06:24:36.204505

Pipeline ID: budgetkey/elasticsearch/index_entities

budgetkey/elasticsearch/index_gov_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-23 12:18:24.204273
Last Completion:
2025-03-23 12:21:06.126966
Last Success:
2025-03-23 12:21:06.126966

Pipeline ID: budgetkey/elasticsearch/index_gov_decisions

budgetkey/elasticsearch/index_muni_budgets
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-23 01:03:03.263859
Last Completion:
2025-03-23 01:24:52.123635
Last Success:
2025-03-23 01:24:52.123635

Pipeline ID: budgetkey/elasticsearch/index_muni_budgets

budgetkey/elasticsearch/index_muni_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-23 01:02:12.333542
Last Completion:
2025-03-23 01:03:03.238917
Last Success:
2025-03-23 01:03:03.238917

Pipeline ID: budgetkey/elasticsearch/index_muni_tenders

budgetkey/elasticsearch/index_national_budget_changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-21 05:52:07.772738
Last Completion:
2025-03-21 05:54:55.428162
Last Success:
2025-03-21 05:54:55.428162

Pipeline ID: budgetkey/elasticsearch/index_national_budget_changes

budgetkey/elasticsearch/index_people
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None
Invalid dependency :Cannot run until dependency passes validation: ./people/aggregated
From ./people/aggregated :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/all']
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['Dependency unsuccessful', 'Cannot run until dependency "./people/political_donations/political_donations" is successfully executed']]
From ./people/aggregated :['From ./people/all', ['Dependency unsuccessful', 'Cannot run until dependency "./people/political_candidates/election_candidates21" is successfully executed']]

Pipeline ID: budgetkey/elasticsearch/index_people

budgetkey/elasticsearch/index_reports
Failed

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-03-21 01:18:21.346605
Last Completion:
2025-03-21 01:18:43.846976
Last Success:
2025-03-16 15:50:00.526686
enrich_ngo_reports
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/enrich_ngo_reports.py", line 91, in <module>
    spew(dp, process_resources(res_iter))
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/enrich_ngo_reports.py", line 69, in process_resource
    for k, v in di[district].items():
KeyError: 'אזור יהודה ושומרון'

Pipeline ID: budgetkey/elasticsearch/index_reports

budgetkey/elasticsearch/index_support_criteria
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None
Dependency unsuccessful :Cannot run until dependency "./supports/criteria/support-criteria" is successfully executed

Pipeline ID: budgetkey/elasticsearch/index_support_criteria

budgetkey/elasticsearch/index_supports
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-23 02:04:32.288313
Last Completion:
2025-03-23 03:08:49.448846
Last Success:
2025-03-23 03:08:49.448846

Pipeline ID: budgetkey/elasticsearch/index_supports

budgetkey/elasticsearch/index_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-23 02:19:11.688092
Last Completion:
2025-03-23 03:00:26.173487
Last Success:
2025-03-23 03:00:26.173487

Pipeline ID: budgetkey/elasticsearch/index_tenders

budgetkey/elasticsearch/index_units
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-23 01:10:53.899623
Last Completion:
2025-03-23 01:11:29.997868
Last Success:
2025-03-23 01:11:29.997868

Pipeline ID: budgetkey/elasticsearch/index_units

budgetkey/elasticsearch/sitemaps
Running

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-03-23 20:01:02.304858
Last Completion:
Last Success:
2025-03-23 14:00:41.060028

Pipeline ID: budgetkey/elasticsearch/sitemaps

Send periodic emails (emails)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-21 05:01:03.241426
Last Completion:
2025-03-21 12:45:49.110389
Last Success:
2025-03-21 12:45:49.110389

Pipeline ID: budgetkey/emails/emails

budgetkey/elasticsearch/index_calls_for_bids
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None
Invalid dependency :Cannot run until dependency passes validation: ./procurement/calls_for_bids/calls-for-bids-all
From ./procurement/calls_for_bids/calls-for-bids-all :['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-calls-for-bids']
From ./procurement/calls_for_bids/calls-for-bids-all :['From ./procurement/calls_for_bids/jobiz-calls-for-bids', ['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-all']]
From ./procurement/calls_for_bids/calls-for-bids-all :['From ./procurement/calls_for_bids/jobiz-calls-for-bids', ['From ./procurement/calls_for_bids/jobiz-all', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed']]]

Pipeline ID: budgetkey/elasticsearch/index_calls_for_bids

budgetkey/elasticsearch/index_people
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None
Invalid dependency :Cannot run until dependency passes validation: ./people/aggregated
From ./people/aggregated :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/all']
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['Dependency unsuccessful', 'Cannot run until dependency "./people/political_donations/political_donations" is successfully executed']]
From ./people/aggregated :['From ./people/all', ['Dependency unsuccessful', 'Cannot run until dependency "./people/political_candidates/election_candidates21" is successfully executed']]

Pipeline ID: budgetkey/elasticsearch/index_people

budgetkey/elasticsearch/index_support_criteria
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None
Dependency unsuccessful :Cannot run until dependency "./supports/criteria/support-criteria" is successfully executed

Pipeline ID: budgetkey/elasticsearch/index_support_criteria

budgetkey/elasticsearch/sitemaps
Running

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-03-23 20:01:02.304858
Last Completion:
Last Success:
2025-03-23 14:00:41.060028

Pipeline ID: budgetkey/elasticsearch/sitemaps

budgetkey/elasticsearch/index_reports
Failed

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-03-21 01:18:21.346605
Last Completion:
2025-03-21 01:18:43.846976
Last Success:
2025-03-16 15:50:00.526686
enrich_ngo_reports
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/enrich_ngo_reports.py", line 91, in <module>
    spew(dp, process_resources(res_iter))
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/enrich_ngo_reports.py", line 69, in process_resource
    for k, v in di[district].items():
KeyError: 'אזור יהודה ושומרון'

Pipeline ID: budgetkey/elasticsearch/index_reports

budget/municipal/fetcher
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-23 00:01:04.910854
Last Completion:
2025-03-23 00:16:02.197937
Last Success:
2025-03-23 00:16:02.197937

Pipeline ID: budget/municipal/fetcher

budget/national/changes/explanations/all
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:42:30.271348
Last Completion:
2025-01-12 07:45:55.696978
Last Success:
2025-01-12 07:45:55.696978

Pipeline ID: budget/national/changes/explanations/all

budget/national/changes/original/current-year-fixes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-21 01:18:29.021053
Last Completion:
2025-03-21 01:19:20.550909
Last Success:
2025-03-21 01:19:20.550909

Pipeline ID: budget/national/changes/original/current-year-fixes

budget/national/changes/original/national-budget-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-21 00:01:34.699166
Last Completion:
2025-03-21 00:04:35.887307
Last Success:
2025-03-21 00:04:35.887307

Pipeline ID: budget/national/changes/original/national-budget-changes

Changes, grouped by transaction_id, with explanations (national-budget-changes-aggregated)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-21 05:49:42.613027
Last Completion:
2025-03-21 05:52:07.624626
Last Success:
2025-03-21 05:52:07.624626

Pipeline ID: budget/national/changes/processed/national-budget-changes-aggregated

budget/national/changes/processed/transactions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-21 01:18:43.916691
Last Completion:
2025-03-21 05:49:42.247651
Last Success:
2025-03-21 05:49:42.247651

Pipeline ID: budget/national/changes/processed/transactions

National Yearly Budgets (national-budgets)
Succeeded

We get the data the Ministry of Finance publishes in data.gov.il every year. It comes in XLS format, with one row per TAKANA and phase (original, approved, executed). In this pipeline we create from each triplet a single row that has all the data.
Last Run triggered by:
dirty-task-init
Last Run started at:
2025-02-20 17:33:51.289252
Last Completion:
2025-02-20 18:29:14.613204
Last Success:
2025-02-20 18:29:14.613204

Pipeline ID: budget/national/original/national-budgets

National Yearly Budgets - Processed (aggregated-yearly)
Succeeded

This pipeline joins the different phases of the budget (allocated, revised and executed). In the original file there's a separate row for each of the phases. We like it better as a single row with all phase info. Another thing this pipeline does is to rename the column titles - to more friendly English names. Also, it create rows for all hierarchies - where upper hierarchies (2, 4 & 6 digits) are plain aggregations of the 8-digit items they contain.
Last Run triggered by:
dirty-task-init
Last Run started at:
2025-03-16 15:58:46.920942
Last Completion:
2025-03-16 17:27:41.222690
Last Success:
2025-03-16 17:27:41.222690

Pipeline ID: budget/national/processed/aggregated-yearly

budget/national/processed/category-explanations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:43:09.618503
Last Completion:
2025-01-12 07:43:10.527802
Last Success:
2025-01-12 07:43:10.527802

Pipeline ID: budget/national/processed/category-explanations

National Yearly Budgets - Joined with category-explanations (connected-items-explained)
Succeeded

This pipeline joins budget items that span across years.
Last Run triggered by:
dirty-task-init
Last Run started at:
2025-03-16 18:01:25.691584
Last Completion:
2025-03-16 18:05:00.201629
Last Success:
2025-03-16 18:05:00.201629

Pipeline ID: budget/national/processed/connected-items-explained

National Yearly Budgets - Connected Items (connected-national-budgets)
Succeeded

This pipeline joins budget items that span across years.
Last Run triggered by:
dirty-task-init
Last Run started at:
2025-03-16 17:43:55.099664
Last Completion:
2025-03-16 18:01:25.407945
Last Success:
2025-03-16 18:01:25.407945

Pipeline ID: budget/national/processed/connected-national-budgets

National Yearly Budgets - Just the total (item 00) (just-the-total)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-03-16 17:43:54.830714
Last Completion:
2025-03-16 17:49:52.395611
Last Success:
2025-03-16 17:49:52.395611

Pipeline ID: budget/national/processed/just-the-total

National Yearly Budgets - Main Item Names (roof-names)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-03-16 17:43:54.843772
Last Completion:
2025-03-16 17:49:52.515501
Last Success:
2025-03-16 17:49:52.515501

Pipeline ID: budget/national/processed/roof-names

National Yearly Budgets - With Extras (with-extras)
Succeeded

This pipeline joins the budget data to itself so that each item has a list of its immediate children.
Last Run triggered by:
dirty-task-init
Last Run started at:
2025-03-16 17:27:41.637143
Last Completion:
2025-03-16 17:43:54.753936
Last Success:
2025-03-16 17:43:54.753936

Pipeline ID: budget/national/processed/with-extras

budgetkey/analysis/spending/publisher_entity_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-23 10:10:53.248356
Last Completion:
2025-03-23 10:44:30.171085
Last Success:
2025-03-23 10:44:30.171085

Pipeline ID: budgetkey/analysis/spending/publisher_entity_analysis

budgetkey/analysis/spending/publisher_foa_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-23 10:10:53.253484
Last Completion:
2025-03-23 10:13:45.814032
Last Success:
2025-03-23 10:13:45.814032

Pipeline ID: budgetkey/analysis/spending/publisher_foa_analysis

budgetkey/analysis/spending/united
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-23 10:00:01.728526
Last Completion:
2025-03-23 10:10:53.017475
Last Success:
2025-03-23 10:10:53.017475

Pipeline ID: budgetkey/analysis/spending/united

Main Page - Aggregated budget by functional classification (budget-functional-aggregates)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-03-16 17:27:41.806210
Last Completion:
2025-03-16 17:33:23.098409
Last Success:
2025-03-16 17:33:23.098409

Pipeline ID: budgetkey/budget-functional-aggregates

budgetkey/documents
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-03-16 17:33:23.414028
Last Completion:
2025-03-16 17:33:26.191261
Last Success:
2025-03-16 17:33:26.191261

Pipeline ID: budgetkey/documents

budgetkey/elasticsearch/index_activities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-23 01:15:26.825330
Last Completion:
2025-03-23 01:16:07.993712
Last Success:
2025-03-23 01:16:07.993712

Pipeline ID: budgetkey/elasticsearch/index_activities

budgetkey/elasticsearch/index_budget
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-03-21 01:13:36.032209
Last Completion:
2025-03-21 01:45:40.899752
Last Success:
2025-03-21 01:45:40.899752

Pipeline ID: budgetkey/elasticsearch/index_budget

budgetkey/elasticsearch/index_contract_spending
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-03-23 05:28:01.494605
Last Completion:
2025-03-23 06:48:51.573700
Last Success:
2025-03-23 06:48:51.573700

Pipeline ID: budgetkey/elasticsearch/index_contract_spending

budgetkey/elasticsearch/index_entities
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-03-23 05:43:58.994295
Last Completion:
2025-03-23 06:24:36.204505
Last Success:
2025-03-23 06:24:36.204505

Pipeline ID: budgetkey/elasticsearch/index_entities

budgetkey/elasticsearch/index_gov_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-23 12:18:24.204273
Last Completion:
2025-03-23 12:21:06.126966
Last Success:
2025-03-23 12:21:06.126966

Pipeline ID: budgetkey/elasticsearch/index_gov_decisions

budgetkey/elasticsearch/index_muni_budgets
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-23 01:03:03.263859
Last Completion:
2025-03-23 01:24:52.123635
Last Success:
2025-03-23 01:24:52.123635

Pipeline ID: budgetkey/elasticsearch/index_muni_budgets

budgetkey/elasticsearch/index_muni_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-23 01:02:12.333542
Last Completion:
2025-03-23 01:03:03.238917
Last Success:
2025-03-23 01:03:03.238917

Pipeline ID: budgetkey/elasticsearch/index_muni_tenders

budgetkey/elasticsearch/index_national_budget_changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-21 05:52:07.772738
Last Completion:
2025-03-21 05:54:55.428162
Last Success:
2025-03-21 05:54:55.428162

Pipeline ID: budgetkey/elasticsearch/index_national_budget_changes

budgetkey/elasticsearch/index_supports
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-23 02:04:32.288313
Last Completion:
2025-03-23 03:08:49.448846
Last Success:
2025-03-23 03:08:49.448846

Pipeline ID: budgetkey/elasticsearch/index_supports

budgetkey/elasticsearch/index_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-23 02:19:11.688092
Last Completion:
2025-03-23 03:00:26.173487
Last Success:
2025-03-23 03:00:26.173487

Pipeline ID: budgetkey/elasticsearch/index_tenders

budgetkey/elasticsearch/index_units
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-23 01:10:53.899623
Last Completion:
2025-03-23 01:11:29.997868
Last Success:
2025-03-23 01:11:29.997868

Pipeline ID: budgetkey/elasticsearch/index_units

Send periodic emails (emails)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-03-21 05:01:03.241426
Last Completion:
2025-03-21 12:45:49.110389
Last Success:
2025-03-21 12:45:49.110389

Pipeline ID: budgetkey/emails/emails