budget/municipal/fetcher
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-16 00:00:25.566993
Last Completion:
2024-04-16 00:05:44.057124
Last Success:
2024-04-16 00:05:44.057124

Pipeline ID: budget/municipal/fetcher

budget/national/changes/explanations/all
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:52:40.851010
Last Completion:
2023-10-30 12:54:56.895489
Last Success:
2023-10-30 12:54:56.895489

Pipeline ID: budget/national/changes/explanations/all

budget/national/changes/original/current-year-fixes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-12 00:46:37.572037
Last Completion:
2024-04-12 00:46:55.577233
Last Success:
2024-04-12 00:46:55.577233

Pipeline ID: budget/national/changes/original/current-year-fixes

budget/national/changes/original/national-budget-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-12 00:04:58.555810
Last Completion:
2024-04-12 00:06:23.175936
Last Success:
2024-04-12 00:06:23.175936

Pipeline ID: budget/national/changes/original/national-budget-changes

Changes, grouped by transaction_id, with explanations (national-budget-changes-aggregated)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-12 03:26:58.012457
Last Completion:
2024-04-12 03:28:45.842729
Last Success:
2024-04-12 03:28:45.842729

Pipeline ID: budget/national/changes/processed/national-budget-changes-aggregated

budget/national/changes/processed/transactions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-12 00:46:55.656374
Last Completion:
2024-04-12 03:26:57.847572
Last Success:
2024-04-12 03:26:57.847572

Pipeline ID: budget/national/changes/processed/transactions

National Yearly Budgets (national-budgets)
Succeeded

We get the data the Ministry of Finance publishes in data.gov.il every year. It comes in XLS format, with one row per TAKANA and phase (original, approved, executed). In this pipeline we create from each triplet a single row that has all the data.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-03-14 15:57:59.170600
Last Completion:
2024-03-14 18:03:17.779046
Last Success:
2024-03-14 18:03:17.779046

Pipeline ID: budget/national/original/national-budgets

National Yearly Budgets - Processed (aggregated-yearly)
Succeeded

This pipeline joins the different phases of the budget (allocated, revised and executed). In the original file there's a separate row for each of the phases. We like it better as a single row with all phase info. Another thing this pipeline does is to rename the column titles - to more friendly English names. Also, it create rows for all hierarchies - where upper hierarchies (2, 4 & 6 digits) are plain aggregations of the 8-digit items they contain.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-03-14 18:21:17.949862
Last Completion:
2024-03-14 20:13:53.924666
Last Success:
2024-03-14 20:13:53.924666

Pipeline ID: budget/national/processed/aggregated-yearly

budget/national/processed/category-explanations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:54:56.900975
Last Completion:
2023-10-30 12:54:57.594178
Last Success:
2023-10-30 12:54:57.594178

Pipeline ID: budget/national/processed/category-explanations

National Yearly Budgets - Joined with category-explanations (connected-items-explained)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-03-14 20:46:11.555946
Last Completion:
2024-03-14 20:48:40.187135
Last Success:
2024-03-14 20:48:40.187135

Pipeline ID: budget/national/processed/connected-items-explained

National Yearly Budgets - Connected Items (connected-national-budgets)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-03-14 20:30:54.956897
Last Completion:
2024-03-14 20:46:11.189046
Last Success:
2024-03-14 20:46:11.189046

Pipeline ID: budget/national/processed/connected-national-budgets

National Yearly Budgets - Just the total (item 00) (just-the-total)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-03-14 20:30:54.770511
Last Completion:
2024-03-14 20:36:56.055236
Last Success:
2024-03-14 20:36:56.055236

Pipeline ID: budget/national/processed/just-the-total

National Yearly Budgets - Main Item Names (roof-names)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-03-14 20:30:54.778208
Last Completion:
2024-03-14 20:36:52.256096
Last Success:
2024-03-14 20:36:52.256096

Pipeline ID: budget/national/processed/roof-names

National Yearly Budgets - With Extras (with-extras)
Succeeded

This pipeline joins the budget data to itself so that each item has a list of its immediate children.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-03-14 20:13:54.003195
Last Completion:
2024-03-14 20:30:54.562845
Last Success:
2024-03-14 20:30:54.562845

Pipeline ID: budget/national/processed/with-extras

budgetkey/analysis/spending/publisher_entity_analysis
Running

Last Run triggered by:
scheduled
Last Run started at:
2024-04-16 10:08:15.212219
Last Completion:
Last Success:
2024-04-15 10:31:19.364188

Pipeline ID: budgetkey/analysis/spending/publisher_entity_analysis

budgetkey/analysis/spending/publisher_foa_analysis
Running

Last Run triggered by:
scheduled
Last Run started at:
2024-04-16 10:08:15.215159
Last Completion:
Last Success:
2024-04-15 10:10:21.893512

Pipeline ID: budgetkey/analysis/spending/publisher_foa_analysis

budgetkey/analysis/spending/united
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-16 10:00:01.697395
Last Completion:
2024-04-16 10:08:15.110479
Last Success:
2024-04-16 10:08:15.110479

Pipeline ID: budgetkey/analysis/spending/united

Main Page - Aggregated budget by functional classification (budget-functional-aggregates)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-03-14 20:13:54.078402
Last Completion:
2024-03-14 20:20:11.480477
Last Success:
2024-03-14 20:20:11.480477

Pipeline ID: budgetkey/budget-functional-aggregates

budgetkey/documents
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-03-14 20:20:11.873205
Last Completion:
2024-03-14 20:20:14.552842
Last Success:
2024-03-14 20:20:14.552842

Pipeline ID: budgetkey/documents

budgetkey/elasticsearch/index_activities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-16 00:29:45.671407
Last Completion:
2024-04-16 00:30:13.162685
Last Success:
2024-04-16 00:30:13.162685

Pipeline ID: budgetkey/elasticsearch/index_activities

budgetkey/elasticsearch/index_budget
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2024-04-12 00:20:43.118855
Last Completion:
2024-04-12 00:37:29.187192
Last Success:
2024-04-12 00:37:29.187192

Pipeline ID: budgetkey/elasticsearch/index_budget

budgetkey/elasticsearch/index_calls_for_bids
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./procurement/calls_for_bids/calls-for-bids-all
From ./procurement/calls_for_bids/calls-for-bids-all :['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-calls-for-bids']
From ./procurement/calls_for_bids/calls-for-bids-all :['From ./procurement/calls_for_bids/jobiz-calls-for-bids', ['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-all']]
From ./procurement/calls_for_bids/calls-for-bids-all :['From ./procurement/calls_for_bids/jobiz-calls-for-bids', ['From ./procurement/calls_for_bids/jobiz-all', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed']]]

Pipeline ID: budgetkey/elasticsearch/index_calls_for_bids

budgetkey/elasticsearch/index_contract_spending
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2024-04-16 02:02:21.983277
Last Completion:
2024-04-16 03:20:38.165852
Last Success:
2024-04-16 03:20:38.165852

Pipeline ID: budgetkey/elasticsearch/index_contract_spending

budgetkey/elasticsearch/index_entities
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2024-04-16 02:14:17.845668
Last Completion:
2024-04-16 03:02:41.046520
Last Success:
2024-04-16 03:02:41.046520

Pipeline ID: budgetkey/elasticsearch/index_entities

budgetkey/elasticsearch/index_gov_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-15 12:38:21.200253
Last Completion:
2024-04-15 12:41:32.022549
Last Success:
2024-04-15 12:41:32.022549

Pipeline ID: budgetkey/elasticsearch/index_gov_decisions

budgetkey/elasticsearch/index_muni_budgets
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-16 00:18:39.766503
Last Completion:
2024-04-16 00:28:49.871077
Last Success:
2024-04-16 00:28:49.871077

Pipeline ID: budgetkey/elasticsearch/index_muni_budgets

budgetkey/elasticsearch/index_muni_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-16 00:09:14.250435
Last Completion:
2024-04-16 00:09:58.179836
Last Success:
2024-04-16 00:09:58.179836

Pipeline ID: budgetkey/elasticsearch/index_muni_tenders

budgetkey/elasticsearch/index_national_budget_changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-12 03:28:46.079422
Last Completion:
2024-04-12 03:31:03.652864
Last Success:
2024-04-12 03:31:03.652864

Pipeline ID: budgetkey/elasticsearch/index_national_budget_changes

budgetkey/elasticsearch/index_people
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/aggregated
From ./people/aggregated :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/all']
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['Dependency unsuccessful', 'Cannot run until dependency "./people/political_donations/political_donations" is successfully executed']]

Pipeline ID: budgetkey/elasticsearch/index_people

budgetkey/elasticsearch/index_reports
Failed

Last Run triggered by:
dirty-task-update
Last Run started at:
2024-04-12 00:37:29.253415
Last Completion:
2024-04-12 00:37:38.481033
Last Success:
2024-04-11 07:09:13.990261

enrich_ngo_reports
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/enrich_ngo_reports.py", line 91, in <module>
    spew(dp, process_resources(res_iter))
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/enrich_ngo_reports.py", line 69, in process_resource
    for k, v in di[district].items():
KeyError: 'אזור יהודה ושומרון'

Pipeline ID: budgetkey/elasticsearch/index_reports

budgetkey/elasticsearch/index_support_criteria
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./supports/criteria/support-criteria" is successfully executed

Pipeline ID: budgetkey/elasticsearch/index_support_criteria

budgetkey/elasticsearch/index_supports
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-16 00:49:24.359871
Last Completion:
2024-04-16 01:29:16.307135
Last Success:
2024-04-16 01:29:16.307135

Pipeline ID: budgetkey/elasticsearch/index_supports

budgetkey/elasticsearch/index_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-16 00:50:12.060083
Last Completion:
2024-04-16 01:14:45.872996
Last Success:
2024-04-16 01:14:45.872996

Pipeline ID: budgetkey/elasticsearch/index_tenders

budgetkey/elasticsearch/index_units
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-16 00:07:27.081824
Last Completion:
2024-04-16 00:07:57.572588
Last Success:
2024-04-16 00:07:57.572588

Pipeline ID: budgetkey/elasticsearch/index_units

budgetkey/elasticsearch/sitemaps
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2024-04-16 03:20:38.380936
Last Completion:
2024-04-16 05:29:42.095259
Last Success:
2024-04-16 05:29:42.095259

Pipeline ID: budgetkey/elasticsearch/sitemaps

Send periodic emails (emails)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-12 05:01:01.736826
Last Completion:
2024-04-12 12:31:57.644097
Last Success:
2024-04-12 12:31:57.644097

Pipeline ID: budgetkey/emails/emails

budgetkey/elasticsearch/index_calls_for_bids
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./procurement/calls_for_bids/calls-for-bids-all
From ./procurement/calls_for_bids/calls-for-bids-all :['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-calls-for-bids']
From ./procurement/calls_for_bids/calls-for-bids-all :['From ./procurement/calls_for_bids/jobiz-calls-for-bids', ['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-all']]
From ./procurement/calls_for_bids/calls-for-bids-all :['From ./procurement/calls_for_bids/jobiz-calls-for-bids', ['From ./procurement/calls_for_bids/jobiz-all', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed']]]

Pipeline ID: budgetkey/elasticsearch/index_calls_for_bids

budgetkey/elasticsearch/index_people
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/aggregated
From ./people/aggregated :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/all']
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['Dependency unsuccessful', 'Cannot run until dependency "./people/political_donations/political_donations" is successfully executed']]

Pipeline ID: budgetkey/elasticsearch/index_people

budgetkey/elasticsearch/index_support_criteria
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./supports/criteria/support-criteria" is successfully executed

Pipeline ID: budgetkey/elasticsearch/index_support_criteria

budgetkey/analysis/spending/publisher_entity_analysis
Running

Last Run triggered by:
scheduled
Last Run started at:
2024-04-16 10:08:15.212219
Last Completion:
Last Success:
2024-04-15 10:31:19.364188

Pipeline ID: budgetkey/analysis/spending/publisher_entity_analysis

budgetkey/analysis/spending/publisher_foa_analysis
Running

Last Run triggered by:
scheduled
Last Run started at:
2024-04-16 10:08:15.215159
Last Completion:
Last Success:
2024-04-15 10:10:21.893512

Pipeline ID: budgetkey/analysis/spending/publisher_foa_analysis

budgetkey/elasticsearch/index_reports
Failed

Last Run triggered by:
dirty-task-update
Last Run started at:
2024-04-12 00:37:29.253415
Last Completion:
2024-04-12 00:37:38.481033
Last Success:
2024-04-11 07:09:13.990261

enrich_ngo_reports
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/enrich_ngo_reports.py", line 91, in <module>
    spew(dp, process_resources(res_iter))
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/enrich_ngo_reports.py", line 69, in process_resource
    for k, v in di[district].items():
KeyError: 'אזור יהודה ושומרון'

Pipeline ID: budgetkey/elasticsearch/index_reports

budget/municipal/fetcher
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-16 00:00:25.566993
Last Completion:
2024-04-16 00:05:44.057124
Last Success:
2024-04-16 00:05:44.057124

Pipeline ID: budget/municipal/fetcher

budget/national/changes/explanations/all
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:52:40.851010
Last Completion:
2023-10-30 12:54:56.895489
Last Success:
2023-10-30 12:54:56.895489

Pipeline ID: budget/national/changes/explanations/all

budget/national/changes/original/current-year-fixes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-12 00:46:37.572037
Last Completion:
2024-04-12 00:46:55.577233
Last Success:
2024-04-12 00:46:55.577233

Pipeline ID: budget/national/changes/original/current-year-fixes

budget/national/changes/original/national-budget-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-12 00:04:58.555810
Last Completion:
2024-04-12 00:06:23.175936
Last Success:
2024-04-12 00:06:23.175936

Pipeline ID: budget/national/changes/original/national-budget-changes

Changes, grouped by transaction_id, with explanations (national-budget-changes-aggregated)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-12 03:26:58.012457
Last Completion:
2024-04-12 03:28:45.842729
Last Success:
2024-04-12 03:28:45.842729

Pipeline ID: budget/national/changes/processed/national-budget-changes-aggregated

budget/national/changes/processed/transactions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-12 00:46:55.656374
Last Completion:
2024-04-12 03:26:57.847572
Last Success:
2024-04-12 03:26:57.847572

Pipeline ID: budget/national/changes/processed/transactions

National Yearly Budgets (national-budgets)
Succeeded

We get the data the Ministry of Finance publishes in data.gov.il every year. It comes in XLS format, with one row per TAKANA and phase (original, approved, executed). In this pipeline we create from each triplet a single row that has all the data.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-03-14 15:57:59.170600
Last Completion:
2024-03-14 18:03:17.779046
Last Success:
2024-03-14 18:03:17.779046

Pipeline ID: budget/national/original/national-budgets

National Yearly Budgets - Processed (aggregated-yearly)
Succeeded

This pipeline joins the different phases of the budget (allocated, revised and executed). In the original file there's a separate row for each of the phases. We like it better as a single row with all phase info. Another thing this pipeline does is to rename the column titles - to more friendly English names. Also, it create rows for all hierarchies - where upper hierarchies (2, 4 & 6 digits) are plain aggregations of the 8-digit items they contain.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-03-14 18:21:17.949862
Last Completion:
2024-03-14 20:13:53.924666
Last Success:
2024-03-14 20:13:53.924666

Pipeline ID: budget/national/processed/aggregated-yearly

budget/national/processed/category-explanations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:54:56.900975
Last Completion:
2023-10-30 12:54:57.594178
Last Success:
2023-10-30 12:54:57.594178

Pipeline ID: budget/national/processed/category-explanations

National Yearly Budgets - Joined with category-explanations (connected-items-explained)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-03-14 20:46:11.555946
Last Completion:
2024-03-14 20:48:40.187135
Last Success:
2024-03-14 20:48:40.187135

Pipeline ID: budget/national/processed/connected-items-explained

National Yearly Budgets - Connected Items (connected-national-budgets)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-03-14 20:30:54.956897
Last Completion:
2024-03-14 20:46:11.189046
Last Success:
2024-03-14 20:46:11.189046

Pipeline ID: budget/national/processed/connected-national-budgets

National Yearly Budgets - Just the total (item 00) (just-the-total)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-03-14 20:30:54.770511
Last Completion:
2024-03-14 20:36:56.055236
Last Success:
2024-03-14 20:36:56.055236

Pipeline ID: budget/national/processed/just-the-total

National Yearly Budgets - Main Item Names (roof-names)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-03-14 20:30:54.778208
Last Completion:
2024-03-14 20:36:52.256096
Last Success:
2024-03-14 20:36:52.256096

Pipeline ID: budget/national/processed/roof-names

National Yearly Budgets - With Extras (with-extras)
Succeeded

This pipeline joins the budget data to itself so that each item has a list of its immediate children.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-03-14 20:13:54.003195
Last Completion:
2024-03-14 20:30:54.562845
Last Success:
2024-03-14 20:30:54.562845

Pipeline ID: budget/national/processed/with-extras

budgetkey/analysis/spending/united
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-16 10:00:01.697395
Last Completion:
2024-04-16 10:08:15.110479
Last Success:
2024-04-16 10:08:15.110479

Pipeline ID: budgetkey/analysis/spending/united

Main Page - Aggregated budget by functional classification (budget-functional-aggregates)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-03-14 20:13:54.078402
Last Completion:
2024-03-14 20:20:11.480477
Last Success:
2024-03-14 20:20:11.480477

Pipeline ID: budgetkey/budget-functional-aggregates

budgetkey/documents
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-03-14 20:20:11.873205
Last Completion:
2024-03-14 20:20:14.552842
Last Success:
2024-03-14 20:20:14.552842

Pipeline ID: budgetkey/documents

budgetkey/elasticsearch/index_activities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-16 00:29:45.671407
Last Completion:
2024-04-16 00:30:13.162685
Last Success:
2024-04-16 00:30:13.162685

Pipeline ID: budgetkey/elasticsearch/index_activities

budgetkey/elasticsearch/index_budget
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2024-04-12 00:20:43.118855
Last Completion:
2024-04-12 00:37:29.187192
Last Success:
2024-04-12 00:37:29.187192

Pipeline ID: budgetkey/elasticsearch/index_budget

budgetkey/elasticsearch/index_contract_spending
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2024-04-16 02:02:21.983277
Last Completion:
2024-04-16 03:20:38.165852
Last Success:
2024-04-16 03:20:38.165852

Pipeline ID: budgetkey/elasticsearch/index_contract_spending

budgetkey/elasticsearch/index_entities
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2024-04-16 02:14:17.845668
Last Completion:
2024-04-16 03:02:41.046520
Last Success:
2024-04-16 03:02:41.046520

Pipeline ID: budgetkey/elasticsearch/index_entities

budgetkey/elasticsearch/index_gov_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-15 12:38:21.200253
Last Completion:
2024-04-15 12:41:32.022549
Last Success:
2024-04-15 12:41:32.022549

Pipeline ID: budgetkey/elasticsearch/index_gov_decisions

budgetkey/elasticsearch/index_muni_budgets
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-16 00:18:39.766503
Last Completion:
2024-04-16 00:28:49.871077
Last Success:
2024-04-16 00:28:49.871077

Pipeline ID: budgetkey/elasticsearch/index_muni_budgets

budgetkey/elasticsearch/index_muni_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-16 00:09:14.250435
Last Completion:
2024-04-16 00:09:58.179836
Last Success:
2024-04-16 00:09:58.179836

Pipeline ID: budgetkey/elasticsearch/index_muni_tenders

budgetkey/elasticsearch/index_national_budget_changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-12 03:28:46.079422
Last Completion:
2024-04-12 03:31:03.652864
Last Success:
2024-04-12 03:31:03.652864

Pipeline ID: budgetkey/elasticsearch/index_national_budget_changes

budgetkey/elasticsearch/index_supports
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-16 00:49:24.359871
Last Completion:
2024-04-16 01:29:16.307135
Last Success:
2024-04-16 01:29:16.307135

Pipeline ID: budgetkey/elasticsearch/index_supports

budgetkey/elasticsearch/index_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-16 00:50:12.060083
Last Completion:
2024-04-16 01:14:45.872996
Last Success:
2024-04-16 01:14:45.872996

Pipeline ID: budgetkey/elasticsearch/index_tenders

budgetkey/elasticsearch/index_units
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-16 00:07:27.081824
Last Completion:
2024-04-16 00:07:57.572588
Last Success:
2024-04-16 00:07:57.572588

Pipeline ID: budgetkey/elasticsearch/index_units

budgetkey/elasticsearch/sitemaps
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2024-04-16 03:20:38.380936
Last Completion:
2024-04-16 05:29:42.095259
Last Success:
2024-04-16 05:29:42.095259

Pipeline ID: budgetkey/elasticsearch/sitemaps

Send periodic emails (emails)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-04-12 05:01:01.736826
Last Completion:
2024-04-12 12:31:57.644097
Last Success:
2024-04-12 12:31:57.644097

Pipeline ID: budgetkey/emails/emails