budget/municipal/fetcher
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-28 00:09:12.906830
Last Completion:
2023-03-28 00:21:11.125436
Last Success:
2023-03-28 00:21:11.125436

Pipeline ID: budget/municipal/fetcher

budget/national/changes/explanations/all
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-15 09:43:51.305155
Last Completion:
2023-03-15 09:45:42.173965
Last Success:
2023-03-15 09:45:42.173965

Pipeline ID: budget/national/changes/explanations/all

budget/national/changes/original/current-year-fixes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-24 01:14:55.238546
Last Completion:
2023-03-24 01:15:28.600509
Last Success:
2023-03-24 01:15:28.600509

Pipeline ID: budget/national/changes/original/current-year-fixes

budget/national/changes/original/national-budget-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-24 00:01:01.718525
Last Completion:
2023-03-24 00:03:54.783329
Last Success:
2023-03-24 00:03:54.783329

Pipeline ID: budget/national/changes/original/national-budget-changes

Changes, grouped by transaction_id, with explanations (national-budget-changes-aggregated)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-24 05:37:43.061936
Last Completion:
2023-03-24 05:39:57.008970
Last Success:
2023-03-24 05:39:57.008970

Pipeline ID: budget/national/changes/processed/national-budget-changes-aggregated

budget/national/changes/processed/transactions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-24 01:15:28.612393
Last Completion:
2023-03-24 05:37:42.922557
Last Success:
2023-03-24 05:37:42.922557

Pipeline ID: budget/national/changes/processed/transactions

National Yearly Budgets (national-budgets)
Succeeded

We get the data the Ministry of Finance publishes in data.gov.il every year. It comes in XLS format, with one row per TAKANA and phase (original, approved, executed). In this pipeline we create from each triplet a single row that has all the data.


Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-23 11:58:58.601066
Last Completion:
2023-03-23 13:31:54.612722
Last Success:
2023-03-23 13:31:54.612722

Pipeline ID: budget/national/original/national-budgets

National Yearly Budgets - Processed (aggregated-yearly)
Succeeded

This pipeline joins the different phases of the budget (allocated, revised and executed). In the original file there's a separate row for each of the phases. We like it better as a single row with all phase info. Another thing this pipeline does is to rename the column titles - to more friendly English names. Also, it create rows for all hierarchies - where upper hierarchies (2, 4 & 6 digits) are plain aggregations of the 8-digit items they contain.


Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-23 18:22:27.188226
Last Completion:
2023-03-23 19:06:45.354035
Last Success:
2023-03-23 19:06:45.354035

Pipeline ID: budget/national/processed/aggregated-yearly

budget/national/processed/category-explanations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-15 09:45:42.183179
Last Completion:
2023-03-15 09:45:42.766711
Last Success:
2023-03-15 09:45:42.766711

Pipeline ID: budget/national/processed/category-explanations

National Yearly Budgets - Joined with category-explanations (connected-items-explained)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-23 19:24:17.492223
Last Completion:
2023-03-23 19:25:52.314864
Last Success:
2023-03-23 19:25:52.314864

Pipeline ID: budget/national/processed/connected-items-explained

National Yearly Budgets - Connected Items (connected-national-budgets)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-23 19:15:35.988272
Last Completion:
2023-03-23 19:24:17.340397
Last Success:
2023-03-23 19:24:17.340397

Pipeline ID: budget/national/processed/connected-national-budgets

National Yearly Budgets - Just the total (item 00) (just-the-total)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-23 19:15:35.803885
Last Completion:
2023-03-23 19:19:04.408374
Last Success:
2023-03-23 19:19:04.408374

Pipeline ID: budget/national/processed/just-the-total

National Yearly Budgets - Main Item Names (roof-names)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-23 19:15:35.808682
Last Completion:
2023-03-23 19:19:02.192321
Last Success:
2023-03-23 19:19:02.192321

Pipeline ID: budget/national/processed/roof-names

National Yearly Budgets - With Extras (with-extras)
Succeeded

This pipeline joins the budget data to itself so that each item has a list of its immediate children.


Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-23 19:06:45.456125
Last Completion:
2023-03-23 19:15:35.709901
Last Success:
2023-03-23 19:15:35.709901

Pipeline ID: budget/national/processed/with-extras

budgetkey/analysis/spending/publisher_entity_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-28 10:10:07.437761
Last Completion:
2023-03-28 11:02:12.480809
Last Success:
2023-03-28 11:02:12.480809

Pipeline ID: budgetkey/analysis/spending/publisher_entity_analysis

budgetkey/analysis/spending/publisher_foa_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-28 10:10:07.447970
Last Completion:
2023-03-28 10:13:57.179205
Last Success:
2023-03-28 10:13:57.179205

Pipeline ID: budgetkey/analysis/spending/publisher_foa_analysis

budgetkey/analysis/spending/united
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-28 10:00:01.376400
Last Completion:
2023-03-28 10:10:07.210207
Last Success:
2023-03-28 10:10:07.210207

Pipeline ID: budgetkey/analysis/spending/united

Main Page - Aggregated budget by functional classification (budget-functional-aggregates)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-23 19:06:45.508912
Last Completion:
2023-03-23 19:09:48.780814
Last Success:
2023-03-23 19:09:48.780814

Pipeline ID: budgetkey/budget-functional-aggregates

budgetkey/documents
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-23 19:09:48.926794
Last Completion:
2023-03-23 19:09:50.881979
Last Success:
2023-03-23 19:09:50.881979

Pipeline ID: budgetkey/documents

budgetkey/elasticsearch/index_activities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-28 00:23:37.226978
Last Completion:
2023-03-28 00:24:12.498910
Last Success:
2023-03-28 00:24:12.498910

Pipeline ID: budgetkey/elasticsearch/index_activities

budgetkey/elasticsearch/index_budget
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2023-03-24 00:33:19.046346
Last Completion:
2023-03-24 01:14:52.486925
Last Success:
2023-03-24 01:14:52.486925

Pipeline ID: budgetkey/elasticsearch/index_budget

budgetkey/elasticsearch/index_calls_for_bids
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-28 16:11:12.432790
Last Completion:
2023-03-28 16:11:45.982460
Last Success:
2023-03-28 16:11:45.982460

Pipeline ID: budgetkey/elasticsearch/index_calls_for_bids

budgetkey/elasticsearch/index_contract_spending
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-28 04:01:15.784156
Last Completion:
2023-03-28 05:32:28.996270
Last Success:
2023-03-28 05:32:28.996270

Pipeline ID: budgetkey/elasticsearch/index_contract_spending

budgetkey/elasticsearch/index_entities
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./entities/entities
From ./entities/entities :['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/all']
From ./entities/entities :['From ./entities/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/associations/guidestar/guidestar']]
From ./entities/entities :['From ./entities/all', ['From ./entities/associations/guidestar/guidestar', ['Dependency unsuccessful', 'Cannot run until dependency "./entities/associations/guidestar/guidestar-scraper" is successfully executed']]]
From ./entities/entities :['From ./entities/all', ['Dependency unsuccessful', 'Cannot run until dependency "./entities/cooperatives/cooperatives" is successfully executed']]

Pipeline ID: budgetkey/elasticsearch/index_entities

budgetkey/elasticsearch/index_gov_decisions
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2023-03-28 12:03:00.776328
Last Completion:
2023-03-28 12:04:36.429475
Last Success:
2023-03-28 12:04:36.429475

Pipeline ID: budgetkey/elasticsearch/index_gov_decisions

budgetkey/elasticsearch/index_muni_budgets
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-28 01:17:59.606625
Last Completion:
2023-03-28 01:34:35.894940
Last Success:
2023-03-28 01:34:35.894940

Pipeline ID: budgetkey/elasticsearch/index_muni_budgets

budgetkey/elasticsearch/index_muni_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-28 01:08:22.787972
Last Completion:
2023-03-28 01:08:56.406172
Last Success:
2023-03-28 01:08:56.406172

Pipeline ID: budgetkey/elasticsearch/index_muni_tenders

budgetkey/elasticsearch/index_national_budget_changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-24 05:39:57.141098
Last Completion:
2023-03-24 05:42:37.584655
Last Success:
2023-03-24 05:42:37.584655

Pipeline ID: budgetkey/elasticsearch/index_national_budget_changes

budgetkey/elasticsearch/index_people
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/aggregated
From ./people/aggregated :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/all']
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/state_owned/state-owned-nominations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/state_owned/state-owned-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/state_owned/correlate']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/state_owned/state-owned-nominations', ['From ./people/company_appointments/state_owned/correlate', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/state_owned/parse_pdf_resources" is successfully executed']]]]]
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/association_founders/association-founders']]
From ./people/aggregated :['From ./people/all', ['From ./people/association_founders/association-founders', ['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/associations/guidestar/guidestar']]]
From ./people/aggregated :['From ./people/all', ['From ./people/association_founders/association-founders', ['From ./entities/associations/guidestar/guidestar', ['Dependency unsuccessful', 'Cannot run until dependency "./entities/associations/guidestar/guidestar-scraper" is successfully executed']]]]
From ./people/aggregated :['From ./people/all', ['Dependency unsuccessful', 'Cannot run until dependency "./people/political_donations/political_donations" is successfully executed']]

Pipeline ID: budgetkey/elasticsearch/index_people

budgetkey/elasticsearch/index_reports
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./reports/all
From ./reports/all :['Invalid dependency', 'Cannot run until dependency passes validation: ./reports/ngos/ngo-district-report']
From ./reports/all :['From ./reports/ngos/ngo-district-report', ['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/associations/guidestar/guidestar']]
From ./reports/all :['From ./reports/ngos/ngo-district-report', ['From ./entities/associations/guidestar/guidestar', ['Dependency unsuccessful', 'Cannot run until dependency "./entities/associations/guidestar/guidestar-scraper" is successfully executed']]]
From ./reports/all :['Invalid dependency', 'Cannot run until dependency passes validation: ./reports/ngos/ngo-activity-report']
From ./reports/all :['From ./reports/ngos/ngo-activity-report', ['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/associations/guidestar/guidestar']]
From ./reports/all :['From ./reports/ngos/ngo-activity-report', ['From ./entities/associations/guidestar/guidestar', ['Dependency unsuccessful', 'Cannot run until dependency "./entities/associations/guidestar/guidestar-scraper" is successfully executed']]]

Pipeline ID: budgetkey/elasticsearch/index_reports

budgetkey/elasticsearch/index_support_criteria
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./supports/criteria/support-criteria" is successfully executed

Pipeline ID: budgetkey/elasticsearch/index_support_criteria

budgetkey/elasticsearch/index_supports
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2023-03-28 01:54:15.708734
Last Completion:
2023-03-28 02:35:06.175566
Last Success:
2023-03-28 02:35:06.175566

Pipeline ID: budgetkey/elasticsearch/index_supports

budgetkey/elasticsearch/index_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-28 01:56:22.810349
Last Completion:
2023-03-28 02:29:40.096323
Last Success:
2023-03-28 02:29:40.096323

Pipeline ID: budgetkey/elasticsearch/index_tenders

budgetkey/elasticsearch/index_units
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-28 00:11:07.811586
Last Completion:
2023-03-28 00:11:42.033934
Last Success:
2023-03-28 00:11:42.033934

Pipeline ID: budgetkey/elasticsearch/index_units

budgetkey/elasticsearch/sitemaps
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./budgetkey/elasticsearch/index_entities
From ./budgetkey/elasticsearch/index_entities :['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/entities']
From ./budgetkey/elasticsearch/index_entities :['From ./entities/entities', ['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/all']]
From ./budgetkey/elasticsearch/index_entities :['From ./entities/entities', ['From ./entities/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/associations/guidestar/guidestar']]]
From ./budgetkey/elasticsearch/index_entities :['From ./entities/entities', ['From ./entities/all', ['From ./entities/associations/guidestar/guidestar', ['Dependency unsuccessful', 'Cannot run until dependency "./entities/associations/guidestar/guidestar-scraper" is successfully executed']]]]
From ./budgetkey/elasticsearch/index_entities :['From ./entities/entities', ['From ./entities/all', ['Dependency unsuccessful', 'Cannot run until dependency "./entities/cooperatives/cooperatives" is successfully executed']]]
Invalid dependency :Cannot run until dependency passes validation: ./budgetkey/elasticsearch/index_support_criteria
From ./budgetkey/elasticsearch/index_support_criteria :['Dependency unsuccessful', 'Cannot run until dependency "./supports/criteria/support-criteria" is successfully executed']
Invalid dependency :Cannot run until dependency passes validation: ./budgetkey/elasticsearch/index_reports
From ./budgetkey/elasticsearch/index_reports :['Invalid dependency', 'Cannot run until dependency passes validation: ./reports/all']
From ./budgetkey/elasticsearch/index_reports :['From ./reports/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./reports/ngos/ngo-district-report']]
From ./budgetkey/elasticsearch/index_reports :['From ./reports/all', ['From ./reports/ngos/ngo-district-report', ['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/associations/guidestar/guidestar']]]
From ./budgetkey/elasticsearch/index_reports :['From ./reports/all', ['From ./reports/ngos/ngo-district-report', ['From ./entities/associations/guidestar/guidestar', ['Dependency unsuccessful', 'Cannot run until dependency "./entities/associations/guidestar/guidestar-scraper" is successfully executed']]]]
From ./budgetkey/elasticsearch/index_reports :['From ./reports/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./reports/ngos/ngo-activity-report']]
From ./budgetkey/elasticsearch/index_reports :['From ./reports/all', ['From ./reports/ngos/ngo-activity-report', ['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/associations/guidestar/guidestar']]]
From ./budgetkey/elasticsearch/index_reports :['From ./reports/all', ['From ./reports/ngos/ngo-activity-report', ['From ./entities/associations/guidestar/guidestar', ['Dependency unsuccessful', 'Cannot run until dependency "./entities/associations/guidestar/guidestar-scraper" is successfully executed']]]]

Pipeline ID: budgetkey/elasticsearch/sitemaps

Send periodic emails (emails)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-24 05:06:39.282138
Last Completion:
2023-03-24 13:44:14.131007
Last Success:
2023-03-24 13:44:14.131007

Pipeline ID: budgetkey/emails/emails

budgetkey/elasticsearch/index_entities
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./entities/entities
From ./entities/entities :['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/all']
From ./entities/entities :['From ./entities/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/associations/guidestar/guidestar']]
From ./entities/entities :['From ./entities/all', ['From ./entities/associations/guidestar/guidestar', ['Dependency unsuccessful', 'Cannot run until dependency "./entities/associations/guidestar/guidestar-scraper" is successfully executed']]]
From ./entities/entities :['From ./entities/all', ['Dependency unsuccessful', 'Cannot run until dependency "./entities/cooperatives/cooperatives" is successfully executed']]

Pipeline ID: budgetkey/elasticsearch/index_entities

budgetkey/elasticsearch/index_people
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/aggregated
From ./people/aggregated :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/all']
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/state_owned/state-owned-nominations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/state_owned/state-owned-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/state_owned/correlate']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/state_owned/state-owned-nominations', ['From ./people/company_appointments/state_owned/correlate', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/state_owned/parse_pdf_resources" is successfully executed']]]]]
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/association_founders/association-founders']]
From ./people/aggregated :['From ./people/all', ['From ./people/association_founders/association-founders', ['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/associations/guidestar/guidestar']]]
From ./people/aggregated :['From ./people/all', ['From ./people/association_founders/association-founders', ['From ./entities/associations/guidestar/guidestar', ['Dependency unsuccessful', 'Cannot run until dependency "./entities/associations/guidestar/guidestar-scraper" is successfully executed']]]]
From ./people/aggregated :['From ./people/all', ['Dependency unsuccessful', 'Cannot run until dependency "./people/political_donations/political_donations" is successfully executed']]

Pipeline ID: budgetkey/elasticsearch/index_people

budgetkey/elasticsearch/index_reports
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./reports/all
From ./reports/all :['Invalid dependency', 'Cannot run until dependency passes validation: ./reports/ngos/ngo-district-report']
From ./reports/all :['From ./reports/ngos/ngo-district-report', ['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/associations/guidestar/guidestar']]
From ./reports/all :['From ./reports/ngos/ngo-district-report', ['From ./entities/associations/guidestar/guidestar', ['Dependency unsuccessful', 'Cannot run until dependency "./entities/associations/guidestar/guidestar-scraper" is successfully executed']]]
From ./reports/all :['Invalid dependency', 'Cannot run until dependency passes validation: ./reports/ngos/ngo-activity-report']
From ./reports/all :['From ./reports/ngos/ngo-activity-report', ['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/associations/guidestar/guidestar']]
From ./reports/all :['From ./reports/ngos/ngo-activity-report', ['From ./entities/associations/guidestar/guidestar', ['Dependency unsuccessful', 'Cannot run until dependency "./entities/associations/guidestar/guidestar-scraper" is successfully executed']]]

Pipeline ID: budgetkey/elasticsearch/index_reports

budgetkey/elasticsearch/index_support_criteria
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./supports/criteria/support-criteria" is successfully executed

Pipeline ID: budgetkey/elasticsearch/index_support_criteria

budgetkey/elasticsearch/sitemaps
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./budgetkey/elasticsearch/index_entities
From ./budgetkey/elasticsearch/index_entities :['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/entities']
From ./budgetkey/elasticsearch/index_entities :['From ./entities/entities', ['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/all']]
From ./budgetkey/elasticsearch/index_entities :['From ./entities/entities', ['From ./entities/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/associations/guidestar/guidestar']]]
From ./budgetkey/elasticsearch/index_entities :['From ./entities/entities', ['From ./entities/all', ['From ./entities/associations/guidestar/guidestar', ['Dependency unsuccessful', 'Cannot run until dependency "./entities/associations/guidestar/guidestar-scraper" is successfully executed']]]]
From ./budgetkey/elasticsearch/index_entities :['From ./entities/entities', ['From ./entities/all', ['Dependency unsuccessful', 'Cannot run until dependency "./entities/cooperatives/cooperatives" is successfully executed']]]
Invalid dependency :Cannot run until dependency passes validation: ./budgetkey/elasticsearch/index_support_criteria
From ./budgetkey/elasticsearch/index_support_criteria :['Dependency unsuccessful', 'Cannot run until dependency "./supports/criteria/support-criteria" is successfully executed']
Invalid dependency :Cannot run until dependency passes validation: ./budgetkey/elasticsearch/index_reports
From ./budgetkey/elasticsearch/index_reports :['Invalid dependency', 'Cannot run until dependency passes validation: ./reports/all']
From ./budgetkey/elasticsearch/index_reports :['From ./reports/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./reports/ngos/ngo-district-report']]
From ./budgetkey/elasticsearch/index_reports :['From ./reports/all', ['From ./reports/ngos/ngo-district-report', ['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/associations/guidestar/guidestar']]]
From ./budgetkey/elasticsearch/index_reports :['From ./reports/all', ['From ./reports/ngos/ngo-district-report', ['From ./entities/associations/guidestar/guidestar', ['Dependency unsuccessful', 'Cannot run until dependency "./entities/associations/guidestar/guidestar-scraper" is successfully executed']]]]
From ./budgetkey/elasticsearch/index_reports :['From ./reports/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./reports/ngos/ngo-activity-report']]
From ./budgetkey/elasticsearch/index_reports :['From ./reports/all', ['From ./reports/ngos/ngo-activity-report', ['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/associations/guidestar/guidestar']]]
From ./budgetkey/elasticsearch/index_reports :['From ./reports/all', ['From ./reports/ngos/ngo-activity-report', ['From ./entities/associations/guidestar/guidestar', ['Dependency unsuccessful', 'Cannot run until dependency "./entities/associations/guidestar/guidestar-scraper" is successfully executed']]]]

Pipeline ID: budgetkey/elasticsearch/sitemaps

budget/municipal/fetcher
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-28 00:09:12.906830
Last Completion:
2023-03-28 00:21:11.125436
Last Success:
2023-03-28 00:21:11.125436

Pipeline ID: budget/municipal/fetcher

budget/national/changes/explanations/all
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-15 09:43:51.305155
Last Completion:
2023-03-15 09:45:42.173965
Last Success:
2023-03-15 09:45:42.173965

Pipeline ID: budget/national/changes/explanations/all

budget/national/changes/original/current-year-fixes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-24 01:14:55.238546
Last Completion:
2023-03-24 01:15:28.600509
Last Success:
2023-03-24 01:15:28.600509

Pipeline ID: budget/national/changes/original/current-year-fixes

budget/national/changes/original/national-budget-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-24 00:01:01.718525
Last Completion:
2023-03-24 00:03:54.783329
Last Success:
2023-03-24 00:03:54.783329

Pipeline ID: budget/national/changes/original/national-budget-changes

Changes, grouped by transaction_id, with explanations (national-budget-changes-aggregated)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-24 05:37:43.061936
Last Completion:
2023-03-24 05:39:57.008970
Last Success:
2023-03-24 05:39:57.008970

Pipeline ID: budget/national/changes/processed/national-budget-changes-aggregated

budget/national/changes/processed/transactions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-24 01:15:28.612393
Last Completion:
2023-03-24 05:37:42.922557
Last Success:
2023-03-24 05:37:42.922557

Pipeline ID: budget/national/changes/processed/transactions

National Yearly Budgets (national-budgets)
Succeeded

We get the data the Ministry of Finance publishes in data.gov.il every year. It comes in XLS format, with one row per TAKANA and phase (original, approved, executed). In this pipeline we create from each triplet a single row that has all the data.


Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-23 11:58:58.601066
Last Completion:
2023-03-23 13:31:54.612722
Last Success:
2023-03-23 13:31:54.612722

Pipeline ID: budget/national/original/national-budgets

National Yearly Budgets - Processed (aggregated-yearly)
Succeeded

This pipeline joins the different phases of the budget (allocated, revised and executed). In the original file there's a separate row for each of the phases. We like it better as a single row with all phase info. Another thing this pipeline does is to rename the column titles - to more friendly English names. Also, it create rows for all hierarchies - where upper hierarchies (2, 4 & 6 digits) are plain aggregations of the 8-digit items they contain.


Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-23 18:22:27.188226
Last Completion:
2023-03-23 19:06:45.354035
Last Success:
2023-03-23 19:06:45.354035

Pipeline ID: budget/national/processed/aggregated-yearly

budget/national/processed/category-explanations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-15 09:45:42.183179
Last Completion:
2023-03-15 09:45:42.766711
Last Success:
2023-03-15 09:45:42.766711

Pipeline ID: budget/national/processed/category-explanations

National Yearly Budgets - Joined with category-explanations (connected-items-explained)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-23 19:24:17.492223
Last Completion:
2023-03-23 19:25:52.314864
Last Success:
2023-03-23 19:25:52.314864

Pipeline ID: budget/national/processed/connected-items-explained

National Yearly Budgets - Connected Items (connected-national-budgets)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-23 19:15:35.988272
Last Completion:
2023-03-23 19:24:17.340397
Last Success:
2023-03-23 19:24:17.340397

Pipeline ID: budget/national/processed/connected-national-budgets

National Yearly Budgets - Just the total (item 00) (just-the-total)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-23 19:15:35.803885
Last Completion:
2023-03-23 19:19:04.408374
Last Success:
2023-03-23 19:19:04.408374

Pipeline ID: budget/national/processed/just-the-total

National Yearly Budgets - Main Item Names (roof-names)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-23 19:15:35.808682
Last Completion:
2023-03-23 19:19:02.192321
Last Success:
2023-03-23 19:19:02.192321

Pipeline ID: budget/national/processed/roof-names

National Yearly Budgets - With Extras (with-extras)
Succeeded

This pipeline joins the budget data to itself so that each item has a list of its immediate children.


Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-23 19:06:45.456125
Last Completion:
2023-03-23 19:15:35.709901
Last Success:
2023-03-23 19:15:35.709901

Pipeline ID: budget/national/processed/with-extras

budgetkey/analysis/spending/publisher_entity_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-28 10:10:07.437761
Last Completion:
2023-03-28 11:02:12.480809
Last Success:
2023-03-28 11:02:12.480809

Pipeline ID: budgetkey/analysis/spending/publisher_entity_analysis

budgetkey/analysis/spending/publisher_foa_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-28 10:10:07.447970
Last Completion:
2023-03-28 10:13:57.179205
Last Success:
2023-03-28 10:13:57.179205

Pipeline ID: budgetkey/analysis/spending/publisher_foa_analysis

budgetkey/analysis/spending/united
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-28 10:00:01.376400
Last Completion:
2023-03-28 10:10:07.210207
Last Success:
2023-03-28 10:10:07.210207

Pipeline ID: budgetkey/analysis/spending/united

Main Page - Aggregated budget by functional classification (budget-functional-aggregates)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-23 19:06:45.508912
Last Completion:
2023-03-23 19:09:48.780814
Last Success:
2023-03-23 19:09:48.780814

Pipeline ID: budgetkey/budget-functional-aggregates

budgetkey/documents
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-23 19:09:48.926794
Last Completion:
2023-03-23 19:09:50.881979
Last Success:
2023-03-23 19:09:50.881979

Pipeline ID: budgetkey/documents

budgetkey/elasticsearch/index_activities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-28 00:23:37.226978
Last Completion:
2023-03-28 00:24:12.498910
Last Success:
2023-03-28 00:24:12.498910

Pipeline ID: budgetkey/elasticsearch/index_activities

budgetkey/elasticsearch/index_budget
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2023-03-24 00:33:19.046346
Last Completion:
2023-03-24 01:14:52.486925
Last Success:
2023-03-24 01:14:52.486925

Pipeline ID: budgetkey/elasticsearch/index_budget

budgetkey/elasticsearch/index_calls_for_bids
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-28 16:11:12.432790
Last Completion:
2023-03-28 16:11:45.982460
Last Success:
2023-03-28 16:11:45.982460

Pipeline ID: budgetkey/elasticsearch/index_calls_for_bids

budgetkey/elasticsearch/index_contract_spending
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-28 04:01:15.784156
Last Completion:
2023-03-28 05:32:28.996270
Last Success:
2023-03-28 05:32:28.996270

Pipeline ID: budgetkey/elasticsearch/index_contract_spending

budgetkey/elasticsearch/index_gov_decisions
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2023-03-28 12:03:00.776328
Last Completion:
2023-03-28 12:04:36.429475
Last Success:
2023-03-28 12:04:36.429475

Pipeline ID: budgetkey/elasticsearch/index_gov_decisions

budgetkey/elasticsearch/index_muni_budgets
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-28 01:17:59.606625
Last Completion:
2023-03-28 01:34:35.894940
Last Success:
2023-03-28 01:34:35.894940

Pipeline ID: budgetkey/elasticsearch/index_muni_budgets

budgetkey/elasticsearch/index_muni_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-28 01:08:22.787972
Last Completion:
2023-03-28 01:08:56.406172
Last Success:
2023-03-28 01:08:56.406172

Pipeline ID: budgetkey/elasticsearch/index_muni_tenders

budgetkey/elasticsearch/index_national_budget_changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-24 05:39:57.141098
Last Completion:
2023-03-24 05:42:37.584655
Last Success:
2023-03-24 05:42:37.584655

Pipeline ID: budgetkey/elasticsearch/index_national_budget_changes

budgetkey/elasticsearch/index_supports
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2023-03-28 01:54:15.708734
Last Completion:
2023-03-28 02:35:06.175566
Last Success:
2023-03-28 02:35:06.175566

Pipeline ID: budgetkey/elasticsearch/index_supports

budgetkey/elasticsearch/index_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-28 01:56:22.810349
Last Completion:
2023-03-28 02:29:40.096323
Last Success:
2023-03-28 02:29:40.096323

Pipeline ID: budgetkey/elasticsearch/index_tenders

budgetkey/elasticsearch/index_units
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-28 00:11:07.811586
Last Completion:
2023-03-28 00:11:42.033934
Last Success:
2023-03-28 00:11:42.033934

Pipeline ID: budgetkey/elasticsearch/index_units

Send periodic emails (emails)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-03-24 05:06:39.282138
Last Completion:
2023-03-24 13:44:14.131007
Last Success:
2023-03-24 13:44:14.131007

Pipeline ID: budgetkey/emails/emails