activities/social_services/social_service_reports
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:09:51.707764
Last Completion:
2025-06-16 00:14:01.615298
Last Success:
2025-06-16 00:14:01.615298

Pipeline ID: activities/social_services/social_service_reports

activities/social_services/social_service_suppliers
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:09:36.712111
Last Completion:
2025-06-16 00:09:44.611746
Last Success:
2025-06-16 00:09:44.611746

Pipeline ID: activities/social_services/social_service_suppliers

activities/social_services/social_service_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:09:44.620807
Last Completion:
2025-06-16 00:09:51.526658
Last Success:
2025-06-16 00:09:51.526658

Pipeline ID: activities/social_services/social_service_tenders

Fetch social services from data input (social_services)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:38.251987
Last Completion:
2025-06-16 00:01:14.161216
Last Success:
2025-06-16 00:01:14.161216

Pipeline ID: activities/social_services/social_services

bank_of_israel/bank_of_israel
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-19 11:19:54.126171
Last Completion:
2025-05-19 11:19:56.840221
Last Success:
2025-05-19 11:19:56.840221

Pipeline ID: bank_of_israel/bank_of_israel

budget/municipal/fetcher
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:04.912807
Last Completion:
2025-06-16 00:11:34.023911
Last Success:
2025-06-16 00:11:34.023911

Pipeline ID: budget/municipal/fetcher

budget/national/changes/explanations/all
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-06-14 17:13:42.193305
Last Completion:
2025-06-14 17:21:16.900949
Last Success:
2025-06-06 00:16:16.199791

explanation_fetcher
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/budget/national/changes/explanations/explanation_fetcher.py", line 72, in <module>
    spew(dp, itertools.chain(res_iter, [get_explanations(parameters['url'])]))
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/budget/national/changes/explanations/explanation_fetcher.py", line 49, in get_explanations
    z_archive = zipfile.ZipFile(archive)
  File "/usr/local/lib/python3.9/zipfile.py", line 1266, in __init__
    self._RealGetContents()
  File "/usr/local/lib/python3.9/zipfile.py", line 1333, in _RealGetContents
    raise BadZipFile("File is not a zip file")
zipfile.BadZipFile: File is not a zip file

Pipeline ID: budget/national/changes/explanations/all

budget/national/changes/original/committee-zipfile
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:24.609684
Last Completion:
2025-06-16 00:00:26.855410
Last Success:
2025-06-16 00:00:26.855410

Pipeline ID: budget/national/changes/original/committee-zipfile

budget/national/changes/original/current-year-fixes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:12:28.822848
Last Completion:
2025-06-16 00:12:51.708708
Last Success:
2025-06-16 00:12:51.708708

Pipeline ID: budget/national/changes/original/current-year-fixes

budget/national/changes/original/national-budget-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:46.107321
Last Completion:
2025-06-16 00:03:13.023566
Last Success:
2025-06-16 00:03:13.023566

Pipeline ID: budget/national/changes/original/national-budget-changes

Changes, grouped by transaction_id, with explanations (national-budget-changes-aggregated)
Invalid

Last Run triggered by:
scheduled
Last Run started at:
2025-06-12 13:08:22.004145
Last Completion:
2025-06-12 14:43:44.102862
Last Success:
2025-06-12 00:33:06.298393

Dependency unsuccessful :Cannot run until dependency "./budget/national/changes/explanations/all" is successfully executed

Pipeline ID: budget/national/changes/processed/national-budget-changes-aggregated

budget/national/changes/processed/transactions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:12:51.725677
Last Completion:
2025-06-16 02:58:32.738200
Last Success:
2025-06-16 02:58:32.738200

Pipeline ID: budget/national/changes/processed/transactions

National Yearly Budgets (national-budgets)
Succeeded

We get the data the Ministry of Finance publishes in data.gov.il every year. It comes in XLS format, with one row per TAKANA and phase (original, approved, executed). In this pipeline we create from each triplet a single row that has all the data.


Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 00:32:58.593096
Last Completion:
2025-06-14 02:54:23.193457
Last Success:
2025-06-14 02:54:23.193457

Pipeline ID: budget/national/original/national-budgets

National Yearly Budgets - Processed (aggregated-yearly)
Succeeded

This pipeline joins the different phases of the budget (allocated, revised and executed). In the original file there's a separate row for each of the phases. We like it better as a single row with all phase info. Another thing this pipeline does is to rename the column titles - to more friendly English names. Also, it create rows for all hierarchies - where upper hierarchies (2, 4 & 6 digits) are plain aggregations of the 8-digit items they contain.


Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 06:14:10.103172
Last Completion:
2025-06-14 09:47:58.885403
Last Success:
2025-06-14 09:47:58.885403

Pipeline ID: budget/national/processed/aggregated-yearly

budget/national/processed/category-explanations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:49:18.734713
Last Completion:
2025-04-27 07:49:19.587602
Last Success:
2025-04-27 07:49:19.587602

Pipeline ID: budget/national/processed/category-explanations

National Yearly Budgets - Joined with category-explanations (connected-items-explained)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 13:33:27.000051
Last Completion:
2025-06-14 13:43:47.407764
Last Success:
2025-06-14 13:43:47.407764

Pipeline ID: budget/national/processed/connected-items-explained

National Yearly Budgets - Connected Items (connected-national-budgets)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 12:15:04.504443
Last Completion:
2025-06-14 13:01:50.010002
Last Success:
2025-06-14 13:01:50.010002

Pipeline ID: budget/national/processed/connected-national-budgets

National Yearly Budgets - Just the total (item 00) (just-the-total)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 11:51:44.296503
Last Completion:
2025-06-14 12:07:29.297403
Last Success:
2025-06-14 12:07:29.297403

Pipeline ID: budget/national/processed/just-the-total

National Yearly Budgets - Main Item Names (roof-names)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 12:02:39.008353
Last Completion:
2025-06-14 12:16:27.088967
Last Success:
2025-06-14 12:16:27.088967

Pipeline ID: budget/national/processed/roof-names

National Yearly Budgets - With Extras (with-extras)
Succeeded

This pipeline joins the budget data to itself so that each item has a list of its immediate children.


Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 10:46:54.295357
Last Completion:
2025-06-14 11:51:43.185539
Last Success:
2025-06-14 11:51:43.185539

Pipeline ID: budget/national/processed/with-extras

budgetkey/analysis/spending/publisher_entity_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 10:18:58.310059
Last Completion:
2025-06-16 11:24:28.463434
Last Success:
2025-06-16 11:24:28.463434

Pipeline ID: budgetkey/analysis/spending/publisher_entity_analysis

budgetkey/analysis/spending/publisher_foa_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 10:18:58.313877
Last Completion:
2025-06-16 10:25:25.541803
Last Success:
2025-06-16 10:25:25.541803

Pipeline ID: budgetkey/analysis/spending/publisher_foa_analysis

budgetkey/analysis/spending/united
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 10:00:02.926555
Last Completion:
2025-06-16 10:18:57.817096
Last Success:
2025-06-16 10:18:57.817096

Pipeline ID: budgetkey/analysis/spending/united

Main Page - Aggregated budget by functional classification (budget-functional-aggregates)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 10:55:48.014238
Last Completion:
2025-06-14 11:04:15.730364
Last Success:
2025-06-14 11:04:15.730364

Pipeline ID: budgetkey/budget-functional-aggregates

budgetkey/documents
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 11:18:02.287297
Last Completion:
2025-06-14 11:18:17.591672
Last Success:
2025-06-14 11:18:17.591672

Pipeline ID: budgetkey/documents

budgetkey/elasticsearch/index_activities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:11:34.111598
Last Completion:
2025-06-16 00:12:15.746290
Last Success:
2025-06-16 00:12:15.746290

Pipeline ID: budgetkey/elasticsearch/index_activities

budgetkey/elasticsearch/index_budget
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-06-14 17:25:39.398067
Last Completion:
2025-06-14 17:55:10.806187
Last Success:
2025-06-14 17:55:10.806187

Pipeline ID: budgetkey/elasticsearch/index_budget

budgetkey/elasticsearch/index_calls_for_bids
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./procurement/calls_for_bids/calls-for-bids-all
From ./procurement/calls_for_bids/calls-for-bids-all :['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-calls-for-bids']
From ./procurement/calls_for_bids/calls-for-bids-all :['From ./procurement/calls_for_bids/jobiz-calls-for-bids', ['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-all']]
From ./procurement/calls_for_bids/calls-for-bids-all :['From ./procurement/calls_for_bids/jobiz-calls-for-bids', ['From ./procurement/calls_for_bids/jobiz-all', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed']]]

Pipeline ID: budgetkey/elasticsearch/index_calls_for_bids

budgetkey/elasticsearch/index_contract_spending
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 12:27:02.973254
Last Completion:
2025-06-16 13:42:53.995261
Last Success:
2025-06-16 13:42:53.995261

Pipeline ID: budgetkey/elasticsearch/index_contract_spending

budgetkey/elasticsearch/index_entities
Invalid

Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 08:08:34.003114
Last Completion:
2025-06-14 11:06:58.913444
Last Success:
2025-06-14 11:06:58.913444

Invalid dependency :Cannot run until dependency passes validation: ./entities/entities
From ./entities/entities :['Dependency unsuccessful', 'Cannot run until dependency "./procurement/spending/spending-by-entity" is successfully executed']
From ./entities/entities :['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/all']
From ./entities/entities :['From ./entities/all', ['Dependency unsuccessful', 'Cannot run until dependency "./entities/special/registry" is successfully executed']]

Pipeline ID: budgetkey/elasticsearch/index_entities

budgetkey/elasticsearch/index_gov_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 12:15:53.515692
Last Completion:
2025-06-16 12:17:58.513804
Last Success:
2025-06-16 12:17:58.513804

Pipeline ID: budgetkey/elasticsearch/index_gov_decisions

budgetkey/elasticsearch/index_muni_budgets
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:16:42.420389
Last Completion:
2025-06-16 00:26:32.520154
Last Success:
2025-06-16 00:26:32.520154

Pipeline ID: budgetkey/elasticsearch/index_muni_budgets

budgetkey/elasticsearch/index_muni_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:12:15.811182
Last Completion:
2025-06-16 00:12:56.108012
Last Success:
2025-06-16 00:12:56.108012

Pipeline ID: budgetkey/elasticsearch/index_muni_tenders

budgetkey/elasticsearch/index_national_budget_changes
Invalid

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-06-12 01:04:12.389366
Last Completion:
2025-06-12 01:14:18.205917
Last Success:
2025-06-12 01:14:18.205917

Invalid dependency :Cannot run until dependency passes validation: ./budget/national/changes/processed/national-budget-changes-aggregated
From ./budget/national/changes/processed/national-budget-changes-aggregated :['Dependency unsuccessful', 'Cannot run until dependency "./budget/national/changes/explanations/all" is successfully executed']
From ./budget/national/changes/processed/national-budget-changes-aggregated :['Invalid dependency', 'Cannot run until dependency passes validation: ./budget/national/changes/processed/transactions']
From ./budget/national/changes/processed/national-budget-changes-aggregated :['From ./budget/national/changes/processed/transactions', ['Dependency unsuccessful', 'Cannot run until dependency "./budget/national/changes/original/national-budget-changes" is successfully executed']]

Pipeline ID: budgetkey/elasticsearch/index_national_budget_changes

budgetkey/elasticsearch/index_people
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/aggregated
From ./people/aggregated :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/all']
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['Dependency unsuccessful', 'Cannot run until dependency "./people/procurement/procurement-individuals" is successfully executed']]
From ./people/aggregated :['From ./people/all', ['Dependency unsuccessful', 'Cannot run until dependency "./people/political_candidates/election_candidates21" is successfully executed']]

Pipeline ID: budgetkey/elasticsearch/index_people

budgetkey/elasticsearch/index_reports
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-06-14 17:55:10.903100
Last Completion:
2025-06-14 17:56:26.504278
Last Success:
2025-06-14 17:56:26.504278

Pipeline ID: budgetkey/elasticsearch/index_reports

budgetkey/elasticsearch/index_support_criteria
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./supports/criteria/support-criteria" is successfully executed

Pipeline ID: budgetkey/elasticsearch/index_support_criteria

budgetkey/elasticsearch/index_supports
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 01:02:19.331204
Last Completion:
2025-06-16 01:24:19.140864
Last Success:
2025-06-16 01:24:19.140864

Pipeline ID: budgetkey/elasticsearch/index_supports

budgetkey/elasticsearch/index_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:34:49.209939
Last Completion:
2025-06-16 01:06:15.763870
Last Success:
2025-06-16 01:06:15.763870

Pipeline ID: budgetkey/elasticsearch/index_tenders

budgetkey/elasticsearch/index_units
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:11:52.309371
Last Completion:
2025-06-16 00:12:23.821710
Last Success:
2025-06-16 00:12:23.821710

Pipeline ID: budgetkey/elasticsearch/index_units

budgetkey/elasticsearch/sitemaps
Invalid

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-06-14 14:46:02.891209
Last Completion:
2025-06-14 15:38:26.314180
Last Success:
2025-06-14 15:38:26.314180

Invalid dependency :Cannot run until dependency passes validation: ./budgetkey/elasticsearch/index_national_budget_changes
From ./budgetkey/elasticsearch/index_national_budget_changes :['Invalid dependency', 'Cannot run until dependency passes validation: ./budget/national/changes/processed/national-budget-changes-aggregated']
From ./budgetkey/elasticsearch/index_national_budget_changes :['From ./budget/national/changes/processed/national-budget-changes-aggregated', ['Dependency unsuccessful', 'Cannot run until dependency "./budget/national/changes/explanations/all" is successfully executed']]
From ./budgetkey/elasticsearch/index_national_budget_changes :['From ./budget/national/changes/processed/national-budget-changes-aggregated', ['Invalid dependency', 'Cannot run until dependency passes validation: ./budget/national/changes/processed/transactions']]
From ./budgetkey/elasticsearch/index_national_budget_changes :['From ./budget/national/changes/processed/national-budget-changes-aggregated', ['From ./budget/national/changes/processed/transactions', ['Dependency unsuccessful', 'Cannot run until dependency "./budget/national/changes/original/national-budget-changes" is successfully executed']]]
Invalid dependency :Cannot run until dependency passes validation: ./budgetkey/elasticsearch/index_entities
From ./budgetkey/elasticsearch/index_entities :['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/entities']
From ./budgetkey/elasticsearch/index_entities :['From ./entities/entities', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/spending/spending-by-entity" is successfully executed']]
From ./budgetkey/elasticsearch/index_entities :['From ./entities/entities', ['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/all']]
From ./budgetkey/elasticsearch/index_entities :['From ./entities/entities', ['From ./entities/all', ['Dependency unsuccessful', 'Cannot run until dependency "./entities/special/registry" is successfully executed']]]

Pipeline ID: budgetkey/elasticsearch/sitemaps

Send periodic emails (emails)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-06-14 17:13:55.305191
Last Completion:
2025-06-15 19:37:16.068204
Last Success:
2025-06-15 19:37:16.068204

Pipeline ID: budgetkey/emails/emails

donations/candidates
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 09:00:56.301458
Last Completion:
2025-04-27 09:01:03.408524
Last Success:
2025-04-27 09:01:03.408524

Pipeline ID: donations/candidates

donations/parties
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:51:35.993955
Last Completion:
2025-04-27 07:51:39.489352
Last Success:
2025-04-27 07:51:39.489352

Pipeline ID: donations/parties

donations/transactions
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-06-14 17:13:10.764860
Last Completion:
2025-06-14 17:13:28.705960
Last Success:
None

get_transactions
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 150, in <module>
    spew(dp, process_resources(res_iter))
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 109, in get_transactions
    for resp in self.get_for_candidate(cid):
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 95, in get_for_candidate
    resp = self.get_for_range(cid, range_start, range_end)
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 70, in get_for_range
    assert len(resp) == 6
AssertionError

Pipeline ID: donations/transactions

education/tochniyot/tochniyot
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-06-14 17:21:48.739998
Last Completion:
2025-06-14 17:21:53.204450
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 103, in flow
    return Flow(scrape(),
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 65, in scrape
    education_programs_count = get_education_programs_count()
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 56, in get_education_programs_count
    res = send_tochniyot_request()
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 80, in send_tochniyot_request
    resp.raise_for_status()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://apps.education.gov.il/TyhNet/ClientWs/TochnitCh.asmx/IturTochnitChByMeafyenim

Pipeline ID: education/tochniyot/tochniyot

entities/all
Invalid

Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 00:00:25.493261
Last Completion:
2025-06-14 00:28:37.395533
Last Success:
2025-06-14 00:28:37.395533

Dependency unsuccessful :Cannot run until dependency "./entities/special/registry" is successfully executed

Pipeline ID: entities/all

entities/associations/guidestar/guidestar
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-31 06:16:08.870355
Last Completion:
2025-05-31 06:25:09.087238
Last Success:
2025-05-31 06:25:09.087238

Pipeline ID: entities/associations/guidestar/guidestar

entities/associations/guidestar/guidestar-scraper
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-31 00:12:28.583435
Last Completion:
2025-05-31 06:16:08.744449
Last Success:
2025-05-31 06:16:08.744449

Pipeline ID: entities/associations/guidestar/guidestar-scraper

עמותות פעילות מרשם העמותות (registry)
Succeeded

רשימת כלל העמותות הפעילות, מתעדכן שבועית.


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 08:08:53.497715
Last Completion:
2025-04-27 08:09:56.818099
Last Success:
2025-04-27 08:09:56.818099

Pipeline ID: entities/associations/registrar/registry

entities/companies/registrar/details
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:26:32.607167
Last Completion:
2025-06-16 00:32:37.408813
Last Success:
2025-06-16 00:32:37.408813

Pipeline ID: entities/companies/registrar/details

חברות פעילות מרשם החברות (scraper)
Succeeded

רשימת כלל החברות הפעילות, מתעדכן שבועית.


Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:20.014132
Last Completion:
2025-06-16 00:11:52.223279
Last Success:
2025-06-16 00:11:52.223279

Pipeline ID: entities/companies/registrar/scraper

רשימת אגודות שיתופיות (cooperatives)
Succeeded

רשימת אגודות שיתופיות, מתוך ממשק נתונים של מאגר של משרד הכלכלה / האגף לאיגוד שיתופי, מתעדכן שבועית


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 08:10:16.612259
Last Completion:
2025-04-27 08:16:46.987648
Last Success:
2025-04-27 08:16:46.987648

Pipeline ID: entities/cooperatives/cooperatives

רשימת הקדשים (endowments)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 08:09:59.917274
Last Completion:
2025-04-27 08:10:16.590682
Last Success:
2025-04-27 08:10:16.590682

Pipeline ID: entities/endowments/endowments

entities/entities
Invalid

Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 05:12:56.992364
Last Completion:
2025-06-14 05:47:36.301119
Last Success:
2025-06-14 05:47:36.301119

Invalid dependency :Cannot run until dependency passes validation: ./entities/all
From ./entities/all :['Dependency unsuccessful', 'Cannot run until dependency "./entities/special/registry" is successfully executed']

Pipeline ID: entities/entities

entities/fingerprints
Invalid

Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 04:47:25.508311
Last Completion:
2025-06-14 06:11:32.323709
Last Success:
2025-06-14 06:11:32.323709

Invalid dependency :Cannot run until dependency passes validation: ./entities/all
From ./entities/all :['Dependency unsuccessful', 'Cannot run until dependency "./entities/special/registry" is successfully executed']

Pipeline ID: entities/fingerprints

entities/foi_orgs/foi_orgs
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-11 18:21:18.557684
Last Completion:
2025-05-11 18:22:18.330826
Last Success:
2025-05-11 18:22:18.330826

Pipeline ID: entities/foi_orgs/foi_orgs

entities/moital/moital_service_providers
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-06-14 17:13:12.937714
Last Completion:
2025-06-14 17:13:26.402947
Last Success:
None

scraper
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/entities/moital/scraper.py", line 79, in <module>
    spew(datapackage, [scrape()])
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/entities/moital/scraper.py", line 32, in scrape
    desired_capabilities=DesiredCapabilities.PHANTOMJS)
AttributeError: type object 'DesiredCapabilities' has no attribute 'PHANTOMJS'

Pipeline ID: entities/moital/moital_service_providers

רשימת אגודות עותומניות (ottoman-association-registry)
Succeeded

רשימת אגודות עותומניות, מתוך תשובה לבקשת חופש מידע


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:54:57.689201
Last Completion:
2025-04-27 07:55:17.098502
Last Success:
2025-04-27 07:55:17.098502

Pipeline ID: entities/ottoman/ottoman-association-registry

רשימת שותפויות (partnerships)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:54:28.914835
Last Completion:
2025-04-27 07:55:18.389566
Last Success:
2025-04-27 07:55:18.389566

Pipeline ID: entities/partnerships/partnerships

entities/safety-orders/safety-orders
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:18.614886
Last Completion:
2025-06-16 00:00:38.216612
Last Success:
None

stream_remote_resources
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 174, in _new_conn
    conn = connection.create_connection(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/connection.py", line 72, in create_connection
    for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
  File "/usr/local/lib/python3.9/socket.py", line 954, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -2] Name or service not known
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 714, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 415, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 244, in request
    super(HTTPConnection, self).request(method, url, body=body, headers=headers)
  File "/usr/local/lib/python3.9/http/client.py", line 1285, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/lib/python3.9/http/client.py", line 1331, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.9/http/client.py", line 1280, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.9/http/client.py", line 1040, in _send_output
    self.send(msg)
  File "/usr/local/lib/python3.9/http/client.py", line 980, in send
    self.connect()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 205, in connect
    conn = self._new_conn()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 186, in _new_conn
    raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7fc4797666a0>: Failed to establish a new connection: [Errno -2] Name or service not known
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 486, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 798, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='employment.molsa.gov.il', port=80): Max retries exceeded with url: /Employment/SafetyAndHealth/Enforcement/Documents/%D7%A6%D7%95%D7%95%D7%99%20%D7%91%D7%98%D7%99%D7%97%D7%95%D7%AA.xlsx (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fc4797666a0>: Failed to establish a new connection: [Errno -2] Name or service not known'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 63, in load
    bytes = _RemoteStream(source, self.__http_session, self.__http_timeout).open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 121, in open
    self.seek(0)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 142, in seek
    self.__response = self.__session.get(self.__source, stream=True, timeout=self.__timeout)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 602, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 519, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPConnectionPool(host='employment.molsa.gov.il', port=80): Max retries exceeded with url: /Employment/SafetyAndHealth/Enforcement/Documents/%D7%A6%D7%95%D7%95%D7%99%20%D7%91%D7%98%D7%99%D7%97%D7%95%D7%AA.xlsx (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fc4797666a0>: Failed to establish a new connection: [Errno -2] Name or service not known'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 244, in <module>
    rows = stream_reader(resource, url, ignore_missing or url == "", limit_rows,
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 199, in stream_reader
    schema, headers, columns, stream, close = get_opener(url, _resource)()
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 175, in opener
    _stream.open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/stream.py", line 425, in open
    self.__parser.open(source, encoding=self.__encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/parsers/xlsx.py", line 81, in open
    source_bytes = self.__loader.load(source, mode="b", encoding=encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 72, in load
    raise exceptions.HTTPError(str(exception))
tabulator.exceptions.HTTPError: HTTPConnectionPool(host='employment.molsa.gov.il', port=80): Max retries exceeded with url: /Employment/SafetyAndHealth/Enforcement/Documents/%D7%A6%D7%95%D7%95%D7%99%20%D7%91%D7%98%D7%99%D7%97%D7%95%D7%AA.xlsx (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fc4797666a0>: Failed to establish a new connection: [Errno -2] Name or service not known'))

Pipeline ID: entities/safety-orders/safety-orders

entities/safety-orders/safety-orders-by-entity
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./entities/safety-orders/safety-orders" is successfully executed

Pipeline ID: entities/safety-orders/safety-orders-by-entity

entities/special/registry
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:06.416374
Last Completion:
2025-06-16 00:06:31.921508
Last Success:
2025-06-13 00:13:24.593304

scraper
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/entities/special/scraper.py", line 163, in <module>
    spew(datapackage, itertools.chain(res_iter, [scrape()]))
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/entities/special/scraper.py", line 76, in scrape
    prepare()
  File "/datapackage_pipelines_budgetkey/pipelines/entities/special/scraper.py", line 60, in prepare
    driver.get("https://www.misim.gov.il/mm_lelorasham/firstPage.aspx")
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 442, in get
    self.execute(Command.GET, {'url': url})
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 430, in execute
    self.error_handler.check_response(response)
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/remote/errorhandler.py", line 247, in check_response
    raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message: timeout: Timed out receiving message from renderer: 300.000
  (Session info: chrome=88.0.4324.96)
Stacktrace:
#0 0x6393e4a23199 <unknown>
DEBUG   :[chan 1] Max packet in: 32768 bytes
DEBUG   :[chan 1] Max packet out: 32768 bytes
DEBUG   :Secsh channel 1 opened.
DEBUG   :[chan 1] Sesch channel 1 request ok
DEBUG   :[chan 1] EOF received (1)
DEBUG   :[chan 1] EOF sent (1)
DEBUG   :Dropping user packet because connection is dead.

Pipeline ID: entities/special/registry

ezvonot/ezvonot_accounts
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:04:01.131902
Last Completion:
2025-06-16 00:04:27.323438
Last Success:
2025-06-16 00:04:27.323438

Pipeline ID: ezvonot/ezvonot_accounts

ezvonot/ezvonot_cases
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:04:27.334585
Last Completion:
2025-06-16 00:04:45.823162
Last Success:
2025-06-16 00:04:45.823162

Pipeline ID: ezvonot/ezvonot_cases

ezvonot/ezvonot_crontab
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:07.638994
Last Completion:
2025-06-16 00:00:09.914244
Last Success:
2025-06-16 00:00:09.914244

Pipeline ID: ezvonot/ezvonot_crontab

ezvonot/ezvonot_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:05:05.609144
Last Completion:
2025-06-16 00:05:37.721863
Last Success:
2025-06-16 00:05:37.721863

Pipeline ID: ezvonot/ezvonot_decisions

ezvonot/ezvonot_decisions_join
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:14:01.628202
Last Completion:
2025-06-16 00:14:54.926080
Last Success:
2025-06-16 00:14:54.926080

Pipeline ID: ezvonot/ezvonot_decisions_join

ezvonot/ezvonot_deposits
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:03:32.115403
Last Completion:
2025-06-16 00:04:01.123851
Last Success:
2025-06-16 00:04:01.123851

Pipeline ID: ezvonot/ezvonot_deposits

ezvonot/ezvonot_purposes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:04:45.832170
Last Completion:
2025-06-16 00:05:05.524400
Last Success:
2025-06-16 00:05:05.524400

Pipeline ID: ezvonot/ezvonot_purposes

facilities/all/facilities_all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:12:56.123895
Last Completion:
2025-06-16 00:16:42.411760
Last Success:
2025-06-16 00:16:42.411760

Pipeline ID: facilities/all/facilities_all

facilities/education/facilities_education
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:04.564021
Last Completion:
2025-06-16 00:00:15.930623
Last Success:
2025-06-16 00:00:15.930623

Pipeline ID: facilities/education/facilities_education

facilities/labor/facilities_labor
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:03:13.047337
Last Completion:
2025-06-16 00:03:32.051043
Last Success:
2025-06-16 00:03:32.051043

Pipeline ID: facilities/labor/facilities_labor

facilities/welfare/facilities_welfare
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:11.707130
Last Completion:
2025-06-16 00:00:24.571514
Last Success:
2025-06-16 00:00:24.571514

Pipeline ID: facilities/welfare/facilities_welfare

government_decisions/government_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 12:15:36.715104
Last Completion:
2025-06-16 12:15:53.237152
Last Success:
2025-06-16 12:15:53.237152

Pipeline ID: government_decisions/government_decisions

government_decisions/scraper
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 12:00:01.916671
Last Completion:
2025-06-16 12:15:36.649277
Last Success:
2025-06-16 12:15:36.649277

Pipeline ID: government_decisions/scraper

lamas/municipal-data
Invalid

Last Run triggered by:
scheduled
Last Run started at:
2025-06-13 01:05:30.289945
Last Completion:
2025-06-13 01:07:26.489874
Last Success:
2025-06-13 01:07:26.489874

Dependency unsuccessful :Cannot run until dependency "./entities/special/registry" is successfully executed

Pipeline ID: lamas/municipal-data

קובץ התאמת רשויות אזוריות לישובים בשטחן (municipality-to-city)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:43:50.134018
Last Completion:
2025-04-27 07:43:53.274072
Last Success:
2025-04-27 07:43:53.274072

Pipeline ID: lamas/municipality-to-city

maya/maya-bonds-and-options-holdings-changes
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-11 18:22:38.534868
Last Completion:
2025-05-11 18:22:45.441201
Last Success:
2025-04-27 18:55:31.211106

Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list
From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']

Pipeline ID: maya/maya-bonds-and-options-holdings-changes

maya/maya-company-director-appointments
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-11 18:22:33.427857
Last Completion:
2025-05-11 18:22:38.530556
Last Success:
2025-04-27 18:54:22.418846

Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list
From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']

Pipeline ID: maya/maya-company-director-appointments

maya/maya-company-officer-list
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-11 18:22:22.629064
Last Completion:
2025-05-11 18:22:27.411203
Last Success:
2025-04-27 18:48:12.550875

Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list
From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']

Pipeline ID: maya/maya-company-officer-list

maya/maya-company-stakeholder-list
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-11 18:22:45.510532
Last Completion:
2025-05-11 18:22:53.732998
Last Success:
2025-04-27 19:11:08.356668

Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list
From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']

Pipeline ID: maya/maya-company-stakeholder-list

maya/maya-company-vip-appointments
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-11 18:22:27.414398
Last Completion:
2025-05-11 18:22:33.424153
Last Success:
2025-04-27 18:47:49.948280

Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list
From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']

Pipeline ID: maya/maya-company-vip-appointments

maya/maya-complete-notification-list
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 17:46:37.626777
Last Completion:
2025-04-27 18:33:14.771345
Last Success:
2025-04-27 18:33:14.771345

Dependency unsuccessful :Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed

Pipeline ID: maya/maya-complete-notification-list

maya/maya-holdings-changes
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-11 18:22:41.752626
Last Completion:
2025-05-11 18:22:49.244447
Last Success:
2025-04-27 18:58:34.823821

Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list
From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']

Pipeline ID: maya/maya-holdings-changes

maya/maya-notification-parse-updates
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-06-14 17:13:28.416241
Last Completion:
2025-06-14 17:13:55.405069
Last Success:
None

flow
ERROR   :Traceback (most recent call last):
ERROR   :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
ERROR   :spew_flow(flow, ctx)
ERROR   :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
ERROR   :spew(self.datapackage, self.resource_iterator, stats=self.stats)
ERROR   :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
ERROR   :for rec in res:
ERROR   :File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource
ERROR   :yield from self.func(resource)
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_notification_parse_updates.py", line 91, in parse_notification
ERROR   :for row in rows:
ERROR   :File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource
ERROR   :yield from self.func(resource)
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_notification_parse_updates.py", line 66, in store_on_s3
ERROR   :for row in rows:
ERROR   :File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource
ERROR   :yield from self.func(resource)
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_notification_parse_updates.py", line 111, in limiter
ERROR   :for row in rows:
ERROR   :File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource
ERROR   :yield from self.func(resource)
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_notification_parse_updates.py", line 101, in remove_already_parsed
ERROR   :all_existing_ids = get_all_existing_ids()
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_notification_parse_updates.py", line 32, in get_all_existing_ids
ERROR   :rows = engine.execute(text("SELECT s3_object_name FROM maya_notifications where parser_version=:v"), v=PARSER_VERSION)
ERROR   :TypeError
ERROR   ::
ERROR   :execute() got an unexpected keyword argument 'v'

Pipeline ID: maya/maya-notification-parse-updates

maya/maya-reported-academic-degrees
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-11 18:22:49.313004
Last Completion:
2025-05-11 18:22:54.235844
Last Success:
2025-04-27 19:05:03.010847

Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list
From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']

Pipeline ID: maya/maya-reported-academic-degrees

maya/maya-reported-work-record
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-11 18:22:53.737915
Last Completion:
2025-05-11 18:22:59.228838
Last Success:
2025-04-27 19:05:58.191031

Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list
From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']

Pipeline ID: maya/maya-reported-work-record

maya/maya-tase-companies-current-management
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./maya/scrape-maya-tase-companies" is successfully executed

Pipeline ID: maya/maya-tase-companies-current-management

maya/maya-tase-companies-current-shareholders
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./maya/scrape-maya-tase-companies" is successfully executed

Pipeline ID: maya/maya-tase-companies-current-shareholders

maya/scrape-maya-notification-list
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 08:12:15.091545
Last Completion:
2025-04-27 10:11:54.691823
Last Success:
2025-04-27 10:11:54.691823

Pipeline ID: maya/scrape-maya-notification-list

maya/scrape-maya-tase-companies
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-06-14 17:13:28.798709
Last Completion:
2025-06-14 17:13:53.289453
Last Success:
None

dump_to_path
ERROR   :Data Package validation error: Descriptor validation error: [] is too short at "schema/fields" in descriptor and at "properties/schema/properties/fields/minItems" in profile
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/dump_to_path.py", line 22, in <module>
    with ingest() as ctx:
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 186, in ingest
    params, datapackage, resource_iterator = _ingest(debug=debug)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 44, in _ingest
    datapackage, resource_iterator, dependency_dp = process_input(sys.stdin, validate, debug)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/input_processor.py", line 88, in process_input
    datapackage.validate(dp_to_validate)
  File "/usr/local/lib/python3.9/site-packages/datapackage/validate.py", line 28, in validate
    Package(descriptor, strict=True)
  File "/usr/local/lib/python3.9/site-packages/datapackage/package.py", line 126, in __init__
    self.__build()
  File "/usr/local/lib/python3.9/site-packages/datapackage/package.py", line 534, in __build
    updated_resource = Resource(descriptor,
  File "/usr/local/lib/python3.9/site-packages/datapackage/resource.py", line 90, in __init__
    self.__build()
  File "/usr/local/lib/python3.9/site-packages/datapackage/resource.py", line 648, in __build
    raise exception
  File "/usr/local/lib/python3.9/site-packages/datapackage/resource.py", line 643, in __build
    self.__profile.validate(self.__current_descriptor)
  File "/usr/local/lib/python3.9/site-packages/datapackage/profile.py", line 89, in validate
    raise exceptions.ValidationError(message, errors=errors)
datapackage.exceptions.ValidationError: There are 1 validation errors (see exception.errors)

Pipeline ID: maya/scrape-maya-tase-companies

people/aggregated
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/all
From ./people/all :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']
From ./people/all :['From ./people/company_appointments/all-appointments', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]
From ./people/all :['Dependency unsuccessful', 'Cannot run until dependency "./people/procurement/procurement-individuals" is successfully executed']
From ./people/all :['Dependency unsuccessful', 'Cannot run until dependency "./people/political_candidates/election_candidates21" is successfully executed']

Pipeline ID: people/aggregated

people/all
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/all-appointments
From ./people/company_appointments/all-appointments :['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed']
From ./people/company_appointments/all-appointments :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]
From ./people/company_appointments/all-appointments :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]
Dependency unsuccessful :Cannot run until dependency "./people/political_candidates/election_candidates21" is successfully executed

Pipeline ID: people/all

people/association_founders/association-founders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-31 06:28:25.693702
Last Completion:
2025-05-31 06:29:06.696125
Last Success:
2025-05-31 06:29:06.696125

Pipeline ID: people/association_founders/association-founders

people/company_appointments/all-appointments
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed
Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations
From ./people/company_appointments/maya/maya-nominations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]
Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations
From ./people/company_appointments/maya/maya-resignations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]

Pipeline ID: people/company_appointments/all-appointments

people/company_appointments/maya/collect-maya-forms-debug-stats
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed

Pipeline ID: people/company_appointments/maya/collect-maya-forms-debug-stats

Join the parsed PDF to get start and end time for each person (correlate)
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations
From ./people/company_appointments/maya/maya-nominations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]
Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations
From ./people/company_appointments/maya/maya-resignations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]

Pipeline ID: people/company_appointments/maya/correlate

people/company_appointments/maya/maya-list
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates
From ./people/company_appointments/maya/maya-notification-updates :['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']

Pipeline ID: people/company_appointments/maya/maya-list

Appointment notices from Maya (maya-nominations)
Invalid

Name, job and company description.


Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list
From ./people/company_appointments/maya/maya-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']
From ./people/company_appointments/maya/maya-list :['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]

Pipeline ID: people/company_appointments/maya/maya-nominations

people/company_appointments/maya/maya-notification-list
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:15.951771
Last Completion:
2025-06-16 00:00:18.607460
Last Success:
None

scrape-notification-list
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 971, in json
    return complexjson.loads(self.text, **kwargs)
  File "/usr/local/lib/python3.9/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "/usr/local/lib/python3.9/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/local/lib/python3.9/json/decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 55, in _maya_api_call
    return res.json()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 975, in json
    raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 130, in <module>
    spew(datapackage, [collect()])
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 113, in collect
    yield from _collect_date_range(year_start, year_end)
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 75, in _collect_date_range
    res = _maya_api_call(date_from, date_to, current_page)
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 57, in _maya_api_call
    raise Exception("Failed to Call Maya API for date_from:{} date_to:{} page_num:{}".format(date_from, date_to, page_num)) from e
Exception: Failed to Call Maya API for date_from:2006-01-01 date_to:2007-01-01 page_num:0

Pipeline ID: people/company_appointments/maya/maya-notification-list

List all notifications from maya system (maya-notification-updates)
Invalid

id, date, company, notification_type, s3_object_name, url


Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed

Pipeline ID: people/company_appointments/maya/maya-notification-updates

Appointment notices from Maya (maya-resignations)
Invalid

Name, job and company description.


Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list
From ./people/company_appointments/maya/maya-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']
From ./people/company_appointments/maya/maya-list :['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]

Pipeline ID: people/company_appointments/maya/maya-resignations

מינויים בכלכליסט (calcalist)
Succeeded

רשימת כל המינויים והחברות מאתר כלכליסט


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:51:54.887624
Last Completion:
2025-04-27 07:52:00.218817
Last Success:
2025-04-27 07:52:00.218817

Pipeline ID: people/company_appointments/media/calcalist/calcalist

Appointment notices from TheMarker (themarker)
Failed

Name, job and company description.


Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:26.862985
Last Completion:
2025-06-16 00:00:46.019345
Last Success:
None

stream_remote_resources
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 63, in load
    bytes = _RemoteStream(source, self.__http_session, self.__http_timeout).open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 121, in open
    self.seek(0)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 143, in seek
    self.__response.raise_for_status()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.themarker.com/st/inter/DB/tm/2015/minuyim30.xlsx
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 244, in <module>
    rows = stream_reader(resource, url, ignore_missing or url == "", limit_rows,
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 199, in stream_reader
    schema, headers, columns, stream, close = get_opener(url, _resource)()
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 175, in opener
    _stream.open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/stream.py", line 425, in open
    self.__parser.open(source, encoding=self.__encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/parsers/xlsx.py", line 81, in open
    source_bytes = self.__loader.load(source, mode="b", encoding=encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 72, in load
    raise exceptions.HTTPError(str(exception))
tabulator.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.themarker.com/st/inter/DB/tm/2015/minuyim30.xlsx

Pipeline ID: people/company_appointments/media/themarker/themarker

Join the parsed PDF to get start and end time for each person (correlate)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:14:54.932648
Last Completion:
2025-06-16 00:15:00.740383
Last Success:
2025-06-16 00:15:00.740383

Pipeline ID: people/company_appointments/state_owned/correlate

Parse and concatenate all PDF reports (parse_pdf_resources)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:05:37.730647
Last Completion:
2025-06-16 00:05:42.423083
Last Success:
2025-06-16 00:05:42.423083

Pipeline ID: people/company_appointments/state_owned/parse_pdf_resources

collect links to all pdf reports on https://mof.gov.il/GCA/Directors/Pages/DirectorsManningReport.aspx (reports)
Succeeded

columns: date, url


Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:12.330251
Last Completion:
2025-06-16 00:00:19.909363
Last Success:
2025-06-16 00:00:19.909363

Pipeline ID: people/company_appointments/state_owned/reports

people/company_appointments/state_owned/state-owned-nominations
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-06-16 00:27:27.821127
Last Completion:
2025-06-16 00:27:35.816154
Last Success:
2025-06-16 00:27:35.816154

Pipeline ID: people/company_appointments/state_owned/state-owned-nominations

people/municipal_appointments/municipal_representitives
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:51:48.927647
Last Completion:
2025-04-27 07:51:54.799172
Last Success:
2025-04-27 07:51:54.799172

Pipeline ID: people/municipal_appointments/municipal_representitives

people/political_candidates/election_candidates21
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-06-14 17:13:26.496941
Last Completion:
2025-06-14 17:13:36.452361
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
    self.datapackage = self.process_datapackage(self.datapackage)
  File "/usr/local/lib/python3.9/site-packages/dataflows/processors/set_type.py", line 71, in process_datapackage
    assert added, 'Failed to find field {} in schema'.format(self.name)
AssertionError: Failed to find field re.compile('^party_letter$') in schema
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
    spew_flow(flow, ctx)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
    datastream = flow.datastream()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/flow.py", line 19, in datastream
    return self._chain(ds)._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  [Previous line repeated 4 more times]
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
    self.raise_exception(exception)
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
    raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor set_type in position #3: Failed to find field re.compile('^party_letter$') in schema

Pipeline ID: people/political_candidates/election_candidates21

people/political_donations/political_donations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-11 14:52:30.138930
Last Completion:
2025-05-11 14:52:33.417812
Last Success:
2025-05-11 14:52:33.417812

Pipeline ID: people/political_donations/political_donations

people/procurement/procurement-individuals
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 12:27:02.951089
Last Completion:
2025-06-16 12:35:17.442153
Last Success:
2025-06-16 12:35:17.442153

Pipeline ID: people/procurement/procurement-individuals

procurement/calls_for_bids/calls-for-bids-all
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-calls-for-bids
From ./procurement/calls_for_bids/jobiz-calls-for-bids :['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-all']
From ./procurement/calls_for_bids/jobiz-calls-for-bids :['From ./procurement/calls_for_bids/jobiz-all', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed']]

Pipeline ID: procurement/calls_for_bids/calls-for-bids-all

procurement/calls_for_bids/calls-for-bids-moh
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:01:14.215051
Last Completion:
2025-06-16 00:01:18.553140
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
    self.datapackage = self.process_datapackage(self.datapackage)
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 112, in process_datapackage
    raise self.exc
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 60, in describe
    sample = list(itertools.islice(self.iterable, self.SAMPLE_SIZE))
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 89, in handle_iterable
    for x in self.iterable:
  File "/datapackage_pipelines_budgetkey/pipelines/procurement/calls_for_bids/m_tmicha.py", line 47, in m_tmicha_scraper
    assert total > 0
AssertionError
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
    spew_flow(flow, ctx)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
    datastream = flow.datastream()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/flow.py", line 19, in datastream
    return self._chain(ds)._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
    self.raise_exception(exception)
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
    raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor iterable_loader in position #1:

Pipeline ID: procurement/calls_for_bids/calls-for-bids-moh

procurement/calls_for_bids/gov-publications
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:22.613057
Last Completion:
2025-04-27 07:43:45.834310
Last Success:
2025-04-27 07:43:45.834310

Pipeline ID: procurement/calls_for_bids/gov-publications

procurement/calls_for_bids/gov-publications-ministry-of-immigration
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:22.619334
Last Completion:
2025-04-27 07:42:34.995234
Last Success:
2025-04-27 07:42:34.995234

Pipeline ID: procurement/calls_for_bids/gov-publications-ministry-of-immigration

procurement/calls_for_bids/gov-publications2
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:22.687912
Last Completion:
2025-04-27 07:42:52.511945
Last Success:
2025-04-27 07:42:52.511945

Pipeline ID: procurement/calls_for_bids/gov-publications2

procurement/calls_for_bids/jobiz-all
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed

Pipeline ID: procurement/calls_for_bids/jobiz-all

procurement/calls_for_bids/jobiz-calls-for-bids
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-all
From ./procurement/calls_for_bids/jobiz-all :['Dependency unsuccessful', 'Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed']

Pipeline ID: procurement/calls_for_bids/jobiz-calls-for-bids

procurement/calls_for_bids/jobiz-scraper
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 15:00:01.707370
Last Completion:
2025-06-16 15:00:05.073171
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 174, in _new_conn
    conn = connection.create_connection(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/connection.py", line 72, in create_connection
    for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
  File "/usr/local/lib/python3.9/socket.py", line 954, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -5] No address associated with hostname
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 714, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 403, in _make_request
    self._validate_conn(conn)
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1053, in _validate_conn
    conn.connect()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 363, in connect
    self.sock = conn = self._new_conn()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 186, in _new_conn
    raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPSConnection object at 0x7fac6d9036a0>: Failed to establish a new connection: [Errno -5] No address associated with hostname
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 486, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 798, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='jobiz.gov.il', port=443): Max retries exceeded with url: /ajax/results/%D7%94%D7%95%D7%93%D7%A2%D7%94%20%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA/0?ie=0&typeie=%D7%94%D7%95%D7%93%D7%A2%D7%94+%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA&search=Array (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fac6d9036a0>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
    self.datapackage = self.process_datapackage(self.datapackage)
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 112, in process_datapackage
    raise self.exc
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 60, in describe
    sample = list(itertools.islice(self.iterable, self.SAMPLE_SIZE))
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 89, in handle_iterable
    for x in self.iterable:
  File "/datapackage_pipelines_budgetkey/pipelines/procurement/calls_for_bids/jobiz.py", line 19, in fetch_results
    content = requests.get(URL.format(index)).json()
  File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 73, in get
    return request("get", url, params=params, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 59, in request
    return session.request(method=method, url=url, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 519, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='jobiz.gov.il', port=443): Max retries exceeded with url: /ajax/results/%D7%94%D7%95%D7%93%D7%A2%D7%94%20%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA/0?ie=0&typeie=%D7%94%D7%95%D7%93%D7%A2%D7%94+%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA&search=Array (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fac6d9036a0>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
    spew_flow(flow, ctx)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
    datastream = flow.datastream()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/flow.py", line 19, in datastream
    return self._chain(ds)._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  [Previous line repeated 5 more times]
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
    self.raise_exception(exception)
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
    raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor iterable_loader in position #1: HTTPSConnectionPool(host='jobiz.gov.il', port=443): Max retries exceeded with url: /ajax/results/%D7%94%D7%95%D7%93%D7%A2%D7%94%20%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA/0?ie=0&typeie=%D7%94%D7%95%D7%93%D7%A2%D7%94+%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA&search=Array (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fac6d9036a0>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))

Pipeline ID: procurement/calls_for_bids/jobiz-scraper

procurement/municipal/fetcher
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:01:26.231732
Last Completion:
2025-06-16 00:01:38.339708
Last Success:
2025-06-16 00:01:38.339708

Pipeline ID: procurement/municipal/fetcher

התקשרויות רכש ממשלתיות (latest-contract-spending)
Succeeded

אנו סוכמים מידע מתוך הדוחות הרבעוניים לתוך טבלה המכילה את המידע העדכני ביותר.


Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 10:11:28.315195
Last Completion:
2025-06-16 12:27:02.612888
Last Success:
2025-06-16 12:27:02.612888

Pipeline ID: procurement/spending/latest-contract-spending

procurement/spending/quarterly-contract-spending-report-uris
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 06:00:01.817709
Last Completion:
2025-06-16 06:00:27.456725
Last Success:
2025-06-16 06:00:27.456725

Pipeline ID: procurement/spending/quarterly-contract-spending-report-uris

דוחות רבעוניים מתוך מרכבה, לפי נוהל היחידה לחופש המידע. (quarterly-contract-spending-reports)
Succeeded

כל משרדי הממשלה ויחידות הסמך (שמחוברות למערכת מרכבה) צריכים לפרסם אחת לרבעון (תוך 45 יום מסוף הרבעון) דו״ח התקשרויות לפי פורמט מוגדר היטב הממומש כדו״ח מובנה במערכת המרכבה. כל המשרדים מדווחים עצמאית והדו״חות עולים לאתר היחידה לחופש המידע, משם אנו אוספים אותם. התוצר של השרשר הזה הוא פירוט כל הדיווחים של כל המשרדים.


Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 06:00:27.606134
Last Completion:
2025-06-16 09:25:33.920118
Last Success:
2025-06-16 09:25:33.920118

Pipeline ID: procurement/spending/quarterly-contract-spending-reports

procurement/spending/quarterly-contract-spending-reports-data
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 09:25:34.188542
Last Completion:
2025-06-16 10:11:27.918633
Last Success:
2025-06-16 10:11:27.918633

Pipeline ID: procurement/spending/quarterly-contract-spending-reports-data

procurement/spending/spending-by-entity
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 12:27:02.938764
Last Completion:
2025-06-16 12:35:20.456720
Last Success:
2025-06-16 12:35:20.456720

Pipeline ID: procurement/spending/spending-by-entity

Load all tenders data from data.gov.il/procurement agency to a flat file (all)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:01:43.531199
Last Completion:
2025-06-16 00:09:36.625849
Last Success:
2025-06-16 00:09:36.625849

Pipeline ID: procurement/tenders/all

procurement/tenders/processed
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:15:00.826585
Last Completion:
2025-06-16 00:34:48.420438
Last Success:
2025-06-16 00:34:48.420438

Pipeline ID: procurement/tenders/processed

reports/all
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-05-31 06:31:22.395485
Last Completion:
2025-05-31 06:31:37.205315
Last Success:
2025-05-31 06:31:37.205315

Pipeline ID: reports/all

reports/ngos/ngo-activity-report
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-31 06:25:09.413039
Last Completion:
2025-05-31 06:30:07.884146
Last Success:
2025-05-31 06:30:07.884146

Pipeline ID: reports/ngos/ngo-activity-report

reports/ngos/ngo-district-report
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-31 06:25:09.401746
Last Completion:
2025-05-31 06:28:25.624432
Last Success:
2025-05-31 06:28:25.624432

Pipeline ID: reports/ngos/ngo-district-report

simpledb/process_simple_dbs
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 12:07:29.307652
Last Completion:
2025-06-14 13:45:35.615136
Last Success:
2025-06-14 13:45:35.615136

Pipeline ID: simpledb/process_simple_dbs

supports/all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-15 22:11:33.566660
Last Completion:
2025-06-15 22:15:39.951720
Last Success:
2025-06-15 22:15:39.951720

Pipeline ID: supports/all

supports/by-payment-year
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:27:35.827881
Last Completion:
2025-06-16 00:39:58.746661
Last Success:
2025-06-16 00:39:58.746661

Pipeline ID: supports/by-payment-year

supports/by-request-year
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:32:37.427834
Last Completion:
2025-06-16 01:02:19.119900
Last Success:
2025-06-16 01:02:19.119900

Pipeline ID: supports/by-request-year

supports/criteria/support-criteria
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:12:23.830216
Last Completion:
2025-06-16 00:12:28.723553
Last Success:
None

sample
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/processors/sample.py", line 11, in <module>
    res_name = parameters.get('resource', datapackage['resources'][0]['name'])
IndexError: list index out of range

Pipeline ID: supports/criteria/support-criteria

supports/criteria/support-criteria-doj
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:01:38.408609
Last Completion:
2025-06-16 00:01:43.510703
Last Success:
2025-06-16 00:01:43.510703

Pipeline ID: supports/criteria/support-criteria-doj

supports/supports-2004
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:35.027140
Last Completion:
2025-04-27 07:42:36.769997
Last Success:
2025-04-27 07:42:36.769997

Pipeline ID: supports/supports-2004

supports/supports-2005
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:36.774459
Last Completion:
2025-04-27 07:42:37.944570
Last Success:
2025-04-27 07:42:37.944570

Pipeline ID: supports/supports-2005

supports/supports-2006
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:37.947887
Last Completion:
2025-04-27 07:42:39.272643
Last Success:
2025-04-27 07:42:39.272643

Pipeline ID: supports/supports-2006

supports/supports-2007
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:39.276258
Last Completion:
2025-04-27 07:42:40.674592
Last Success:
2025-04-27 07:42:40.674592

Pipeline ID: supports/supports-2007

supports/supports-2008
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:40.678237
Last Completion:
2025-04-27 07:42:42.147887
Last Success:
2025-04-27 07:42:42.147887

Pipeline ID: supports/supports-2008

supports/supports-2009
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:40.794441
Last Completion:
2025-04-27 07:42:42.174578
Last Success:
2025-04-27 07:42:42.174578

Pipeline ID: supports/supports-2009

supports/supports-2010
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:42.150961
Last Completion:
2025-04-27 07:42:43.401282
Last Success:
2025-04-27 07:42:43.401282

Pipeline ID: supports/supports-2010

supports/supports-2011
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:42.178775
Last Completion:
2025-04-27 07:42:43.366890
Last Success:
2025-04-27 07:42:43.366890

Pipeline ID: supports/supports-2011

supports/supports-2012
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:43.369795
Last Completion:
2025-04-27 07:42:44.809607
Last Success:
2025-04-27 07:42:44.809607

Pipeline ID: supports/supports-2012

supports/supports-2013
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:43.404371
Last Completion:
2025-04-27 07:42:44.813024
Last Success:
2025-04-27 07:42:44.813024

Pipeline ID: supports/supports-2013

supports/supports-2014
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:44.813457
Last Completion:
2025-04-27 07:42:46.121643
Last Success:
2025-04-27 07:42:46.121643

Pipeline ID: supports/supports-2014

supports/supports-2015
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:44.815917
Last Completion:
2025-04-27 07:42:46.060798
Last Success:
2025-04-27 07:42:46.060798

Pipeline ID: supports/supports-2015

supports/supports-2016
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:46.064375
Last Completion:
2025-04-27 07:42:47.462899
Last Success:
2025-04-27 07:42:47.462899

Pipeline ID: supports/supports-2016

supports/supports-2017
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:46.125641
Last Completion:
2025-04-27 07:42:47.424521
Last Success:
2025-04-27 07:42:47.424521

Pipeline ID: supports/supports-2017

supports/supports-2018
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:47.436082
Last Completion:
2025-04-27 07:42:48.833932
Last Success:
2025-04-27 07:42:48.833932

Pipeline ID: supports/supports-2018

supports/supports-2019
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:47.466944
Last Completion:
2025-04-27 07:42:48.803936
Last Success:
2025-04-27 07:42:48.803936

Pipeline ID: supports/supports-2019

supports/supports-2020
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:48.809601
Last Completion:
2025-04-27 07:42:50.224309
Last Success:
2025-04-27 07:42:50.224309

Pipeline ID: supports/supports-2020

supports/supports-2021
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:48.837287
Last Completion:
2025-04-27 07:42:50.256060
Last Success:
2025-04-27 07:42:50.256060

Pipeline ID: supports/supports-2021

supports/supports-2022
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:50.227848
Last Completion:
2025-04-27 07:42:51.508275
Last Success:
2025-04-27 07:42:51.508275

Pipeline ID: supports/supports-2022

supports/supports-2023
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-06-15 20:00:04.135594
Last Completion:
2025-06-15 20:10:30.756397
Last Success:
2025-06-13 22:02:11.102059

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
DEBUG   :Dropping user packet because connection is dead.
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
    DF.load(wrapper(year), format='csv',
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
    return scraper(gcd, year)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
    chart = get_chart(driver)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 34, in get_chart
    chart = WebDriverWait(driver, 60).until(
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
    raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x56e3b4788199 <unknown>
WARNING :FAILED to teardown google-chrome

Pipeline ID: supports/supports-2023

supports/supports-2024
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-15 21:00:01.901223
Last Completion:
2025-06-15 21:12:03.490999
Last Success:
2025-06-15 21:12:03.490999

Pipeline ID: supports/supports-2024

supports/supports-2025
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-15 22:00:01.681786
Last Completion:
2025-06-15 22:11:33.459743
Last Success:
2025-06-15 22:11:33.459743

Pipeline ID: supports/supports-2025

supports/supports-by-entity
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:34:43.215951
Last Completion:
2025-06-16 00:38:38.616395
Last Success:
2025-06-16 00:38:38.616395

Pipeline ID: supports/supports-by-entity

supports/with-entities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:09.449711
Last Completion:
2025-06-16 00:27:27.632233
Last Success:
2025-06-16 00:27:27.632233

Pipeline ID: supports/with-entities

units/social_services/social_services
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:01:18.558679
Last Completion:
2025-06-16 00:01:26.223910
Last Success:
2025-06-16 00:01:26.223910

Pipeline ID: units/social_services/social_services

Changes, grouped by transaction_id, with explanations (national-budget-changes-aggregated)
Invalid

Last Run triggered by:
scheduled
Last Run started at:
2025-06-12 13:08:22.004145
Last Completion:
2025-06-12 14:43:44.102862
Last Success:
2025-06-12 00:33:06.298393

Dependency unsuccessful :Cannot run until dependency "./budget/national/changes/explanations/all" is successfully executed

Pipeline ID: budget/national/changes/processed/national-budget-changes-aggregated

budgetkey/elasticsearch/index_calls_for_bids
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./procurement/calls_for_bids/calls-for-bids-all
From ./procurement/calls_for_bids/calls-for-bids-all :['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-calls-for-bids']
From ./procurement/calls_for_bids/calls-for-bids-all :['From ./procurement/calls_for_bids/jobiz-calls-for-bids', ['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-all']]
From ./procurement/calls_for_bids/calls-for-bids-all :['From ./procurement/calls_for_bids/jobiz-calls-for-bids', ['From ./procurement/calls_for_bids/jobiz-all', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed']]]

Pipeline ID: budgetkey/elasticsearch/index_calls_for_bids

budgetkey/elasticsearch/index_entities
Invalid

Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 08:08:34.003114
Last Completion:
2025-06-14 11:06:58.913444
Last Success:
2025-06-14 11:06:58.913444

Invalid dependency :Cannot run until dependency passes validation: ./entities/entities
From ./entities/entities :['Dependency unsuccessful', 'Cannot run until dependency "./procurement/spending/spending-by-entity" is successfully executed']
From ./entities/entities :['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/all']
From ./entities/entities :['From ./entities/all', ['Dependency unsuccessful', 'Cannot run until dependency "./entities/special/registry" is successfully executed']]

Pipeline ID: budgetkey/elasticsearch/index_entities

budgetkey/elasticsearch/index_national_budget_changes
Invalid

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-06-12 01:04:12.389366
Last Completion:
2025-06-12 01:14:18.205917
Last Success:
2025-06-12 01:14:18.205917

Invalid dependency :Cannot run until dependency passes validation: ./budget/national/changes/processed/national-budget-changes-aggregated
From ./budget/national/changes/processed/national-budget-changes-aggregated :['Dependency unsuccessful', 'Cannot run until dependency "./budget/national/changes/explanations/all" is successfully executed']
From ./budget/national/changes/processed/national-budget-changes-aggregated :['Invalid dependency', 'Cannot run until dependency passes validation: ./budget/national/changes/processed/transactions']
From ./budget/national/changes/processed/national-budget-changes-aggregated :['From ./budget/national/changes/processed/transactions', ['Dependency unsuccessful', 'Cannot run until dependency "./budget/national/changes/original/national-budget-changes" is successfully executed']]

Pipeline ID: budgetkey/elasticsearch/index_national_budget_changes

budgetkey/elasticsearch/index_people
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/aggregated
From ./people/aggregated :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/all']
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['Dependency unsuccessful', 'Cannot run until dependency "./people/procurement/procurement-individuals" is successfully executed']]
From ./people/aggregated :['From ./people/all', ['Dependency unsuccessful', 'Cannot run until dependency "./people/political_candidates/election_candidates21" is successfully executed']]

Pipeline ID: budgetkey/elasticsearch/index_people

budgetkey/elasticsearch/index_support_criteria
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./supports/criteria/support-criteria" is successfully executed

Pipeline ID: budgetkey/elasticsearch/index_support_criteria

budgetkey/elasticsearch/sitemaps
Invalid

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-06-14 14:46:02.891209
Last Completion:
2025-06-14 15:38:26.314180
Last Success:
2025-06-14 15:38:26.314180

Invalid dependency :Cannot run until dependency passes validation: ./budgetkey/elasticsearch/index_national_budget_changes
From ./budgetkey/elasticsearch/index_national_budget_changes :['Invalid dependency', 'Cannot run until dependency passes validation: ./budget/national/changes/processed/national-budget-changes-aggregated']
From ./budgetkey/elasticsearch/index_national_budget_changes :['From ./budget/national/changes/processed/national-budget-changes-aggregated', ['Dependency unsuccessful', 'Cannot run until dependency "./budget/national/changes/explanations/all" is successfully executed']]
From ./budgetkey/elasticsearch/index_national_budget_changes :['From ./budget/national/changes/processed/national-budget-changes-aggregated', ['Invalid dependency', 'Cannot run until dependency passes validation: ./budget/national/changes/processed/transactions']]
From ./budgetkey/elasticsearch/index_national_budget_changes :['From ./budget/national/changes/processed/national-budget-changes-aggregated', ['From ./budget/national/changes/processed/transactions', ['Dependency unsuccessful', 'Cannot run until dependency "./budget/national/changes/original/national-budget-changes" is successfully executed']]]
Invalid dependency :Cannot run until dependency passes validation: ./budgetkey/elasticsearch/index_entities
From ./budgetkey/elasticsearch/index_entities :['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/entities']
From ./budgetkey/elasticsearch/index_entities :['From ./entities/entities', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/spending/spending-by-entity" is successfully executed']]
From ./budgetkey/elasticsearch/index_entities :['From ./entities/entities', ['Invalid dependency', 'Cannot run until dependency passes validation: ./entities/all']]
From ./budgetkey/elasticsearch/index_entities :['From ./entities/entities', ['From ./entities/all', ['Dependency unsuccessful', 'Cannot run until dependency "./entities/special/registry" is successfully executed']]]

Pipeline ID: budgetkey/elasticsearch/sitemaps

entities/all
Invalid

Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 00:00:25.493261
Last Completion:
2025-06-14 00:28:37.395533
Last Success:
2025-06-14 00:28:37.395533

Dependency unsuccessful :Cannot run until dependency "./entities/special/registry" is successfully executed

Pipeline ID: entities/all

entities/entities
Invalid

Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 05:12:56.992364
Last Completion:
2025-06-14 05:47:36.301119
Last Success:
2025-06-14 05:47:36.301119

Invalid dependency :Cannot run until dependency passes validation: ./entities/all
From ./entities/all :['Dependency unsuccessful', 'Cannot run until dependency "./entities/special/registry" is successfully executed']

Pipeline ID: entities/entities

entities/fingerprints
Invalid

Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 04:47:25.508311
Last Completion:
2025-06-14 06:11:32.323709
Last Success:
2025-06-14 06:11:32.323709

Invalid dependency :Cannot run until dependency passes validation: ./entities/all
From ./entities/all :['Dependency unsuccessful', 'Cannot run until dependency "./entities/special/registry" is successfully executed']

Pipeline ID: entities/fingerprints

entities/safety-orders/safety-orders-by-entity
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./entities/safety-orders/safety-orders" is successfully executed

Pipeline ID: entities/safety-orders/safety-orders-by-entity

lamas/municipal-data
Invalid

Last Run triggered by:
scheduled
Last Run started at:
2025-06-13 01:05:30.289945
Last Completion:
2025-06-13 01:07:26.489874
Last Success:
2025-06-13 01:07:26.489874

Dependency unsuccessful :Cannot run until dependency "./entities/special/registry" is successfully executed

Pipeline ID: lamas/municipal-data

maya/maya-bonds-and-options-holdings-changes
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-11 18:22:38.534868
Last Completion:
2025-05-11 18:22:45.441201
Last Success:
2025-04-27 18:55:31.211106

Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list
From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']

Pipeline ID: maya/maya-bonds-and-options-holdings-changes

maya/maya-company-director-appointments
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-11 18:22:33.427857
Last Completion:
2025-05-11 18:22:38.530556
Last Success:
2025-04-27 18:54:22.418846

Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list
From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']

Pipeline ID: maya/maya-company-director-appointments

maya/maya-company-officer-list
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-11 18:22:22.629064
Last Completion:
2025-05-11 18:22:27.411203
Last Success:
2025-04-27 18:48:12.550875

Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list
From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']

Pipeline ID: maya/maya-company-officer-list

maya/maya-company-stakeholder-list
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-11 18:22:45.510532
Last Completion:
2025-05-11 18:22:53.732998
Last Success:
2025-04-27 19:11:08.356668

Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list
From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']

Pipeline ID: maya/maya-company-stakeholder-list

maya/maya-company-vip-appointments
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-11 18:22:27.414398
Last Completion:
2025-05-11 18:22:33.424153
Last Success:
2025-04-27 18:47:49.948280

Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list
From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']

Pipeline ID: maya/maya-company-vip-appointments

maya/maya-complete-notification-list
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 17:46:37.626777
Last Completion:
2025-04-27 18:33:14.771345
Last Success:
2025-04-27 18:33:14.771345

Dependency unsuccessful :Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed

Pipeline ID: maya/maya-complete-notification-list

maya/maya-holdings-changes
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-11 18:22:41.752626
Last Completion:
2025-05-11 18:22:49.244447
Last Success:
2025-04-27 18:58:34.823821

Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list
From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']

Pipeline ID: maya/maya-holdings-changes

maya/maya-reported-academic-degrees
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-11 18:22:49.313004
Last Completion:
2025-05-11 18:22:54.235844
Last Success:
2025-04-27 19:05:03.010847

Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list
From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']

Pipeline ID: maya/maya-reported-academic-degrees

maya/maya-reported-work-record
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-11 18:22:53.737915
Last Completion:
2025-05-11 18:22:59.228838
Last Success:
2025-04-27 19:05:58.191031

Invalid dependency :Cannot run until dependency passes validation: ./maya/maya-complete-notification-list
From ./maya/maya-complete-notification-list :['Dependency unsuccessful', 'Cannot run until dependency "./maya/maya-notification-parse-updates" is successfully executed']

Pipeline ID: maya/maya-reported-work-record

maya/maya-tase-companies-current-management
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./maya/scrape-maya-tase-companies" is successfully executed

Pipeline ID: maya/maya-tase-companies-current-management

maya/maya-tase-companies-current-shareholders
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./maya/scrape-maya-tase-companies" is successfully executed

Pipeline ID: maya/maya-tase-companies-current-shareholders

people/aggregated
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/all
From ./people/all :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']
From ./people/all :['From ./people/company_appointments/all-appointments', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]
From ./people/all :['Dependency unsuccessful', 'Cannot run until dependency "./people/procurement/procurement-individuals" is successfully executed']
From ./people/all :['Dependency unsuccessful', 'Cannot run until dependency "./people/political_candidates/election_candidates21" is successfully executed']

Pipeline ID: people/aggregated

people/all
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/all-appointments
From ./people/company_appointments/all-appointments :['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed']
From ./people/company_appointments/all-appointments :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]
From ./people/company_appointments/all-appointments :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]
Dependency unsuccessful :Cannot run until dependency "./people/political_candidates/election_candidates21" is successfully executed

Pipeline ID: people/all

people/company_appointments/all-appointments
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed
Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations
From ./people/company_appointments/maya/maya-nominations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]
Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations
From ./people/company_appointments/maya/maya-resignations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]

Pipeline ID: people/company_appointments/all-appointments

people/company_appointments/maya/collect-maya-forms-debug-stats
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed

Pipeline ID: people/company_appointments/maya/collect-maya-forms-debug-stats

Join the parsed PDF to get start and end time for each person (correlate)
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations
From ./people/company_appointments/maya/maya-nominations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]
Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations
From ./people/company_appointments/maya/maya-resignations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]

Pipeline ID: people/company_appointments/maya/correlate

people/company_appointments/maya/maya-list
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates
From ./people/company_appointments/maya/maya-notification-updates :['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']

Pipeline ID: people/company_appointments/maya/maya-list

Appointment notices from Maya (maya-nominations)
Invalid

Name, job and company description.


Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list
From ./people/company_appointments/maya/maya-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']
From ./people/company_appointments/maya/maya-list :['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]

Pipeline ID: people/company_appointments/maya/maya-nominations

List all notifications from maya system (maya-notification-updates)
Invalid

id, date, company, notification_type, s3_object_name, url


Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed

Pipeline ID: people/company_appointments/maya/maya-notification-updates

Appointment notices from Maya (maya-resignations)
Invalid

Name, job and company description.


Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list
From ./people/company_appointments/maya/maya-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']
From ./people/company_appointments/maya/maya-list :['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]

Pipeline ID: people/company_appointments/maya/maya-resignations

procurement/calls_for_bids/calls-for-bids-all
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-calls-for-bids
From ./procurement/calls_for_bids/jobiz-calls-for-bids :['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-all']
From ./procurement/calls_for_bids/jobiz-calls-for-bids :['From ./procurement/calls_for_bids/jobiz-all', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed']]

Pipeline ID: procurement/calls_for_bids/calls-for-bids-all

procurement/calls_for_bids/jobiz-all
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed

Pipeline ID: procurement/calls_for_bids/jobiz-all

procurement/calls_for_bids/jobiz-calls-for-bids
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-all
From ./procurement/calls_for_bids/jobiz-all :['Dependency unsuccessful', 'Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed']

Pipeline ID: procurement/calls_for_bids/jobiz-calls-for-bids

budget/national/changes/explanations/all
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-06-14 17:13:42.193305
Last Completion:
2025-06-14 17:21:16.900949
Last Success:
2025-06-06 00:16:16.199791

explanation_fetcher
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/budget/national/changes/explanations/explanation_fetcher.py", line 72, in <module>
    spew(dp, itertools.chain(res_iter, [get_explanations(parameters['url'])]))
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/budget/national/changes/explanations/explanation_fetcher.py", line 49, in get_explanations
    z_archive = zipfile.ZipFile(archive)
  File "/usr/local/lib/python3.9/zipfile.py", line 1266, in __init__
    self._RealGetContents()
  File "/usr/local/lib/python3.9/zipfile.py", line 1333, in _RealGetContents
    raise BadZipFile("File is not a zip file")
zipfile.BadZipFile: File is not a zip file

Pipeline ID: budget/national/changes/explanations/all

donations/transactions
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-06-14 17:13:10.764860
Last Completion:
2025-06-14 17:13:28.705960
Last Success:
None

get_transactions
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 150, in <module>
    spew(dp, process_resources(res_iter))
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 109, in get_transactions
    for resp in self.get_for_candidate(cid):
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 95, in get_for_candidate
    resp = self.get_for_range(cid, range_start, range_end)
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 70, in get_for_range
    assert len(resp) == 6
AssertionError

Pipeline ID: donations/transactions

education/tochniyot/tochniyot
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-06-14 17:21:48.739998
Last Completion:
2025-06-14 17:21:53.204450
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 103, in flow
    return Flow(scrape(),
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 65, in scrape
    education_programs_count = get_education_programs_count()
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 56, in get_education_programs_count
    res = send_tochniyot_request()
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 80, in send_tochniyot_request
    resp.raise_for_status()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://apps.education.gov.il/TyhNet/ClientWs/TochnitCh.asmx/IturTochnitChByMeafyenim

Pipeline ID: education/tochniyot/tochniyot

entities/moital/moital_service_providers
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-06-14 17:13:12.937714
Last Completion:
2025-06-14 17:13:26.402947
Last Success:
None

scraper
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/entities/moital/scraper.py", line 79, in <module>
    spew(datapackage, [scrape()])
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/entities/moital/scraper.py", line 32, in scrape
    desired_capabilities=DesiredCapabilities.PHANTOMJS)
AttributeError: type object 'DesiredCapabilities' has no attribute 'PHANTOMJS'

Pipeline ID: entities/moital/moital_service_providers

entities/safety-orders/safety-orders
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:18.614886
Last Completion:
2025-06-16 00:00:38.216612
Last Success:
None

stream_remote_resources
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 174, in _new_conn
    conn = connection.create_connection(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/connection.py", line 72, in create_connection
    for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
  File "/usr/local/lib/python3.9/socket.py", line 954, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -2] Name or service not known
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 714, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 415, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 244, in request
    super(HTTPConnection, self).request(method, url, body=body, headers=headers)
  File "/usr/local/lib/python3.9/http/client.py", line 1285, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/lib/python3.9/http/client.py", line 1331, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.9/http/client.py", line 1280, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.9/http/client.py", line 1040, in _send_output
    self.send(msg)
  File "/usr/local/lib/python3.9/http/client.py", line 980, in send
    self.connect()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 205, in connect
    conn = self._new_conn()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 186, in _new_conn
    raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7fc4797666a0>: Failed to establish a new connection: [Errno -2] Name or service not known
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 486, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 798, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='employment.molsa.gov.il', port=80): Max retries exceeded with url: /Employment/SafetyAndHealth/Enforcement/Documents/%D7%A6%D7%95%D7%95%D7%99%20%D7%91%D7%98%D7%99%D7%97%D7%95%D7%AA.xlsx (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fc4797666a0>: Failed to establish a new connection: [Errno -2] Name or service not known'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 63, in load
    bytes = _RemoteStream(source, self.__http_session, self.__http_timeout).open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 121, in open
    self.seek(0)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 142, in seek
    self.__response = self.__session.get(self.__source, stream=True, timeout=self.__timeout)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 602, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 519, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPConnectionPool(host='employment.molsa.gov.il', port=80): Max retries exceeded with url: /Employment/SafetyAndHealth/Enforcement/Documents/%D7%A6%D7%95%D7%95%D7%99%20%D7%91%D7%98%D7%99%D7%97%D7%95%D7%AA.xlsx (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fc4797666a0>: Failed to establish a new connection: [Errno -2] Name or service not known'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 244, in <module>
    rows = stream_reader(resource, url, ignore_missing or url == "", limit_rows,
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 199, in stream_reader
    schema, headers, columns, stream, close = get_opener(url, _resource)()
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 175, in opener
    _stream.open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/stream.py", line 425, in open
    self.__parser.open(source, encoding=self.__encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/parsers/xlsx.py", line 81, in open
    source_bytes = self.__loader.load(source, mode="b", encoding=encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 72, in load
    raise exceptions.HTTPError(str(exception))
tabulator.exceptions.HTTPError: HTTPConnectionPool(host='employment.molsa.gov.il', port=80): Max retries exceeded with url: /Employment/SafetyAndHealth/Enforcement/Documents/%D7%A6%D7%95%D7%95%D7%99%20%D7%91%D7%98%D7%99%D7%97%D7%95%D7%AA.xlsx (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fc4797666a0>: Failed to establish a new connection: [Errno -2] Name or service not known'))

Pipeline ID: entities/safety-orders/safety-orders

entities/special/registry
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:06.416374
Last Completion:
2025-06-16 00:06:31.921508
Last Success:
2025-06-13 00:13:24.593304

scraper
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/entities/special/scraper.py", line 163, in <module>
    spew(datapackage, itertools.chain(res_iter, [scrape()]))
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/entities/special/scraper.py", line 76, in scrape
    prepare()
  File "/datapackage_pipelines_budgetkey/pipelines/entities/special/scraper.py", line 60, in prepare
    driver.get("https://www.misim.gov.il/mm_lelorasham/firstPage.aspx")
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 442, in get
    self.execute(Command.GET, {'url': url})
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 430, in execute
    self.error_handler.check_response(response)
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/remote/errorhandler.py", line 247, in check_response
    raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message: timeout: Timed out receiving message from renderer: 300.000
  (Session info: chrome=88.0.4324.96)
Stacktrace:
#0 0x6393e4a23199 <unknown>
DEBUG   :[chan 1] Max packet in: 32768 bytes
DEBUG   :[chan 1] Max packet out: 32768 bytes
DEBUG   :Secsh channel 1 opened.
DEBUG   :[chan 1] Sesch channel 1 request ok
DEBUG   :[chan 1] EOF received (1)
DEBUG   :[chan 1] EOF sent (1)
DEBUG   :Dropping user packet because connection is dead.

Pipeline ID: entities/special/registry

maya/maya-notification-parse-updates
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-06-14 17:13:28.416241
Last Completion:
2025-06-14 17:13:55.405069
Last Success:
None

flow
ERROR   :Traceback (most recent call last):
ERROR   :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
ERROR   :spew_flow(flow, ctx)
ERROR   :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
ERROR   :spew(self.datapackage, self.resource_iterator, stats=self.stats)
ERROR   :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
ERROR   :for rec in res:
ERROR   :File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource
ERROR   :yield from self.func(resource)
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_notification_parse_updates.py", line 91, in parse_notification
ERROR   :for row in rows:
ERROR   :File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource
ERROR   :yield from self.func(resource)
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_notification_parse_updates.py", line 66, in store_on_s3
ERROR   :for row in rows:
ERROR   :File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource
ERROR   :yield from self.func(resource)
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_notification_parse_updates.py", line 111, in limiter
ERROR   :for row in rows:
ERROR   :File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource
ERROR   :yield from self.func(resource)
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_notification_parse_updates.py", line 101, in remove_already_parsed
ERROR   :all_existing_ids = get_all_existing_ids()
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_notification_parse_updates.py", line 32, in get_all_existing_ids
ERROR   :rows = engine.execute(text("SELECT s3_object_name FROM maya_notifications where parser_version=:v"), v=PARSER_VERSION)
ERROR   :TypeError
ERROR   ::
ERROR   :execute() got an unexpected keyword argument 'v'

Pipeline ID: maya/maya-notification-parse-updates

maya/scrape-maya-tase-companies
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-06-14 17:13:28.798709
Last Completion:
2025-06-14 17:13:53.289453
Last Success:
None

dump_to_path
ERROR   :Data Package validation error: Descriptor validation error: [] is too short at "schema/fields" in descriptor and at "properties/schema/properties/fields/minItems" in profile
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/dump_to_path.py", line 22, in <module>
    with ingest() as ctx:
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 186, in ingest
    params, datapackage, resource_iterator = _ingest(debug=debug)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 44, in _ingest
    datapackage, resource_iterator, dependency_dp = process_input(sys.stdin, validate, debug)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/input_processor.py", line 88, in process_input
    datapackage.validate(dp_to_validate)
  File "/usr/local/lib/python3.9/site-packages/datapackage/validate.py", line 28, in validate
    Package(descriptor, strict=True)
  File "/usr/local/lib/python3.9/site-packages/datapackage/package.py", line 126, in __init__
    self.__build()
  File "/usr/local/lib/python3.9/site-packages/datapackage/package.py", line 534, in __build
    updated_resource = Resource(descriptor,
  File "/usr/local/lib/python3.9/site-packages/datapackage/resource.py", line 90, in __init__
    self.__build()
  File "/usr/local/lib/python3.9/site-packages/datapackage/resource.py", line 648, in __build
    raise exception
  File "/usr/local/lib/python3.9/site-packages/datapackage/resource.py", line 643, in __build
    self.__profile.validate(self.__current_descriptor)
  File "/usr/local/lib/python3.9/site-packages/datapackage/profile.py", line 89, in validate
    raise exceptions.ValidationError(message, errors=errors)
datapackage.exceptions.ValidationError: There are 1 validation errors (see exception.errors)

Pipeline ID: maya/scrape-maya-tase-companies

people/company_appointments/maya/maya-notification-list
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:15.951771
Last Completion:
2025-06-16 00:00:18.607460
Last Success:
None

scrape-notification-list
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 971, in json
    return complexjson.loads(self.text, **kwargs)
  File "/usr/local/lib/python3.9/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "/usr/local/lib/python3.9/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/local/lib/python3.9/json/decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 55, in _maya_api_call
    return res.json()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 975, in json
    raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 130, in <module>
    spew(datapackage, [collect()])
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 113, in collect
    yield from _collect_date_range(year_start, year_end)
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 75, in _collect_date_range
    res = _maya_api_call(date_from, date_to, current_page)
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 57, in _maya_api_call
    raise Exception("Failed to Call Maya API for date_from:{} date_to:{} page_num:{}".format(date_from, date_to, page_num)) from e
Exception: Failed to Call Maya API for date_from:2006-01-01 date_to:2007-01-01 page_num:0

Pipeline ID: people/company_appointments/maya/maya-notification-list

Appointment notices from TheMarker (themarker)
Failed

Name, job and company description.


Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:26.862985
Last Completion:
2025-06-16 00:00:46.019345
Last Success:
None

stream_remote_resources
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 63, in load
    bytes = _RemoteStream(source, self.__http_session, self.__http_timeout).open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 121, in open
    self.seek(0)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 143, in seek
    self.__response.raise_for_status()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.themarker.com/st/inter/DB/tm/2015/minuyim30.xlsx
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 244, in <module>
    rows = stream_reader(resource, url, ignore_missing or url == "", limit_rows,
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 199, in stream_reader
    schema, headers, columns, stream, close = get_opener(url, _resource)()
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 175, in opener
    _stream.open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/stream.py", line 425, in open
    self.__parser.open(source, encoding=self.__encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/parsers/xlsx.py", line 81, in open
    source_bytes = self.__loader.load(source, mode="b", encoding=encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 72, in load
    raise exceptions.HTTPError(str(exception))
tabulator.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.themarker.com/st/inter/DB/tm/2015/minuyim30.xlsx

Pipeline ID: people/company_appointments/media/themarker/themarker

people/political_candidates/election_candidates21
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-06-14 17:13:26.496941
Last Completion:
2025-06-14 17:13:36.452361
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
    self.datapackage = self.process_datapackage(self.datapackage)
  File "/usr/local/lib/python3.9/site-packages/dataflows/processors/set_type.py", line 71, in process_datapackage
    assert added, 'Failed to find field {} in schema'.format(self.name)
AssertionError: Failed to find field re.compile('^party_letter$') in schema
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
    spew_flow(flow, ctx)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
    datastream = flow.datastream()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/flow.py", line 19, in datastream
    return self._chain(ds)._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  [Previous line repeated 4 more times]
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
    self.raise_exception(exception)
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
    raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor set_type in position #3: Failed to find field re.compile('^party_letter$') in schema

Pipeline ID: people/political_candidates/election_candidates21

procurement/calls_for_bids/calls-for-bids-moh
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:01:14.215051
Last Completion:
2025-06-16 00:01:18.553140
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
    self.datapackage = self.process_datapackage(self.datapackage)
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 112, in process_datapackage
    raise self.exc
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 60, in describe
    sample = list(itertools.islice(self.iterable, self.SAMPLE_SIZE))
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 89, in handle_iterable
    for x in self.iterable:
  File "/datapackage_pipelines_budgetkey/pipelines/procurement/calls_for_bids/m_tmicha.py", line 47, in m_tmicha_scraper
    assert total > 0
AssertionError
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
    spew_flow(flow, ctx)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
    datastream = flow.datastream()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/flow.py", line 19, in datastream
    return self._chain(ds)._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
    self.raise_exception(exception)
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
    raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor iterable_loader in position #1:

Pipeline ID: procurement/calls_for_bids/calls-for-bids-moh

procurement/calls_for_bids/jobiz-scraper
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 15:00:01.707370
Last Completion:
2025-06-16 15:00:05.073171
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 174, in _new_conn
    conn = connection.create_connection(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/connection.py", line 72, in create_connection
    for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
  File "/usr/local/lib/python3.9/socket.py", line 954, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -5] No address associated with hostname
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 714, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 403, in _make_request
    self._validate_conn(conn)
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1053, in _validate_conn
    conn.connect()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 363, in connect
    self.sock = conn = self._new_conn()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 186, in _new_conn
    raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPSConnection object at 0x7fac6d9036a0>: Failed to establish a new connection: [Errno -5] No address associated with hostname
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 486, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 798, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='jobiz.gov.il', port=443): Max retries exceeded with url: /ajax/results/%D7%94%D7%95%D7%93%D7%A2%D7%94%20%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA/0?ie=0&typeie=%D7%94%D7%95%D7%93%D7%A2%D7%94+%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA&search=Array (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fac6d9036a0>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
    self.datapackage = self.process_datapackage(self.datapackage)
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 112, in process_datapackage
    raise self.exc
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 60, in describe
    sample = list(itertools.islice(self.iterable, self.SAMPLE_SIZE))
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 89, in handle_iterable
    for x in self.iterable:
  File "/datapackage_pipelines_budgetkey/pipelines/procurement/calls_for_bids/jobiz.py", line 19, in fetch_results
    content = requests.get(URL.format(index)).json()
  File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 73, in get
    return request("get", url, params=params, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 59, in request
    return session.request(method=method, url=url, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 519, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='jobiz.gov.il', port=443): Max retries exceeded with url: /ajax/results/%D7%94%D7%95%D7%93%D7%A2%D7%94%20%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA/0?ie=0&typeie=%D7%94%D7%95%D7%93%D7%A2%D7%94+%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA&search=Array (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fac6d9036a0>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
    spew_flow(flow, ctx)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
    datastream = flow.datastream()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/flow.py", line 19, in datastream
    return self._chain(ds)._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  [Previous line repeated 5 more times]
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
    self.raise_exception(exception)
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
    raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor iterable_loader in position #1: HTTPSConnectionPool(host='jobiz.gov.il', port=443): Max retries exceeded with url: /ajax/results/%D7%94%D7%95%D7%93%D7%A2%D7%94%20%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA/0?ie=0&typeie=%D7%94%D7%95%D7%93%D7%A2%D7%94+%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA&search=Array (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fac6d9036a0>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))

Pipeline ID: procurement/calls_for_bids/jobiz-scraper

supports/criteria/support-criteria
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:12:23.830216
Last Completion:
2025-06-16 00:12:28.723553
Last Success:
None

sample
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/processors/sample.py", line 11, in <module>
    res_name = parameters.get('resource', datapackage['resources'][0]['name'])
IndexError: list index out of range

Pipeline ID: supports/criteria/support-criteria

supports/supports-2023
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-06-15 20:00:04.135594
Last Completion:
2025-06-15 20:10:30.756397
Last Success:
2025-06-13 22:02:11.102059

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
DEBUG   :Dropping user packet because connection is dead.
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
    DF.load(wrapper(year), format='csv',
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
    return scraper(gcd, year)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
    chart = get_chart(driver)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 34, in get_chart
    chart = WebDriverWait(driver, 60).until(
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
    raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x56e3b4788199 <unknown>
WARNING :FAILED to teardown google-chrome

Pipeline ID: supports/supports-2023

activities/social_services/social_service_reports
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:09:51.707764
Last Completion:
2025-06-16 00:14:01.615298
Last Success:
2025-06-16 00:14:01.615298

Pipeline ID: activities/social_services/social_service_reports

activities/social_services/social_service_suppliers
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:09:36.712111
Last Completion:
2025-06-16 00:09:44.611746
Last Success:
2025-06-16 00:09:44.611746

Pipeline ID: activities/social_services/social_service_suppliers

activities/social_services/social_service_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:09:44.620807
Last Completion:
2025-06-16 00:09:51.526658
Last Success:
2025-06-16 00:09:51.526658

Pipeline ID: activities/social_services/social_service_tenders

Fetch social services from data input (social_services)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:38.251987
Last Completion:
2025-06-16 00:01:14.161216
Last Success:
2025-06-16 00:01:14.161216

Pipeline ID: activities/social_services/social_services

bank_of_israel/bank_of_israel
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-19 11:19:54.126171
Last Completion:
2025-05-19 11:19:56.840221
Last Success:
2025-05-19 11:19:56.840221

Pipeline ID: bank_of_israel/bank_of_israel

budget/municipal/fetcher
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:04.912807
Last Completion:
2025-06-16 00:11:34.023911
Last Success:
2025-06-16 00:11:34.023911

Pipeline ID: budget/municipal/fetcher

budget/national/changes/original/committee-zipfile
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:24.609684
Last Completion:
2025-06-16 00:00:26.855410
Last Success:
2025-06-16 00:00:26.855410

Pipeline ID: budget/national/changes/original/committee-zipfile

budget/national/changes/original/current-year-fixes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:12:28.822848
Last Completion:
2025-06-16 00:12:51.708708
Last Success:
2025-06-16 00:12:51.708708

Pipeline ID: budget/national/changes/original/current-year-fixes

budget/national/changes/original/national-budget-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:46.107321
Last Completion:
2025-06-16 00:03:13.023566
Last Success:
2025-06-16 00:03:13.023566

Pipeline ID: budget/national/changes/original/national-budget-changes

budget/national/changes/processed/transactions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:12:51.725677
Last Completion:
2025-06-16 02:58:32.738200
Last Success:
2025-06-16 02:58:32.738200

Pipeline ID: budget/national/changes/processed/transactions

National Yearly Budgets (national-budgets)
Succeeded

We get the data the Ministry of Finance publishes in data.gov.il every year. It comes in XLS format, with one row per TAKANA and phase (original, approved, executed). In this pipeline we create from each triplet a single row that has all the data.


Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 00:32:58.593096
Last Completion:
2025-06-14 02:54:23.193457
Last Success:
2025-06-14 02:54:23.193457

Pipeline ID: budget/national/original/national-budgets

National Yearly Budgets - Processed (aggregated-yearly)
Succeeded

This pipeline joins the different phases of the budget (allocated, revised and executed). In the original file there's a separate row for each of the phases. We like it better as a single row with all phase info. Another thing this pipeline does is to rename the column titles - to more friendly English names. Also, it create rows for all hierarchies - where upper hierarchies (2, 4 & 6 digits) are plain aggregations of the 8-digit items they contain.


Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 06:14:10.103172
Last Completion:
2025-06-14 09:47:58.885403
Last Success:
2025-06-14 09:47:58.885403

Pipeline ID: budget/national/processed/aggregated-yearly

budget/national/processed/category-explanations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:49:18.734713
Last Completion:
2025-04-27 07:49:19.587602
Last Success:
2025-04-27 07:49:19.587602

Pipeline ID: budget/national/processed/category-explanations

National Yearly Budgets - Joined with category-explanations (connected-items-explained)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 13:33:27.000051
Last Completion:
2025-06-14 13:43:47.407764
Last Success:
2025-06-14 13:43:47.407764

Pipeline ID: budget/national/processed/connected-items-explained

National Yearly Budgets - Connected Items (connected-national-budgets)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 12:15:04.504443
Last Completion:
2025-06-14 13:01:50.010002
Last Success:
2025-06-14 13:01:50.010002

Pipeline ID: budget/national/processed/connected-national-budgets

National Yearly Budgets - Just the total (item 00) (just-the-total)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 11:51:44.296503
Last Completion:
2025-06-14 12:07:29.297403
Last Success:
2025-06-14 12:07:29.297403

Pipeline ID: budget/national/processed/just-the-total

National Yearly Budgets - Main Item Names (roof-names)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 12:02:39.008353
Last Completion:
2025-06-14 12:16:27.088967
Last Success:
2025-06-14 12:16:27.088967

Pipeline ID: budget/national/processed/roof-names

National Yearly Budgets - With Extras (with-extras)
Succeeded

This pipeline joins the budget data to itself so that each item has a list of its immediate children.


Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 10:46:54.295357
Last Completion:
2025-06-14 11:51:43.185539
Last Success:
2025-06-14 11:51:43.185539

Pipeline ID: budget/national/processed/with-extras

budgetkey/analysis/spending/publisher_entity_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 10:18:58.310059
Last Completion:
2025-06-16 11:24:28.463434
Last Success:
2025-06-16 11:24:28.463434

Pipeline ID: budgetkey/analysis/spending/publisher_entity_analysis

budgetkey/analysis/spending/publisher_foa_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 10:18:58.313877
Last Completion:
2025-06-16 10:25:25.541803
Last Success:
2025-06-16 10:25:25.541803

Pipeline ID: budgetkey/analysis/spending/publisher_foa_analysis

budgetkey/analysis/spending/united
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 10:00:02.926555
Last Completion:
2025-06-16 10:18:57.817096
Last Success:
2025-06-16 10:18:57.817096

Pipeline ID: budgetkey/analysis/spending/united

Main Page - Aggregated budget by functional classification (budget-functional-aggregates)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 10:55:48.014238
Last Completion:
2025-06-14 11:04:15.730364
Last Success:
2025-06-14 11:04:15.730364

Pipeline ID: budgetkey/budget-functional-aggregates

budgetkey/documents
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 11:18:02.287297
Last Completion:
2025-06-14 11:18:17.591672
Last Success:
2025-06-14 11:18:17.591672

Pipeline ID: budgetkey/documents

budgetkey/elasticsearch/index_activities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:11:34.111598
Last Completion:
2025-06-16 00:12:15.746290
Last Success:
2025-06-16 00:12:15.746290

Pipeline ID: budgetkey/elasticsearch/index_activities

budgetkey/elasticsearch/index_budget
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-06-14 17:25:39.398067
Last Completion:
2025-06-14 17:55:10.806187
Last Success:
2025-06-14 17:55:10.806187

Pipeline ID: budgetkey/elasticsearch/index_budget

budgetkey/elasticsearch/index_contract_spending
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 12:27:02.973254
Last Completion:
2025-06-16 13:42:53.995261
Last Success:
2025-06-16 13:42:53.995261

Pipeline ID: budgetkey/elasticsearch/index_contract_spending

budgetkey/elasticsearch/index_gov_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 12:15:53.515692
Last Completion:
2025-06-16 12:17:58.513804
Last Success:
2025-06-16 12:17:58.513804

Pipeline ID: budgetkey/elasticsearch/index_gov_decisions

budgetkey/elasticsearch/index_muni_budgets
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:16:42.420389
Last Completion:
2025-06-16 00:26:32.520154
Last Success:
2025-06-16 00:26:32.520154

Pipeline ID: budgetkey/elasticsearch/index_muni_budgets

budgetkey/elasticsearch/index_muni_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:12:15.811182
Last Completion:
2025-06-16 00:12:56.108012
Last Success:
2025-06-16 00:12:56.108012

Pipeline ID: budgetkey/elasticsearch/index_muni_tenders

budgetkey/elasticsearch/index_reports
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-06-14 17:55:10.903100
Last Completion:
2025-06-14 17:56:26.504278
Last Success:
2025-06-14 17:56:26.504278

Pipeline ID: budgetkey/elasticsearch/index_reports

budgetkey/elasticsearch/index_supports
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 01:02:19.331204
Last Completion:
2025-06-16 01:24:19.140864
Last Success:
2025-06-16 01:24:19.140864

Pipeline ID: budgetkey/elasticsearch/index_supports

budgetkey/elasticsearch/index_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:34:49.209939
Last Completion:
2025-06-16 01:06:15.763870
Last Success:
2025-06-16 01:06:15.763870

Pipeline ID: budgetkey/elasticsearch/index_tenders

budgetkey/elasticsearch/index_units
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:11:52.309371
Last Completion:
2025-06-16 00:12:23.821710
Last Success:
2025-06-16 00:12:23.821710

Pipeline ID: budgetkey/elasticsearch/index_units

Send periodic emails (emails)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-06-14 17:13:55.305191
Last Completion:
2025-06-15 19:37:16.068204
Last Success:
2025-06-15 19:37:16.068204

Pipeline ID: budgetkey/emails/emails

donations/candidates
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 09:00:56.301458
Last Completion:
2025-04-27 09:01:03.408524
Last Success:
2025-04-27 09:01:03.408524

Pipeline ID: donations/candidates

donations/parties
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:51:35.993955
Last Completion:
2025-04-27 07:51:39.489352
Last Success:
2025-04-27 07:51:39.489352

Pipeline ID: donations/parties

entities/associations/guidestar/guidestar
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-31 06:16:08.870355
Last Completion:
2025-05-31 06:25:09.087238
Last Success:
2025-05-31 06:25:09.087238

Pipeline ID: entities/associations/guidestar/guidestar

entities/associations/guidestar/guidestar-scraper
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-31 00:12:28.583435
Last Completion:
2025-05-31 06:16:08.744449
Last Success:
2025-05-31 06:16:08.744449

Pipeline ID: entities/associations/guidestar/guidestar-scraper

עמותות פעילות מרשם העמותות (registry)
Succeeded

רשימת כלל העמותות הפעילות, מתעדכן שבועית.


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 08:08:53.497715
Last Completion:
2025-04-27 08:09:56.818099
Last Success:
2025-04-27 08:09:56.818099

Pipeline ID: entities/associations/registrar/registry

entities/companies/registrar/details
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:26:32.607167
Last Completion:
2025-06-16 00:32:37.408813
Last Success:
2025-06-16 00:32:37.408813

Pipeline ID: entities/companies/registrar/details

חברות פעילות מרשם החברות (scraper)
Succeeded

רשימת כלל החברות הפעילות, מתעדכן שבועית.


Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:20.014132
Last Completion:
2025-06-16 00:11:52.223279
Last Success:
2025-06-16 00:11:52.223279

Pipeline ID: entities/companies/registrar/scraper

רשימת אגודות שיתופיות (cooperatives)
Succeeded

רשימת אגודות שיתופיות, מתוך ממשק נתונים של מאגר של משרד הכלכלה / האגף לאיגוד שיתופי, מתעדכן שבועית


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 08:10:16.612259
Last Completion:
2025-04-27 08:16:46.987648
Last Success:
2025-04-27 08:16:46.987648

Pipeline ID: entities/cooperatives/cooperatives

רשימת הקדשים (endowments)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 08:09:59.917274
Last Completion:
2025-04-27 08:10:16.590682
Last Success:
2025-04-27 08:10:16.590682

Pipeline ID: entities/endowments/endowments

entities/foi_orgs/foi_orgs
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-11 18:21:18.557684
Last Completion:
2025-05-11 18:22:18.330826
Last Success:
2025-05-11 18:22:18.330826

Pipeline ID: entities/foi_orgs/foi_orgs

רשימת אגודות עותומניות (ottoman-association-registry)
Succeeded

רשימת אגודות עותומניות, מתוך תשובה לבקשת חופש מידע


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:54:57.689201
Last Completion:
2025-04-27 07:55:17.098502
Last Success:
2025-04-27 07:55:17.098502

Pipeline ID: entities/ottoman/ottoman-association-registry

רשימת שותפויות (partnerships)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:54:28.914835
Last Completion:
2025-04-27 07:55:18.389566
Last Success:
2025-04-27 07:55:18.389566

Pipeline ID: entities/partnerships/partnerships

ezvonot/ezvonot_accounts
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:04:01.131902
Last Completion:
2025-06-16 00:04:27.323438
Last Success:
2025-06-16 00:04:27.323438

Pipeline ID: ezvonot/ezvonot_accounts

ezvonot/ezvonot_cases
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:04:27.334585
Last Completion:
2025-06-16 00:04:45.823162
Last Success:
2025-06-16 00:04:45.823162

Pipeline ID: ezvonot/ezvonot_cases

ezvonot/ezvonot_crontab
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:07.638994
Last Completion:
2025-06-16 00:00:09.914244
Last Success:
2025-06-16 00:00:09.914244

Pipeline ID: ezvonot/ezvonot_crontab

ezvonot/ezvonot_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:05:05.609144
Last Completion:
2025-06-16 00:05:37.721863
Last Success:
2025-06-16 00:05:37.721863

Pipeline ID: ezvonot/ezvonot_decisions

ezvonot/ezvonot_decisions_join
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:14:01.628202
Last Completion:
2025-06-16 00:14:54.926080
Last Success:
2025-06-16 00:14:54.926080

Pipeline ID: ezvonot/ezvonot_decisions_join

ezvonot/ezvonot_deposits
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:03:32.115403
Last Completion:
2025-06-16 00:04:01.123851
Last Success:
2025-06-16 00:04:01.123851

Pipeline ID: ezvonot/ezvonot_deposits

ezvonot/ezvonot_purposes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:04:45.832170
Last Completion:
2025-06-16 00:05:05.524400
Last Success:
2025-06-16 00:05:05.524400

Pipeline ID: ezvonot/ezvonot_purposes

facilities/all/facilities_all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:12:56.123895
Last Completion:
2025-06-16 00:16:42.411760
Last Success:
2025-06-16 00:16:42.411760

Pipeline ID: facilities/all/facilities_all

facilities/education/facilities_education
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:04.564021
Last Completion:
2025-06-16 00:00:15.930623
Last Success:
2025-06-16 00:00:15.930623

Pipeline ID: facilities/education/facilities_education

facilities/labor/facilities_labor
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:03:13.047337
Last Completion:
2025-06-16 00:03:32.051043
Last Success:
2025-06-16 00:03:32.051043

Pipeline ID: facilities/labor/facilities_labor

facilities/welfare/facilities_welfare
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:11.707130
Last Completion:
2025-06-16 00:00:24.571514
Last Success:
2025-06-16 00:00:24.571514

Pipeline ID: facilities/welfare/facilities_welfare

government_decisions/government_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 12:15:36.715104
Last Completion:
2025-06-16 12:15:53.237152
Last Success:
2025-06-16 12:15:53.237152

Pipeline ID: government_decisions/government_decisions

government_decisions/scraper
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 12:00:01.916671
Last Completion:
2025-06-16 12:15:36.649277
Last Success:
2025-06-16 12:15:36.649277

Pipeline ID: government_decisions/scraper

קובץ התאמת רשויות אזוריות לישובים בשטחן (municipality-to-city)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:43:50.134018
Last Completion:
2025-04-27 07:43:53.274072
Last Success:
2025-04-27 07:43:53.274072

Pipeline ID: lamas/municipality-to-city

maya/scrape-maya-notification-list
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 08:12:15.091545
Last Completion:
2025-04-27 10:11:54.691823
Last Success:
2025-04-27 10:11:54.691823

Pipeline ID: maya/scrape-maya-notification-list

people/association_founders/association-founders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-31 06:28:25.693702
Last Completion:
2025-05-31 06:29:06.696125
Last Success:
2025-05-31 06:29:06.696125

Pipeline ID: people/association_founders/association-founders

מינויים בכלכליסט (calcalist)
Succeeded

רשימת כל המינויים והחברות מאתר כלכליסט


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:51:54.887624
Last Completion:
2025-04-27 07:52:00.218817
Last Success:
2025-04-27 07:52:00.218817

Pipeline ID: people/company_appointments/media/calcalist/calcalist

Join the parsed PDF to get start and end time for each person (correlate)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:14:54.932648
Last Completion:
2025-06-16 00:15:00.740383
Last Success:
2025-06-16 00:15:00.740383

Pipeline ID: people/company_appointments/state_owned/correlate

Parse and concatenate all PDF reports (parse_pdf_resources)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:05:37.730647
Last Completion:
2025-06-16 00:05:42.423083
Last Success:
2025-06-16 00:05:42.423083

Pipeline ID: people/company_appointments/state_owned/parse_pdf_resources

collect links to all pdf reports on https://mof.gov.il/GCA/Directors/Pages/DirectorsManningReport.aspx (reports)
Succeeded

columns: date, url


Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:12.330251
Last Completion:
2025-06-16 00:00:19.909363
Last Success:
2025-06-16 00:00:19.909363

Pipeline ID: people/company_appointments/state_owned/reports

people/company_appointments/state_owned/state-owned-nominations
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-06-16 00:27:27.821127
Last Completion:
2025-06-16 00:27:35.816154
Last Success:
2025-06-16 00:27:35.816154

Pipeline ID: people/company_appointments/state_owned/state-owned-nominations

people/municipal_appointments/municipal_representitives
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:51:48.927647
Last Completion:
2025-04-27 07:51:54.799172
Last Success:
2025-04-27 07:51:54.799172

Pipeline ID: people/municipal_appointments/municipal_representitives

people/political_donations/political_donations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-05-11 14:52:30.138930
Last Completion:
2025-05-11 14:52:33.417812
Last Success:
2025-05-11 14:52:33.417812

Pipeline ID: people/political_donations/political_donations

people/procurement/procurement-individuals
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 12:27:02.951089
Last Completion:
2025-06-16 12:35:17.442153
Last Success:
2025-06-16 12:35:17.442153

Pipeline ID: people/procurement/procurement-individuals

procurement/calls_for_bids/gov-publications
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:22.613057
Last Completion:
2025-04-27 07:43:45.834310
Last Success:
2025-04-27 07:43:45.834310

Pipeline ID: procurement/calls_for_bids/gov-publications

procurement/calls_for_bids/gov-publications-ministry-of-immigration
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:22.619334
Last Completion:
2025-04-27 07:42:34.995234
Last Success:
2025-04-27 07:42:34.995234

Pipeline ID: procurement/calls_for_bids/gov-publications-ministry-of-immigration

procurement/calls_for_bids/gov-publications2
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:22.687912
Last Completion:
2025-04-27 07:42:52.511945
Last Success:
2025-04-27 07:42:52.511945

Pipeline ID: procurement/calls_for_bids/gov-publications2

procurement/municipal/fetcher
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:01:26.231732
Last Completion:
2025-06-16 00:01:38.339708
Last Success:
2025-06-16 00:01:38.339708

Pipeline ID: procurement/municipal/fetcher

התקשרויות רכש ממשלתיות (latest-contract-spending)
Succeeded

אנו סוכמים מידע מתוך הדוחות הרבעוניים לתוך טבלה המכילה את המידע העדכני ביותר.


Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 10:11:28.315195
Last Completion:
2025-06-16 12:27:02.612888
Last Success:
2025-06-16 12:27:02.612888

Pipeline ID: procurement/spending/latest-contract-spending

procurement/spending/quarterly-contract-spending-report-uris
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 06:00:01.817709
Last Completion:
2025-06-16 06:00:27.456725
Last Success:
2025-06-16 06:00:27.456725

Pipeline ID: procurement/spending/quarterly-contract-spending-report-uris

דוחות רבעוניים מתוך מרכבה, לפי נוהל היחידה לחופש המידע. (quarterly-contract-spending-reports)
Succeeded

כל משרדי הממשלה ויחידות הסמך (שמחוברות למערכת מרכבה) צריכים לפרסם אחת לרבעון (תוך 45 יום מסוף הרבעון) דו״ח התקשרויות לפי פורמט מוגדר היטב הממומש כדו״ח מובנה במערכת המרכבה. כל המשרדים מדווחים עצמאית והדו״חות עולים לאתר היחידה לחופש המידע, משם אנו אוספים אותם. התוצר של השרשר הזה הוא פירוט כל הדיווחים של כל המשרדים.


Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 06:00:27.606134
Last Completion:
2025-06-16 09:25:33.920118
Last Success:
2025-06-16 09:25:33.920118

Pipeline ID: procurement/spending/quarterly-contract-spending-reports

procurement/spending/quarterly-contract-spending-reports-data
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 09:25:34.188542
Last Completion:
2025-06-16 10:11:27.918633
Last Success:
2025-06-16 10:11:27.918633

Pipeline ID: procurement/spending/quarterly-contract-spending-reports-data

procurement/spending/spending-by-entity
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 12:27:02.938764
Last Completion:
2025-06-16 12:35:20.456720
Last Success:
2025-06-16 12:35:20.456720

Pipeline ID: procurement/spending/spending-by-entity

Load all tenders data from data.gov.il/procurement agency to a flat file (all)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:01:43.531199
Last Completion:
2025-06-16 00:09:36.625849
Last Success:
2025-06-16 00:09:36.625849

Pipeline ID: procurement/tenders/all

procurement/tenders/processed
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:15:00.826585
Last Completion:
2025-06-16 00:34:48.420438
Last Success:
2025-06-16 00:34:48.420438

Pipeline ID: procurement/tenders/processed

reports/all
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-05-31 06:31:22.395485
Last Completion:
2025-05-31 06:31:37.205315
Last Success:
2025-05-31 06:31:37.205315

Pipeline ID: reports/all

reports/ngos/ngo-activity-report
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-31 06:25:09.413039
Last Completion:
2025-05-31 06:30:07.884146
Last Success:
2025-05-31 06:30:07.884146

Pipeline ID: reports/ngos/ngo-activity-report

reports/ngos/ngo-district-report
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-05-31 06:25:09.401746
Last Completion:
2025-05-31 06:28:25.624432
Last Success:
2025-05-31 06:28:25.624432

Pipeline ID: reports/ngos/ngo-district-report

simpledb/process_simple_dbs
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-14 12:07:29.307652
Last Completion:
2025-06-14 13:45:35.615136
Last Success:
2025-06-14 13:45:35.615136

Pipeline ID: simpledb/process_simple_dbs

supports/all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-15 22:11:33.566660
Last Completion:
2025-06-15 22:15:39.951720
Last Success:
2025-06-15 22:15:39.951720

Pipeline ID: supports/all

supports/by-payment-year
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:27:35.827881
Last Completion:
2025-06-16 00:39:58.746661
Last Success:
2025-06-16 00:39:58.746661

Pipeline ID: supports/by-payment-year

supports/by-request-year
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:32:37.427834
Last Completion:
2025-06-16 01:02:19.119900
Last Success:
2025-06-16 01:02:19.119900

Pipeline ID: supports/by-request-year

supports/criteria/support-criteria-doj
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:01:38.408609
Last Completion:
2025-06-16 00:01:43.510703
Last Success:
2025-06-16 00:01:43.510703

Pipeline ID: supports/criteria/support-criteria-doj

supports/supports-2004
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:35.027140
Last Completion:
2025-04-27 07:42:36.769997
Last Success:
2025-04-27 07:42:36.769997

Pipeline ID: supports/supports-2004

supports/supports-2005
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:36.774459
Last Completion:
2025-04-27 07:42:37.944570
Last Success:
2025-04-27 07:42:37.944570

Pipeline ID: supports/supports-2005

supports/supports-2006
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:37.947887
Last Completion:
2025-04-27 07:42:39.272643
Last Success:
2025-04-27 07:42:39.272643

Pipeline ID: supports/supports-2006

supports/supports-2007
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:39.276258
Last Completion:
2025-04-27 07:42:40.674592
Last Success:
2025-04-27 07:42:40.674592

Pipeline ID: supports/supports-2007

supports/supports-2008
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:40.678237
Last Completion:
2025-04-27 07:42:42.147887
Last Success:
2025-04-27 07:42:42.147887

Pipeline ID: supports/supports-2008

supports/supports-2009
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:40.794441
Last Completion:
2025-04-27 07:42:42.174578
Last Success:
2025-04-27 07:42:42.174578

Pipeline ID: supports/supports-2009

supports/supports-2010
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:42.150961
Last Completion:
2025-04-27 07:42:43.401282
Last Success:
2025-04-27 07:42:43.401282

Pipeline ID: supports/supports-2010

supports/supports-2011
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:42.178775
Last Completion:
2025-04-27 07:42:43.366890
Last Success:
2025-04-27 07:42:43.366890

Pipeline ID: supports/supports-2011

supports/supports-2012
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:43.369795
Last Completion:
2025-04-27 07:42:44.809607
Last Success:
2025-04-27 07:42:44.809607

Pipeline ID: supports/supports-2012

supports/supports-2013
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:43.404371
Last Completion:
2025-04-27 07:42:44.813024
Last Success:
2025-04-27 07:42:44.813024

Pipeline ID: supports/supports-2013

supports/supports-2014
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:44.813457
Last Completion:
2025-04-27 07:42:46.121643
Last Success:
2025-04-27 07:42:46.121643

Pipeline ID: supports/supports-2014

supports/supports-2015
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:44.815917
Last Completion:
2025-04-27 07:42:46.060798
Last Success:
2025-04-27 07:42:46.060798

Pipeline ID: supports/supports-2015

supports/supports-2016
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:46.064375
Last Completion:
2025-04-27 07:42:47.462899
Last Success:
2025-04-27 07:42:47.462899

Pipeline ID: supports/supports-2016

supports/supports-2017
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:46.125641
Last Completion:
2025-04-27 07:42:47.424521
Last Success:
2025-04-27 07:42:47.424521

Pipeline ID: supports/supports-2017

supports/supports-2018
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:47.436082
Last Completion:
2025-04-27 07:42:48.833932
Last Success:
2025-04-27 07:42:48.833932

Pipeline ID: supports/supports-2018

supports/supports-2019
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:47.466944
Last Completion:
2025-04-27 07:42:48.803936
Last Success:
2025-04-27 07:42:48.803936

Pipeline ID: supports/supports-2019

supports/supports-2020
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:48.809601
Last Completion:
2025-04-27 07:42:50.224309
Last Success:
2025-04-27 07:42:50.224309

Pipeline ID: supports/supports-2020

supports/supports-2021
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:48.837287
Last Completion:
2025-04-27 07:42:50.256060
Last Success:
2025-04-27 07:42:50.256060

Pipeline ID: supports/supports-2021

supports/supports-2022
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-27 07:42:50.227848
Last Completion:
2025-04-27 07:42:51.508275
Last Success:
2025-04-27 07:42:51.508275

Pipeline ID: supports/supports-2022

supports/supports-2024
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-15 21:00:01.901223
Last Completion:
2025-06-15 21:12:03.490999
Last Success:
2025-06-15 21:12:03.490999

Pipeline ID: supports/supports-2024

supports/supports-2025
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-15 22:00:01.681786
Last Completion:
2025-06-15 22:11:33.459743
Last Success:
2025-06-15 22:11:33.459743

Pipeline ID: supports/supports-2025

supports/supports-by-entity
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:34:43.215951
Last Completion:
2025-06-16 00:38:38.616395
Last Success:
2025-06-16 00:38:38.616395

Pipeline ID: supports/supports-by-entity

supports/with-entities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:00:09.449711
Last Completion:
2025-06-16 00:27:27.632233
Last Success:
2025-06-16 00:27:27.632233

Pipeline ID: supports/with-entities

units/social_services/social_services
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-06-16 00:01:18.558679
Last Completion:
2025-06-16 00:01:26.223910
Last Success:
2025-06-16 00:01:26.223910

Pipeline ID: units/social_services/social_services