activities/social_services/social_service_reports
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:54:44.617827
Last Completion:
2022-09-26 00:57:03.882052
Last Success:
2022-09-26 00:57:03.882052

Pipeline ID: activities/social_services/social_service_reports

activities/social_services/social_service_suppliers
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:54:35.604915
Last Completion:
2022-09-26 00:54:44.118186
Last Success:
2022-09-26 00:54:44.118186

Pipeline ID: activities/social_services/social_service_suppliers

activities/social_services/social_service_tenders
Failed

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:54:41.114868
Last Completion:
2022-09-26 00:54:46.108028
Last Success:
None

flow
ERROR   :Output pipe disappeared!

Pipeline ID: activities/social_services/social_service_tenders

Fetch social services from data input (social_services)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:11:51.795924
Last Completion:
2022-09-26 00:12:23.715431
Last Success:
2022-09-26 00:12:23.715431

Pipeline ID: activities/social_services/social_services

bank_of_israel/bank_of_israel
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 16:21:22.888411
Last Completion:
2022-02-07 16:23:44.680458
Last Success:
2022-02-07 16:23:44.680458

Pipeline ID: bank_of_israel/bank_of_israel

budget/municipal/fetcher
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:00:27.096795
Last Completion:
2022-09-26 00:02:22.985115
Last Success:
2022-09-26 00:02:22.985115

Pipeline ID: budget/municipal/fetcher

budget/national/changes/explanations/all
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 16:07:57.319532
Last Completion:
2022-02-07 16:10:25.596498
Last Success:
2022-02-07 16:10:25.596498

Pipeline ID: budget/national/changes/explanations/all

budget/national/changes/original/current-year-fixes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-16 02:57:54.234682
Last Completion:
2022-09-16 02:58:05.114521
Last Success:
2022-09-16 02:58:05.114521

Pipeline ID: budget/national/changes/original/current-year-fixes

budget/national/changes/original/national-budget-changes
Failed

Last Run triggered by:
scheduled
Last Run started at:
2022-09-23 00:01:21.584197
Last Completion:
2022-09-23 00:02:47.301794
Last Success:
2022-09-16 01:27:01.079530

fix_values
ERROR   :Traceback (most recent call last):
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/budget/national/changes/original/fix_values.py", line 49, in <module>
ERROR   :process(process_row=process_row)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 232, in process
ERROR   :process_row)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
ERROR   :spew(self.datapackage, self.resource_iterator, stats=self.stats)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
ERROR   :for rec in res:
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 201, in generic_process_resource
ERROR   :parameters, stats)
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/budget/national/changes/original/fix_values.py", line 44, in process_row
ERROR   :row[amount] *= 1000
ERROR   :TypeError
ERROR   ::
ERROR   :unsupported operand type(s) for *=: 'NoneType' and 'int'

Pipeline ID: budget/national/changes/original/national-budget-changes

Changes, grouped by transaction_id, with explanations (national-budget-changes-aggregated)
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2022-09-23 00:22:52.219398
Last Completion:
2022-09-23 00:28:31.917658
Last Success:
2022-09-23 00:28:31.917658

Pipeline ID: budget/national/changes/processed/national-budget-changes-aggregated

budget/national/changes/processed/transactions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-16 02:58:05.155668
Last Completion:
2022-09-16 06:59:33.870042
Last Success:
2022-09-16 06:59:33.870042

Pipeline ID: budget/national/changes/processed/transactions

National Yearly Budgets (national-budgets)
Succeeded

We get the data the Ministry of Finance publishes in data.gov.il every year. It comes in XLS format, with one row per TAKANA and phase (original, approved, executed). In this pipeline we create from each triplet a single row that has all the data.


Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 16:08:26.483368
Last Completion:
2022-02-07 17:42:24.896833
Last Success:
2022-02-07 17:42:24.896833

Pipeline ID: budget/national/original/national-budgets

National Yearly Budgets - Processed (aggregated-yearly)
Succeeded

This pipeline joins the different phases of the budget (allocated, revised and executed). In the original file there's a separate row for each of the phases. We like it better as a single row with all phase info. Another thing this pipeline does is to rename the column titles - to more friendly English names. Also, it create rows for all hierarchies - where upper hierarchies (2, 4 & 6 digits) are plain aggregations of the 8-digit items they contain.


Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 19:12:01.843318
Last Completion:
2022-02-07 20:45:03.015439
Last Success:
2022-02-07 20:45:03.015439

Pipeline ID: budget/national/processed/aggregated-yearly

budget/national/processed/category-explanations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 16:08:32.778707
Last Completion:
2022-02-07 16:08:37.767002
Last Success:
2022-02-07 16:08:37.767002

Pipeline ID: budget/national/processed/category-explanations

National Yearly Budgets - Joined with category-explanations (connected-items-explained)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-08 15:19:44.494312
Last Completion:
2022-02-08 15:23:28.188195
Last Success:
2022-02-08 15:23:28.188195

Pipeline ID: budget/national/processed/connected-items-explained

National Yearly Budgets - Connected Items (connected-national-budgets)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-08 14:58:57.516419
Last Completion:
2022-02-08 15:13:52.486142
Last Success:
2022-02-08 15:13:52.486142

Pipeline ID: budget/national/processed/connected-national-budgets

National Yearly Budgets - Just the total (item 00) (just-the-total)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 23:38:41.688405
Last Completion:
2022-02-07 23:41:46.416088
Last Success:
2022-02-07 23:41:46.416088

Pipeline ID: budget/national/processed/just-the-total

National Yearly Budgets - Main Item Names (roof-names)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 23:40:08.146269
Last Completion:
2022-02-07 23:43:26.500359
Last Success:
2022-02-07 23:43:26.500359

Pipeline ID: budget/national/processed/roof-names

National Yearly Budgets - With Extras (with-extras)
Succeeded

This pipeline joins the budget data to itself so that each item has a list of its immediate children.


Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 21:50:29.590346
Last Completion:
2022-02-07 22:08:06.880647
Last Success:
2022-02-07 22:08:06.880647

Pipeline ID: budget/national/processed/with-extras

budgetkey/analysis/spending/publisher_entity_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 10:12:14.845628
Last Completion:
2022-09-26 11:07:50.001805
Last Success:
2022-09-26 11:07:50.001805

Pipeline ID: budgetkey/analysis/spending/publisher_entity_analysis

budgetkey/analysis/spending/publisher_foa_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 10:12:14.853785
Last Completion:
2022-09-26 10:16:20.886119
Last Success:
2022-09-26 10:16:20.886119

Pipeline ID: budgetkey/analysis/spending/publisher_foa_analysis

budgetkey/analysis/spending/united
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 10:00:03.616887
Last Completion:
2022-09-26 10:12:14.669018
Last Success:
2022-09-26 10:12:14.669018

Pipeline ID: budgetkey/analysis/spending/united

Main Page - Aggregated budget by functional classification (budget-functional-aggregates)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 22:08:06.895627
Last Completion:
2022-02-07 22:12:02.474564
Last Success:
2022-02-07 22:12:02.474564

Pipeline ID: budgetkey/budget-functional-aggregates

budgetkey/documents
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 23:43:26.504813
Last Completion:
2022-02-07 23:43:28.383386
Last Success:
2022-02-07 23:43:28.383386

Pipeline ID: budgetkey/documents

budgetkey/elasticsearch/index_activities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:54:46.187178
Last Completion:
2022-09-26 00:55:25.991603
Last Success:
2022-09-26 00:55:25.991603

Pipeline ID: budgetkey/elasticsearch/index_activities

budgetkey/elasticsearch/index_budget
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2022-09-23 01:27:36.888955
Last Completion:
2022-09-23 02:15:55.118196
Last Success:
2022-09-23 02:15:55.118196

Pipeline ID: budgetkey/elasticsearch/index_budget

budgetkey/elasticsearch/index_calls_for_bids
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-25 16:10:33.312094
Last Completion:
2022-09-25 16:11:06.753836
Last Success:
2022-09-25 16:11:06.753836

Pipeline ID: budgetkey/elasticsearch/index_calls_for_bids

budgetkey/elasticsearch/index_contract_spending
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 05:08:02.583798
Last Completion:
2022-09-26 06:53:25.569003
Last Success:
2022-09-26 06:53:25.569003

Pipeline ID: budgetkey/elasticsearch/index_contract_spending

budgetkey/elasticsearch/index_entities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 05:26:02.487990
Last Completion:
2022-09-26 06:26:17.067461
Last Success:
2022-09-26 06:26:17.067461

Pipeline ID: budgetkey/elasticsearch/index_entities

budgetkey/elasticsearch/index_gov_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 12:01:09.187779
Last Completion:
2022-09-26 12:02:44.250363
Last Success:
2022-09-26 12:02:44.250363

Pipeline ID: budgetkey/elasticsearch/index_gov_decisions

budgetkey/elasticsearch/index_muni_budgets
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:39:07.903065
Last Completion:
2022-09-26 00:41:21.213092
Last Success:
2022-09-26 00:41:21.213092

Pipeline ID: budgetkey/elasticsearch/index_muni_budgets

budgetkey/elasticsearch/index_national_budget_changes
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2022-09-23 02:12:03.710759
Last Completion:
2022-09-23 02:20:27.508025
Last Success:
2022-09-23 02:20:27.508025

Pipeline ID: budgetkey/elasticsearch/index_national_budget_changes

budgetkey/elasticsearch/index_people
Invalid

Last Run triggered by:
dirty-task-update
Last Run started at:
2022-03-25 01:13:27.398964
Last Completion:
2022-03-25 01:25:09.701698
Last Success:
2022-03-25 01:25:09.701698

Invalid dependency :Cannot run until dependency passes validation: ./people/aggregated
From ./people/aggregated :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/all']
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/procurement/procurement-individuals']]
From ./people/aggregated :['From ./people/all', ['From ./people/procurement/procurement-individuals', ['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/spending/latest-contract-spending']]]
From ./people/aggregated :['From ./people/all', ['From ./people/procurement/procurement-individuals', ['From ./procurement/spending/latest-contract-spending', ['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/spending/quarterly-contract-spending-reports-data']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/procurement/procurement-individuals', ['From ./procurement/spending/latest-contract-spending', ['From ./procurement/spending/quarterly-contract-spending-reports-data', ['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/spending/quarterly-contract-spending-reports']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/procurement/procurement-individuals', ['From ./procurement/spending/latest-contract-spending', ['From ./procurement/spending/quarterly-contract-spending-reports-data', ['From ./procurement/spending/quarterly-contract-spending-reports', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/spending/quarterly-contract-spending-report-uris" is successfully executed']]]]]]

Pipeline ID: budgetkey/elasticsearch/index_people

budgetkey/elasticsearch/index_reports
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2022-09-23 01:43:55.182052
Last Completion:
2022-09-23 01:45:19.080208
Last Success:
2022-09-23 01:45:19.080208

Pipeline ID: budgetkey/elasticsearch/index_reports

budgetkey/elasticsearch/index_support_criteria
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./supports/criteria/support-criteria" is successfully executed

Pipeline ID: budgetkey/elasticsearch/index_support_criteria

budgetkey/elasticsearch/index_supports
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 01:24:51.406823
Last Completion:
2022-09-26 02:45:28.604937
Last Success:
2022-09-26 02:45:28.604937

Pipeline ID: budgetkey/elasticsearch/index_supports

budgetkey/elasticsearch/index_tenders
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-08-19 15:17:13.183768
Last Completion:
2022-08-19 15:36:49.070782
Last Success:
2022-08-19 15:36:49.070782

Invalid dependency :Cannot run until dependency passes validation: ./procurement/tenders/processed
From ./procurement/tenders/processed :['Dependency unsuccessful', 'Cannot run until dependency "./activities/social_services/social_service_tenders" is successfully executed']

Pipeline ID: budgetkey/elasticsearch/index_tenders

budgetkey/elasticsearch/index_units
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:41:21.290064
Last Completion:
2022-09-26 00:41:51.882540
Last Success:
2022-09-26 00:41:51.882540

Pipeline ID: budgetkey/elasticsearch/index_units

budgetkey/elasticsearch/sitemaps
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./budgetkey/elasticsearch/index_tenders
From ./budgetkey/elasticsearch/index_tenders :['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/tenders/processed']
From ./budgetkey/elasticsearch/index_tenders :['From ./procurement/tenders/processed', ['Dependency unsuccessful', 'Cannot run until dependency "./activities/social_services/social_service_tenders" is successfully executed']]
Invalid dependency :Cannot run until dependency passes validation: ./budgetkey/elasticsearch/index_support_criteria
From ./budgetkey/elasticsearch/index_support_criteria :['Dependency unsuccessful', 'Cannot run until dependency "./supports/criteria/support-criteria" is successfully executed']

Pipeline ID: budgetkey/elasticsearch/sitemaps

Send periodic emails (emails)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-23 05:21:27.226833
Last Completion:
2022-09-23 13:42:46.454127
Last Success:
2022-09-23 13:42:46.454127

Pipeline ID: budgetkey/emails/emails

donations/candidates
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 17:13:59.699174
Last Completion:
2022-02-07 17:14:04.265931
Last Success:
2022-02-07 17:14:04.265931

Pipeline ID: donations/candidates

donations/parties
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 16:08:37.782997
Last Completion:
2022-02-07 16:08:39.703451
Last Success:
2022-02-07 16:08:39.703451

Pipeline ID: donations/parties

donations/transactions
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-09-18 11:53:25.044548
Last Completion:
2022-09-18 11:53:47.578371
Last Success:
None

get_transactions
ERROR   :Retrying in a bit (SSLError(MaxRetryError("HTTPSConnectionPool(host='statements.mevaker.gov.il', port=443): Max retries exceeded with url: /Handler/GuarantyDonationPublisherHandler.ashx (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1091)')))")))
DEBUG   :Starting new HTTPS connection (1): statements.mevaker.gov.il:443
ERROR   :Retrying in a bit (SSLError(MaxRetryError("HTTPSConnectionPool(host='statements.mevaker.gov.il', port=443): Max retries exceeded with url: /Handler/GuarantyDonationPublisherHandler.ashx (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1091)')))")))
DEBUG   :Starting new HTTPS connection (1): statements.mevaker.gov.il:443
ERROR   :Retrying in a bit (SSLError(MaxRetryError("HTTPSConnectionPool(host='statements.mevaker.gov.il', port=443): Max retries exceeded with url: /Handler/GuarantyDonationPublisherHandler.ashx (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1091)')))")))
DEBUG   :Starting new HTTPS connection (1): statements.mevaker.gov.il:443
ERROR   :Retrying in a bit (SSLError(MaxRetryError("HTTPSConnectionPool(host='statements.mevaker.gov.il', port=443): Max retries exceeded with url: /Handler/GuarantyDonationPublisherHandler.ashx (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1091)')))")))
DEBUG   :Starting new HTTPS connection (1): statements.mevaker.gov.il:443
ERROR   :Retrying in a bit (SSLError(MaxRetryError("HTTPSConnectionPool(host='statements.mevaker.gov.il', port=443): Max retries exceeded with url: /Handler/GuarantyDonationPublisherHandler.ashx (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1091)')))")))
DEBUG   :Starting new HTTPS connection (1): statements.mevaker.gov.il:443
ERROR   :Retrying in a bit (SSLError(MaxRetryError("HTTPSConnectionPool(host='statements.mevaker.gov.il', port=443): Max retries exceeded with url: /Handler/GuarantyDonationPublisherHandler.ashx (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1091)')))")))
DEBUG   :Starting new HTTPS connection (1): statements.mevaker.gov.il:443
ERROR   :Retrying in a bit (SSLError(MaxRetryError("HTTPSConnectionPool(host='statements.mevaker.gov.il', port=443): Max retries exceeded with url: /Handler/GuarantyDonationPublisherHandler.ashx (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1091)')))")))
DEBUG   :Starting new HTTPS connection (1): statements.mevaker.gov.il:443
ERROR   :Retrying in a bit (SSLError(MaxRetryError("HTTPSConnectionPool(host='statements.mevaker.gov.il', port=443): Max retries exceeded with url: /Handler/GuarantyDonationPublisherHandler.ashx (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1091)')))")))
DEBUG   :Starting new HTTPS connection (1): statements.mevaker.gov.il:443
ERROR   :Retrying in a bit (SSLError(MaxRetryError("HTTPSConnectionPool(host='statements.mevaker.gov.il', port=443): Max retries exceeded with url: /Handler/GuarantyDonationPublisherHandler.ashx (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1091)')))")))
DEBUG   :Starting new HTTPS connection (1): statements.mevaker.gov.il:443
ERROR   :Retrying in a bit (SSLError(MaxRetryError("HTTPSConnectionPool(host='statements.mevaker.gov.il', port=443): Max retries exceeded with url: /Handler/GuarantyDonationPublisherHandler.ashx (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1091)')))")))
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 150, in <module>
    spew(dp, process_resources(res_iter))
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 109, in get_transactions
    for resp in self.get_for_candidate(cid):
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 95, in get_for_candidate
    resp = self.get_for_range(cid, range_start, range_end)
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 70, in get_for_range
    assert len(resp) == 6
AssertionError

Pipeline ID: donations/transactions

education/tochniyot/tochniyot
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 16:53:22.866406
Last Completion:
2022-02-07 16:53:58.879433
Last Success:
2022-02-07 16:53:58.879433

Pipeline ID: education/tochniyot/tochniyot

entities/all
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2022-09-26 01:24:44.906408
Last Completion:
2022-09-26 01:43:28.014716
Last Success:
2022-09-26 01:43:28.014716

Pipeline ID: entities/all

entities/associations/guidestar/guidestar
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-05-31 00:18:07.039449
Last Completion:
2022-05-31 00:22:32.257968
Last Success:
2022-05-31 00:22:32.257968

Pipeline ID: entities/associations/guidestar/guidestar

entities/associations/guidestar/guidestar-scraper
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-05-31 00:00:23.212871
Last Completion:
2022-05-31 00:01:42.420179
Last Success:
2022-05-31 00:01:42.420179

Pipeline ID: entities/associations/guidestar/guidestar-scraper

עמותות פעילות מרשם העמותות (registry)
Succeeded

רשימת כלל העמותות הפעילות, מתעדכן שבועית.


Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 16:19:30.108809
Last Completion:
2022-02-07 16:19:57.388000
Last Success:
2022-02-07 16:19:57.388000

Pipeline ID: entities/associations/registrar/registry

entities/companies/registrar/details
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:55:26.002295
Last Completion:
2022-09-26 01:06:12.392093
Last Success:
2022-09-26 01:06:12.392093

Pipeline ID: entities/companies/registrar/details

חברות פעילות מרשם החברות (scraper)
Succeeded

רשימת כלל החברות הפעילות, מתעדכן שבועית.


Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:02:32.690616
Last Completion:
2022-09-26 00:15:48.620711
Last Success:
2022-09-26 00:15:48.620711

Pipeline ID: entities/companies/registrar/scraper

רשימת אגודות שיתופיות (cooperatives)
Succeeded

רשימת אגודות שיתופיות, מתוך ממשק נתונים של מאגר של משרד הכלכלה / האגף לאיגוד שיתופי, מתעדכן שבועית


Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 16:20:14.682094
Last Completion:
2022-02-07 16:53:22.781832
Last Success:
2022-02-07 16:53:22.781832

Pipeline ID: entities/cooperatives/cooperatives

רשימת הקדשים (endowments)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 16:20:00.401028
Last Completion:
2022-02-07 16:20:14.618048
Last Success:
2022-02-07 16:20:14.618048

Pipeline ID: entities/endowments/endowments

entities/entities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 05:17:50.112434
Last Completion:
2022-09-26 05:26:02.213469
Last Success:
2022-09-26 05:26:02.213469

Pipeline ID: entities/entities

entities/fingerprints
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2022-09-26 01:43:33.109900
Last Completion:
2022-09-26 03:05:45.590622
Last Success:
2022-09-26 03:05:45.590622

Pipeline ID: entities/fingerprints

entities/foi_orgs/foi_orgs
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 16:10:27.421757
Last Completion:
2022-02-07 16:11:30.801621
Last Success:
2022-02-07 16:11:30.801621

Pipeline ID: entities/foi_orgs/foi_orgs

entities/moital/moital_service_providers
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-09-18 11:53:54.077134
Last Completion:
2022-09-18 11:53:54.968884
Last Success:
None

scraper
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/entities/moital/scraper.py", line 79, in <module>
    spew(datapackage, [scrape()])
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/entities/moital/scraper.py", line 32, in scrape
    desired_capabilities=DesiredCapabilities.PHANTOMJS)
AttributeError: type object 'DesiredCapabilities' has no attribute 'PHANTOMJS'

Pipeline ID: entities/moital/moital_service_providers

רשימת אגודות עותומניות (ottoman-association-registry)
Succeeded

רשימת אגודות עותומניות, מתוך תשובה לבקשת חופש מידע


Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 16:11:16.374183
Last Completion:
2022-02-07 16:11:32.588997
Last Success:
2022-02-07 16:11:32.588997

Pipeline ID: entities/ottoman/ottoman-association-registry

רשימת שותפויות (partnerships)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 16:10:32.620789
Last Completion:
2022-02-07 16:11:16.364914
Last Success:
2022-02-07 16:11:16.364914

Pipeline ID: entities/partnerships/partnerships

entities/safety-orders/safety-orders
Failed

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:09:50.785089
Last Completion:
2022-09-26 00:09:55.399476
Last Success:
None

stream_remote_resources
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 245, in <module>
    resource.pop('http_headers', None))
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 199, in stream_reader
    schema, headers, columns, stream, close = get_opener(url, _resource)()
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 175, in opener
    _stream.open()
  File "/usr/local/lib/python3.7/site-packages/tabulator/stream.py", line 423, in open
    self.__parser.open(source, encoding=self.__encoding)
  File "/usr/local/lib/python3.7/site-packages/tabulator/parsers/xlsx.py", line 99, in open
    self.__bytes, read_only=not self.__fill_merged_cells, data_only=True
  File "/usr/local/lib/python3.7/site-packages/openpyxl/reader/excel.py", line 316, in load_workbook
    data_only, keep_links)
  File "/usr/local/lib/python3.7/site-packages/openpyxl/reader/excel.py", line 124, in __init__
    self.archive = _validate_archive(fn)
  File "/usr/local/lib/python3.7/site-packages/openpyxl/reader/excel.py", line 96, in _validate_archive
    archive = ZipFile(filename, 'r')
  File "/usr/local/lib/python3.7/zipfile.py", line 1258, in __init__
    self._RealGetContents()
  File "/usr/local/lib/python3.7/zipfile.py", line 1325, in _RealGetContents
    raise BadZipFile("File is not a zip file")
zipfile.BadZipFile: File is not a zip file

Pipeline ID: entities/safety-orders/safety-orders

entities/safety-orders/safety-orders-by-entity
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./entities/safety-orders/safety-orders" is successfully executed

Pipeline ID: entities/safety-orders/safety-orders-by-entity

entities/special/registry
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:00:22.187457
Last Completion:
2022-09-26 00:09:50.708484
Last Success:
2022-09-26 00:09:50.708484

Pipeline ID: entities/special/registry

ezvonot/ezvonot_accounts
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:42:26.792963
Last Completion:
2022-09-26 00:42:53.311248
Last Success:
2022-09-26 00:42:53.311248

Pipeline ID: ezvonot/ezvonot_accounts

ezvonot/ezvonot_cases
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:42:53.381104
Last Completion:
2022-09-26 00:43:12.093666
Last Success:
2022-09-26 00:43:12.093666

Pipeline ID: ezvonot/ezvonot_cases

ezvonot/ezvonot_crontab
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:02:30.022344
Last Completion:
2022-09-26 00:02:32.589691
Last Success:
2022-09-26 00:02:32.589691

Pipeline ID: ezvonot/ezvonot_crontab

ezvonot/ezvonot_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:43:29.305060
Last Completion:
2022-09-26 00:44:00.107736
Last Success:
2022-09-26 00:44:00.107736

Pipeline ID: ezvonot/ezvonot_decisions

ezvonot/ezvonot_decisions_join
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2022-09-26 01:16:26.008534
Last Completion:
2022-09-26 01:17:53.380087
Last Success:
2022-09-26 01:17:53.380087

Pipeline ID: ezvonot/ezvonot_decisions_join

ezvonot/ezvonot_deposits
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:41:51.891014
Last Completion:
2022-09-26 00:42:26.785676
Last Success:
2022-09-26 00:42:26.785676

Pipeline ID: ezvonot/ezvonot_deposits

ezvonot/ezvonot_purposes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:43:12.123502
Last Completion:
2022-09-26 00:43:29.288563
Last Success:
2022-09-26 00:43:29.288563

Pipeline ID: ezvonot/ezvonot_purposes

government_decisions/government_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 12:00:59.230741
Last Completion:
2022-09-26 12:01:09.030004
Last Success:
2022-09-26 12:01:09.030004

Pipeline ID: government_decisions/government_decisions

government_decisions/scraper
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 12:00:02.854050
Last Completion:
2022-09-26 12:00:59.142463
Last Success:
2022-09-26 12:00:59.142463

Pipeline ID: government_decisions/scraper

lamas/municipal-data
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:44:00.202367
Last Completion:
2022-09-26 00:44:54.493293
Last Success:
2022-09-26 00:44:54.493293

Pipeline ID: lamas/municipal-data

קובץ התאמת רשויות אזוריות לישובים בשטחן (municipality-to-city)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 16:06:30.088442
Last Completion:
2022-02-07 16:06:33.079304
Last Success:
2022-02-07 16:06:33.079304

Pipeline ID: lamas/municipality-to-city

maya/maya-bonds-and-options-holdings-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 03:41:30.980111
Last Completion:
2022-09-26 03:50:14.710985
Last Success:
2022-09-26 03:50:14.710985

Pipeline ID: maya/maya-bonds-and-options-holdings-changes

maya/maya-company-officer-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 03:41:07.505482
Last Completion:
2022-09-26 03:50:53.595996
Last Success:
2022-09-26 03:50:53.595996

Pipeline ID: maya/maya-company-officer-list

maya/maya-company-stakeholder-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 03:50:19.887642
Last Completion:
2022-09-26 04:08:21.222569
Last Success:
2022-09-26 04:08:21.222569

Pipeline ID: maya/maya-company-stakeholder-list

maya/maya-company-vip-appointments
Failed

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 03:41:07.511614
Last Completion:
2022-09-26 03:41:30.914804
Last Success:
None

flow
ERROR   :Traceback (most recent call last):
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
ERROR   :spew_flow(flow, ctx)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
ERROR   :spew(self.datapackage, self.resource_iterator, stats=self.stats)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
ERROR   :for rec in res:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/processors/delete_fields.py", line 7, in process_resource
ERROR   :for row in rows:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource
ERROR   :yield from self.func(resource)
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_parser_utils.py", line 52, in iter
ERROR   :for row in rows:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource
ERROR   :yield from self.func(resource)
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/parse_maya_vip_appointments.py", line 111, in parse_document
ERROR   :for row in rows:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource
ERROR   :yield from self.func(resource)
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/parse_maya_vip_appointments.py", line 88, in validate
ERROR   :verify_row_values(row, 'IsIsraeli', {'אדם פרטי ללא אזרחות ישראלית', 'אדם פרטי עם אזרחות ישראלית'})
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_parser_utils.py", line 35, in verify_row_values
ERROR   :raise Exception("Document {} failed validation. textAlias {} had illegal value: {}".format(url, field, doc[field]))
ERROR   :Exception
ERROR   ::
ERROR   :Document https://mayafiles.tase.co.il/RHtm/1444001-1445000/H1444010.htm failed validation. textAlias IsIsraeli had illegal value: ['Individual who holds Israeli citizenship']

Pipeline ID: maya/maya-company-vip-appointments

maya/maya-complete-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 03:05:39.328916
Last Completion:
2022-09-26 03:41:07.242579
Last Success:
2022-09-26 03:41:07.242579

Pipeline ID: maya/maya-complete-notification-list

maya/maya-holdings-changes
Failed

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 03:50:14.717408
Last Completion:
2022-09-26 03:50:19.880854
Last Success:
None

flow
ERROR   :Traceback (most recent call last):
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
ERROR   :spew_flow(flow, ctx)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
ERROR   :spew(self.datapackage, self.resource_iterator, stats=self.stats)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
ERROR   :for rec in res:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/processors/delete_fields.py", line 7, in process_resource
ERROR   :for row in rows:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource
ERROR   :yield from self.func(resource)
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/parse_maya_holdings_change.py", line 122, in parse_document
ERROR   :for row in rows:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource
ERROR   :yield from self.func(resource)
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/parse_maya_holdings_change.py", line 118, in validate
ERROR   :verify_row_values(row, 'EntityType', ENTITY_TYPES)
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_parser_utils.py", line 35, in verify_row_values
ERROR   :raise Exception("Document {} failed validation. textAlias {} had illegal value: {}".format(url, field, doc[field]))
ERROR   :Exception
ERROR   ::
ERROR   :Document https://mayafiles.tase.co.il/RHtm/1473001-1474000/H1473091.htm failed validation. textAlias EntityType had illegal value: ['Individual who does not hold Israeli citizenship', 'Individual who does not hold Israeli citizenship', 'Individual who does not hold Israeli citizenship']

Pipeline ID: maya/maya-holdings-changes

maya/maya-notification-parse-updates
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 01:14:42.504804
Last Completion:
2022-09-26 03:05:39.097533
Last Success:
2022-09-26 03:05:39.097533

Pipeline ID: maya/maya-notification-parse-updates

maya/maya-reported-academic-degrees
Failed

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 03:50:53.605830
Last Completion:
2022-09-26 03:51:15.907017
Last Success:
None

flow
ERROR   :Traceback (most recent call last):
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
ERROR   :spew_flow(flow, ctx)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
ERROR   :spew(self.datapackage, self.resource_iterator, stats=self.stats)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
ERROR   :for rec in res:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/processors/delete_fields.py", line 7, in process_resource
ERROR   :for row in rows:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource
ERROR   :yield from self.func(resource)
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_parser_utils.py", line 52, in iter
ERROR   :for row in rows:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource
ERROR   :yield from self.func(resource)
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/parse_reported_academic_degrees.py", line 67, in parse_document
ERROR   :for row in rows:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource
ERROR   :yield from self.func(resource)
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/parse_reported_academic_degrees.py", line 51, in validate
ERROR   :verify_row_values(row, 'SugMisparZihuy', SUG_MISPAR_ZIHUY_MAPPING)
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_parser_utils.py", line 35, in verify_row_values
ERROR   :raise Exception("Document {} failed validation. textAlias {} had illegal value: {}".format(url, field, doc[field]))
ERROR   :Exception
ERROR   ::
ERROR   :Document https://mayafiles.tase.co.il/RHtm/1444001-1445000/H1444010.htm failed validation. textAlias SugMisparZihuy had illegal value: ['ID no.']

Pipeline ID: maya/maya-reported-academic-degrees

maya/maya-reported-work-record
Failed

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 03:51:15.916944
Last Completion:
2022-09-26 03:51:38.180321
Last Success:
None

flow
ERROR   :Traceback (most recent call last):
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
ERROR   :spew_flow(flow, ctx)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
ERROR   :spew(self.datapackage, self.resource_iterator, stats=self.stats)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
ERROR   :for rec in res:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/processors/delete_fields.py", line 7, in process_resource
ERROR   :for row in rows:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource
ERROR   :yield from self.func(resource)
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_parser_utils.py", line 52, in iter
ERROR   :for row in rows:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource
ERROR   :yield from self.func(resource)
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/parse_reported_work_record.py", line 67, in parse_document
ERROR   :for row in rows:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource
ERROR   :yield from self.func(resource)
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/parse_reported_work_record.py", line 52, in validate
ERROR   :verify_row_values(row, 'SugMisparZihuy', SUG_MISPAR_ZIHUY_MAPPING)
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_parser_utils.py", line 35, in verify_row_values
ERROR   :raise Exception("Document {} failed validation. textAlias {} had illegal value: {}".format(url, field, doc[field]))
ERROR   :Exception
ERROR   ::
ERROR   :Document https://mayafiles.tase.co.il/RHtm/1444001-1445000/H1444010.htm failed validation. textAlias SugMisparZihuy had illegal value: ['ID no.']

Pipeline ID: maya/maya-reported-work-record

maya/maya-tase-companies-current-management
Running

Last Run triggered by:
dirty-task-update
Last Run started at:
2022-09-26 08:46:01.342613
Last Completion:
Last Success:
2022-09-26 08:45:26.344452

Pipeline ID: maya/maya-tase-companies-current-management

maya/maya-tase-companies-current-shareholders
Running

Last Run triggered by:
dirty-task-update
Last Run started at:
2022-09-26 08:24:01.348817
Last Completion:
Last Success:
2022-09-26 08:23:43.542184

Pipeline ID: maya/maya-tase-companies-current-shareholders

maya/scrape-maya-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:12:23.785113
Last Completion:
2022-09-26 00:39:07.883219
Last Success:
2022-09-26 00:39:07.883219

Pipeline ID: maya/scrape-maya-notification-list

maya/scrape-maya-tase-companies
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:10:02.611474
Last Completion:
2022-09-26 00:11:43.305386
Last Success:
2022-09-26 00:11:43.305386

Pipeline ID: maya/scrape-maya-tase-companies

people/aggregated
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-03-24 15:22:19.595098
Last Completion:
2022-03-24 15:29:29.006865
Last Success:
2022-03-24 15:29:29.006865

Invalid dependency :Cannot run until dependency passes validation: ./people/all
From ./people/all :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']
From ./people/all :['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]
From ./people/all :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/procurement/procurement-individuals']
From ./people/all :['From ./people/procurement/procurement-individuals', ['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/spending/latest-contract-spending']]
From ./people/all :['From ./people/procurement/procurement-individuals', ['From ./procurement/spending/latest-contract-spending', ['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/spending/quarterly-contract-spending-reports-data']]]
From ./people/all :['From ./people/procurement/procurement-individuals', ['From ./procurement/spending/latest-contract-spending', ['From ./procurement/spending/quarterly-contract-spending-reports-data', ['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/spending/quarterly-contract-spending-reports']]]]
From ./people/all :['From ./people/procurement/procurement-individuals', ['From ./procurement/spending/latest-contract-spending', ['From ./procurement/spending/quarterly-contract-spending-reports-data', ['From ./procurement/spending/quarterly-contract-spending-reports', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/spending/quarterly-contract-spending-report-uris" is successfully executed']]]]]

Pipeline ID: people/aggregated

people/all
Invalid

Last Run triggered by:
scheduled
Last Run started at:
2022-03-24 05:27:53.221203
Last Completion:
2022-03-24 05:28:53.549060
Last Success:
2022-03-24 05:28:53.549060

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/all-appointments
From ./people/company_appointments/all-appointments :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]
From ./people/company_appointments/all-appointments :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]

Pipeline ID: people/all

people/association_founders/association-founders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-05-31 00:59:07.438038
Last Completion:
2022-05-31 00:59:48.116003
Last Success:
2022-05-31 00:59:48.116003

Pipeline ID: people/association_founders/association-founders

people/company_appointments/all-appointments
Invalid

Last Run triggered by:
dirty-task-update
Last Run started at:
2022-03-24 01:56:42.730671
Last Completion:
2022-03-24 02:00:05.040115
Last Success:
2022-03-24 02:00:05.040115

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations
From ./people/company_appointments/maya/maya-nominations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]
Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations
From ./people/company_appointments/maya/maya-resignations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]

Pipeline ID: people/company_appointments/all-appointments

people/company_appointments/maya/collect-maya-forms-debug-stats
Invalid

Last Run triggered by:
scheduled
Last Run started at:
2022-03-23 02:16:22.908989
Last Completion:
2022-03-23 02:16:29.114154
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed

Pipeline ID: people/company_appointments/maya/collect-maya-forms-debug-stats

Join the parsed PDF to get start and end time for each person (correlate)
Invalid

Last Run triggered by:
dirty-task-update
Last Run started at:
2022-03-24 01:48:31.927341
Last Completion:
2022-03-24 01:49:49.033072
Last Success:
2022-03-24 01:49:49.033072

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations
From ./people/company_appointments/maya/maya-nominations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]
Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations
From ./people/company_appointments/maya/maya-resignations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]

Pipeline ID: people/company_appointments/maya/correlate

people/company_appointments/maya/maya-list
Invalid

Last Run triggered by:
dirty-task-update
Last Run started at:
2022-03-24 00:17:27.791335
Last Completion:
2022-03-24 00:20:25.191562
Last Success:
2022-03-24 00:20:25.191562

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates
From ./people/company_appointments/maya/maya-notification-updates :['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']

Pipeline ID: people/company_appointments/maya/maya-list

Appointment notices from Maya (maya-nominations)
Invalid

Name, job and company description.


Last Run triggered by:
dirty-task-update
Last Run started at:
2022-03-24 00:40:03.993696
Last Completion:
2022-03-24 00:41:26.628480
Last Success:
2022-03-24 00:41:26.628480

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list
From ./people/company_appointments/maya/maya-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']
From ./people/company_appointments/maya/maya-list :['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]

Pipeline ID: people/company_appointments/maya/maya-nominations

people/company_appointments/maya/maya-notification-list
Failed

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:11:49.011165
Last Completion:
2022-09-26 00:11:51.789257
Last Success:
None

scrape-notification-list
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/requests/models.py", line 910, in json
    return complexjson.loads(self.text, **kwargs)
  File "/usr/local/lib/python3.7/json/__init__.py", line 348, in loads
    return _default_decoder.decode(s)
  File "/usr/local/lib/python3.7/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/local/lib/python3.7/json/decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 55, in _maya_api_call
    return res.json()
  File "/usr/local/lib/python3.7/site-packages/requests/models.py", line 917, in json
    raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: [Errno Expecting value] <html style="height:100%"><head><META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW"><meta name="format-detection" content="telephone=no"><meta name="viewport" content="initial-scale=1.0"><meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1"><script type="text/javascript" src="/_Incapsula_Resource?SWJIYLWA=719d34d31c8e3a6e6fffd425f7e032f3"></script></head><body style="margin:0px;height:100%"><iframe id="main-iframe" src="/_Incapsula_Resource?CWUDNSAI=23&xinfo=13-27951820-0%200NNN%20RT%281664151111160%2014%29%20q%280%20-1%20-1%200%29%20r%280%20-1%29%20B15%2811%2c1795525%2c0%29%20U6&incident_id=352000840044364939-142777417455375629&edet=15&cinfo=0b000000&rpinfo=0&mth=POST" frameborder=0 width="100%" height="100%" marginheight="0px" marginwidth="0px">Request unsuccessful. Incapsula incident ID: 352000840044364939-142777417455375629</iframe></body></html>: 0
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 130, in <module>
    spew(datapackage, [collect()])
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 113, in collect
    yield from _collect_date_range(year_start, year_end)
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 75, in _collect_date_range
    res = _maya_api_call(date_from, date_to, current_page)
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 57, in _maya_api_call
    raise Exception("Failed to Call Maya API for date_from:{} date_to:{} page_num:{}".format(date_from, date_to, page_num)) from e
Exception: Failed to Call Maya API for date_from:2006-01-01 date_to:2007-01-01 page_num:0

Pipeline ID: people/company_appointments/maya/maya-notification-list

List all notifications from maya system (maya-notification-updates)
Invalid

id, date, company, notification_type, s3_object_name, url


Last Run triggered by:
scheduled
Last Run started at:
2022-03-23 02:16:29.237984
Last Completion:
2022-03-23 02:55:31.635833
Last Success:
2022-03-23 02:55:31.635833

Dependency unsuccessful :Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed

Pipeline ID: people/company_appointments/maya/maya-notification-updates

Appointment notices from Maya (maya-resignations)
Invalid

Name, job and company description.


Last Run triggered by:
dirty-task-update
Last Run started at:
2022-03-24 00:41:26.716751
Last Completion:
2022-03-24 00:42:45.612526
Last Success:
2022-03-24 00:42:45.612526

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list
From ./people/company_appointments/maya/maya-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']
From ./people/company_appointments/maya/maya-list :['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]

Pipeline ID: people/company_appointments/maya/maya-resignations

מינויים בכלכליסט (calcalist)
Succeeded

רשימת כל המינויים והחברות מאתר כלכליסט


Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 16:08:51.425035
Last Completion:
2022-02-07 16:16:12.473095
Last Success:
2022-02-07 16:16:12.473095

Pipeline ID: people/company_appointments/media/calcalist/calcalist

Appointment notices from TheMarker (themarker)
Succeeded

Name, job and company description.


Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:00:10.831155
Last Completion:
2022-09-26 00:00:27.080848
Last Success:
2022-09-26 00:00:27.080848

Pipeline ID: people/company_appointments/media/themarker/themarker

Join the parsed PDF to get start and end time for each person (correlate)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 01:24:42.715809
Last Completion:
2022-09-26 01:24:51.390171
Last Success:
2022-09-26 01:24:51.390171

Pipeline ID: people/company_appointments/state_owned/correlate

Parse and concatenate all PDF reports (parse_pdf_resources)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:54:31.791682
Last Completion:
2022-09-26 00:54:35.586617
Last Success:
2022-09-26 00:54:35.586617

Pipeline ID: people/company_appointments/state_owned/parse_pdf_resources

collect links to all pdf reports on https://mof.gov.il/GCA/Directors/Pages/DirectorsManningReport.aspx (reports)
Succeeded

columns: date, url


Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:09:55.409022
Last Completion:
2022-09-26 00:10:02.585125
Last Success:
2022-09-26 00:10:02.585125

Pipeline ID: people/company_appointments/state_owned/reports

people/company_appointments/state_owned/state-owned-nominations
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 01:43:28.031906
Last Completion:
2022-09-26 01:43:33.089310
Last Success:
2022-09-26 01:43:33.089310

Pipeline ID: people/company_appointments/state_owned/state-owned-nominations

people/municipal_appointments/municipal_representitives
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 16:08:49.103612
Last Completion:
2022-02-07 16:08:51.417135
Last Success:
2022-02-07 16:08:51.417135

Pipeline ID: people/municipal_appointments/municipal_representitives

people/political_candidates/election_candidates21
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 16:08:41.807688
Last Completion:
2022-02-07 16:09:12.328094
Last Success:
2022-02-07 16:09:12.328094

Pipeline ID: people/political_candidates/election_candidates21

people/political_donations/political_donations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 16:08:39.711304
Last Completion:
2022-02-07 16:08:41.799953
Last Success:
2022-02-07 16:08:41.799953

Pipeline ID: people/political_donations/political_donations

people/procurement/procurement-individuals
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 05:08:02.330652
Last Completion:
2022-09-26 05:17:46.287395
Last Success:
2022-09-26 05:17:46.287395

Pipeline ID: people/procurement/procurement-individuals

procurement/calls_for_bids/calls-for-bids-all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-25 16:00:04.134915
Last Completion:
2022-09-25 16:10:33.132725
Last Success:
2022-09-25 16:10:33.132725

Pipeline ID: procurement/calls_for_bids/calls-for-bids-all

procurement/calls_for_bids/calls-for-bids-moh
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:00:11.597701
Last Completion:
2022-09-26 00:00:22.007185
Last Success:
2022-09-26 00:00:22.007185

Pipeline ID: procurement/calls_for_bids/calls-for-bids-moh

procurement/calls_for_bids/gov-publications
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 16:00:42.766201
Last Completion:
2022-02-07 16:01:14.001038
Last Success:
2022-02-07 16:01:14.001038

Pipeline ID: procurement/calls_for_bids/gov-publications

procurement/calls_for_bids/gov-publications-ministry-of-immigration
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 16:00:42.790325
Last Completion:
2022-02-07 16:00:49.764791
Last Success:
2022-02-07 16:00:49.764791

Pipeline ID: procurement/calls_for_bids/gov-publications-ministry-of-immigration

procurement/calls_for_bids/gov-publications2
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 16:00:42.776628
Last Completion:
2022-02-07 16:01:00.166965
Last Success:
2022-02-07 16:01:00.166965

Pipeline ID: procurement/calls_for_bids/gov-publications2

procurement/calls_for_bids/jobiz-all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-25 15:00:10.758407
Last Completion:
2022-09-25 15:00:13.274544
Last Success:
2022-09-25 15:00:13.274544

Pipeline ID: procurement/calls_for_bids/jobiz-all

procurement/calls_for_bids/jobiz-calls-for-bids
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-25 15:00:13.300136
Last Completion:
2022-09-25 15:00:15.055426
Last Success:
2022-09-25 15:00:15.055426

Pipeline ID: procurement/calls_for_bids/jobiz-calls-for-bids

procurement/calls_for_bids/jobiz-scraper
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-25 15:00:02.934077
Last Completion:
2022-09-25 15:00:10.723098
Last Success:
2022-09-25 15:00:10.723098

Pipeline ID: procurement/calls_for_bids/jobiz-scraper

התקשרויות רכש ממשלתיות (latest-contract-spending)
Succeeded

אנו סוכמים מידע מתוך הדוחות הרבעוניים לתוך טבלה המכילה את המידע העדכני ביותר.


Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 01:09:11.206802
Last Completion:
2022-09-26 05:08:01.902217
Last Success:
2022-09-26 05:08:01.902217

Pipeline ID: procurement/spending/latest-contract-spending

procurement/spending/quarterly-contract-spending-report-uris
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-25 23:00:02.454682
Last Completion:
2022-09-25 23:00:30.327528
Last Success:
2022-09-25 23:00:30.327528

Pipeline ID: procurement/spending/quarterly-contract-spending-report-uris

דוחות רבעוניים מתוך מרכבה, לפי נוהל היחידה לחופש המידע. (quarterly-contract-spending-reports)
Succeeded

כל משרדי הממשלה ויחידות הסמך (שמחוברות למערכת מרכבה) צריכים לפרסם אחת לרבעון (תוך 45 יום מסוף הרבעון) דו״ח התקשרויות לפי פורמט מוגדר היטב הממומש כדו״ח מובנה במערכת המרכבה. כל המשרדים מדווחים עצמאית והדו״חות עולים לאתר היחידה לחופש המידע, משם אנו אוספים אותם. התוצר של השרשר הזה הוא פירוט כל הדיווחים של כל המשרדים.


Last Run triggered by:
scheduled
Last Run started at:
2022-09-25 23:00:30.473075
Last Completion:
2022-09-25 23:16:05.518422
Last Success:
2022-09-25 23:16:05.518422

Pipeline ID: procurement/spending/quarterly-contract-spending-reports

procurement/spending/quarterly-contract-spending-reports-data
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-25 23:16:05.613479
Last Completion:
2022-09-26 00:35:25.880947
Last Success:
2022-09-26 00:35:25.880947

Pipeline ID: procurement/spending/quarterly-contract-spending-reports-data

procurement/spending/spending-by-entity
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 05:08:02.273742
Last Completion:
2022-09-26 05:17:49.903893
Last Success:
2022-09-26 05:17:49.903893

Pipeline ID: procurement/spending/spending-by-entity

Load all tenders data from data.gov.il to flat file (all)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:15:48.711008
Last Completion:
2022-09-26 00:23:32.293453
Last Success:
2022-09-26 00:23:32.293453

Pipeline ID: procurement/tenders/all

procurement/tenders/processed
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-08-19 15:08:17.134685
Last Completion:
2022-08-19 15:17:12.781142
Last Success:
2022-08-19 15:17:12.781142

Dependency unsuccessful :Cannot run until dependency "./activities/social_services/social_service_tenders" is successfully executed

Pipeline ID: procurement/tenders/processed

reports/all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-05-31 01:40:03.246091
Last Completion:
2022-05-31 01:40:11.736526
Last Success:
2022-05-31 01:40:11.736526

Pipeline ID: reports/all

reports/ngos/ngo-activity-report
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-05-31 00:55:01.017315
Last Completion:
2022-05-31 00:59:07.422675
Last Success:
2022-05-31 00:59:07.422675

Pipeline ID: reports/ngos/ngo-activity-report

reports/ngos/ngo-district-report
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-05-31 00:52:34.839756
Last Completion:
2022-05-31 00:55:00.937806
Last Success:
2022-05-31 00:55:00.937806

Pipeline ID: reports/ngos/ngo-district-report

supports/all
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./supports/supports-2021" is successfully executed

Pipeline ID: supports/all

supports/by-payment-year
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:57:03.908211
Last Completion:
2022-09-26 01:14:42.498196
Last Success:
2022-09-26 01:14:42.498196

Pipeline ID: supports/by-payment-year

supports/by-request-year
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 01:06:12.479505
Last Completion:
2022-09-26 01:24:44.810421
Last Success:
2022-09-26 01:24:44.810421

Pipeline ID: supports/by-request-year

supports/criteria/support-criteria
Failed

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:54:35.522735
Last Completion:
2022-09-26 00:54:41.100120
Last Success:
None

sample
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/processors/sample.py", line 11, in <module>
    res_name = parameters.get('resource', datapackage['resources'][0]['name'])
IndexError: list index out of range

Pipeline ID: supports/criteria/support-criteria

supports/criteria/support-criteria-doj
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2022-09-26 00:11:43.311333
Last Completion:
2022-09-26 00:11:48.999292
Last Success:
2022-09-26 00:11:48.999292

Pipeline ID: supports/criteria/support-criteria-doj

supports/supports-2004
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 16:00:55.739852
Last Completion:
2022-02-07 16:00:57.037390
Last Success:
2022-02-07 16:00:57.037390

Pipeline ID: supports/supports-2004

supports/supports-2005
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 16:00:57.042426
Last Completion:
2022-02-07 16:00:58.492944
Last Success:
2022-02-07 16:00:58.492944

Pipeline ID: supports/supports-2005

supports/supports-2006
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 16:00:58.497137
Last Completion:
2022-02-07 16:01:00.808614
Last Success:
2022-02-07 16:01:00.808614

Pipeline ID: supports/supports-2006

supports/supports-2007
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2022-02-07 16:00:58.675581
Last Completion:
2022-02-07 16:01:01.204087
Last Success:
2022-02-07 16:01:01.204087

Pipeline ID: supports/supports-2007

supports/supports-2008
Succeeded