activities/social_services/social_service_reports
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 03:52:14.100422
Last Completion:
2023-09-28 03:53:17.910129
Last Success:
2023-09-28 03:53:17.910129

Pipeline ID: activities/social_services/social_service_reports

activities/social_services/social_service_suppliers
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 03:52:08.122404
Last Completion:
2023-09-28 03:52:11.370908
Last Success:
2023-09-28 03:52:11.370908

Pipeline ID: activities/social_services/social_service_suppliers

activities/social_services/social_service_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 03:52:11.399631
Last Completion:
2023-09-28 03:52:14.030690
Last Success:
2023-09-28 03:52:14.030690

Pipeline ID: activities/social_services/social_service_tenders

Fetch social services from data input (social_services)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 01:18:35.416749
Last Completion:
2023-09-28 01:18:55.518719
Last Success:
2023-09-28 01:18:55.518719

Pipeline ID: activities/social_services/social_services

bank_of_israel/bank_of_israel
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-15 09:55:56.007231
Last Completion:
2023-03-15 09:56:02.879346
Last Success:
2023-03-15 09:56:02.879346

Pipeline ID: bank_of_israel/bank_of_israel

budget/municipal/fetcher
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 01:14:44.252678
Last Completion:
2023-09-28 01:19:41.920521
Last Success:
2023-09-28 01:19:41.920521

Pipeline ID: budget/municipal/fetcher

budget/national/changes/explanations/all
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-15 09:43:51.305155
Last Completion:
2023-03-15 09:45:42.173965
Last Success:
2023-03-15 09:45:42.173965

Pipeline ID: budget/national/changes/explanations/all

budget/national/changes/original/current-year-fixes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 01:48:41.545846
Last Completion:
2023-09-28 01:48:57.405082
Last Success:
2023-09-28 01:48:57.405082

Pipeline ID: budget/national/changes/original/current-year-fixes

budget/national/changes/original/national-budget-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 00:32:55.566447
Last Completion:
2023-09-28 00:35:31.818868
Last Success:
2023-09-28 00:35:31.818868

Pipeline ID: budget/national/changes/original/national-budget-changes

Changes, grouped by transaction_id, with explanations (national-budget-changes-aggregated)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 06:30:22.972212
Last Completion:
2023-09-28 06:33:31.752162
Last Success:
2023-09-28 06:33:31.752162

Pipeline ID: budget/national/changes/processed/national-budget-changes-aggregated

budget/national/changes/processed/transactions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 01:48:57.415060
Last Completion:
2023-09-28 05:21:33.425458
Last Success:
2023-09-28 05:21:33.425458

Pipeline ID: budget/national/changes/processed/transactions

National Yearly Budgets (national-budgets)
Succeeded

We get the data the Ministry of Finance publishes in data.gov.il every year. It comes in XLS format, with one row per TAKANA and phase (original, approved, executed). In this pipeline we create from each triplet a single row that has all the data.


Last Run triggered by:
dirty-task-init
Last Run started at:
2023-06-11 10:37:33.269237
Last Completion:
2023-06-11 12:39:00.612511
Last Success:
2023-06-11 12:39:00.612511

Pipeline ID: budget/national/original/national-budgets

National Yearly Budgets - Processed (aggregated-yearly)
Succeeded

This pipeline joins the different phases of the budget (allocated, revised and executed). In the original file there's a separate row for each of the phases. We like it better as a single row with all phase info. Another thing this pipeline does is to rename the column titles - to more friendly English names. Also, it create rows for all hierarchies - where upper hierarchies (2, 4 & 6 digits) are plain aggregations of the 8-digit items they contain.


Last Run triggered by:
dirty-task-init
Last Run started at:
2023-07-24 14:15:51.535375
Last Completion:
2023-07-24 15:31:27.929959
Last Success:
2023-07-24 15:31:27.929959

Pipeline ID: budget/national/processed/aggregated-yearly

budget/national/processed/category-explanations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-15 09:45:42.183179
Last Completion:
2023-03-15 09:45:42.766711
Last Success:
2023-03-15 09:45:42.766711

Pipeline ID: budget/national/processed/category-explanations

National Yearly Budgets - Joined with category-explanations (connected-items-explained)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-update
Last Run started at:
2023-07-24 15:55:42.205913
Last Completion:
2023-07-24 15:57:37.043082
Last Success:
2023-07-24 15:57:37.043082

Pipeline ID: budget/national/processed/connected-items-explained

National Yearly Budgets - Connected Items (connected-national-budgets)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-update
Last Run started at:
2023-07-24 15:42:01.302369
Last Completion:
2023-07-24 15:55:42.048977
Last Success:
2023-07-24 15:55:42.048977

Pipeline ID: budget/national/processed/connected-national-budgets

National Yearly Budgets - Just the total (item 00) (just-the-total)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-07-24 15:42:02.045933
Last Completion:
2023-07-24 15:47:45.165913
Last Success:
2023-07-24 15:47:45.165913

Pipeline ID: budget/national/processed/just-the-total

National Yearly Budgets - Main Item Names (roof-names)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-07-24 15:42:02.053896
Last Completion:
2023-07-24 15:47:49.639283
Last Success:
2023-07-24 15:47:49.639283

Pipeline ID: budget/national/processed/roof-names

National Yearly Budgets - With Extras (with-extras)
Succeeded

This pipeline joins the budget data to itself so that each item has a list of its immediate children.


Last Run triggered by:
dirty-task-init
Last Run started at:
2023-07-24 15:31:28.095448
Last Completion:
2023-07-24 15:42:01.159958
Last Success:
2023-07-24 15:42:01.159958

Pipeline ID: budget/national/processed/with-extras

budgetkey/analysis/spending/publisher_entity_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 02:08:01.515879
Last Completion:
2023-09-28 03:43:59.552519
Last Success:
2023-09-28 03:43:59.552519

Pipeline ID: budgetkey/analysis/spending/publisher_entity_analysis

budgetkey/analysis/spending/publisher_foa_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 03:14:46.542788
Last Completion:
2023-09-28 03:21:41.835044
Last Success:
2023-09-28 03:21:41.835044

Pipeline ID: budgetkey/analysis/spending/publisher_foa_analysis

budgetkey/analysis/spending/united
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 00:38:04.726950
Last Completion:
2023-09-28 00:53:43.313351
Last Success:
2023-09-28 00:53:43.313351

Pipeline ID: budgetkey/analysis/spending/united

Main Page - Aggregated budget by functional classification (budget-functional-aggregates)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-07-24 15:31:28.150381
Last Completion:
2023-07-24 15:35:10.771847
Last Success:
2023-07-24 15:35:10.771847

Pipeline ID: budgetkey/budget-functional-aggregates

budgetkey/documents
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-07-24 15:35:11.023210
Last Completion:
2023-07-24 15:35:13.057575
Last Success:
2023-07-24 15:35:13.057575

Pipeline ID: budgetkey/documents

budgetkey/elasticsearch/index_activities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 03:53:17.919282
Last Completion:
2023-09-28 03:53:48.268801
Last Success:
2023-09-28 03:53:48.268801

Pipeline ID: budgetkey/elasticsearch/index_activities

budgetkey/elasticsearch/index_budget
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2023-09-27 23:59:09.717440
Last Completion:
2023-09-28 00:32:55.549799
Last Success:
2023-09-28 00:32:55.549799

Pipeline ID: budgetkey/elasticsearch/index_budget

budgetkey/elasticsearch/index_calls_for_bids
Invalid

Last Run triggered by:
scheduled
Last Run started at:
2023-04-02 15:06:02.108212
Last Completion:
2023-04-02 15:06:37.869298
Last Success:
2023-04-02 15:06:37.869298

Dependency unsuccessful :Cannot run until dependency "./procurement/calls_for_bids/calls-for-bids-all" is successfully executed

Pipeline ID: budgetkey/elasticsearch/index_calls_for_bids

budgetkey/elasticsearch/index_contract_spending
Running

Last Run triggered by:
dirty-task-update
Last Run started at:
2023-09-28 06:16:03.721731
Last Completion:
Last Success:
2023-09-28 03:14:46.448712

Pipeline ID: budgetkey/elasticsearch/index_contract_spending

budgetkey/elasticsearch/index_entities
Queued

Last Run triggered by:
dirty-task-update
Last Run started at:
Last Completion:
Last Success:
2023-09-19 11:11:09.299261

Pipeline ID: budgetkey/elasticsearch/index_entities

budgetkey/elasticsearch/index_gov_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 05:50:14.816608
Last Completion:
2023-09-28 05:53:04.409572
Last Success:
2023-09-28 05:53:04.409572

Pipeline ID: budgetkey/elasticsearch/index_gov_decisions

budgetkey/elasticsearch/index_muni_budgets
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 03:53:48.300971
Last Completion:
2023-09-28 03:59:43.712897
Last Success:
2023-09-28 03:59:43.712897

Pipeline ID: budgetkey/elasticsearch/index_muni_budgets

budgetkey/elasticsearch/index_muni_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 03:51:38.025198
Last Completion:
2023-09-28 03:52:08.115134
Last Success:
2023-09-28 03:52:08.115134

Pipeline ID: budgetkey/elasticsearch/index_muni_tenders

budgetkey/elasticsearch/index_national_budget_changes
Running

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 08:14:02.807216
Last Completion:
Last Success:
2023-09-28 01:54:54.320130

Pipeline ID: budgetkey/elasticsearch/index_national_budget_changes

budgetkey/elasticsearch/index_people
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/aggregated
From ./people/aggregated :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/all']
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/state_owned/state-owned-nominations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/state_owned/state-owned-nominations', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/state_owned/correlate" is successfully executed']]]]
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/procurement/procurement-individuals']]
From ./people/aggregated :['From ./people/all', ['From ./people/procurement/procurement-individuals', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/spending/latest-contract-spending" is successfully executed']]]
From ./people/aggregated :['From ./people/all', ['Dependency unsuccessful', 'Cannot run until dependency "./people/political_donations/political_donations" is successfully executed']]

Pipeline ID: budgetkey/elasticsearch/index_people

budgetkey/elasticsearch/index_reports
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./reports/all
From ./reports/all :['Dependency unsuccessful', 'Cannot run until dependency "./reports/ngos/ngo-district-report" is successfully executed']
From ./reports/all :['Dependency unsuccessful', 'Cannot run until dependency "./reports/ngos/ngo-activity-report" is successfully executed']

Pipeline ID: budgetkey/elasticsearch/index_reports

budgetkey/elasticsearch/index_support_criteria
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./supports/criteria/support-criteria" is successfully executed

Pipeline ID: budgetkey/elasticsearch/index_support_criteria

budgetkey/elasticsearch/index_supports
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 06:22:06.215974
Last Completion:
2023-09-28 07:01:50.152755
Last Success:
2023-09-28 07:01:50.152755

Pipeline ID: budgetkey/elasticsearch/index_supports

budgetkey/elasticsearch/index_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 07:26:26.851829
Last Completion:
2023-09-28 08:14:02.745492
Last Success:
2023-09-28 08:14:02.745492

Pipeline ID: budgetkey/elasticsearch/index_tenders

budgetkey/elasticsearch/index_units
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 05:04:33.787484
Last Completion:
2023-09-28 05:05:00.798524
Last Success:
2023-09-28 05:05:00.798524

Pipeline ID: budgetkey/elasticsearch/index_units

budgetkey/elasticsearch/sitemaps
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./budgetkey/elasticsearch/index_national_budget_changes" is successfully executed
Dependency unsuccessful :Cannot run until dependency "./budgetkey/elasticsearch/index_entities" is successfully executed
Dependency unsuccessful :Cannot run until dependency "./budgetkey/elasticsearch/index_contract_spending" is successfully executed
Invalid dependency :Cannot run until dependency passes validation: ./budgetkey/elasticsearch/index_calls_for_bids
From ./budgetkey/elasticsearch/index_calls_for_bids :['Dependency unsuccessful', 'Cannot run until dependency "./procurement/calls_for_bids/calls-for-bids-all" is successfully executed']
Invalid dependency :Cannot run until dependency passes validation: ./budgetkey/elasticsearch/index_support_criteria
From ./budgetkey/elasticsearch/index_support_criteria :['Dependency unsuccessful', 'Cannot run until dependency "./supports/criteria/support-criteria" is successfully executed']
Invalid dependency :Cannot run until dependency passes validation: ./budgetkey/elasticsearch/index_reports
From ./budgetkey/elasticsearch/index_reports :['Invalid dependency', 'Cannot run until dependency passes validation: ./reports/all']
From ./budgetkey/elasticsearch/index_reports :['From ./reports/all', ['Dependency unsuccessful', 'Cannot run until dependency "./reports/ngos/ngo-district-report" is successfully executed']]
From ./budgetkey/elasticsearch/index_reports :['From ./reports/all', ['Dependency unsuccessful', 'Cannot run until dependency "./reports/ngos/ngo-activity-report" is successfully executed']]

Pipeline ID: budgetkey/elasticsearch/sitemaps

Send periodic emails (emails)
Running

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 00:35:32.253399
Last Completion:
Last Success:
2023-09-15 05:54:56.043316

Pipeline ID: budgetkey/emails/emails

donations/candidates
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./donations/parties" is successfully executed

Pipeline ID: donations/candidates

donations/parties
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-09-18 09:29:03.824939
Last Completion:
2023-09-18 09:29:06.832250
Last Success:
None

get_parties
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 714, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 403, in _make_request
    self._validate_conn(conn)
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1053, in _validate_conn
    conn.connect()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 419, in connect
    self.sock = ssl_wrap_socket(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 449, in ssl_wrap_socket
    ssl_sock = _ssl_wrap_socket_impl(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 493, in _ssl_wrap_socket_impl
    return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
  File "/usr/local/lib/python3.9/ssl.py", line 501, in wrap_socket
    return self.sslsocket_class._create(
  File "/usr/local/lib/python3.9/ssl.py", line 1041, in _create
    self.do_handshake()
  File "/usr/local/lib/python3.9/ssl.py", line 1310, in do_handshake
    self._sslobj.do_handshake()
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1129)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 486, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 798, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='statements.mevaker.gov.il', port=443): Max retries exceeded with url: /Handler/GuarantyDonationPublisherHandler.ashx (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1129)')))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_parties.py", line 38, in <module>
    spew(dp, [get_parties()])
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_parties.py", line 17, in get_parties
    resp = requests.post('https://statements.mevaker.gov.il/Handler/GuarantyDonationPublisherHandler.ashx',
  File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 115, in post
    return request("post", url, data=data, json=json, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 59, in request
    return session.request(method=method, url=url, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 517, in send
    raise SSLError(e, request=request)
requests.exceptions.SSLError: HTTPSConnectionPool(host='statements.mevaker.gov.il', port=443): Max retries exceeded with url: /Handler/GuarantyDonationPublisherHandler.ashx (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1129)')))

Pipeline ID: donations/parties

donations/transactions
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./donations/candidates
From ./donations/candidates :['Dependency unsuccessful', 'Cannot run until dependency "./donations/parties" is successfully executed']

Pipeline ID: donations/transactions

education/tochniyot/tochniyot
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-09-18 10:11:15.619243
Last Completion:
2023-09-18 10:11:18.906302
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 103, in flow
    return Flow(scrape(),
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 65, in scrape
    education_programs_count = get_education_programs_count()
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 56, in get_education_programs_count
    res = send_tochniyot_request()
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 80, in send_tochniyot_request
    resp.raise_for_status()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://apps.education.gov.il/TyhNet/ClientWs/TochnitCh.asmx/IturTochnitChByMeafyenim

Pipeline ID: education/tochniyot/tochniyot

entities/all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 05:53:08.249594
Last Completion:
2023-09-28 06:02:09.505113
Last Success:
2023-09-28 06:02:09.505113

Pipeline ID: entities/all

entities/associations/guidestar/guidestar
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-05-31 04:47:42.703109
Last Completion:
2023-05-31 04:48:31.136146
Last Success:
2023-05-31 04:48:31.136146

Pipeline ID: entities/associations/guidestar/guidestar

entities/associations/guidestar/guidestar-scraper
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-05-31 00:00:08.934171
Last Completion:
2023-05-31 04:47:42.538813
Last Success:
2023-05-31 04:47:42.538813

Pipeline ID: entities/associations/guidestar/guidestar-scraper

עמותות פעילות מרשם העמותות (registry)
Succeeded

רשימת כלל העמותות הפעילות, מתעדכן שבועית.


Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-15 09:53:16.981874
Last Completion:
2023-03-15 09:54:18.780863
Last Success:
2023-03-15 09:54:18.780863

Pipeline ID: entities/associations/registrar/registry

entities/companies/registrar/details
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 03:44:05.362925
Last Completion:
2023-09-28 03:46:57.240342
Last Success:
2023-09-28 03:46:57.240342

Pipeline ID: entities/companies/registrar/details

חברות פעילות מרשם החברות (scraper)
Succeeded

רשימת כלל החברות הפעילות, מתעדכן שבועית.


Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 01:13:06.434154
Last Completion:
2023-09-28 01:17:17.220734
Last Success:
2023-09-28 01:17:17.220734

Pipeline ID: entities/companies/registrar/scraper

רשימת אגודות שיתופיות (cooperatives)
Succeeded

רשימת אגודות שיתופיות, מתוך ממשק נתונים של מאגר של משרד הכלכלה / האגף לאיגוד שיתופי, מתעדכן שבועית


Last Run triggered by:
dirty-task-init
Last Run started at:
2023-06-12 11:40:17.622705
Last Completion:
2023-06-12 11:44:16.668970
Last Success:
2023-06-12 11:44:16.668970

Pipeline ID: entities/cooperatives/cooperatives

רשימת הקדשים (endowments)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-15 09:54:22.292135
Last Completion:
2023-03-15 09:54:38.509763
Last Success:
2023-03-15 09:54:38.509763

Pipeline ID: entities/endowments/endowments

entities/entities
Queued

Last Run triggered by:
dirty-task-update
Last Run started at:
Last Completion:
Last Success:
2023-09-28 07:52:48.522756

Pipeline ID: entities/entities

entities/fingerprints
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 06:33:35.020395
Last Completion:
2023-09-28 07:44:25.875459
Last Success:
2023-09-28 07:44:25.875459

Pipeline ID: entities/fingerprints

entities/foi_orgs/foi_orgs
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-15 09:46:26.652245
Last Completion:
2023-03-15 09:47:30.797610
Last Success:
2023-03-15 09:47:30.797610

Pipeline ID: entities/foi_orgs/foi_orgs

entities/moital/moital_service_providers
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-09-18 09:30:24.605361
Last Completion:
2023-09-18 09:30:27.929744
Last Success:
None

scraper
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/entities/moital/scraper.py", line 79, in <module>
    spew(datapackage, [scrape()])
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/entities/moital/scraper.py", line 32, in scrape
    desired_capabilities=DesiredCapabilities.PHANTOMJS)
AttributeError: type object 'DesiredCapabilities' has no attribute 'PHANTOMJS'

Pipeline ID: entities/moital/moital_service_providers

רשימת אגודות עותומניות (ottoman-association-registry)
Succeeded

רשימת אגודות עותומניות, מתוך תשובה לבקשת חופש מידע


Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-15 09:47:30.802945
Last Completion:
2023-03-15 09:47:46.606334
Last Success:
2023-03-15 09:47:46.606334

Pipeline ID: entities/ottoman/ottoman-association-registry

רשימת שותפויות (partnerships)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-15 09:47:15.798809
Last Completion:
2023-03-15 09:48:08.707808
Last Success:
2023-03-15 09:48:08.707808

Pipeline ID: entities/partnerships/partnerships

entities/safety-orders/safety-orders
Failed

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 01:18:55.528099
Last Completion:
2023-09-28 01:19:13.100934
Last Success:
None

stream_remote_resources
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 174, in _new_conn
    conn = connection.create_connection(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/connection.py", line 72, in create_connection
    for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
  File "/usr/local/lib/python3.9/socket.py", line 954, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -5] No address associated with hostname
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 714, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 415, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 244, in request
    super(HTTPConnection, self).request(method, url, body=body, headers=headers)
  File "/usr/local/lib/python3.9/http/client.py", line 1285, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/lib/python3.9/http/client.py", line 1331, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.9/http/client.py", line 1280, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.9/http/client.py", line 1040, in _send_output
    self.send(msg)
  File "/usr/local/lib/python3.9/http/client.py", line 980, in send
    self.connect()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 205, in connect
    conn = self._new_conn()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 186, in _new_conn
    raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f94a83d5e20>: Failed to establish a new connection: [Errno -5] No address associated with hostname
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 486, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 798, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='employment.molsa.gov.il', port=80): Max retries exceeded with url: /Employment/SafetyAndHealth/Enforcement/Documents/%D7%A6%D7%95%D7%95%D7%99%20%D7%91%D7%98%D7%99%D7%97%D7%95%D7%AA.xlsx (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f94a83d5e20>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 63, in load
    bytes = _RemoteStream(source, self.__http_session, self.__http_timeout).open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 121, in open
    self.seek(0)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 142, in seek
    self.__response = self.__session.get(self.__source, stream=True, timeout=self.__timeout)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 602, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 519, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPConnectionPool(host='employment.molsa.gov.il', port=80): Max retries exceeded with url: /Employment/SafetyAndHealth/Enforcement/Documents/%D7%A6%D7%95%D7%95%D7%99%20%D7%91%D7%98%D7%99%D7%97%D7%95%D7%AA.xlsx (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f94a83d5e20>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 244, in <module>
    rows = stream_reader(resource, url, ignore_missing or url == "", limit_rows,
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 199, in stream_reader
    schema, headers, columns, stream, close = get_opener(url, _resource)()
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 175, in opener
    _stream.open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/stream.py", line 423, in open
    self.__parser.open(source, encoding=self.__encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/parsers/xlsx.py", line 81, in open
    source_bytes = self.__loader.load(source, mode="b", encoding=encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 72, in load
    raise exceptions.HTTPError(str(exception))
tabulator.exceptions.HTTPError: HTTPConnectionPool(host='employment.molsa.gov.il', port=80): Max retries exceeded with url: /Employment/SafetyAndHealth/Enforcement/Documents/%D7%A6%D7%95%D7%95%D7%99%20%D7%91%D7%98%D7%99%D7%97%D7%95%D7%AA.xlsx (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f94a83d5e20>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))

Pipeline ID: entities/safety-orders/safety-orders

entities/safety-orders/safety-orders-by-entity
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./entities/safety-orders/safety-orders" is successfully executed

Pipeline ID: entities/safety-orders/safety-orders-by-entity

entities/special/registry
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 01:17:17.232136
Last Completion:
2023-09-28 01:26:28.027848
Last Success:
2023-09-28 01:26:28.027848

Pipeline ID: entities/special/registry

ezvonot/ezvonot_accounts
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 05:03:54.701297
Last Completion:
2023-09-28 05:04:05.642608
Last Success:
2023-09-28 05:04:05.642608

Pipeline ID: ezvonot/ezvonot_accounts

ezvonot/ezvonot_cases
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 05:04:05.650099
Last Completion:
2023-09-28 05:04:14.282483
Last Success:
2023-09-28 05:04:14.282483

Pipeline ID: ezvonot/ezvonot_cases

ezvonot/ezvonot_crontab
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 01:20:57.533876
Last Completion:
2023-09-28 01:20:58.926840
Last Success:
2023-09-28 01:20:58.926840

Pipeline ID: ezvonot/ezvonot_crontab

ezvonot/ezvonot_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 05:04:22.333110
Last Completion:
2023-09-28 05:04:33.780111
Last Success:
2023-09-28 05:04:33.780111

Pipeline ID: ezvonot/ezvonot_decisions

ezvonot/ezvonot_decisions_join
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 06:21:29.799773
Last Completion:
2023-09-28 06:22:06.206266
Last Success:
2023-09-28 06:22:06.206266

Pipeline ID: ezvonot/ezvonot_decisions_join

ezvonot/ezvonot_deposits
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 05:03:40.760669
Last Completion:
2023-09-28 05:03:54.695249
Last Success:
2023-09-28 05:03:54.695249

Pipeline ID: ezvonot/ezvonot_deposits

ezvonot/ezvonot_purposes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 05:04:14.289910
Last Completion:
2023-09-28 05:04:22.326338
Last Success:
2023-09-28 05:04:22.326338

Pipeline ID: ezvonot/ezvonot_purposes

government_decisions/government_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 03:39:36.236945
Last Completion:
2023-09-28 03:39:51.609019
Last Success:
2023-09-28 03:39:51.609019

Pipeline ID: government_decisions/government_decisions

government_decisions/scraper
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 00:58:11.846349
Last Completion:
2023-09-28 00:59:14.615148
Last Success:
2023-09-28 00:59:14.615148

Pipeline ID: government_decisions/scraper

lamas/municipal-data
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 05:05:00.811930
Last Completion:
2023-09-28 05:05:30.045475
Last Success:
2023-09-28 05:05:30.045475

Pipeline ID: lamas/municipal-data

קובץ התאמת רשויות אזוריות לישובים בשטחן (municipality-to-city)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-15 09:40:08.678615
Last Completion:
2023-03-15 09:40:11.045676
Last Success:
2023-03-15 09:40:11.045676

Pipeline ID: lamas/municipality-to-city

maya/maya-bonds-and-options-holdings-changes
Queued

Last Run triggered by:
scheduled
Last Run started at:
Last Completion:
Last Success:
2023-09-28 05:28:09.258418

Pipeline ID: maya/maya-bonds-and-options-holdings-changes

maya/maya-company-officer-list
Queued

Last Run triggered by:
scheduled
Last Run started at:
Last Completion:
Last Success:
2023-09-28 05:24:54.649570

Pipeline ID: maya/maya-company-officer-list

maya/maya-company-stakeholder-list
Queued

Last Run triggered by:
scheduled
Last Run started at:
Last Completion:
Last Success:
2023-09-28 05:39:05.427181

Pipeline ID: maya/maya-company-stakeholder-list

maya/maya-company-vip-appointments
Queued

Last Run triggered by:
scheduled
Last Run started at:
Last Completion:
Last Success:
None

Pipeline ID: maya/maya-company-vip-appointments

maya/maya-complete-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 07:01:50.213755
Last Completion:
2023-09-28 07:26:26.829972
Last Success:
2023-09-28 07:26:26.829972

Pipeline ID: maya/maya-complete-notification-list

maya/maya-holdings-changes
Queued

Last Run triggered by:
scheduled
Last Run started at:
Last Completion:
Last Success:
2023-09-28 05:31:21.712732

Pipeline ID: maya/maya-holdings-changes

maya/maya-notification-parse-updates
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 05:15:00.512255
Last Completion:
2023-09-28 06:06:09.020400
Last Success:
2023-09-28 06:06:09.020400

Pipeline ID: maya/maya-notification-parse-updates

maya/maya-reported-academic-degrees
Queued

Last Run triggered by:
scheduled
Last Run started at:
Last Completion:
Last Success:
2023-09-28 05:42:14.720151

Pipeline ID: maya/maya-reported-academic-degrees

maya/maya-reported-work-record
Queued

Last Run triggered by:
scheduled
Last Run started at:
Last Completion:
Last Success:
2023-09-28 05:45:28.298212

Pipeline ID: maya/maya-reported-work-record

maya/maya-tase-companies-current-management
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 04:52:01.758894
Last Completion:
2023-09-28 05:50:14.754383
Last Success:
2023-09-28 05:50:14.754383

Pipeline ID: maya/maya-tase-companies-current-management

maya/maya-tase-companies-current-shareholders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 03:59:43.721115
Last Completion:
2023-09-28 04:52:01.749880
Last Success:
2023-09-28 04:52:01.749880

Pipeline ID: maya/maya-tase-companies-current-shareholders

maya/scrape-maya-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 01:23:03.134018
Last Completion:
2023-09-28 02:07:56.628013
Last Success:
2023-09-28 02:07:56.628013

Pipeline ID: maya/scrape-maya-notification-list

maya/scrape-maya-tase-companies
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 01:19:13.105990
Last Completion:
2023-09-28 01:20:48.630088
Last Success:
2023-09-28 01:20:48.630088

Pipeline ID: maya/scrape-maya-tase-companies

people/aggregated
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/all
From ./people/all :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']
From ./people/all :['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/state_owned/state-owned-nominations']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/state_owned/state-owned-nominations', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/state_owned/correlate" is successfully executed']]]
From ./people/all :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/procurement/procurement-individuals']
From ./people/all :['From ./people/procurement/procurement-individuals', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/spending/latest-contract-spending" is successfully executed']]
From ./people/all :['Dependency unsuccessful', 'Cannot run until dependency "./people/political_donations/political_donations" is successfully executed']

Pipeline ID: people/aggregated

people/all
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/all-appointments
From ./people/company_appointments/all-appointments :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]
From ./people/company_appointments/all-appointments :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]
Dependency unsuccessful :Cannot run until dependency "./people/political_donations/political_donations" is successfully executed

Pipeline ID: people/all

people/association_founders/association-founders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-05-31 04:48:31.412691
Last Completion:
2023-05-31 04:49:31.119954
Last Success:
2023-05-31 04:49:31.119954

Pipeline ID: people/association_founders/association-founders

people/company_appointments/all-appointments
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations
From ./people/company_appointments/maya/maya-nominations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]
Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations
From ./people/company_appointments/maya/maya-resignations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]

Pipeline ID: people/company_appointments/all-appointments

people/company_appointments/maya/collect-maya-forms-debug-stats
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed

Pipeline ID: people/company_appointments/maya/collect-maya-forms-debug-stats

Join the parsed PDF to get start and end time for each person (correlate)
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations
From ./people/company_appointments/maya/maya-nominations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]
Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations
From ./people/company_appointments/maya/maya-resignations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]

Pipeline ID: people/company_appointments/maya/correlate

people/company_appointments/maya/maya-list
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates
From ./people/company_appointments/maya/maya-notification-updates :['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']

Pipeline ID: people/company_appointments/maya/maya-list

Appointment notices from Maya (maya-nominations)
Invalid

Name, job and company description.


Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list
From ./people/company_appointments/maya/maya-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']
From ./people/company_appointments/maya/maya-list :['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]

Pipeline ID: people/company_appointments/maya/maya-nominations

people/company_appointments/maya/maya-notification-list
Failed

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 01:20:53.735564
Last Completion:
2023-09-28 01:20:57.529893
Last Success:
None

scrape-notification-list
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 971, in json
    return complexjson.loads(self.text, **kwargs)
  File "/usr/local/lib/python3.9/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "/usr/local/lib/python3.9/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/local/lib/python3.9/json/decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 55, in _maya_api_call
    return res.json()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 975, in json
    raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 130, in <module>
    spew(datapackage, [collect()])
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 113, in collect
    yield from _collect_date_range(year_start, year_end)
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 75, in _collect_date_range
    res = _maya_api_call(date_from, date_to, current_page)
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 57, in _maya_api_call
    raise Exception("Failed to Call Maya API for date_from:{} date_to:{} page_num:{}".format(date_from, date_to, page_num)) from e
Exception: Failed to Call Maya API for date_from:2006-01-01 date_to:2007-01-01 page_num:0

Pipeline ID: people/company_appointments/maya/maya-notification-list

List all notifications from maya system (maya-notification-updates)
Invalid

id, date, company, notification_type, s3_object_name, url


Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed

Pipeline ID: people/company_appointments/maya/maya-notification-updates

Appointment notices from Maya (maya-resignations)
Invalid

Name, job and company description.


Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list
From ./people/company_appointments/maya/maya-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']
From ./people/company_appointments/maya/maya-list :['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]

Pipeline ID: people/company_appointments/maya/maya-resignations

מינויים בכלכליסט (calcalist)
Succeeded

רשימת כל המינויים והחברות מאתר כלכליסט


Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-15 09:45:56.009748
Last Completion:
2023-03-15 09:53:16.898180
Last Success:
2023-03-15 09:53:16.898180

Pipeline ID: people/company_appointments/media/calcalist/calcalist

Appointment notices from TheMarker (themarker)
Succeeded

Name, job and company description.


Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 01:26:28.042471
Last Completion:
2023-09-28 01:26:34.041200
Last Success:
2023-09-28 01:26:34.041200

Pipeline ID: people/company_appointments/media/themarker/themarker

Join the parsed PDF to get start and end time for each person (correlate)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 05:53:04.417122
Last Completion:
2023-09-28 05:53:08.231910
Last Success:
2023-09-28 05:53:08.231910

Pipeline ID: people/company_appointments/state_owned/correlate

Parse and concatenate all PDF reports (parse_pdf_resources)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 03:43:59.563836
Last Completion:
2023-09-28 03:44:02.005037
Last Success:
2023-09-28 03:44:02.005037

Pipeline ID: people/company_appointments/state_owned/parse_pdf_resources

collect links to all pdf reports on https://mof.gov.il/GCA/Directors/Pages/DirectorsManningReport.aspx (reports)
Succeeded

columns: date, url


Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 01:14:38.668776
Last Completion:
2023-09-28 01:14:44.246075
Last Success:
2023-09-28 01:14:44.246075

Pipeline ID: people/company_appointments/state_owned/reports

people/company_appointments/state_owned/state-owned-nominations
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 06:33:31.759712
Last Completion:
2023-09-28 06:33:35.012214
Last Success:
2023-09-28 06:33:35.012214

Pipeline ID: people/company_appointments/state_owned/state-owned-nominations

people/municipal_appointments/municipal_representitives
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-15 09:45:53.455017
Last Completion:
2023-03-15 09:45:56.003206
Last Success:
2023-03-15 09:45:56.003206

Pipeline ID: people/municipal_appointments/municipal_representitives

people/political_candidates/election_candidates21
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-15 09:45:51.151500
Last Completion:
2023-03-15 09:46:26.644279
Last Success:
2023-03-15 09:46:26.644279

Pipeline ID: people/political_candidates/election_candidates21

people/political_donations/political_donations
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-09-18 09:29:06.905818
Last Completion:
2023-09-18 09:29:10.926469
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 971, in json
    return complexjson.loads(self.text, **kwargs)
  File "/usr/local/lib/python3.9/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "/usr/local/lib/python3.9/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/local/lib/python3.9/json/decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage/helpers.py", line 59, in retrieve_descriptor
    the_descriptor = req.json()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 975, in json
    raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/processors/load.py", line 121, in process_datapackage
    return self.safe_process_datapackage(dp)
  File "/usr/local/lib/python3.9/site-packages/dataflows/processors/load.py", line 159, in safe_process_datapackage
    self.load_dp = Package(self.load_source)
  File "/usr/local/lib/python3.9/site-packages/datapackage/package.py", line 102, in __init__
    descriptor = helpers.retrieve_descriptor(descriptor)
  File "/usr/local/lib/python3.9/site-packages/datapackage/helpers.py", line 62, in retrieve_descriptor
    six.raise_from(exceptions.DataPackageException(message), error)
  File "<string>", line 3, in raise_from
datapackage.exceptions.DataPackageException: Unable to load JSON at "https://next.obudget.org/datapackages/donations/transactions/datapackage.json"
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
    self.datapackage = self.process_datapackage(self.datapackage)
  File "/usr/local/lib/python3.9/site-packages/dataflows/processors/load.py", line 123, in process_datapackage
    raise SourceLoadError('Failed to load source {!r} and options {!r}: {}'
dataflows.base.exceptions.SourceLoadError: Failed to load source 'https://next.obudget.org/datapackages/donations/transactions/datapackage.json' and options {}: Unable to load JSON at "https://next.obudget.org/datapackages/donations/transactions/datapackage.json"
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
    spew_flow(flow, ctx)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
    datastream = flow.datastream()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/flow.py", line 18, in datastream
    return self._chain(ds)._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
    self.raise_exception(exception)
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
    raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor load in position #1: Failed to load source 'https://next.obudget.org/datapackages/donations/transactions/datapackage.json' and options {}: Unable to load JSON at "https://next.obudget.org/datapackages/donations/transactions/datapackage.json"

Pipeline ID: people/political_donations/political_donations

people/procurement/procurement-individuals
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2023-09-28 06:13:19.113237
Last Completion:
2023-09-28 06:21:29.738033
Last Success:
2023-09-28 06:21:29.738033

Pipeline ID: people/procurement/procurement-individuals

procurement/calls_for_bids/calls-for-bids-all
Running

Last Run triggered by:
dirty-task-update
Last Run started at:
2023-09-28 03:39:51.625208
Last Completion:
Last Success:
None

Pipeline ID: procurement/calls_for_bids/calls-for-bids-all

procurement/calls_for_bids/calls-for-bids-moh
Failed

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 01:22:53.940668
Last Completion:
2023-09-28 01:22:58.415006
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
    self.datapackage = self.process_datapackage(self.datapackage)
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 112, in process_datapackage
    raise self.exc
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 60, in describe
    sample = list(itertools.islice(self.iterable, self.SAMPLE_SIZE))
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 89, in handle_iterable
    for x in self.iterable:
  File "/datapackage_pipelines_budgetkey/pipelines/procurement/calls_for_bids/m_tmicha.py", line 47, in m_tmicha_scraper
    assert total > 0
AssertionError
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
    spew_flow(flow, ctx)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
    datastream = flow.datastream()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/flow.py", line 18, in datastream
    return self._chain(ds)._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
    self.raise_exception(exception)
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
    raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor iterable_loader in position #1:

Pipeline ID: procurement/calls_for_bids/calls-for-bids-moh

procurement/calls_for_bids/gov-publications
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-15 09:33:14.485435
Last Completion:
2023-03-15 09:34:00.828915
Last Success:
2023-03-15 09:34:00.828915

Pipeline ID: procurement/calls_for_bids/gov-publications

procurement/calls_for_bids/gov-publications-ministry-of-immigration
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-15 09:33:14.498060
Last Completion:
2023-03-15 09:33:23.429338
Last Success:
2023-03-15 09:33:23.429338

Pipeline ID: procurement/calls_for_bids/gov-publications-ministry-of-immigration

procurement/calls_for_bids/gov-publications2
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-15 09:33:14.489180
Last Completion:
2023-03-15 09:33:36.120629
Last Success:
2023-03-15 09:33:36.120629

Pipeline ID: procurement/calls_for_bids/gov-publications2

procurement/calls_for_bids/jobiz-all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 02:07:56.705167
Last Completion:
2023-09-28 02:08:01.500886
Last Success:
2023-09-28 02:08:01.500886

Pipeline ID: procurement/calls_for_bids/jobiz-all

procurement/calls_for_bids/jobiz-calls-for-bids
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 05:31:21.718439
Last Completion:
2023-09-28 05:31:23.366558
Last Success:
2023-09-28 05:31:23.366558

Pipeline ID: procurement/calls_for_bids/jobiz-calls-for-bids

procurement/calls_for_bids/jobiz-scraper
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 00:47:40.022507
Last Completion:
2023-09-28 00:48:03.016357
Last Success:
2023-09-28 00:48:03.016357

Pipeline ID: procurement/calls_for_bids/jobiz-scraper

procurement/municipal/fetcher
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 01:18:28.960219
Last Completion:
2023-09-28 01:18:35.410609
Last Success:
2023-09-28 01:18:35.410609

Pipeline ID: procurement/municipal/fetcher

התקשרויות רכש ממשלתיות (latest-contract-spending)
Running

אנו סוכמים מידע מתוך הדוחות הרבעוניים לתוך טבלה המכילה את המידע העדכני ביותר.


Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 07:52:48.546718
Last Completion:
Last Success:
2023-09-28 05:03:37.677123

Pipeline ID: procurement/spending/latest-contract-spending

procurement/spending/quarterly-contract-spending-report-uris
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 00:57:41.608150
Last Completion:
2023-09-28 00:58:11.781604
Last Success:
2023-09-28 00:58:11.781604

Pipeline ID: procurement/spending/quarterly-contract-spending-report-uris

דוחות רבעוניים מתוך מרכבה, לפי נוהל היחידה לחופש המידע. (quarterly-contract-spending-reports)
Succeeded

כל משרדי הממשלה ויחידות הסמך (שמחוברות למערכת מרכבה) צריכים לפרסם אחת לרבעון (תוך 45 יום מסוף הרבעון) דו״ח התקשרויות לפי פורמט מוגדר היטב הממומש כדו״ח מובנה במערכת המרכבה. כל המשרדים מדווחים עצמאית והדו״חות עולים לאתר היחידה לחופש המידע, משם אנו אוספים אותם. התוצר של השרשר הזה הוא פירוט כל הדיווחים של כל המשרדים.


Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 03:21:41.922161
Last Completion:
2023-09-28 03:39:36.224881
Last Success:
2023-09-28 03:39:36.224881

Pipeline ID: procurement/spending/quarterly-contract-spending-reports

procurement/spending/quarterly-contract-spending-reports-data
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 05:45:28.479795
Last Completion:
2023-09-28 06:30:22.953723
Last Success:
2023-09-28 06:30:22.953723

Pipeline ID: procurement/spending/quarterly-contract-spending-reports-data

procurement/spending/spending-by-entity
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2023-09-28 06:06:09.132356
Last Completion:
2023-09-28 06:16:03.709259
Last Success:
2023-09-28 06:16:03.709259

Pipeline ID: procurement/spending/spending-by-entity

Load all tenders data from data.gov.il to flat file (all)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 01:19:41.930238
Last Completion:
2023-09-28 01:22:53.934189
Last Success:
2023-09-28 01:22:53.934189

Pipeline ID: procurement/tenders/all

procurement/tenders/processed
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 06:02:09.539994
Last Completion:
2023-09-28 06:13:19.097526
Last Success:
2023-09-28 06:13:19.097526

Pipeline ID: procurement/tenders/processed

reports/all
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./reports/ngos/ngo-district-report" is successfully executed
Dependency unsuccessful :Cannot run until dependency "./reports/ngos/ngo-activity-report" is successfully executed

Pipeline ID: reports/all

reports/ngos/ngo-activity-report
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-09-18 10:08:00.717445
Last Completion:
2023-09-18 10:10:22.305898
Last Success:
None

filter
ERROR   :Traceback (most recent call last):
ERROR   :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/filter.py", line 18, in <module>
ERROR   :spew_flow(flow(ctx.parameters), ctx)
ERROR   :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
ERROR   :spew(self.datapackage, self.resource_iterator, stats=self.stats)
ERROR   :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
ERROR   :for rec in res:
ERROR   :File "/usr/local/lib/python3.9/site-packages/dataflows/processors/filter_rows.py", line 20, in process_resource
ERROR   :if condition(row):
ERROR   :File "/usr/local/lib/python3.9/site-packages/dataflows/processors/filter_rows.py", line 6, in func
ERROR   :return any(
ERROR   :File "/usr/local/lib/python3.9/site-packages/dataflows/processors/filter_rows.py", line 7, in <genexpr>
ERROR   :(row[k] == v)
ERROR   :KeyError
ERROR   ::
ERROR   :'association_has_article_46'

Pipeline ID: reports/ngos/ngo-activity-report

reports/ngos/ngo-district-report
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-09-18 10:07:45.910096
Last Completion:
2023-09-18 10:10:36.011127
Last Success:
None

filter
ERROR   :Traceback (most recent call last):
ERROR   :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/filter.py", line 18, in <module>
ERROR   :spew_flow(flow(ctx.parameters), ctx)
ERROR   :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
ERROR   :spew(self.datapackage, self.resource_iterator, stats=self.stats)
ERROR   :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
ERROR   :for rec in res:
ERROR   :File "/usr/local/lib/python3.9/site-packages/dataflows/processors/filter_rows.py", line 20, in process_resource
ERROR   :if condition(row):
ERROR   :File "/usr/local/lib/python3.9/site-packages/dataflows/processors/filter_rows.py", line 6, in func
ERROR   :return any(
ERROR   :File "/usr/local/lib/python3.9/site-packages/dataflows/processors/filter_rows.py", line 7, in <genexpr>
ERROR   :(row[k] == v)
ERROR   :KeyError
ERROR   ::
ERROR   :'association_has_article_46'

Pipeline ID: reports/ngos/ngo-district-report

supports/all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 03:46:57.250731
Last Completion:
2023-09-28 03:51:38.017286
Last Success:
2023-09-28 03:51:38.017286

Pipeline ID: supports/all

supports/by-payment-year
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 05:05:30.202194
Last Completion:
2023-09-28 05:08:52.124881
Last Success:
2023-09-28 05:08:52.124881

Pipeline ID: supports/by-payment-year

supports/by-request-year
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 05:08:52.131983
Last Completion:
2023-09-28 05:13:44.843699
Last Success:
2023-09-28 05:13:44.843699

Pipeline ID: supports/by-request-year

supports/criteria/support-criteria
Failed

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 05:03:37.699174
Last Completion:
2023-09-28 05:03:40.755183
Last Success:
None

sample
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/processors/sample.py", line 11, in <module>
    res_name = parameters.get('resource', datapackage['resources'][0]['name'])
IndexError: list index out of range

Pipeline ID: supports/criteria/support-criteria

supports/criteria/support-criteria-doj
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2023-09-28 01:20:48.636890
Last Completion:
2023-09-28 01:20:53.728501
Last Success:
2023-09-28 01:20:53.728501

Pipeline ID: supports/criteria/support-criteria-doj

supports/supports-2004
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-15 09:33:27.059110
Last Completion:
2023-03-15 09:33:28.138097
Last Success:
2023-03-15 09:33:28.138097

Pipeline ID: supports/supports-2004

supports/supports-2005
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-03-15 09:33:28.142172
Last Completion:
2023-03-15 09:33:29.420871
Last Success:
2023-03-15 09:33:29.420871

Pipeline ID: supports/supports-2005

supports/supports-2006
Succeeded