activities/social_services/social_service_reports
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:40:30.298342
Last Completion:
2024-11-20 09:43:19.897810
Last Success:
2024-11-20 09:43:19.897810

Pipeline ID: activities/social_services/social_service_reports

activities/social_services/social_service_suppliers
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:40:30.115664
Last Completion:
2024-11-20 09:40:38.870685
Last Success:
2024-11-20 09:40:38.870685

Pipeline ID: activities/social_services/social_service_suppliers

activities/social_services/social_service_tenders
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:40:30.119872
Last Completion:
2024-11-20 09:40:37.484195
Last Success:
2024-11-20 09:40:37.484195

Pipeline ID: activities/social_services/social_service_tenders

Fetch social services from data input (social_services)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-08 00:07:15.949302
Last Completion:
2024-11-08 00:07:46.520247
Last Success:
2024-11-08 00:07:46.520247

Pipeline ID: activities/social_services/social_services

bank_of_israel/bank_of_israel
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 13:09:59.775673
Last Completion:
2023-10-30 13:10:04.882030
Last Success:
2023-10-30 13:10:04.882030

Pipeline ID: bank_of_israel/bank_of_israel

budget/municipal/fetcher
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:40:55.292002
Last Completion:
2024-11-20 09:46:33.408628
Last Success:
2024-11-20 09:46:33.408628

Pipeline ID: budget/municipal/fetcher

budget/national/changes/explanations/all
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:52:40.851010
Last Completion:
2023-10-30 12:54:56.895489
Last Success:
2023-10-30 12:54:56.895489

Pipeline ID: budget/national/changes/explanations/all

budget/national/changes/original/current-year-fixes
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 10:07:15.490096
Last Completion:
2024-11-20 10:07:47.010883
Last Success:
2024-11-20 10:07:47.010883

Pipeline ID: budget/national/changes/original/current-year-fixes

budget/national/changes/original/national-budget-changes
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:40:39.898652
Last Completion:
2024-11-20 09:42:58.889004
Last Success:
2024-11-20 09:42:58.889004

Pipeline ID: budget/national/changes/original/national-budget-changes

Changes, grouped by transaction_id, with explanations (national-budget-changes-aggregated)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 14:09:58.420290
Last Completion:
2024-11-20 14:12:17.394257
Last Success:
2024-11-20 14:12:17.394257

Pipeline ID: budget/national/changes/processed/national-budget-changes-aggregated

budget/national/changes/processed/transactions
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 10:07:47.085653
Last Completion:
2024-11-20 14:09:58.318243
Last Success:
2024-11-20 14:09:58.318243

Pipeline ID: budget/national/changes/processed/transactions

National Yearly Budgets (national-budgets)
Succeeded

We get the data the Ministry of Finance publishes in data.gov.il every year. It comes in XLS format, with one row per TAKANA and phase (original, approved, executed). In this pipeline we create from each triplet a single row that has all the data.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-07-11 08:51:37.202691
Last Completion:
2024-07-11 11:35:17.635110
Last Success:
2024-07-11 11:35:17.635110

Pipeline ID: budget/national/original/national-budgets

National Yearly Budgets - Processed (aggregated-yearly)
Succeeded

This pipeline joins the different phases of the budget (allocated, revised and executed). In the original file there's a separate row for each of the phases. We like it better as a single row with all phase info. Another thing this pipeline does is to rename the column titles - to more friendly English names. Also, it create rows for all hierarchies - where upper hierarchies (2, 4 & 6 digits) are plain aggregations of the 8-digit items they contain.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-07-15 14:08:03.511289
Last Completion:
2024-07-15 15:45:59.400596
Last Success:
2024-07-15 15:45:59.400596

Pipeline ID: budget/national/processed/aggregated-yearly

budget/national/processed/category-explanations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:54:56.900975
Last Completion:
2023-10-30 12:54:57.594178
Last Success:
2023-10-30 12:54:57.594178

Pipeline ID: budget/national/processed/category-explanations

National Yearly Budgets - Joined with category-explanations (connected-items-explained)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-07-15 16:28:43.560691
Last Completion:
2024-07-15 16:32:38.123678
Last Success:
2024-07-15 16:32:38.123678

Pipeline ID: budget/national/processed/connected-items-explained

National Yearly Budgets - Connected Items (connected-national-budgets)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-07-15 16:04:17.718760
Last Completion:
2024-07-15 16:28:43.214063
Last Success:
2024-07-15 16:28:43.214063

Pipeline ID: budget/national/processed/connected-national-budgets

National Yearly Budgets - Just the total (item 00) (just-the-total)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-07-15 16:04:17.439847
Last Completion:
2024-07-15 16:14:09.208421
Last Success:
2024-07-15 16:14:09.208421

Pipeline ID: budget/national/processed/just-the-total

National Yearly Budgets - Main Item Names (roof-names)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-07-15 16:04:17.446654
Last Completion:
2024-07-15 16:14:03.520688
Last Success:
2024-07-15 16:14:03.520688

Pipeline ID: budget/national/processed/roof-names

National Yearly Budgets - With Extras (with-extras)
Succeeded

This pipeline joins the budget data to itself so that each item has a list of its immediate children.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-07-15 15:45:59.561381
Last Completion:
2024-07-15 16:04:17.308187
Last Success:
2024-07-15 16:04:17.308187

Pipeline ID: budget/national/processed/with-extras

budgetkey/analysis/spending/publisher_entity_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 11:41:30.777079
Last Completion:
2024-11-20 15:36:50.363911
Last Success:
2024-11-20 15:36:50.363911

Pipeline ID: budgetkey/analysis/spending/publisher_entity_analysis

budgetkey/analysis/spending/publisher_foa_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 12:41:56.006654
Last Completion:
2024-11-20 12:45:20.829396
Last Success:
2024-11-20 12:45:20.829396

Pipeline ID: budgetkey/analysis/spending/publisher_foa_analysis

budgetkey/analysis/spending/united
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 11:12:44.802810
Last Completion:
2024-11-20 11:38:11.675041
Last Success:
2024-11-20 11:38:11.675041

Pipeline ID: budgetkey/analysis/spending/united

Main Page - Aggregated budget by functional classification (budget-functional-aggregates)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-07-15 15:45:59.707700
Last Completion:
2024-07-15 15:51:44.417288
Last Success:
2024-07-15 15:51:44.417288

Pipeline ID: budgetkey/budget-functional-aggregates

budgetkey/documents
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-07-15 15:51:44.737799
Last Completion:
2024-07-15 15:51:48.099677
Last Success:
2024-07-15 15:51:48.099677

Pipeline ID: budgetkey/documents

budgetkey/elasticsearch/index_activities
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:50:13.299550
Last Completion:
2024-11-20 09:50:45.320478
Last Success:
2024-11-20 09:50:45.320478

Pipeline ID: budgetkey/elasticsearch/index_activities

budgetkey/elasticsearch/index_budget
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:54:03.208458
Last Completion:
2024-11-20 10:27:01.983851
Last Success:
2024-11-20 10:27:01.983851

Pipeline ID: budgetkey/elasticsearch/index_budget

budgetkey/elasticsearch/index_calls_for_bids
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./procurement/calls_for_bids/calls-for-bids-all
From ./procurement/calls_for_bids/calls-for-bids-all :['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-calls-for-bids']
From ./procurement/calls_for_bids/calls-for-bids-all :['From ./procurement/calls_for_bids/jobiz-calls-for-bids', ['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-all']]
From ./procurement/calls_for_bids/calls-for-bids-all :['From ./procurement/calls_for_bids/jobiz-calls-for-bids', ['From ./procurement/calls_for_bids/jobiz-all', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed']]]

Pipeline ID: budgetkey/elasticsearch/index_calls_for_bids

budgetkey/elasticsearch/index_contract_spending
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 15:07:55.625919
Last Completion:
2024-11-20 17:01:29.192074
Last Success:
2024-11-20 17:01:29.192074

Pipeline ID: budgetkey/elasticsearch/index_contract_spending

budgetkey/elasticsearch/index_entities
Running

Last Run triggered by:
dirty-task-update
Last Run started at:
2024-11-20 22:09:01.171576
Last Completion:
Last Success:
2024-11-20 22:08:11.170280

Pipeline ID: budgetkey/elasticsearch/index_entities

budgetkey/elasticsearch/index_gov_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 13:10:26.208976
Last Completion:
2024-11-20 13:15:01.689128
Last Success:
2024-11-20 13:15:01.689128

Pipeline ID: budgetkey/elasticsearch/index_gov_decisions

budgetkey/elasticsearch/index_muni_budgets
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 10:27:02.072701
Last Completion:
2024-11-20 10:47:57.592875
Last Success:
2024-11-20 10:47:57.592875

Pipeline ID: budgetkey/elasticsearch/index_muni_budgets

budgetkey/elasticsearch/index_muni_tenders
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:58:25.291742
Last Completion:
2024-11-20 09:59:04.080764
Last Success:
2024-11-20 09:59:04.080764

Pipeline ID: budgetkey/elasticsearch/index_muni_tenders

budgetkey/elasticsearch/index_national_budget_changes
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 14:12:17.511708
Last Completion:
2024-11-20 14:14:55.029998
Last Success:
2024-11-20 14:14:55.029998

Pipeline ID: budgetkey/elasticsearch/index_national_budget_changes

budgetkey/elasticsearch/index_people
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/aggregated
From ./people/aggregated :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/all']
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/state_owned/state-owned-nominations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/state_owned/state-owned-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/state_owned/correlate']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/state_owned/state-owned-nominations', ['From ./people/company_appointments/state_owned/correlate', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/state_owned/parse_pdf_resources" is successfully executed']]]]]
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/procurement/procurement-individuals']]
From ./people/aggregated :['From ./people/all', ['From ./people/procurement/procurement-individuals', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/spending/latest-contract-spending" is successfully executed']]]
From ./people/aggregated :['From ./people/all', ['Dependency unsuccessful', 'Cannot run until dependency "./people/political_donations/political_donations" is successfully executed']]

Pipeline ID: budgetkey/elasticsearch/index_people

budgetkey/elasticsearch/index_reports
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:55:25.279159
Last Completion:
2024-11-20 09:55:38.712878
Last Success:
2024-10-11 07:03:57.501831

enrich_ngo_reports
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/enrich_ngo_reports.py", line 91, in <module>
    spew(dp, process_resources(res_iter))
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/enrich_ngo_reports.py", line 69, in process_resource
    for k, v in di[district].items():
KeyError: 'אזור יהודה ושומרון'

Pipeline ID: budgetkey/elasticsearch/index_reports

budgetkey/elasticsearch/index_support_criteria
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./supports/criteria/support-criteria" is successfully executed

Pipeline ID: budgetkey/elasticsearch/index_support_criteria

budgetkey/elasticsearch/index_supports
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 11:30:51.288054
Last Completion:
2024-11-20 12:51:47.903432
Last Success:
2024-11-20 12:51:47.903432

Pipeline ID: budgetkey/elasticsearch/index_supports

budgetkey/elasticsearch/index_tenders
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 11:41:25.199347
Last Completion:
2024-11-20 12:45:39.705351
Last Success:
2024-11-20 12:45:39.705351

Pipeline ID: budgetkey/elasticsearch/index_tenders

budgetkey/elasticsearch/index_units
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 10:06:41.590990
Last Completion:
2024-11-20 10:07:15.471650
Last Success:
2024-11-20 10:07:15.471650

Pipeline ID: budgetkey/elasticsearch/index_units

budgetkey/elasticsearch/sitemaps
Invalid

Last Run triggered by:
dirty-task-update
Last Run started at:
2024-11-20 19:56:03.424248
Last Completion:
2024-11-20 22:29:08.289811
Last Success:
2024-11-20 22:29:08.289811

Dirty dependency :Cannot run until dependency is executed: ./budgetkey/elasticsearch/index_entities

Pipeline ID: budgetkey/elasticsearch/sitemaps

Send periodic emails (emails)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-01 05:01:03.352108
Last Completion:
2024-11-01 14:19:44.544333
Last Success:
2024-11-01 14:19:44.544333

Pipeline ID: budgetkey/emails/emails

donations/candidates
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./donations/parties" is successfully executed

Pipeline ID: donations/candidates

donations/parties
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:40:39.082522
Last Completion:
2024-11-20 09:40:43.394640
Last Success:
None

get_parties
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 714, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 403, in _make_request
    self._validate_conn(conn)
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1053, in _validate_conn
    conn.connect()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 419, in connect
    self.sock = ssl_wrap_socket(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 449, in ssl_wrap_socket
    ssl_sock = _ssl_wrap_socket_impl(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 493, in _ssl_wrap_socket_impl
    return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
  File "/usr/local/lib/python3.9/ssl.py", line 501, in wrap_socket
    return self.sslsocket_class._create(
  File "/usr/local/lib/python3.9/ssl.py", line 1041, in _create
    self.do_handshake()
  File "/usr/local/lib/python3.9/ssl.py", line 1310, in do_handshake
    self._sslobj.do_handshake()
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1129)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 486, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 798, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='statements.mevaker.gov.il', port=443): Max retries exceeded with url: /Handler/GuarantyDonationPublisherHandler.ashx (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1129)')))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_parties.py", line 38, in <module>
    spew(dp, [get_parties()])
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_parties.py", line 17, in get_parties
    resp = requests.post('https://statements.mevaker.gov.il/Handler/GuarantyDonationPublisherHandler.ashx',
  File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 115, in post
    return request("post", url, data=data, json=json, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 59, in request
    return session.request(method=method, url=url, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 517, in send
    raise SSLError(e, request=request)
requests.exceptions.SSLError: HTTPSConnectionPool(host='statements.mevaker.gov.il', port=443): Max retries exceeded with url: /Handler/GuarantyDonationPublisherHandler.ashx (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1129)')))

Pipeline ID: donations/parties

donations/transactions
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./donations/candidates
From ./donations/candidates :['Dependency unsuccessful', 'Cannot run until dependency "./donations/parties" is successfully executed']

Pipeline ID: donations/transactions

education/tochniyot/tochniyot
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:53:03.792526
Last Completion:
2024-11-20 09:53:08.289927
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 103, in flow
    return Flow(scrape(),
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 65, in scrape
    education_programs_count = get_education_programs_count()
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 56, in get_education_programs_count
    res = send_tochniyot_request()
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 80, in send_tochniyot_request
    resp.raise_for_status()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://apps.education.gov.il/TyhNet/ClientWs/TochnitCh.asmx/IturTochnitChByMeafyenim

Pipeline ID: education/tochniyot/tochniyot

entities/all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 20:02:19.923489
Last Completion:
2024-11-20 20:10:13.800674
Last Success:
2024-11-20 20:10:13.800674

Pipeline ID: entities/all

entities/associations/guidestar/guidestar
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-05-31 05:24:46.370065
Last Completion:
2024-05-31 05:32:19.747601
Last Success:
2024-05-31 05:32:19.747601

Pipeline ID: entities/associations/guidestar/guidestar

entities/associations/guidestar/guidestar-scraper
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-05-31 00:11:57.440292
Last Completion:
2024-05-31 05:24:46.281650
Last Success:
2024-05-31 05:24:46.281650

Pipeline ID: entities/associations/guidestar/guidestar-scraper

עמותות פעילות מרשם העמותות (registry)
Succeeded

רשימת כלל העמותות הפעילות, מתעדכן שבועית.


Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 15:15:01.594645
Last Completion:
2024-01-31 15:15:17.127177
Last Success:
2024-01-31 15:15:17.127177

Pipeline ID: entities/associations/registrar/registry

entities/companies/registrar/details
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 20:00:01.787530
Last Completion:
2024-11-20 20:02:19.789875
Last Success:
2024-11-20 20:02:19.789875

Pipeline ID: entities/companies/registrar/details

חברות פעילות מרשם החברות (scraper)
Succeeded

רשימת כלל החברות הפעילות, מתעדכן שבועית.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:40:30.772135
Last Completion:
2024-11-20 09:45:56.687740
Last Success:
2024-11-20 09:45:56.687740

Pipeline ID: entities/companies/registrar/scraper

רשימת אגודות שיתופיות (cooperatives)
Succeeded

רשימת אגודות שיתופיות, מתוך ממשק נתונים של מאגר של משרד הכלכלה / האגף לאיגוד שיתופי, מתעדכן שבועית


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-08 20:31:35.314352
Last Completion:
2024-04-08 20:37:24.229649
Last Success:
2024-04-08 20:37:24.229649

Pipeline ID: entities/cooperatives/cooperatives

רשימת הקדשים (endowments)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 13:09:05.360924
Last Completion:
2023-10-30 13:09:19.670080
Last Success:
2023-10-30 13:09:19.670080

Pipeline ID: entities/endowments/endowments

entities/entities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 20:10:14.031320
Last Completion:
2024-11-20 20:15:30.370020
Last Success:
2024-11-20 20:15:30.370020

Pipeline ID: entities/entities

entities/fingerprints
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2024-11-20 21:42:01.104407
Last Completion:
2024-11-20 22:37:37.427766
Last Success:
2024-11-20 22:37:37.427766

Pipeline ID: entities/fingerprints

entities/foi_orgs/foi_orgs
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-07 13:28:06.864201
Last Completion:
2024-04-07 13:29:04.260428
Last Success:
2024-04-07 13:29:04.260428

Pipeline ID: entities/foi_orgs/foi_orgs

entities/moital/moital_service_providers
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:40:30.292526
Last Completion:
2024-11-20 09:40:34.073157
Last Success:
None

scraper
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/entities/moital/scraper.py", line 79, in <module>
    spew(datapackage, [scrape()])
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/entities/moital/scraper.py", line 32, in scrape
    desired_capabilities=DesiredCapabilities.PHANTOMJS)
AttributeError: type object 'DesiredCapabilities' has no attribute 'PHANTOMJS'

Pipeline ID: entities/moital/moital_service_providers

רשימת אגודות עותומניות (ottoman-association-registry)
Succeeded

רשימת אגודות עותומניות, מתוך תשובה לבקשת חופש מידע


Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:57:38.877023
Last Completion:
2023-10-30 12:57:55.586668
Last Success:
2023-10-30 12:57:55.586668

Pipeline ID: entities/ottoman/ottoman-association-registry

רשימת שותפויות (partnerships)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:57:24.491656
Last Completion:
2023-10-30 12:58:22.293466
Last Success:
2023-10-30 12:58:22.293466

Pipeline ID: entities/partnerships/partnerships

entities/safety-orders/safety-orders
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:40:37.528571
Last Completion:
2024-11-20 09:40:55.285657
Last Success:
None

stream_remote_resources
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 174, in _new_conn
    conn = connection.create_connection(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/connection.py", line 72, in create_connection
    for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
  File "/usr/local/lib/python3.9/socket.py", line 954, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -2] Name or service not known
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 714, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 415, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 244, in request
    super(HTTPConnection, self).request(method, url, body=body, headers=headers)
  File "/usr/local/lib/python3.9/http/client.py", line 1285, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/lib/python3.9/http/client.py", line 1331, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.9/http/client.py", line 1280, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.9/http/client.py", line 1040, in _send_output
    self.send(msg)
  File "/usr/local/lib/python3.9/http/client.py", line 980, in send
    self.connect()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 205, in connect
    conn = self._new_conn()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 186, in _new_conn
    raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f355e4565b0>: Failed to establish a new connection: [Errno -2] Name or service not known
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 486, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 798, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='employment.molsa.gov.il', port=80): Max retries exceeded with url: /Employment/SafetyAndHealth/Enforcement/Documents/%D7%A6%D7%95%D7%95%D7%99%20%D7%91%D7%98%D7%99%D7%97%D7%95%D7%AA.xlsx (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f355e4565b0>: Failed to establish a new connection: [Errno -2] Name or service not known'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 63, in load
    bytes = _RemoteStream(source, self.__http_session, self.__http_timeout).open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 121, in open
    self.seek(0)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 142, in seek
    self.__response = self.__session.get(self.__source, stream=True, timeout=self.__timeout)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 602, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 519, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPConnectionPool(host='employment.molsa.gov.il', port=80): Max retries exceeded with url: /Employment/SafetyAndHealth/Enforcement/Documents/%D7%A6%D7%95%D7%95%D7%99%20%D7%91%D7%98%D7%99%D7%97%D7%95%D7%AA.xlsx (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f355e4565b0>: Failed to establish a new connection: [Errno -2] Name or service not known'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 244, in <module>
    rows = stream_reader(resource, url, ignore_missing or url == "", limit_rows,
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 199, in stream_reader
    schema, headers, columns, stream, close = get_opener(url, _resource)()
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 175, in opener
    _stream.open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/stream.py", line 423, in open
    self.__parser.open(source, encoding=self.__encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/parsers/xlsx.py", line 81, in open
    source_bytes = self.__loader.load(source, mode="b", encoding=encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 72, in load
    raise exceptions.HTTPError(str(exception))
tabulator.exceptions.HTTPError: HTTPConnectionPool(host='employment.molsa.gov.il', port=80): Max retries exceeded with url: /Employment/SafetyAndHealth/Enforcement/Documents/%D7%A6%D7%95%D7%95%D7%99%20%D7%91%D7%98%D7%99%D7%97%D7%95%D7%AA.xlsx (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f355e4565b0>: Failed to establish a new connection: [Errno -2] Name or service not known'))

Pipeline ID: entities/safety-orders/safety-orders

entities/safety-orders/safety-orders-by-entity
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./entities/safety-orders/safety-orders" is successfully executed

Pipeline ID: entities/safety-orders/safety-orders-by-entity

entities/special/registry
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:40:34.107544
Last Completion:
2024-11-20 09:51:34.718286
Last Success:
2024-11-20 09:51:34.718286

Pipeline ID: entities/special/registry

ezvonot/ezvonot_accounts
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:51:28.280723
Last Completion:
2024-11-20 09:51:52.690881
Last Success:
2024-11-20 09:51:52.690881

Pipeline ID: ezvonot/ezvonot_accounts

ezvonot/ezvonot_cases
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:51:34.790174
Last Completion:
2024-11-20 09:51:45.881102
Last Success:
2024-11-20 09:51:45.881102

Pipeline ID: ezvonot/ezvonot_cases

ezvonot/ezvonot_crontab
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-08 00:06:36.812935
Last Completion:
2024-11-08 00:06:38.606792
Last Success:
2024-11-08 00:06:38.606792

Pipeline ID: ezvonot/ezvonot_crontab

ezvonot/ezvonot_decisions
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:51:52.701338
Last Completion:
2024-11-20 09:52:12.209193
Last Success:
2024-11-20 09:52:12.209193

Pipeline ID: ezvonot/ezvonot_decisions

ezvonot/ezvonot_decisions_join
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 10:29:56.109768
Last Completion:
2024-11-20 10:31:08.880649
Last Success:
2024-11-20 10:31:08.880649

Pipeline ID: ezvonot/ezvonot_decisions_join

ezvonot/ezvonot_deposits
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:51:10.908825
Last Completion:
2024-11-20 09:51:28.272627
Last Success:
2024-11-20 09:51:28.272627

Pipeline ID: ezvonot/ezvonot_deposits

ezvonot/ezvonot_purposes
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:51:45.892399
Last Completion:
2024-11-20 09:52:00.006018
Last Success:
2024-11-20 09:52:00.006018

Pipeline ID: ezvonot/ezvonot_purposes

government_decisions/government_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 13:10:04.999126
Last Completion:
2024-11-20 13:10:25.898441
Last Success:
2024-11-20 13:10:25.898441

Pipeline ID: government_decisions/government_decisions

government_decisions/scraper
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 12:45:39.735111
Last Completion:
2024-11-20 13:10:04.598948
Last Success:
2024-11-20 13:10:04.598948

Pipeline ID: government_decisions/scraper

lamas/municipal-data
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 10:29:12.295427
Last Completion:
2024-11-20 10:29:56.098478
Last Success:
2024-11-20 10:29:56.098478

Pipeline ID: lamas/municipal-data

קובץ התאמת רשויות אזוריות לישובים בשטחן (municipality-to-city)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:52:13.469318
Last Completion:
2023-10-30 12:52:15.993864
Last Success:
2023-10-30 12:52:15.993864

Pipeline ID: lamas/municipality-to-city

maya/maya-bonds-and-options-holdings-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 02:48:18.335340
Last Completion:
2024-01-31 03:02:04.156723
Last Success:
2024-01-31 03:02:04.156723

Pipeline ID: maya/maya-bonds-and-options-holdings-changes

maya/maya-company-director-appointments
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-02-03 13:51:26.936818
Last Completion:
2024-02-03 13:55:44.753315
Last Success:
2024-02-03 13:55:44.753315

Pipeline ID: maya/maya-company-director-appointments

maya/maya-company-officer-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 02:48:18.246500
Last Completion:
2024-01-31 03:04:11.542069
Last Success:
2024-01-31 03:04:11.542069

Pipeline ID: maya/maya-company-officer-list

maya/maya-company-stakeholder-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 02:53:54.152005
Last Completion:
2024-01-31 03:13:46.756725
Last Success:
2024-01-31 03:13:46.756725

Pipeline ID: maya/maya-company-stakeholder-list

maya/maya-company-vip-appointments
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 02:48:18.252588
Last Completion:
2024-01-31 03:01:59.830546
Last Success:
2024-01-31 03:01:59.830546

Pipeline ID: maya/maya-company-vip-appointments

maya/maya-complete-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 02:13:17.753935
Last Completion:
2024-01-31 02:48:17.966176
Last Success:
2024-01-31 02:48:17.966176

Pipeline ID: maya/maya-complete-notification-list

maya/maya-holdings-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 02:48:18.343706
Last Completion:
2024-01-31 03:03:44.847913
Last Success:
2024-01-31 03:03:44.847913

Pipeline ID: maya/maya-holdings-changes

maya/maya-notification-parse-updates
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 01:41:17.261505
Last Completion:
2024-01-31 02:09:57.763024
Last Success:
2024-01-31 02:09:57.763024

Pipeline ID: maya/maya-notification-parse-updates

maya/maya-reported-academic-degrees
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 03:01:59.837087
Last Completion:
2024-01-31 03:10:54.251795
Last Success:
2024-01-31 03:10:54.251795

Pipeline ID: maya/maya-reported-academic-degrees

maya/maya-reported-work-record
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 03:02:04.164341
Last Completion:
2024-01-31 03:10:52.455060
Last Success:
2024-01-31 03:10:52.455060

Pipeline ID: maya/maya-reported-work-record

maya/maya-tase-companies-current-management
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 00:47:58.759296
Last Completion:
2024-01-31 01:41:05.358576
Last Success:
2024-01-31 01:41:05.358576

Pipeline ID: maya/maya-tase-companies-current-management

maya/maya-tase-companies-current-shareholders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 00:45:21.335042
Last Completion:
2024-01-31 01:42:56.156595
Last Success:
2024-01-31 01:42:56.156595

Pipeline ID: maya/maya-tase-companies-current-shareholders

maya/scrape-maya-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 00:00:17.363394
Last Completion:
2024-01-31 00:55:22.884936
Last Success:
2024-01-31 00:55:22.884936

Pipeline ID: maya/scrape-maya-notification-list

maya/scrape-maya-tase-companies
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 00:09:17.239457
Last Completion:
2024-01-31 00:10:55.731875
Last Success:
2024-01-31 00:10:55.731875

Pipeline ID: maya/scrape-maya-tase-companies

people/aggregated
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/all
From ./people/all :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']
From ./people/all :['From ./people/company_appointments/all-appointments', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/state_owned/state-owned-nominations']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/state_owned/state-owned-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/state_owned/correlate']]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/state_owned/state-owned-nominations', ['From ./people/company_appointments/state_owned/correlate', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/state_owned/parse_pdf_resources" is successfully executed']]]]
From ./people/all :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/procurement/procurement-individuals']
From ./people/all :['From ./people/procurement/procurement-individuals', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/spending/latest-contract-spending" is successfully executed']]
From ./people/all :['Dependency unsuccessful', 'Cannot run until dependency "./people/political_donations/political_donations" is successfully executed']

Pipeline ID: people/aggregated

people/all
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/all-appointments
From ./people/company_appointments/all-appointments :['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed']
From ./people/company_appointments/all-appointments :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]
From ./people/company_appointments/all-appointments :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]
Dependency unsuccessful :Cannot run until dependency "./people/political_donations/political_donations" is successfully executed

Pipeline ID: people/all

people/association_founders/association-founders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-05-31 05:34:11.763816
Last Completion:
2024-05-31 05:34:31.764983
Last Success:
2024-05-31 05:34:31.764983

Pipeline ID: people/association_founders/association-founders

people/company_appointments/all-appointments
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed
Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations
From ./people/company_appointments/maya/maya-nominations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]
Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations
From ./people/company_appointments/maya/maya-resignations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]

Pipeline ID: people/company_appointments/all-appointments

people/company_appointments/maya/collect-maya-forms-debug-stats
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed

Pipeline ID: people/company_appointments/maya/collect-maya-forms-debug-stats

Join the parsed PDF to get start and end time for each person (correlate)
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations
From ./people/company_appointments/maya/maya-nominations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]
Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations
From ./people/company_appointments/maya/maya-resignations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]

Pipeline ID: people/company_appointments/maya/correlate

people/company_appointments/maya/maya-list
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates
From ./people/company_appointments/maya/maya-notification-updates :['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']

Pipeline ID: people/company_appointments/maya/maya-list

Appointment notices from Maya (maya-nominations)
Invalid

Name, job and company description.


Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list
From ./people/company_appointments/maya/maya-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']
From ./people/company_appointments/maya/maya-list :['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]

Pipeline ID: people/company_appointments/maya/maya-nominations

people/company_appointments/maya/maya-notification-list
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:50:47.678338
Last Completion:
2024-11-20 09:50:49.705054
Last Success:
None

scrape-notification-list
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 971, in json
    return complexjson.loads(self.text, **kwargs)
  File "/usr/local/lib/python3.9/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "/usr/local/lib/python3.9/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/local/lib/python3.9/json/decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 55, in _maya_api_call
    return res.json()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 975, in json
    raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 130, in <module>
    spew(datapackage, [collect()])
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 113, in collect
    yield from _collect_date_range(year_start, year_end)
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 75, in _collect_date_range
    res = _maya_api_call(date_from, date_to, current_page)
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 57, in _maya_api_call
    raise Exception("Failed to Call Maya API for date_from:{} date_to:{} page_num:{}".format(date_from, date_to, page_num)) from e
Exception: Failed to Call Maya API for date_from:2006-01-01 date_to:2007-01-01 page_num:0

Pipeline ID: people/company_appointments/maya/maya-notification-list

List all notifications from maya system (maya-notification-updates)
Invalid

id, date, company, notification_type, s3_object_name, url


Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed

Pipeline ID: people/company_appointments/maya/maya-notification-updates

Appointment notices from Maya (maya-resignations)
Invalid

Name, job and company description.


Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list
From ./people/company_appointments/maya/maya-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']
From ./people/company_appointments/maya/maya-list :['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]

Pipeline ID: people/company_appointments/maya/maya-resignations

מינויים בכלכליסט (calcalist)
Succeeded

רשימת כל המינויים והחברות מאתר כלכליסט


Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:56:38.289031
Last Completion:
2023-10-30 12:56:44.262040
Last Success:
2023-10-30 12:56:44.262040

Pipeline ID: people/company_appointments/media/calcalist/calcalist

Appointment notices from TheMarker (themarker)
Failed

Name, job and company description.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:50:49.711724
Last Completion:
2024-11-20 09:51:08.519370
Last Success:
None

stream_remote_resources
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 63, in load
    bytes = _RemoteStream(source, self.__http_session, self.__http_timeout).open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 121, in open
    self.seek(0)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 143, in seek
    self.__response.raise_for_status()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.themarker.com/st/inter/DB/tm/2015/minuyim30.xlsx
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 244, in <module>
    rows = stream_reader(resource, url, ignore_missing or url == "", limit_rows,
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 199, in stream_reader
    schema, headers, columns, stream, close = get_opener(url, _resource)()
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 175, in opener
    _stream.open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/stream.py", line 423, in open
    self.__parser.open(source, encoding=self.__encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/parsers/xlsx.py", line 81, in open
    source_bytes = self.__loader.load(source, mode="b", encoding=encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 72, in load
    raise exceptions.HTTPError(str(exception))
tabulator.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.themarker.com/st/inter/DB/tm/2015/minuyim30.xlsx

Pipeline ID: people/company_appointments/media/themarker/themarker

Join the parsed PDF to get start and end time for each person (correlate)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 10:29:07.798981
Last Completion:
2024-11-20 10:29:12.276581
Last Success:
2024-11-20 10:29:12.276581

Pipeline ID: people/company_appointments/state_owned/correlate

Parse and concatenate all PDF reports (parse_pdf_resources)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:51:08.542616
Last Completion:
2024-11-20 09:51:10.830253
Last Success:
2024-11-20 09:51:10.830253

Pipeline ID: people/company_appointments/state_owned/parse_pdf_resources

collect links to all pdf reports on https://mof.gov.il/GCA/Directors/Pages/DirectorsManningReport.aspx (reports)
Succeeded

columns: date, url


Last Run triggered by:
scheduled
Last Run started at:
2024-11-08 00:07:05.879431
Last Completion:
2024-11-08 00:07:11.720356
Last Success:
2024-11-08 00:07:11.720356

Pipeline ID: people/company_appointments/state_owned/reports

people/company_appointments/state_owned/state-owned-nominations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 11:30:45.870023
Last Completion:
2024-11-20 11:30:51.108858
Last Success:
2024-11-20 11:30:51.108858

Pipeline ID: people/company_appointments/state_owned/state-owned-nominations

people/municipal_appointments/municipal_representitives
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:56:30.686311
Last Completion:
2023-10-30 12:56:38.279365
Last Success:
2023-10-30 12:56:38.279365

Pipeline ID: people/municipal_appointments/municipal_representitives

people/political_candidates/election_candidates21
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:55:44.421800
Last Completion:
2023-10-30 12:56:30.674608
Last Success:
2023-10-30 12:56:30.674608

Pipeline ID: people/political_candidates/election_candidates21

people/political_donations/political_donations
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:50:45.336900
Last Completion:
2024-11-20 09:50:47.671048
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 971, in json
    return complexjson.loads(self.text, **kwargs)
  File "/usr/local/lib/python3.9/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "/usr/local/lib/python3.9/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/local/lib/python3.9/json/decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage/helpers.py", line 59, in retrieve_descriptor
    the_descriptor = req.json()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 975, in json
    raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/processors/load.py", line 121, in process_datapackage
    return self.safe_process_datapackage(dp)
  File "/usr/local/lib/python3.9/site-packages/dataflows/processors/load.py", line 159, in safe_process_datapackage
    self.load_dp = Package(self.load_source)
  File "/usr/local/lib/python3.9/site-packages/datapackage/package.py", line 102, in __init__
    descriptor = helpers.retrieve_descriptor(descriptor)
  File "/usr/local/lib/python3.9/site-packages/datapackage/helpers.py", line 62, in retrieve_descriptor
    six.raise_from(exceptions.DataPackageException(message), error)
  File "<string>", line 3, in raise_from
datapackage.exceptions.DataPackageException: Unable to load JSON at "https://next.obudget.org/datapackages/donations/transactions/datapackage.json"
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
    self.datapackage = self.process_datapackage(self.datapackage)
  File "/usr/local/lib/python3.9/site-packages/dataflows/processors/load.py", line 123, in process_datapackage
    raise SourceLoadError('Failed to load source {!r} and options {!r}: {}'
dataflows.base.exceptions.SourceLoadError: Failed to load source 'https://next.obudget.org/datapackages/donations/transactions/datapackage.json' and options {}: Unable to load JSON at "https://next.obudget.org/datapackages/donations/transactions/datapackage.json"
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
    spew_flow(flow, ctx)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
    datastream = flow.datastream()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/flow.py", line 18, in datastream
    return self._chain(ds)._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
    self.raise_exception(exception)
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
    raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor load in position #1: Failed to load source 'https://next.obudget.org/datapackages/donations/transactions/datapackage.json' and options {}: Unable to load JSON at "https://next.obudget.org/datapackages/donations/transactions/datapackage.json"

Pipeline ID: people/political_donations/political_donations

people/procurement/procurement-individuals
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 15:07:55.632827
Last Completion:
2024-11-20 15:15:54.004645
Last Success:
2024-11-20 15:15:54.004645

Pipeline ID: people/procurement/procurement-individuals

procurement/calls_for_bids/calls-for-bids-all
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-01-01 15:35:55.333030
Last Completion:
2024-01-01 15:39:00.080680
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-calls-for-bids
From ./procurement/calls_for_bids/jobiz-calls-for-bids :['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-all']
From ./procurement/calls_for_bids/jobiz-calls-for-bids :['From ./procurement/calls_for_bids/jobiz-all', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed']]

Pipeline ID: procurement/calls_for_bids/calls-for-bids-all

procurement/calls_for_bids/calls-for-bids-moh
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:52:04.610763
Last Completion:
2024-11-20 09:52:07.924571
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
    self.datapackage = self.process_datapackage(self.datapackage)
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 112, in process_datapackage
    raise self.exc
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 60, in describe
    sample = list(itertools.islice(self.iterable, self.SAMPLE_SIZE))
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 89, in handle_iterable
    for x in self.iterable:
  File "/datapackage_pipelines_budgetkey/pipelines/procurement/calls_for_bids/m_tmicha.py", line 47, in m_tmicha_scraper
    assert total > 0
AssertionError
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
    spew_flow(flow, ctx)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
    datastream = flow.datastream()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/flow.py", line 18, in datastream
    return self._chain(ds)._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
    self.raise_exception(exception)
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
    raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor iterable_loader in position #1:

Pipeline ID: procurement/calls_for_bids/calls-for-bids-moh

procurement/calls_for_bids/gov-publications
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:38:23.074698
Last Completion:
2023-10-30 12:45:35.525258
Last Success:
2023-10-30 12:45:35.525258

Pipeline ID: procurement/calls_for_bids/gov-publications

procurement/calls_for_bids/gov-publications-ministry-of-immigration
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:38:23.084630
Last Completion:
2023-10-30 12:41:13.866915
Last Success:
2023-10-30 12:41:13.866915

Pipeline ID: procurement/calls_for_bids/gov-publications-ministry-of-immigration

procurement/calls_for_bids/gov-publications2
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:38:23.077767
Last Completion:
2023-10-30 12:48:07.690633
Last Success:
2023-10-30 12:48:07.690633

Pipeline ID: procurement/calls_for_bids/gov-publications2

procurement/calls_for_bids/jobiz-all
Invalid

Last Run triggered by:
scheduled
Last Run started at:
2023-11-23 15:00:11.714981
Last Completion:
2023-11-23 15:00:14.954407
Last Success:
2023-11-23 15:00:14.954407

Dependency unsuccessful :Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed

Pipeline ID: procurement/calls_for_bids/jobiz-all

procurement/calls_for_bids/jobiz-calls-for-bids
Invalid

Last Run triggered by:
dirty-task-update
Last Run started at:
2023-12-19 15:01:00.047665
Last Completion:
2023-12-19 15:01:02.166318
Last Success:
2023-12-19 15:01:02.166318

Invalid dependency :Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-all
From ./procurement/calls_for_bids/jobiz-all :['Dependency unsuccessful', 'Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed']

Pipeline ID: procurement/calls_for_bids/jobiz-calls-for-bids

procurement/calls_for_bids/jobiz-scraper
Failed

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 15:00:02.278138
Last Completion:
2024-11-20 15:00:05.191392
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 174, in _new_conn
    conn = connection.create_connection(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/connection.py", line 72, in create_connection
    for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
  File "/usr/local/lib/python3.9/socket.py", line 954, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -5] No address associated with hostname
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 714, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 403, in _make_request
    self._validate_conn(conn)
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1053, in _validate_conn
    conn.connect()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 363, in connect
    self.sock = conn = self._new_conn()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 186, in _new_conn
    raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPSConnection object at 0x7fa20a7f2af0>: Failed to establish a new connection: [Errno -5] No address associated with hostname
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 486, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 798, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='jobiz.gov.il', port=443): Max retries exceeded with url: /ajax/results/%D7%94%D7%95%D7%93%D7%A2%D7%94%20%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA/0?ie=0&typeie=%D7%94%D7%95%D7%93%D7%A2%D7%94+%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA&search=Array (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fa20a7f2af0>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
    self.datapackage = self.process_datapackage(self.datapackage)
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 112, in process_datapackage
    raise self.exc
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 60, in describe
    sample = list(itertools.islice(self.iterable, self.SAMPLE_SIZE))
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 89, in handle_iterable
    for x in self.iterable:
  File "/datapackage_pipelines_budgetkey/pipelines/procurement/calls_for_bids/jobiz.py", line 19, in fetch_results
    content = requests.get(URL.format(index)).json()
  File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 73, in get
    return request("get", url, params=params, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 59, in request
    return session.request(method=method, url=url, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 519, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='jobiz.gov.il', port=443): Max retries exceeded with url: /ajax/results/%D7%94%D7%95%D7%93%D7%A2%D7%94%20%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA/0?ie=0&typeie=%D7%94%D7%95%D7%93%D7%A2%D7%94+%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA&search=Array (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fa20a7f2af0>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
    spew_flow(flow, ctx)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
    datastream = flow.datastream()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/flow.py", line 18, in datastream
    return self._chain(ds)._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  [Previous line repeated 5 more times]
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
    self.raise_exception(exception)
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
    raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor iterable_loader in position #1: HTTPSConnectionPool(host='jobiz.gov.il', port=443): Max retries exceeded with url: /ajax/results/%D7%94%D7%95%D7%93%D7%A2%D7%94%20%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA/0?ie=0&typeie=%D7%94%D7%95%D7%93%D7%A2%D7%94+%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA&search=Array (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fa20a7f2af0>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))

Pipeline ID: procurement/calls_for_bids/jobiz-scraper

procurement/municipal/fetcher
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-08 00:06:56.795543
Last Completion:
2024-11-08 00:07:05.815241
Last Success:
2024-11-08 00:07:05.815241

Pipeline ID: procurement/municipal/fetcher

התקשרויות רכש ממשלתיות (latest-contract-spending)
Succeeded

אנו סוכמים מידע מתוך הדוחות הרבעוניים לתוך טבלה המכילה את המידע העדכני ביותר.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 12:54:14.796596
Last Completion:
2024-11-20 15:07:55.354443
Last Success:
2024-11-20 15:07:55.354443

Pipeline ID: procurement/spending/latest-contract-spending

procurement/spending/quarterly-contract-spending-report-uris
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:52:12.225182
Last Completion:
2024-11-20 09:53:03.776968
Last Success:
2024-11-20 09:53:03.776968

Pipeline ID: procurement/spending/quarterly-contract-spending-report-uris

דוחות רבעוניים מתוך מרכבה, לפי נוהל היחידה לחופש המידע. (quarterly-contract-spending-reports)
Succeeded

כל משרדי הממשלה ויחידות הסמך (שמחוברות למערכת מרכבה) צריכים לפרסם אחת לרבעון (תוך 45 יום מסוף הרבעון) דו״ח התקשרויות לפי פורמט מוגדר היטב הממומש כדו״ח מובנה במערכת המרכבה. כל המשרדים מדווחים עצמאית והדו״חות עולים לאתר היחידה לחופש המידע, משם אנו אוספים אותם. התוצר של השרשר הזה הוא פירוט כל הדיווחים של כל המשרדים.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 10:51:31.493297
Last Completion:
2024-11-20 11:29:39.980924
Last Success:
2024-11-20 11:29:39.980924

Pipeline ID: procurement/spending/quarterly-contract-spending-reports

procurement/spending/quarterly-contract-spending-reports-data
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 11:38:11.692855
Last Completion:
2024-11-20 12:41:55.992193
Last Success:
2024-11-20 12:41:55.992193

Pipeline ID: procurement/spending/quarterly-contract-spending-reports-data

procurement/spending/spending-by-entity
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 15:07:55.595155
Last Completion:
2024-11-20 15:15:48.474583
Last Success:
2024-11-20 15:15:48.474583

Pipeline ID: procurement/spending/spending-by-entity

Load all tenders data from data.gov.il to flat file (all)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:52:07.979897
Last Completion:
2024-11-20 09:58:25.273093
Last Success:
2024-11-20 09:58:25.273093

Pipeline ID: procurement/tenders/all

procurement/tenders/processed
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 11:12:41.006582
Last Completion:
2024-11-20 11:30:45.772268
Last Success:
2024-11-20 11:30:45.772268

Pipeline ID: procurement/tenders/processed

reports/all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-05-31 05:35:47.151958
Last Completion:
2024-05-31 05:35:54.247934
Last Success:
2024-05-31 05:35:54.247934

Pipeline ID: reports/all

reports/ngos/ngo-activity-report
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-05-31 05:32:24.243260
Last Completion:
2024-05-31 05:34:43.865004
Last Success:
2024-05-31 05:34:43.865004

Pipeline ID: reports/ngos/ngo-activity-report

reports/ngos/ngo-district-report
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-05-31 05:32:19.872661
Last Completion:
2024-05-31 05:34:11.755968
Last Success:
2024-05-31 05:34:11.755968

Pipeline ID: reports/ngos/ngo-district-report

simpledb/process_simple_dbs
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-10-13 07:24:10.953160
Last Completion:
2024-10-13 07:39:22.179636
Last Success:
2024-10-13 07:39:22.179636

Pipeline ID: simpledb/process_simple_dbs

supports/all
Invalid

Last Run triggered by:
scheduled
Last Run started at:
2024-11-01 21:11:28.650855
Last Completion:
2024-11-01 21:15:09.323984
Last Success:
2024-11-01 21:15:09.323984

Dependency unsuccessful :Cannot run until dependency "./supports/supports-2024" is successfully executed

Pipeline ID: supports/all

supports/by-payment-year
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 10:31:08.892465
Last Completion:
2024-11-20 10:41:23.610949
Last Success:
2024-11-20 10:41:23.610949

Pipeline ID: supports/by-payment-year

supports/by-request-year
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 10:41:23.694797
Last Completion:
2024-11-20 11:12:44.704146
Last Success:
2024-11-20 11:12:44.704146

Pipeline ID: supports/by-request-year

supports/criteria/support-criteria
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:47:41.362938
Last Completion:
2024-11-20 09:47:44.073991
Last Success:
None

sample
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/processors/sample.py", line 11, in <module>
    res_name = parameters.get('resource', datapackage['resources'][0]['name'])
IndexError: list index out of range

Pipeline ID: supports/criteria/support-criteria

supports/criteria/support-criteria-doj
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-08 00:07:11.728987
Last Completion:
2024-11-08 00:07:15.941470
Last Success:
2024-11-08 00:07:15.941470

Pipeline ID: supports/criteria/support-criteria-doj

supports/supports-2004
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:53.681254
Last Completion:
2024-04-09 04:45:56.573568
Last Success:
2024-04-09 04:45:56.573568

Pipeline ID: supports/supports-2004

supports/supports-2005
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:53.756307
Last Completion:
2024-04-09 04:45:57.173589
Last Success:
2024-04-09 04:45:57.173589

Pipeline ID: supports/supports-2005

supports/supports-2006
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:53.759548
Last Completion:
2024-04-09 04:45:56.863781
Last Success:
2024-04-09 04:45:56.863781

Pipeline ID: supports/supports-2006

supports/supports-2007
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:53.763061
Last Completion:
2024-04-09 04:45:57.371584
Last Success:
2024-04-09 04:45:57.371584

Pipeline ID: supports/supports-2007

supports/supports-2008
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:56.161095
Last Completion:
2024-04-09 04:45:58.180755
Last Success:
2024-04-09 04:45:58.180755

Pipeline ID: supports/supports-2008

supports/supports-2009
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:56.579196
Last Completion:
2024-04-09 04:45:58.897073
Last Success:
2024-04-09 04:45:58.897073

Pipeline ID: supports/supports-2009

supports/supports-2010
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:56.868919
Last Completion:
2024-04-09 04:45:59.557000
Last Success:
2024-04-09 04:45:59.557000

Pipeline ID: supports/supports-2010

supports/supports-2011
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:57.180514
Last Completion:
2024-04-09 04:45:59.464111
Last Success:
2024-04-09 04:45:59.464111

Pipeline ID: supports/supports-2011

supports/supports-2012
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:57.377418
Last Completion:
2024-04-09 04:45:59.854402
Last Success:
2024-04-09 04:45:59.854402

Pipeline ID: supports/supports-2012

supports/supports-2013
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:58.184901
Last Completion:
2024-04-09 04:46:00.857555
Last Success:
2024-04-09 04:46:00.857555

Pipeline ID: supports/supports-2013

supports/supports-2014
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:58.947138
Last Completion:
2024-04-09 04:46:01.155239
Last Success:
2024-04-09 04:46:01.155239

Pipeline ID: supports/supports-2014

supports/supports-2015
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:59.253330
Last Completion:
2024-04-09 04:46:01.654638
Last Success:
2024-04-09 04:46:01.654638

Pipeline ID: supports/supports-2015

supports/supports-2016
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:59.468513
Last Completion:
2024-04-09 04:46:02.672315
Last Success:
2024-04-09 04:46:02.672315

Pipeline ID: supports/supports-2016

supports/supports-2017
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:59.560635
Last Completion:
2024-04-09 04:46:02.790150
Last Success:
2024-04-09 04:46:02.790150

Pipeline ID: supports/supports-2017

supports/supports-2018
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:59.861253
Last Completion:
2024-04-09 05:01:17.552294
Last Success:
2024-04-09 05:01:17.552294

Pipeline ID: supports/supports-2018

supports/supports-2019
Failed

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 16:00:02.226367
Last Completion:
2024-11-20 16:10:44.015153
Last Success:
2024-11-07 16:12:54.662435

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
    DF.load(wrapper(year), format='csv',
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
    return scraper(gcd, year)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
    chart = get_chart(driver)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 30, in get_chart
    frame = WebDriverWait(driver, 121).until(
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
    raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x5569301a6199 <unknown>
WARNING :FAILED to teardown google-chrome

Pipeline ID: supports/supports-2019

supports/supports-2020
Failed

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 17:00:01.762406
Last Completion:
2024-11-20 17:09:39.910729
Last Success:
2024-11-07 17:13:11.481516

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
    DF.load(wrapper(year), format='csv',
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
    return scraper(gcd, year)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
    chart = get_chart(driver)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 30, in get_chart
    frame = WebDriverWait(driver, 121).until(
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
    raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x56539d154199 <unknown>
WARNING :FAILED to teardown google-chrome

Pipeline ID: supports/supports-2020

supports/supports-2021
Failed

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 18:00:01.670629
Last Completion:
2024-11-20 18:07:47.752261
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
    DF.load(wrapper(year), format='csv',
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
    return scraper(gcd, year)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
    chart = get_chart(driver)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 30, in get_chart
    frame = WebDriverWait(driver, 121).until(
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
    raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x561d14c99199 <unknown>
WARNING :FAILED to teardown google-chrome

Pipeline ID: supports/supports-2021

supports/supports-2022
Failed

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 19:00:01.622564
Last Completion:
2024-11-20 19:08:10.074975
Last Success:
2024-11-05 19:15:12.431963

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
    DF.load(wrapper(year), format='csv',
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
    return scraper(gcd, year)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
    chart = get_chart(driver)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 30, in get_chart
    frame = WebDriverWait(driver, 121).until(
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
    raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x55f0ec91c199 <unknown>
WARNING :FAILED to teardown google-chrome

Pipeline ID: supports/supports-2022

supports/supports-2023
Failed

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 20:00:03.186154
Last Completion:
2024-11-20 20:11:28.114930
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
    DF.load(wrapper(year), format='csv',
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
    return scraper(gcd, year)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
    chart = get_chart(driver)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 30, in get_chart
    frame = WebDriverWait(driver, 121).until(
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
    raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x562c291b1199 <unknown>
WARNING :FAILED to teardown google-chrome

Pipeline ID: supports/supports-2023

supports/supports-2024
Failed

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 21:00:01.575319
Last Completion:
2024-11-20 21:09:12.847272
Last Success:
2024-11-01 21:11:28.612580

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
    DF.load(wrapper(year), format='csv',
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
    return scraper(gcd, year)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
    chart = get_chart(driver)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 30, in get_chart
    frame = WebDriverWait(driver, 121).until(
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
    raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x558bce8d6199 <unknown>
WARNING :FAILED to teardown google-chrome

Pipeline ID: supports/supports-2024

supports/supports-by-entity
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 10:47:57.691387
Last Completion:
2024-11-20 10:51:31.392139
Last Success:
2024-11-20 10:51:31.392139

Pipeline ID: supports/supports-by-entity

supports/with-entities
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:46:33.420937
Last Completion:
2024-11-20 09:52:46.156483
Last Success:
2024-11-20 09:52:46.156483

Pipeline ID: supports/with-entities

units/social_services/social_services
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:40:29.640188
Last Completion:
2024-11-20 09:40:39.597002
Last Success:
2024-11-20 09:40:39.597002

Pipeline ID: units/social_services/social_services

budgetkey/elasticsearch/index_calls_for_bids
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./procurement/calls_for_bids/calls-for-bids-all
From ./procurement/calls_for_bids/calls-for-bids-all :['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-calls-for-bids']
From ./procurement/calls_for_bids/calls-for-bids-all :['From ./procurement/calls_for_bids/jobiz-calls-for-bids', ['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-all']]
From ./procurement/calls_for_bids/calls-for-bids-all :['From ./procurement/calls_for_bids/jobiz-calls-for-bids', ['From ./procurement/calls_for_bids/jobiz-all', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed']]]

Pipeline ID: budgetkey/elasticsearch/index_calls_for_bids

budgetkey/elasticsearch/index_people
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/aggregated
From ./people/aggregated :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/all']
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/state_owned/state-owned-nominations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/state_owned/state-owned-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/state_owned/correlate']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/state_owned/state-owned-nominations', ['From ./people/company_appointments/state_owned/correlate', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/state_owned/parse_pdf_resources" is successfully executed']]]]]
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/procurement/procurement-individuals']]
From ./people/aggregated :['From ./people/all', ['From ./people/procurement/procurement-individuals', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/spending/latest-contract-spending" is successfully executed']]]
From ./people/aggregated :['From ./people/all', ['Dependency unsuccessful', 'Cannot run until dependency "./people/political_donations/political_donations" is successfully executed']]

Pipeline ID: budgetkey/elasticsearch/index_people

budgetkey/elasticsearch/index_support_criteria
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./supports/criteria/support-criteria" is successfully executed

Pipeline ID: budgetkey/elasticsearch/index_support_criteria

budgetkey/elasticsearch/sitemaps
Invalid

Last Run triggered by:
dirty-task-update
Last Run started at:
2024-11-20 19:56:03.424248
Last Completion:
2024-11-20 22:29:08.289811
Last Success:
2024-11-20 22:29:08.289811

Dirty dependency :Cannot run until dependency is executed: ./budgetkey/elasticsearch/index_entities

Pipeline ID: budgetkey/elasticsearch/sitemaps

donations/candidates
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./donations/parties" is successfully executed

Pipeline ID: donations/candidates

donations/transactions
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./donations/candidates
From ./donations/candidates :['Dependency unsuccessful', 'Cannot run until dependency "./donations/parties" is successfully executed']

Pipeline ID: donations/transactions

entities/safety-orders/safety-orders-by-entity
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./entities/safety-orders/safety-orders" is successfully executed

Pipeline ID: entities/safety-orders/safety-orders-by-entity

people/aggregated
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/all
From ./people/all :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']
From ./people/all :['From ./people/company_appointments/all-appointments', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/state_owned/state-owned-nominations']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/state_owned/state-owned-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/state_owned/correlate']]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/state_owned/state-owned-nominations', ['From ./people/company_appointments/state_owned/correlate', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/state_owned/parse_pdf_resources" is successfully executed']]]]
From ./people/all :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/procurement/procurement-individuals']
From ./people/all :['From ./people/procurement/procurement-individuals', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/spending/latest-contract-spending" is successfully executed']]
From ./people/all :['Dependency unsuccessful', 'Cannot run until dependency "./people/political_donations/political_donations" is successfully executed']

Pipeline ID: people/aggregated

people/all
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/all-appointments
From ./people/company_appointments/all-appointments :['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed']
From ./people/company_appointments/all-appointments :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]
From ./people/company_appointments/all-appointments :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]
Dependency unsuccessful :Cannot run until dependency "./people/political_donations/political_donations" is successfully executed

Pipeline ID: people/all

people/company_appointments/all-appointments
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed
Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations
From ./people/company_appointments/maya/maya-nominations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]
Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations
From ./people/company_appointments/maya/maya-resignations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]

Pipeline ID: people/company_appointments/all-appointments

people/company_appointments/maya/collect-maya-forms-debug-stats
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed

Pipeline ID: people/company_appointments/maya/collect-maya-forms-debug-stats

Join the parsed PDF to get start and end time for each person (correlate)
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations
From ./people/company_appointments/maya/maya-nominations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]
Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations
From ./people/company_appointments/maya/maya-resignations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]

Pipeline ID: people/company_appointments/maya/correlate

people/company_appointments/maya/maya-list
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates
From ./people/company_appointments/maya/maya-notification-updates :['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']

Pipeline ID: people/company_appointments/maya/maya-list

Appointment notices from Maya (maya-nominations)
Invalid

Name, job and company description.


Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list
From ./people/company_appointments/maya/maya-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']
From ./people/company_appointments/maya/maya-list :['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]

Pipeline ID: people/company_appointments/maya/maya-nominations

List all notifications from maya system (maya-notification-updates)
Invalid

id, date, company, notification_type, s3_object_name, url


Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed

Pipeline ID: people/company_appointments/maya/maya-notification-updates

Appointment notices from Maya (maya-resignations)
Invalid

Name, job and company description.


Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list
From ./people/company_appointments/maya/maya-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']
From ./people/company_appointments/maya/maya-list :['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]

Pipeline ID: people/company_appointments/maya/maya-resignations

procurement/calls_for_bids/calls-for-bids-all
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-01-01 15:35:55.333030
Last Completion:
2024-01-01 15:39:00.080680
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-calls-for-bids
From ./procurement/calls_for_bids/jobiz-calls-for-bids :['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-all']
From ./procurement/calls_for_bids/jobiz-calls-for-bids :['From ./procurement/calls_for_bids/jobiz-all', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed']]

Pipeline ID: procurement/calls_for_bids/calls-for-bids-all

procurement/calls_for_bids/jobiz-all
Invalid

Last Run triggered by:
scheduled
Last Run started at:
2023-11-23 15:00:11.714981
Last Completion:
2023-11-23 15:00:14.954407
Last Success:
2023-11-23 15:00:14.954407

Dependency unsuccessful :Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed

Pipeline ID: procurement/calls_for_bids/jobiz-all

procurement/calls_for_bids/jobiz-calls-for-bids
Invalid

Last Run triggered by:
dirty-task-update
Last Run started at:
2023-12-19 15:01:00.047665
Last Completion:
2023-12-19 15:01:02.166318
Last Success:
2023-12-19 15:01:02.166318

Invalid dependency :Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-all
From ./procurement/calls_for_bids/jobiz-all :['Dependency unsuccessful', 'Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed']

Pipeline ID: procurement/calls_for_bids/jobiz-calls-for-bids

supports/all
Invalid

Last Run triggered by:
scheduled
Last Run started at:
2024-11-01 21:11:28.650855
Last Completion:
2024-11-01 21:15:09.323984
Last Success:
2024-11-01 21:15:09.323984

Dependency unsuccessful :Cannot run until dependency "./supports/supports-2024" is successfully executed

Pipeline ID: supports/all

budgetkey/elasticsearch/index_entities
Running

Last Run triggered by:
dirty-task-update
Last Run started at:
2024-11-20 22:09:01.171576
Last Completion:
Last Success:
2024-11-20 22:08:11.170280

Pipeline ID: budgetkey/elasticsearch/index_entities

budgetkey/elasticsearch/index_reports
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:55:25.279159
Last Completion:
2024-11-20 09:55:38.712878
Last Success:
2024-10-11 07:03:57.501831

enrich_ngo_reports
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/enrich_ngo_reports.py", line 91, in <module>
    spew(dp, process_resources(res_iter))
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/enrich_ngo_reports.py", line 69, in process_resource
    for k, v in di[district].items():
KeyError: 'אזור יהודה ושומרון'

Pipeline ID: budgetkey/elasticsearch/index_reports

donations/parties
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:40:39.082522
Last Completion:
2024-11-20 09:40:43.394640
Last Success:
None

get_parties
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 714, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 403, in _make_request
    self._validate_conn(conn)
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1053, in _validate_conn
    conn.connect()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 419, in connect
    self.sock = ssl_wrap_socket(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 449, in ssl_wrap_socket
    ssl_sock = _ssl_wrap_socket_impl(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 493, in _ssl_wrap_socket_impl
    return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
  File "/usr/local/lib/python3.9/ssl.py", line 501, in wrap_socket
    return self.sslsocket_class._create(
  File "/usr/local/lib/python3.9/ssl.py", line 1041, in _create
    self.do_handshake()
  File "/usr/local/lib/python3.9/ssl.py", line 1310, in do_handshake
    self._sslobj.do_handshake()
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1129)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 486, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 798, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='statements.mevaker.gov.il', port=443): Max retries exceeded with url: /Handler/GuarantyDonationPublisherHandler.ashx (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1129)')))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_parties.py", line 38, in <module>
    spew(dp, [get_parties()])
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_parties.py", line 17, in get_parties
    resp = requests.post('https://statements.mevaker.gov.il/Handler/GuarantyDonationPublisherHandler.ashx',
  File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 115, in post
    return request("post", url, data=data, json=json, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 59, in request
    return session.request(method=method, url=url, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 517, in send
    raise SSLError(e, request=request)
requests.exceptions.SSLError: HTTPSConnectionPool(host='statements.mevaker.gov.il', port=443): Max retries exceeded with url: /Handler/GuarantyDonationPublisherHandler.ashx (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1129)')))

Pipeline ID: donations/parties

education/tochniyot/tochniyot
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:53:03.792526
Last Completion:
2024-11-20 09:53:08.289927
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 103, in flow
    return Flow(scrape(),
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 65, in scrape
    education_programs_count = get_education_programs_count()
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 56, in get_education_programs_count
    res = send_tochniyot_request()
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 80, in send_tochniyot_request
    resp.raise_for_status()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://apps.education.gov.il/TyhNet/ClientWs/TochnitCh.asmx/IturTochnitChByMeafyenim

Pipeline ID: education/tochniyot/tochniyot

entities/moital/moital_service_providers
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:40:30.292526
Last Completion:
2024-11-20 09:40:34.073157
Last Success:
None

scraper
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/entities/moital/scraper.py", line 79, in <module>
    spew(datapackage, [scrape()])
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/entities/moital/scraper.py", line 32, in scrape
    desired_capabilities=DesiredCapabilities.PHANTOMJS)
AttributeError: type object 'DesiredCapabilities' has no attribute 'PHANTOMJS'

Pipeline ID: entities/moital/moital_service_providers

entities/safety-orders/safety-orders
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:40:37.528571
Last Completion:
2024-11-20 09:40:55.285657
Last Success:
None

stream_remote_resources
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 174, in _new_conn
    conn = connection.create_connection(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/connection.py", line 72, in create_connection
    for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
  File "/usr/local/lib/python3.9/socket.py", line 954, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -2] Name or service not known
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 714, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 415, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 244, in request
    super(HTTPConnection, self).request(method, url, body=body, headers=headers)
  File "/usr/local/lib/python3.9/http/client.py", line 1285, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/lib/python3.9/http/client.py", line 1331, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.9/http/client.py", line 1280, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.9/http/client.py", line 1040, in _send_output
    self.send(msg)
  File "/usr/local/lib/python3.9/http/client.py", line 980, in send
    self.connect()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 205, in connect
    conn = self._new_conn()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 186, in _new_conn
    raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f355e4565b0>: Failed to establish a new connection: [Errno -2] Name or service not known
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 486, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 798, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='employment.molsa.gov.il', port=80): Max retries exceeded with url: /Employment/SafetyAndHealth/Enforcement/Documents/%D7%A6%D7%95%D7%95%D7%99%20%D7%91%D7%98%D7%99%D7%97%D7%95%D7%AA.xlsx (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f355e4565b0>: Failed to establish a new connection: [Errno -2] Name or service not known'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 63, in load
    bytes = _RemoteStream(source, self.__http_session, self.__http_timeout).open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 121, in open
    self.seek(0)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 142, in seek
    self.__response = self.__session.get(self.__source, stream=True, timeout=self.__timeout)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 602, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 519, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPConnectionPool(host='employment.molsa.gov.il', port=80): Max retries exceeded with url: /Employment/SafetyAndHealth/Enforcement/Documents/%D7%A6%D7%95%D7%95%D7%99%20%D7%91%D7%98%D7%99%D7%97%D7%95%D7%AA.xlsx (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f355e4565b0>: Failed to establish a new connection: [Errno -2] Name or service not known'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 244, in <module>
    rows = stream_reader(resource, url, ignore_missing or url == "", limit_rows,
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 199, in stream_reader
    schema, headers, columns, stream, close = get_opener(url, _resource)()
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 175, in opener
    _stream.open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/stream.py", line 423, in open
    self.__parser.open(source, encoding=self.__encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/parsers/xlsx.py", line 81, in open
    source_bytes = self.__loader.load(source, mode="b", encoding=encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 72, in load
    raise exceptions.HTTPError(str(exception))
tabulator.exceptions.HTTPError: HTTPConnectionPool(host='employment.molsa.gov.il', port=80): Max retries exceeded with url: /Employment/SafetyAndHealth/Enforcement/Documents/%D7%A6%D7%95%D7%95%D7%99%20%D7%91%D7%98%D7%99%D7%97%D7%95%D7%AA.xlsx (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f355e4565b0>: Failed to establish a new connection: [Errno -2] Name or service not known'))

Pipeline ID: entities/safety-orders/safety-orders

people/company_appointments/maya/maya-notification-list
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:50:47.678338
Last Completion:
2024-11-20 09:50:49.705054
Last Success:
None

scrape-notification-list
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 971, in json
    return complexjson.loads(self.text, **kwargs)
  File "/usr/local/lib/python3.9/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "/usr/local/lib/python3.9/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/local/lib/python3.9/json/decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 55, in _maya_api_call
    return res.json()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 975, in json
    raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 130, in <module>
    spew(datapackage, [collect()])
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 113, in collect
    yield from _collect_date_range(year_start, year_end)
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 75, in _collect_date_range
    res = _maya_api_call(date_from, date_to, current_page)
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 57, in _maya_api_call
    raise Exception("Failed to Call Maya API for date_from:{} date_to:{} page_num:{}".format(date_from, date_to, page_num)) from e
Exception: Failed to Call Maya API for date_from:2006-01-01 date_to:2007-01-01 page_num:0

Pipeline ID: people/company_appointments/maya/maya-notification-list

Appointment notices from TheMarker (themarker)
Failed

Name, job and company description.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:50:49.711724
Last Completion:
2024-11-20 09:51:08.519370
Last Success:
None

stream_remote_resources
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 63, in load
    bytes = _RemoteStream(source, self.__http_session, self.__http_timeout).open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 121, in open
    self.seek(0)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 143, in seek
    self.__response.raise_for_status()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.themarker.com/st/inter/DB/tm/2015/minuyim30.xlsx
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 244, in <module>
    rows = stream_reader(resource, url, ignore_missing or url == "", limit_rows,
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 199, in stream_reader
    schema, headers, columns, stream, close = get_opener(url, _resource)()
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 175, in opener
    _stream.open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/stream.py", line 423, in open
    self.__parser.open(source, encoding=self.__encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/parsers/xlsx.py", line 81, in open
    source_bytes = self.__loader.load(source, mode="b", encoding=encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 72, in load
    raise exceptions.HTTPError(str(exception))
tabulator.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.themarker.com/st/inter/DB/tm/2015/minuyim30.xlsx

Pipeline ID: people/company_appointments/media/themarker/themarker

people/political_donations/political_donations
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:50:45.336900
Last Completion:
2024-11-20 09:50:47.671048
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 971, in json
    return complexjson.loads(self.text, **kwargs)
  File "/usr/local/lib/python3.9/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "/usr/local/lib/python3.9/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/local/lib/python3.9/json/decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage/helpers.py", line 59, in retrieve_descriptor
    the_descriptor = req.json()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 975, in json
    raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/processors/load.py", line 121, in process_datapackage
    return self.safe_process_datapackage(dp)
  File "/usr/local/lib/python3.9/site-packages/dataflows/processors/load.py", line 159, in safe_process_datapackage
    self.load_dp = Package(self.load_source)
  File "/usr/local/lib/python3.9/site-packages/datapackage/package.py", line 102, in __init__
    descriptor = helpers.retrieve_descriptor(descriptor)
  File "/usr/local/lib/python3.9/site-packages/datapackage/helpers.py", line 62, in retrieve_descriptor
    six.raise_from(exceptions.DataPackageException(message), error)
  File "<string>", line 3, in raise_from
datapackage.exceptions.DataPackageException: Unable to load JSON at "https://next.obudget.org/datapackages/donations/transactions/datapackage.json"
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
    self.datapackage = self.process_datapackage(self.datapackage)
  File "/usr/local/lib/python3.9/site-packages/dataflows/processors/load.py", line 123, in process_datapackage
    raise SourceLoadError('Failed to load source {!r} and options {!r}: {}'
dataflows.base.exceptions.SourceLoadError: Failed to load source 'https://next.obudget.org/datapackages/donations/transactions/datapackage.json' and options {}: Unable to load JSON at "https://next.obudget.org/datapackages/donations/transactions/datapackage.json"
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
    spew_flow(flow, ctx)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
    datastream = flow.datastream()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/flow.py", line 18, in datastream
    return self._chain(ds)._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
    self.raise_exception(exception)
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
    raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor load in position #1: Failed to load source 'https://next.obudget.org/datapackages/donations/transactions/datapackage.json' and options {}: Unable to load JSON at "https://next.obudget.org/datapackages/donations/transactions/datapackage.json"

Pipeline ID: people/political_donations/political_donations

procurement/calls_for_bids/calls-for-bids-moh
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:52:04.610763
Last Completion:
2024-11-20 09:52:07.924571
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
    self.datapackage = self.process_datapackage(self.datapackage)
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 112, in process_datapackage
    raise self.exc
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 60, in describe
    sample = list(itertools.islice(self.iterable, self.SAMPLE_SIZE))
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 89, in handle_iterable
    for x in self.iterable:
  File "/datapackage_pipelines_budgetkey/pipelines/procurement/calls_for_bids/m_tmicha.py", line 47, in m_tmicha_scraper
    assert total > 0
AssertionError
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
    spew_flow(flow, ctx)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
    datastream = flow.datastream()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/flow.py", line 18, in datastream
    return self._chain(ds)._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
    self.raise_exception(exception)
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
    raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor iterable_loader in position #1:

Pipeline ID: procurement/calls_for_bids/calls-for-bids-moh

procurement/calls_for_bids/jobiz-scraper
Failed

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 15:00:02.278138
Last Completion:
2024-11-20 15:00:05.191392
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 174, in _new_conn
    conn = connection.create_connection(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/connection.py", line 72, in create_connection
    for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
  File "/usr/local/lib/python3.9/socket.py", line 954, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -5] No address associated with hostname
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 714, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 403, in _make_request
    self._validate_conn(conn)
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1053, in _validate_conn
    conn.connect()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 363, in connect
    self.sock = conn = self._new_conn()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 186, in _new_conn
    raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPSConnection object at 0x7fa20a7f2af0>: Failed to establish a new connection: [Errno -5] No address associated with hostname
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 486, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 798, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='jobiz.gov.il', port=443): Max retries exceeded with url: /ajax/results/%D7%94%D7%95%D7%93%D7%A2%D7%94%20%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA/0?ie=0&typeie=%D7%94%D7%95%D7%93%D7%A2%D7%94+%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA&search=Array (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fa20a7f2af0>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
    self.datapackage = self.process_datapackage(self.datapackage)
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 112, in process_datapackage
    raise self.exc
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 60, in describe
    sample = list(itertools.islice(self.iterable, self.SAMPLE_SIZE))
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 89, in handle_iterable
    for x in self.iterable:
  File "/datapackage_pipelines_budgetkey/pipelines/procurement/calls_for_bids/jobiz.py", line 19, in fetch_results
    content = requests.get(URL.format(index)).json()
  File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 73, in get
    return request("get", url, params=params, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 59, in request
    return session.request(method=method, url=url, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 519, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='jobiz.gov.il', port=443): Max retries exceeded with url: /ajax/results/%D7%94%D7%95%D7%93%D7%A2%D7%94%20%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA/0?ie=0&typeie=%D7%94%D7%95%D7%93%D7%A2%D7%94+%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA&search=Array (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fa20a7f2af0>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
    spew_flow(flow, ctx)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
    datastream = flow.datastream()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/flow.py", line 18, in datastream
    return self._chain(ds)._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  [Previous line repeated 5 more times]
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
    self.raise_exception(exception)
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
    raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor iterable_loader in position #1: HTTPSConnectionPool(host='jobiz.gov.il', port=443): Max retries exceeded with url: /ajax/results/%D7%94%D7%95%D7%93%D7%A2%D7%94%20%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA/0?ie=0&typeie=%D7%94%D7%95%D7%93%D7%A2%D7%94+%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA&search=Array (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fa20a7f2af0>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))

Pipeline ID: procurement/calls_for_bids/jobiz-scraper

supports/criteria/support-criteria
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:47:41.362938
Last Completion:
2024-11-20 09:47:44.073991
Last Success:
None

sample
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/processors/sample.py", line 11, in <module>
    res_name = parameters.get('resource', datapackage['resources'][0]['name'])
IndexError: list index out of range

Pipeline ID: supports/criteria/support-criteria

supports/supports-2019
Failed

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 16:00:02.226367
Last Completion:
2024-11-20 16:10:44.015153
Last Success:
2024-11-07 16:12:54.662435

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
    DF.load(wrapper(year), format='csv',
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
    return scraper(gcd, year)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
    chart = get_chart(driver)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 30, in get_chart
    frame = WebDriverWait(driver, 121).until(
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
    raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x5569301a6199 <unknown>
WARNING :FAILED to teardown google-chrome

Pipeline ID: supports/supports-2019

supports/supports-2020
Failed

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 17:00:01.762406
Last Completion:
2024-11-20 17:09:39.910729
Last Success:
2024-11-07 17:13:11.481516

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
    DF.load(wrapper(year), format='csv',
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
    return scraper(gcd, year)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
    chart = get_chart(driver)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 30, in get_chart
    frame = WebDriverWait(driver, 121).until(
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
    raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x56539d154199 <unknown>
WARNING :FAILED to teardown google-chrome

Pipeline ID: supports/supports-2020

supports/supports-2021
Failed

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 18:00:01.670629
Last Completion:
2024-11-20 18:07:47.752261
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
    DF.load(wrapper(year), format='csv',
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
    return scraper(gcd, year)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
    chart = get_chart(driver)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 30, in get_chart
    frame = WebDriverWait(driver, 121).until(
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
    raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x561d14c99199 <unknown>
WARNING :FAILED to teardown google-chrome

Pipeline ID: supports/supports-2021

supports/supports-2022
Failed

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 19:00:01.622564
Last Completion:
2024-11-20 19:08:10.074975
Last Success:
2024-11-05 19:15:12.431963

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
    DF.load(wrapper(year), format='csv',
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
    return scraper(gcd, year)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
    chart = get_chart(driver)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 30, in get_chart
    frame = WebDriverWait(driver, 121).until(
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
    raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x55f0ec91c199 <unknown>
WARNING :FAILED to teardown google-chrome

Pipeline ID: supports/supports-2022

supports/supports-2023
Failed

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 20:00:03.186154
Last Completion:
2024-11-20 20:11:28.114930
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
    DF.load(wrapper(year), format='csv',
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
    return scraper(gcd, year)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
    chart = get_chart(driver)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 30, in get_chart
    frame = WebDriverWait(driver, 121).until(
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
    raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x562c291b1199 <unknown>
WARNING :FAILED to teardown google-chrome

Pipeline ID: supports/supports-2023

supports/supports-2024
Failed

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 21:00:01.575319
Last Completion:
2024-11-20 21:09:12.847272
Last Success:
2024-11-01 21:11:28.612580

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
    DF.load(wrapper(year), format='csv',
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
    return scraper(gcd, year)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
    chart = get_chart(driver)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 30, in get_chart
    frame = WebDriverWait(driver, 121).until(
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
    raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x558bce8d6199 <unknown>
WARNING :FAILED to teardown google-chrome

Pipeline ID: supports/supports-2024

activities/social_services/social_service_reports
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:40:30.298342
Last Completion:
2024-11-20 09:43:19.897810
Last Success:
2024-11-20 09:43:19.897810

Pipeline ID: activities/social_services/social_service_reports

activities/social_services/social_service_suppliers
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:40:30.115664
Last Completion:
2024-11-20 09:40:38.870685
Last Success:
2024-11-20 09:40:38.870685

Pipeline ID: activities/social_services/social_service_suppliers

activities/social_services/social_service_tenders
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:40:30.119872
Last Completion:
2024-11-20 09:40:37.484195
Last Success:
2024-11-20 09:40:37.484195

Pipeline ID: activities/social_services/social_service_tenders

Fetch social services from data input (social_services)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-08 00:07:15.949302
Last Completion:
2024-11-08 00:07:46.520247
Last Success:
2024-11-08 00:07:46.520247

Pipeline ID: activities/social_services/social_services

bank_of_israel/bank_of_israel
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 13:09:59.775673
Last Completion:
2023-10-30 13:10:04.882030
Last Success:
2023-10-30 13:10:04.882030

Pipeline ID: bank_of_israel/bank_of_israel

budget/municipal/fetcher
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:40:55.292002
Last Completion:
2024-11-20 09:46:33.408628
Last Success:
2024-11-20 09:46:33.408628

Pipeline ID: budget/municipal/fetcher

budget/national/changes/explanations/all
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:52:40.851010
Last Completion:
2023-10-30 12:54:56.895489
Last Success:
2023-10-30 12:54:56.895489

Pipeline ID: budget/national/changes/explanations/all

budget/national/changes/original/current-year-fixes
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 10:07:15.490096
Last Completion:
2024-11-20 10:07:47.010883
Last Success:
2024-11-20 10:07:47.010883

Pipeline ID: budget/national/changes/original/current-year-fixes

budget/national/changes/original/national-budget-changes
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:40:39.898652
Last Completion:
2024-11-20 09:42:58.889004
Last Success:
2024-11-20 09:42:58.889004

Pipeline ID: budget/national/changes/original/national-budget-changes

Changes, grouped by transaction_id, with explanations (national-budget-changes-aggregated)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 14:09:58.420290
Last Completion:
2024-11-20 14:12:17.394257
Last Success:
2024-11-20 14:12:17.394257

Pipeline ID: budget/national/changes/processed/national-budget-changes-aggregated

budget/national/changes/processed/transactions
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 10:07:47.085653
Last Completion:
2024-11-20 14:09:58.318243
Last Success:
2024-11-20 14:09:58.318243

Pipeline ID: budget/national/changes/processed/transactions

National Yearly Budgets (national-budgets)
Succeeded

We get the data the Ministry of Finance publishes in data.gov.il every year. It comes in XLS format, with one row per TAKANA and phase (original, approved, executed). In this pipeline we create from each triplet a single row that has all the data.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-07-11 08:51:37.202691
Last Completion:
2024-07-11 11:35:17.635110
Last Success:
2024-07-11 11:35:17.635110

Pipeline ID: budget/national/original/national-budgets

National Yearly Budgets - Processed (aggregated-yearly)
Succeeded

This pipeline joins the different phases of the budget (allocated, revised and executed). In the original file there's a separate row for each of the phases. We like it better as a single row with all phase info. Another thing this pipeline does is to rename the column titles - to more friendly English names. Also, it create rows for all hierarchies - where upper hierarchies (2, 4 & 6 digits) are plain aggregations of the 8-digit items they contain.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-07-15 14:08:03.511289
Last Completion:
2024-07-15 15:45:59.400596
Last Success:
2024-07-15 15:45:59.400596

Pipeline ID: budget/national/processed/aggregated-yearly

budget/national/processed/category-explanations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:54:56.900975
Last Completion:
2023-10-30 12:54:57.594178
Last Success:
2023-10-30 12:54:57.594178

Pipeline ID: budget/national/processed/category-explanations

National Yearly Budgets - Joined with category-explanations (connected-items-explained)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-07-15 16:28:43.560691
Last Completion:
2024-07-15 16:32:38.123678
Last Success:
2024-07-15 16:32:38.123678

Pipeline ID: budget/national/processed/connected-items-explained

National Yearly Budgets - Connected Items (connected-national-budgets)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-07-15 16:04:17.718760
Last Completion:
2024-07-15 16:28:43.214063
Last Success:
2024-07-15 16:28:43.214063

Pipeline ID: budget/national/processed/connected-national-budgets

National Yearly Budgets - Just the total (item 00) (just-the-total)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-07-15 16:04:17.439847
Last Completion:
2024-07-15 16:14:09.208421
Last Success:
2024-07-15 16:14:09.208421

Pipeline ID: budget/national/processed/just-the-total

National Yearly Budgets - Main Item Names (roof-names)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-07-15 16:04:17.446654
Last Completion:
2024-07-15 16:14:03.520688
Last Success:
2024-07-15 16:14:03.520688

Pipeline ID: budget/national/processed/roof-names

National Yearly Budgets - With Extras (with-extras)
Succeeded

This pipeline joins the budget data to itself so that each item has a list of its immediate children.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-07-15 15:45:59.561381
Last Completion:
2024-07-15 16:04:17.308187
Last Success:
2024-07-15 16:04:17.308187

Pipeline ID: budget/national/processed/with-extras

budgetkey/analysis/spending/publisher_entity_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 11:41:30.777079
Last Completion:
2024-11-20 15:36:50.363911
Last Success:
2024-11-20 15:36:50.363911

Pipeline ID: budgetkey/analysis/spending/publisher_entity_analysis

budgetkey/analysis/spending/publisher_foa_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 12:41:56.006654
Last Completion:
2024-11-20 12:45:20.829396
Last Success:
2024-11-20 12:45:20.829396

Pipeline ID: budgetkey/analysis/spending/publisher_foa_analysis

budgetkey/analysis/spending/united
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 11:12:44.802810
Last Completion:
2024-11-20 11:38:11.675041
Last Success:
2024-11-20 11:38:11.675041

Pipeline ID: budgetkey/analysis/spending/united

Main Page - Aggregated budget by functional classification (budget-functional-aggregates)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-07-15 15:45:59.707700
Last Completion:
2024-07-15 15:51:44.417288
Last Success:
2024-07-15 15:51:44.417288

Pipeline ID: budgetkey/budget-functional-aggregates

budgetkey/documents
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-07-15 15:51:44.737799
Last Completion:
2024-07-15 15:51:48.099677
Last Success:
2024-07-15 15:51:48.099677

Pipeline ID: budgetkey/documents

budgetkey/elasticsearch/index_activities
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:50:13.299550
Last Completion:
2024-11-20 09:50:45.320478
Last Success:
2024-11-20 09:50:45.320478

Pipeline ID: budgetkey/elasticsearch/index_activities

budgetkey/elasticsearch/index_budget
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:54:03.208458
Last Completion:
2024-11-20 10:27:01.983851
Last Success:
2024-11-20 10:27:01.983851

Pipeline ID: budgetkey/elasticsearch/index_budget

budgetkey/elasticsearch/index_contract_spending
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 15:07:55.625919
Last Completion:
2024-11-20 17:01:29.192074
Last Success:
2024-11-20 17:01:29.192074

Pipeline ID: budgetkey/elasticsearch/index_contract_spending

budgetkey/elasticsearch/index_gov_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 13:10:26.208976
Last Completion:
2024-11-20 13:15:01.689128
Last Success:
2024-11-20 13:15:01.689128

Pipeline ID: budgetkey/elasticsearch/index_gov_decisions

budgetkey/elasticsearch/index_muni_budgets
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 10:27:02.072701
Last Completion:
2024-11-20 10:47:57.592875
Last Success:
2024-11-20 10:47:57.592875

Pipeline ID: budgetkey/elasticsearch/index_muni_budgets

budgetkey/elasticsearch/index_muni_tenders
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:58:25.291742
Last Completion:
2024-11-20 09:59:04.080764
Last Success:
2024-11-20 09:59:04.080764

Pipeline ID: budgetkey/elasticsearch/index_muni_tenders

budgetkey/elasticsearch/index_national_budget_changes
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 14:12:17.511708
Last Completion:
2024-11-20 14:14:55.029998
Last Success:
2024-11-20 14:14:55.029998

Pipeline ID: budgetkey/elasticsearch/index_national_budget_changes

budgetkey/elasticsearch/index_supports
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 11:30:51.288054
Last Completion:
2024-11-20 12:51:47.903432
Last Success:
2024-11-20 12:51:47.903432

Pipeline ID: budgetkey/elasticsearch/index_supports

budgetkey/elasticsearch/index_tenders
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 11:41:25.199347
Last Completion:
2024-11-20 12:45:39.705351
Last Success:
2024-11-20 12:45:39.705351

Pipeline ID: budgetkey/elasticsearch/index_tenders

budgetkey/elasticsearch/index_units
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 10:06:41.590990
Last Completion:
2024-11-20 10:07:15.471650
Last Success:
2024-11-20 10:07:15.471650

Pipeline ID: budgetkey/elasticsearch/index_units

Send periodic emails (emails)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-01 05:01:03.352108
Last Completion:
2024-11-01 14:19:44.544333
Last Success:
2024-11-01 14:19:44.544333

Pipeline ID: budgetkey/emails/emails

entities/all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 20:02:19.923489
Last Completion:
2024-11-20 20:10:13.800674
Last Success:
2024-11-20 20:10:13.800674

Pipeline ID: entities/all

entities/associations/guidestar/guidestar
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-05-31 05:24:46.370065
Last Completion:
2024-05-31 05:32:19.747601
Last Success:
2024-05-31 05:32:19.747601

Pipeline ID: entities/associations/guidestar/guidestar

entities/associations/guidestar/guidestar-scraper
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-05-31 00:11:57.440292
Last Completion:
2024-05-31 05:24:46.281650
Last Success:
2024-05-31 05:24:46.281650

Pipeline ID: entities/associations/guidestar/guidestar-scraper

עמותות פעילות מרשם העמותות (registry)
Succeeded

רשימת כלל העמותות הפעילות, מתעדכן שבועית.


Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 15:15:01.594645
Last Completion:
2024-01-31 15:15:17.127177
Last Success:
2024-01-31 15:15:17.127177

Pipeline ID: entities/associations/registrar/registry

entities/companies/registrar/details
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 20:00:01.787530
Last Completion:
2024-11-20 20:02:19.789875
Last Success:
2024-11-20 20:02:19.789875

Pipeline ID: entities/companies/registrar/details

חברות פעילות מרשם החברות (scraper)
Succeeded

רשימת כלל החברות הפעילות, מתעדכן שבועית.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:40:30.772135
Last Completion:
2024-11-20 09:45:56.687740
Last Success:
2024-11-20 09:45:56.687740

Pipeline ID: entities/companies/registrar/scraper

רשימת אגודות שיתופיות (cooperatives)
Succeeded

רשימת אגודות שיתופיות, מתוך ממשק נתונים של מאגר של משרד הכלכלה / האגף לאיגוד שיתופי, מתעדכן שבועית


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-08 20:31:35.314352
Last Completion:
2024-04-08 20:37:24.229649
Last Success:
2024-04-08 20:37:24.229649

Pipeline ID: entities/cooperatives/cooperatives

רשימת הקדשים (endowments)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 13:09:05.360924
Last Completion:
2023-10-30 13:09:19.670080
Last Success:
2023-10-30 13:09:19.670080

Pipeline ID: entities/endowments/endowments

entities/entities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 20:10:14.031320
Last Completion:
2024-11-20 20:15:30.370020
Last Success:
2024-11-20 20:15:30.370020

Pipeline ID: entities/entities

entities/fingerprints
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2024-11-20 21:42:01.104407
Last Completion:
2024-11-20 22:37:37.427766
Last Success:
2024-11-20 22:37:37.427766

Pipeline ID: entities/fingerprints

entities/foi_orgs/foi_orgs
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-07 13:28:06.864201
Last Completion:
2024-04-07 13:29:04.260428
Last Success:
2024-04-07 13:29:04.260428

Pipeline ID: entities/foi_orgs/foi_orgs

רשימת אגודות עותומניות (ottoman-association-registry)
Succeeded

רשימת אגודות עותומניות, מתוך תשובה לבקשת חופש מידע


Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:57:38.877023
Last Completion:
2023-10-30 12:57:55.586668
Last Success:
2023-10-30 12:57:55.586668

Pipeline ID: entities/ottoman/ottoman-association-registry

רשימת שותפויות (partnerships)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:57:24.491656
Last Completion:
2023-10-30 12:58:22.293466
Last Success:
2023-10-30 12:58:22.293466

Pipeline ID: entities/partnerships/partnerships

entities/special/registry
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:40:34.107544
Last Completion:
2024-11-20 09:51:34.718286
Last Success:
2024-11-20 09:51:34.718286

Pipeline ID: entities/special/registry

ezvonot/ezvonot_accounts
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:51:28.280723
Last Completion:
2024-11-20 09:51:52.690881
Last Success:
2024-11-20 09:51:52.690881

Pipeline ID: ezvonot/ezvonot_accounts

ezvonot/ezvonot_cases
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:51:34.790174
Last Completion:
2024-11-20 09:51:45.881102
Last Success:
2024-11-20 09:51:45.881102

Pipeline ID: ezvonot/ezvonot_cases

ezvonot/ezvonot_crontab
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-08 00:06:36.812935
Last Completion:
2024-11-08 00:06:38.606792
Last Success:
2024-11-08 00:06:38.606792

Pipeline ID: ezvonot/ezvonot_crontab

ezvonot/ezvonot_decisions
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:51:52.701338
Last Completion:
2024-11-20 09:52:12.209193
Last Success:
2024-11-20 09:52:12.209193

Pipeline ID: ezvonot/ezvonot_decisions

ezvonot/ezvonot_decisions_join
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 10:29:56.109768
Last Completion:
2024-11-20 10:31:08.880649
Last Success:
2024-11-20 10:31:08.880649

Pipeline ID: ezvonot/ezvonot_decisions_join

ezvonot/ezvonot_deposits
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:51:10.908825
Last Completion:
2024-11-20 09:51:28.272627
Last Success:
2024-11-20 09:51:28.272627

Pipeline ID: ezvonot/ezvonot_deposits

ezvonot/ezvonot_purposes
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:51:45.892399
Last Completion:
2024-11-20 09:52:00.006018
Last Success:
2024-11-20 09:52:00.006018

Pipeline ID: ezvonot/ezvonot_purposes

government_decisions/government_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 13:10:04.999126
Last Completion:
2024-11-20 13:10:25.898441
Last Success:
2024-11-20 13:10:25.898441

Pipeline ID: government_decisions/government_decisions

government_decisions/scraper
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-20 12:45:39.735111
Last Completion:
2024-11-20 13:10:04.598948
Last Success:
2024-11-20 13:10:04.598948

Pipeline ID: government_decisions/scraper

lamas/municipal-data
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 10:29:12.295427
Last Completion:
2024-11-20 10:29:56.098478
Last Success:
2024-11-20 10:29:56.098478

Pipeline ID: lamas/municipal-data

קובץ התאמת רשויות אזוריות לישובים בשטחן (municipality-to-city)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:52:13.469318
Last Completion:
2023-10-30 12:52:15.993864
Last Success:
2023-10-30 12:52:15.993864

Pipeline ID: lamas/municipality-to-city

maya/maya-bonds-and-options-holdings-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 02:48:18.335340
Last Completion:
2024-01-31 03:02:04.156723
Last Success:
2024-01-31 03:02:04.156723

Pipeline ID: maya/maya-bonds-and-options-holdings-changes

maya/maya-company-director-appointments
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-02-03 13:51:26.936818
Last Completion:
2024-02-03 13:55:44.753315
Last Success:
2024-02-03 13:55:44.753315

Pipeline ID: maya/maya-company-director-appointments

maya/maya-company-officer-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 02:48:18.246500
Last Completion:
2024-01-31 03:04:11.542069
Last Success:
2024-01-31 03:04:11.542069

Pipeline ID: maya/maya-company-officer-list

maya/maya-company-stakeholder-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 02:53:54.152005
Last Completion:
2024-01-31 03:13:46.756725
Last Success:
2024-01-31 03:13:46.756725

Pipeline ID: maya/maya-company-stakeholder-list

maya/maya-company-vip-appointments
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 02:48:18.252588
Last Completion:
2024-01-31 03:01:59.830546
Last Success:
2024-01-31 03:01:59.830546

Pipeline ID: maya/maya-company-vip-appointments

maya/maya-complete-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 02:13:17.753935
Last Completion:
2024-01-31 02:48:17.966176
Last Success:
2024-01-31 02:48:17.966176

Pipeline ID: maya/maya-complete-notification-list

maya/maya-holdings-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 02:48:18.343706
Last Completion:
2024-01-31 03:03:44.847913
Last Success:
2024-01-31 03:03:44.847913

Pipeline ID: maya/maya-holdings-changes

maya/maya-notification-parse-updates
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 01:41:17.261505
Last Completion:
2024-01-31 02:09:57.763024
Last Success:
2024-01-31 02:09:57.763024

Pipeline ID: maya/maya-notification-parse-updates

maya/maya-reported-academic-degrees
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 03:01:59.837087
Last Completion:
2024-01-31 03:10:54.251795
Last Success:
2024-01-31 03:10:54.251795

Pipeline ID: maya/maya-reported-academic-degrees

maya/maya-reported-work-record
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 03:02:04.164341
Last Completion:
2024-01-31 03:10:52.455060
Last Success:
2024-01-31 03:10:52.455060

Pipeline ID: maya/maya-reported-work-record

maya/maya-tase-companies-current-management
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 00:47:58.759296
Last Completion:
2024-01-31 01:41:05.358576
Last Success:
2024-01-31 01:41:05.358576

Pipeline ID: maya/maya-tase-companies-current-management

maya/maya-tase-companies-current-shareholders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 00:45:21.335042
Last Completion:
2024-01-31 01:42:56.156595
Last Success:
2024-01-31 01:42:56.156595

Pipeline ID: maya/maya-tase-companies-current-shareholders

maya/scrape-maya-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 00:00:17.363394
Last Completion:
2024-01-31 00:55:22.884936
Last Success:
2024-01-31 00:55:22.884936

Pipeline ID: maya/scrape-maya-notification-list

maya/scrape-maya-tase-companies
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-01-31 00:09:17.239457
Last Completion:
2024-01-31 00:10:55.731875
Last Success:
2024-01-31 00:10:55.731875

Pipeline ID: maya/scrape-maya-tase-companies

people/association_founders/association-founders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-05-31 05:34:11.763816
Last Completion:
2024-05-31 05:34:31.764983
Last Success:
2024-05-31 05:34:31.764983

Pipeline ID: people/association_founders/association-founders

מינויים בכלכליסט (calcalist)
Succeeded

רשימת כל המינויים והחברות מאתר כלכליסט


Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:56:38.289031
Last Completion:
2023-10-30 12:56:44.262040
Last Success:
2023-10-30 12:56:44.262040

Pipeline ID: people/company_appointments/media/calcalist/calcalist

Join the parsed PDF to get start and end time for each person (correlate)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 10:29:07.798981
Last Completion:
2024-11-20 10:29:12.276581
Last Success:
2024-11-20 10:29:12.276581

Pipeline ID: people/company_appointments/state_owned/correlate

Parse and concatenate all PDF reports (parse_pdf_resources)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:51:08.542616
Last Completion:
2024-11-20 09:51:10.830253
Last Success:
2024-11-20 09:51:10.830253

Pipeline ID: people/company_appointments/state_owned/parse_pdf_resources

collect links to all pdf reports on https://mof.gov.il/GCA/Directors/Pages/DirectorsManningReport.aspx (reports)
Succeeded

columns: date, url


Last Run triggered by:
scheduled
Last Run started at:
2024-11-08 00:07:05.879431
Last Completion:
2024-11-08 00:07:11.720356
Last Success:
2024-11-08 00:07:11.720356

Pipeline ID: people/company_appointments/state_owned/reports

people/company_appointments/state_owned/state-owned-nominations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 11:30:45.870023
Last Completion:
2024-11-20 11:30:51.108858
Last Success:
2024-11-20 11:30:51.108858

Pipeline ID: people/company_appointments/state_owned/state-owned-nominations

people/municipal_appointments/municipal_representitives
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:56:30.686311
Last Completion:
2023-10-30 12:56:38.279365
Last Success:
2023-10-30 12:56:38.279365

Pipeline ID: people/municipal_appointments/municipal_representitives

people/political_candidates/election_candidates21
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:55:44.421800
Last Completion:
2023-10-30 12:56:30.674608
Last Success:
2023-10-30 12:56:30.674608

Pipeline ID: people/political_candidates/election_candidates21

people/procurement/procurement-individuals
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 15:07:55.632827
Last Completion:
2024-11-20 15:15:54.004645
Last Success:
2024-11-20 15:15:54.004645

Pipeline ID: people/procurement/procurement-individuals

procurement/calls_for_bids/gov-publications
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:38:23.074698
Last Completion:
2023-10-30 12:45:35.525258
Last Success:
2023-10-30 12:45:35.525258

Pipeline ID: procurement/calls_for_bids/gov-publications

procurement/calls_for_bids/gov-publications-ministry-of-immigration
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:38:23.084630
Last Completion:
2023-10-30 12:41:13.866915
Last Success:
2023-10-30 12:41:13.866915

Pipeline ID: procurement/calls_for_bids/gov-publications-ministry-of-immigration

procurement/calls_for_bids/gov-publications2
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2023-10-30 12:38:23.077767
Last Completion:
2023-10-30 12:48:07.690633
Last Success:
2023-10-30 12:48:07.690633

Pipeline ID: procurement/calls_for_bids/gov-publications2

procurement/municipal/fetcher
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-08 00:06:56.795543
Last Completion:
2024-11-08 00:07:05.815241
Last Success:
2024-11-08 00:07:05.815241

Pipeline ID: procurement/municipal/fetcher

התקשרויות רכש ממשלתיות (latest-contract-spending)
Succeeded

אנו סוכמים מידע מתוך הדוחות הרבעוניים לתוך טבלה המכילה את המידע העדכני ביותר.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 12:54:14.796596
Last Completion:
2024-11-20 15:07:55.354443
Last Success:
2024-11-20 15:07:55.354443

Pipeline ID: procurement/spending/latest-contract-spending

procurement/spending/quarterly-contract-spending-report-uris
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:52:12.225182
Last Completion:
2024-11-20 09:53:03.776968
Last Success:
2024-11-20 09:53:03.776968

Pipeline ID: procurement/spending/quarterly-contract-spending-report-uris

דוחות רבעוניים מתוך מרכבה, לפי נוהל היחידה לחופש המידע. (quarterly-contract-spending-reports)
Succeeded

כל משרדי הממשלה ויחידות הסמך (שמחוברות למערכת מרכבה) צריכים לפרסם אחת לרבעון (תוך 45 יום מסוף הרבעון) דו״ח התקשרויות לפי פורמט מוגדר היטב הממומש כדו״ח מובנה במערכת המרכבה. כל המשרדים מדווחים עצמאית והדו״חות עולים לאתר היחידה לחופש המידע, משם אנו אוספים אותם. התוצר של השרשר הזה הוא פירוט כל הדיווחים של כל המשרדים.


Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 10:51:31.493297
Last Completion:
2024-11-20 11:29:39.980924
Last Success:
2024-11-20 11:29:39.980924

Pipeline ID: procurement/spending/quarterly-contract-spending-reports

procurement/spending/quarterly-contract-spending-reports-data
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 11:38:11.692855
Last Completion:
2024-11-20 12:41:55.992193
Last Success:
2024-11-20 12:41:55.992193

Pipeline ID: procurement/spending/quarterly-contract-spending-reports-data

procurement/spending/spending-by-entity
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 15:07:55.595155
Last Completion:
2024-11-20 15:15:48.474583
Last Success:
2024-11-20 15:15:48.474583

Pipeline ID: procurement/spending/spending-by-entity

Load all tenders data from data.gov.il to flat file (all)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:52:07.979897
Last Completion:
2024-11-20 09:58:25.273093
Last Success:
2024-11-20 09:58:25.273093

Pipeline ID: procurement/tenders/all

procurement/tenders/processed
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 11:12:41.006582
Last Completion:
2024-11-20 11:30:45.772268
Last Success:
2024-11-20 11:30:45.772268

Pipeline ID: procurement/tenders/processed

reports/all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-05-31 05:35:47.151958
Last Completion:
2024-05-31 05:35:54.247934
Last Success:
2024-05-31 05:35:54.247934

Pipeline ID: reports/all

reports/ngos/ngo-activity-report
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-05-31 05:32:24.243260
Last Completion:
2024-05-31 05:34:43.865004
Last Success:
2024-05-31 05:34:43.865004

Pipeline ID: reports/ngos/ngo-activity-report

reports/ngos/ngo-district-report
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-05-31 05:32:19.872661
Last Completion:
2024-05-31 05:34:11.755968
Last Success:
2024-05-31 05:34:11.755968

Pipeline ID: reports/ngos/ngo-district-report

simpledb/process_simple_dbs
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-10-13 07:24:10.953160
Last Completion:
2024-10-13 07:39:22.179636
Last Success:
2024-10-13 07:39:22.179636

Pipeline ID: simpledb/process_simple_dbs

supports/by-payment-year
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 10:31:08.892465
Last Completion:
2024-11-20 10:41:23.610949
Last Success:
2024-11-20 10:41:23.610949

Pipeline ID: supports/by-payment-year

supports/by-request-year
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 10:41:23.694797
Last Completion:
2024-11-20 11:12:44.704146
Last Success:
2024-11-20 11:12:44.704146

Pipeline ID: supports/by-request-year

supports/criteria/support-criteria-doj
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2024-11-08 00:07:11.728987
Last Completion:
2024-11-08 00:07:15.941470
Last Success:
2024-11-08 00:07:15.941470

Pipeline ID: supports/criteria/support-criteria-doj

supports/supports-2004
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:53.681254
Last Completion:
2024-04-09 04:45:56.573568
Last Success:
2024-04-09 04:45:56.573568

Pipeline ID: supports/supports-2004

supports/supports-2005
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:53.756307
Last Completion:
2024-04-09 04:45:57.173589
Last Success:
2024-04-09 04:45:57.173589

Pipeline ID: supports/supports-2005

supports/supports-2006
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:53.759548
Last Completion:
2024-04-09 04:45:56.863781
Last Success:
2024-04-09 04:45:56.863781

Pipeline ID: supports/supports-2006

supports/supports-2007
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:53.763061
Last Completion:
2024-04-09 04:45:57.371584
Last Success:
2024-04-09 04:45:57.371584

Pipeline ID: supports/supports-2007

supports/supports-2008
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:56.161095
Last Completion:
2024-04-09 04:45:58.180755
Last Success:
2024-04-09 04:45:58.180755

Pipeline ID: supports/supports-2008

supports/supports-2009
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:56.579196
Last Completion:
2024-04-09 04:45:58.897073
Last Success:
2024-04-09 04:45:58.897073

Pipeline ID: supports/supports-2009

supports/supports-2010
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:56.868919
Last Completion:
2024-04-09 04:45:59.557000
Last Success:
2024-04-09 04:45:59.557000

Pipeline ID: supports/supports-2010

supports/supports-2011
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:57.180514
Last Completion:
2024-04-09 04:45:59.464111
Last Success:
2024-04-09 04:45:59.464111

Pipeline ID: supports/supports-2011

supports/supports-2012
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:57.377418
Last Completion:
2024-04-09 04:45:59.854402
Last Success:
2024-04-09 04:45:59.854402

Pipeline ID: supports/supports-2012

supports/supports-2013
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:58.184901
Last Completion:
2024-04-09 04:46:00.857555
Last Success:
2024-04-09 04:46:00.857555

Pipeline ID: supports/supports-2013

supports/supports-2014
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:58.947138
Last Completion:
2024-04-09 04:46:01.155239
Last Success:
2024-04-09 04:46:01.155239

Pipeline ID: supports/supports-2014

supports/supports-2015
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:59.253330
Last Completion:
2024-04-09 04:46:01.654638
Last Success:
2024-04-09 04:46:01.654638

Pipeline ID: supports/supports-2015

supports/supports-2016
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:59.468513
Last Completion:
2024-04-09 04:46:02.672315
Last Success:
2024-04-09 04:46:02.672315

Pipeline ID: supports/supports-2016

supports/supports-2017
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:59.560635
Last Completion:
2024-04-09 04:46:02.790150
Last Success:
2024-04-09 04:46:02.790150

Pipeline ID: supports/supports-2017

supports/supports-2018
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-04-09 04:45:59.861253
Last Completion:
2024-04-09 05:01:17.552294
Last Success:
2024-04-09 05:01:17.552294

Pipeline ID: supports/supports-2018

supports/supports-by-entity
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 10:47:57.691387
Last Completion:
2024-11-20 10:51:31.392139
Last Success:
2024-11-20 10:51:31.392139

Pipeline ID: supports/supports-by-entity

supports/with-entities
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:46:33.420937
Last Completion:
2024-11-20 09:52:46.156483
Last Success:
2024-11-20 09:52:46.156483

Pipeline ID: supports/with-entities

units/social_services/social_services
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2024-11-20 09:40:29.640188
Last Completion:
2024-11-20 09:40:39.597002
Last Success:
2024-11-20 09:40:39.597002

Pipeline ID: units/social_services/social_services