activities/social_services/social_service_reports
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:05:01.268439
Last Completion:
2025-04-21 02:07:13.359674
Last Success:
2025-04-21 02:07:13.359674

Pipeline ID: activities/social_services/social_service_reports

activities/social_services/social_service_suppliers
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:04:52.651825
Last Completion:
2025-04-21 02:04:56.980608
Last Success:
2025-04-21 02:04:56.980608

Pipeline ID: activities/social_services/social_service_suppliers

activities/social_services/social_service_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:04:56.990123
Last Completion:
2025-04-21 02:05:01.151858
Last Success:
2025-04-21 02:05:01.151858

Pipeline ID: activities/social_services/social_service_tenders

Fetch social services from data input (social_services)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:00:37.038062
Last Completion:
2025-04-21 00:01:27.955414
Last Success:
2025-04-21 00:01:27.955414

Pipeline ID: activities/social_services/social_services

bank_of_israel/bank_of_israel
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 17:49:18.157655
Last Completion:
2025-04-20 17:49:22.642511
Last Success:
None

scraper
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/pyquery/pyquery.py", line 77, in fromstring
    result = getattr(etree, meth)(context)
  File "src/lxml/etree.pyx", line 3307, in lxml.etree.fromstring
  File "src/lxml/parser.pxi", line 1995, in lxml.etree._parseMemoryDocument
  File "src/lxml/parser.pxi", line 1875, in lxml.etree._parseDoc
  File "src/lxml/parser.pxi", line 1105, in lxml.etree._BaseParser._parseUnicodeDoc
  File "src/lxml/parser.pxi", line 633, in lxml.etree._ParserContext._handleParseResultDoc
  File "src/lxml/parser.pxi", line 743, in lxml.etree._handleParseResult
  File "src/lxml/parser.pxi", line 672, in lxml.etree._raiseParseError
  File "<string>", line 1
lxml.etree.XMLSyntaxError: Document is empty, line 1, column 1
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/bank_of_israel/scraper.py", line 124, in <module>
    series_sum = get_all_series()
  File "/datapackage_pipelines_budgetkey/pipelines/bank_of_israel/scraper.py", line 23, in get_all_series
    series = get_series(sid)
  File "/datapackage_pipelines_budgetkey/pipelines/bank_of_israel/scraper.py", line 36, in get_series
    resp = pq(data.decode(response.encoding or 'utf8'))
  File "/usr/local/lib/python3.9/site-packages/pyquery/pyquery.py", line 230, in __init__
    elements = fromstring(context, self.parser)
  File "/usr/local/lib/python3.9/site-packages/pyquery/pyquery.py", line 81, in fromstring
    result = getattr(lxml.html, meth)(context)
  File "/usr/local/lib/python3.9/site-packages/lxml/html/__init__.py", line 850, in fromstring
    doc = document_fromstring(html, parser=parser, base_url=base_url, **kw)
  File "/usr/local/lib/python3.9/site-packages/lxml/html/__init__.py", line 738, in document_fromstring
    raise etree.ParserError(
lxml.etree.ParserError: Document is empty

Pipeline ID: bank_of_israel/bank_of_israel

budget/municipal/fetcher
Running

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:38:18.138586
Last Completion:
Last Success:
2025-04-17 00:25:39.129523

Pipeline ID: budget/municipal/fetcher

budget/national/changes/explanations/all
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:42:30.271348
Last Completion:
2025-01-12 07:45:55.696978
Last Success:
2025-01-12 07:45:55.696978

Pipeline ID: budget/national/changes/explanations/all

budget/national/changes/original/committee-zipfile
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:38:13.147958
Last Completion:
2025-04-21 00:38:18.061934
Last Success:
2025-04-21 00:38:18.061934

Pipeline ID: budget/national/changes/original/committee-zipfile

budget/national/changes/original/current-year-fixes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-11 01:37:14.334031
Last Completion:
2025-04-11 01:37:37.730582
Last Success:
2025-04-11 01:37:37.730582

Pipeline ID: budget/national/changes/original/current-year-fixes

budget/national/changes/original/national-budget-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-11 00:11:20.150852
Last Completion:
2025-04-11 00:14:11.355309
Last Success:
2025-04-11 00:14:11.355309

Pipeline ID: budget/national/changes/original/national-budget-changes

Changes, grouped by transaction_id, with explanations (national-budget-changes-aggregated)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-11 05:33:23.915698
Last Completion:
2025-04-11 05:35:48.098845
Last Success:
2025-04-11 05:35:48.098845

Pipeline ID: budget/national/changes/processed/national-budget-changes-aggregated

budget/national/changes/processed/transactions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-11 01:37:37.744659
Last Completion:
2025-04-11 05:33:23.783387
Last Success:
2025-04-11 05:33:23.783387

Pipeline ID: budget/national/changes/processed/transactions

National Yearly Budgets (national-budgets)
Succeeded

We get the data the Ministry of Finance publishes in data.gov.il every year. It comes in XLS format, with one row per TAKANA and phase (original, approved, executed). In this pipeline we create from each triplet a single row that has all the data.


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-03 18:45:03.048448
Last Completion:
2025-04-03 19:40:14.105250
Last Success:
2025-04-03 19:40:14.105250

Pipeline ID: budget/national/original/national-budgets

National Yearly Budgets - Processed (aggregated-yearly)
Succeeded

This pipeline joins the different phases of the budget (allocated, revised and executed). In the original file there's a separate row for each of the phases. We like it better as a single row with all phase info. Another thing this pipeline does is to rename the column titles - to more friendly English names. Also, it create rows for all hierarchies - where upper hierarchies (2, 4 & 6 digits) are plain aggregations of the 8-digit items they contain.


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-03 19:40:14.607980
Last Completion:
2025-04-03 20:31:41.656835
Last Success:
2025-04-03 20:31:41.656835

Pipeline ID: budget/national/processed/aggregated-yearly

budget/national/processed/category-explanations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:43:09.618503
Last Completion:
2025-01-12 07:43:10.527802
Last Success:
2025-01-12 07:43:10.527802

Pipeline ID: budget/national/processed/category-explanations

National Yearly Budgets - Joined with category-explanations (connected-items-explained)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-03 20:56:29.327098
Last Completion:
2025-04-03 20:58:53.720601
Last Success:
2025-04-03 20:58:53.720601

Pipeline ID: budget/national/processed/connected-items-explained

National Yearly Budgets - Connected Items (connected-national-budgets)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-03 20:45:25.440648
Last Completion:
2025-04-03 20:56:28.979139
Last Success:
2025-04-03 20:56:28.979139

Pipeline ID: budget/national/processed/connected-national-budgets

National Yearly Budgets - Just the total (item 00) (just-the-total)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-03 20:41:56.523059
Last Completion:
2025-04-03 20:45:26.746811
Last Success:
2025-04-03 20:45:26.746811

Pipeline ID: budget/national/processed/just-the-total

National Yearly Budgets - Main Item Names (roof-names)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-03 20:41:56.529251
Last Completion:
2025-04-03 20:45:25.427507
Last Success:
2025-04-03 20:45:25.427507

Pipeline ID: budget/national/processed/roof-names

National Yearly Budgets - With Extras (with-extras)
Succeeded

This pipeline joins the budget data to itself so that each item has a list of its immediate children.


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-03 20:31:41.886456
Last Completion:
2025-04-03 20:41:56.367662
Last Success:
2025-04-03 20:41:56.367662

Pipeline ID: budget/national/processed/with-extras

budgetkey/analysis/spending/publisher_entity_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-16 10:14:45.790470
Last Completion:
2025-04-16 10:50:31.476451
Last Success:
2025-04-16 10:50:31.476451

Pipeline ID: budgetkey/analysis/spending/publisher_entity_analysis

budgetkey/analysis/spending/publisher_foa_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-16 10:14:45.801760
Last Completion:
2025-04-16 10:17:59.663245
Last Success:
2025-04-16 10:17:59.663245

Pipeline ID: budgetkey/analysis/spending/publisher_foa_analysis

budgetkey/analysis/spending/united
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-16 10:00:02.188671
Last Completion:
2025-04-16 10:14:45.507738
Last Success:
2025-04-16 10:14:45.507738

Pipeline ID: budgetkey/analysis/spending/united

Main Page - Aggregated budget by functional classification (budget-functional-aggregates)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-03 20:31:42.034413
Last Completion:
2025-04-03 20:35:08.959877
Last Success:
2025-04-03 20:35:08.959877

Pipeline ID: budgetkey/budget-functional-aggregates

budgetkey/documents
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-03 20:35:09.229687
Last Completion:
2025-04-03 20:35:12.153264
Last Success:
2025-04-03 20:35:12.153264

Pipeline ID: budgetkey/documents

budgetkey/elasticsearch/index_activities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:07:13.429335
Last Completion:
2025-04-21 02:07:47.566730
Last Success:
2025-04-21 02:07:47.566730

Pipeline ID: budgetkey/elasticsearch/index_activities

budgetkey/elasticsearch/index_budget
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 18:08:19.635234
Last Completion:
2025-04-20 18:55:01.742296
Last Success:
2025-04-11 01:36:40.239562

dump_to_es
ERROR   :DUMP TO ES ERROR ConnectionTimeout caused by - ReadTimeoutError(HTTPConnectionPool(host='elasticsearch-new', port=9200): Read timed out. (read timeout=10))
ERROR   :TB
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 466, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 461, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/local/lib/python3.9/http/client.py", line 1377, in getresponse
    response.begin()
  File "/usr/local/lib/python3.9/http/client.py", line 320, in begin
    version, status, reason = self._read_status()
  File "/usr/local/lib/python3.9/http/client.py", line 281, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/local/lib/python3.9/socket.py", line 704, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/connection/http_urllib3.py", line 251, in perform_request
    response = self.pool.urlopen(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 798, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/retry.py", line 525, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.9/site-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 714, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 468, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 357, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPConnectionPool(host='elasticsearch-new', port=9200): Read timed out. (read timeout=10)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/processors/dump_to_es.py", line 112, in <module>
    spew_flow(flow(ctx.parameters), ctx)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
    spew(self.datapackage, self.resource_iterator, stats=self.stats)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/usr/local/lib/python3.9/site-packages/dataflows/processors/dumpers/dumper_base.py", line 69, in row_counter
    for row in iterator:
  File "/usr/local/lib/python3.9/site-packages/tableschema_elasticsearch/storage.py", line 224, in write
    for result, row in iter:
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 329, in streaming_bulk
    for data, (ok, info) in zip(
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 256, in _process_bulk_chunk
    for item in gen:
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 195, in _process_bulk_chunk_error
    raise error
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 240, in _process_bulk_chunk
    resp = client.bulk("\n".join(bulk_actions) + "\n", *args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/client/utils.py", line 168, in _wrapped
    return func(*args, params=params, headers=headers, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/client/__init__.py", line 463, in bulk
    return self.transport.perform_request(
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/transport.py", line 415, in perform_request
    raise e
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/transport.py", line 381, in perform_request
    status, headers_response, data = connection.perform_request(
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/connection/http_urllib3.py", line 265, in perform_request
    raise ConnectionTimeout("TIMEOUT", str(e), e)
elasticsearch.exceptions.ConnectionTimeout: ConnectionTimeout caused by - ReadTimeoutError(HTTPConnectionPool(host='elasticsearch-new', port=9200): Read timed out. (read timeout=10))
ERROR   :Traceback (most recent call last):
ERROR   :File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 466, in _make_request
ERROR   :six.raise_from(e, None)
ERROR   :File "<string>", line 3, in raise_from
ERROR   :File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 461, in _make_request
ERROR   :httplib_response = conn.getresponse()
ERROR   :File "/usr/local/lib/python3.9/http/client.py", line 1377, in getresponse
ERROR   :response.begin()
ERROR   :File "/usr/local/lib/python3.9/http/client.py", line 320, in begin
ERROR   :version, status, reason = self._read_status()
ERROR   :File "/usr/local/lib/python3.9/http/client.py", line 281, in _read_status
ERROR   :line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
ERROR   :File "/usr/local/lib/python3.9/socket.py", line 704, in readinto
ERROR   :return self._sock.recv_into(b)
ERROR   :socket
ERROR   :.
ERROR   :timeout
ERROR   ::
ERROR   :timed out
ERROR   :During handling of the above exception, another exception occurred:
ERROR   :Traceback (most recent call last):
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/connection/http_urllib3.py", line 251, in perform_request
ERROR   :response = self.pool.urlopen(
ERROR   :File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 798, in urlopen
ERROR   :retries = retries.increment(
ERROR   :File "/usr/local/lib/python3.9/site-packages/urllib3/util/retry.py", line 525, in increment
ERROR   :raise six.reraise(type(error), error, _stacktrace)
ERROR   :File "/usr/local/lib/python3.9/site-packages/urllib3/packages/six.py", line 770, in reraise
ERROR   :raise value
ERROR   :File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 714, in urlopen
ERROR   :httplib_response = self._make_request(
ERROR   :File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 468, in _make_request
ERROR   :self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
ERROR   :File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 357, in _raise_timeout
ERROR   :raise ReadTimeoutError(
ERROR   :urllib3.exceptions
ERROR   :.
ERROR   :ReadTimeoutError
ERROR   ::
ERROR   :HTTPConnectionPool(host='elasticsearch-new', port=9200): Read timed out. (read timeout=10)
ERROR   :During handling of the above exception, another exception occurred:
ERROR   :Traceback (most recent call last):
ERROR   :File "/datapackage_pipelines_budgetkey/processors/dump_to_es.py", line 112, in <module>
ERROR   :spew_flow(flow(ctx.parameters), ctx)
ERROR   :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
ERROR   :spew(self.datapackage, self.resource_iterator, stats=self.stats)
ERROR   :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
ERROR   :for rec in res:
ERROR   :File "/usr/local/lib/python3.9/site-packages/dataflows/processors/dumpers/dumper_base.py", line 69, in row_counter
ERROR   :for row in iterator:
ERROR   :File "/usr/local/lib/python3.9/site-packages/tableschema_elasticsearch/storage.py", line 224, in write
ERROR   :for result, row in iter:
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 329, in streaming_bulk
ERROR   :for data, (ok, info) in zip(
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 256, in _process_bulk_chunk
ERROR   :for item in gen:
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 195, in _process_bulk_chunk_error
ERROR   :raise error
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 240, in _process_bulk_chunk
ERROR   :resp = client.bulk("\n".join(bulk_actions) + "\n", *args, **kwargs)
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/client/utils.py", line 168, in _wrapped
ERROR   :return func(*args, params=params, headers=headers, **kwargs)
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/client/__init__.py", line 463, in bulk
ERROR   :return self.transport.perform_request(
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/transport.py", line 415, in perform_request
ERROR   :raise e
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/transport.py", line 381, in perform_request
ERROR   :status, headers_response, data = connection.perform_request(
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/connection/http_urllib3.py", line 265, in perform_request
ERROR   :raise ConnectionTimeout("TIMEOUT", str(e), e)
ERROR   :elasticsearch.exceptions
ERROR   :.
ERROR   :ConnectionTimeout
ERROR   ::
ERROR   :ConnectionTimeout caused by - ReadTimeoutError(HTTPConnectionPool(host='elasticsearch-new', port=9200): Read timed out. (read timeout=10))

Pipeline ID: budgetkey/elasticsearch/index_budget

budgetkey/elasticsearch/index_calls_for_bids
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./procurement/calls_for_bids/calls-for-bids-all
From ./procurement/calls_for_bids/calls-for-bids-all :['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-calls-for-bids']
From ./procurement/calls_for_bids/calls-for-bids-all :['From ./procurement/calls_for_bids/jobiz-calls-for-bids', ['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-all']]
From ./procurement/calls_for_bids/calls-for-bids-all :['From ./procurement/calls_for_bids/jobiz-calls-for-bids', ['From ./procurement/calls_for_bids/jobiz-all', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed']]]

Pipeline ID: budgetkey/elasticsearch/index_calls_for_bids

budgetkey/elasticsearch/index_contract_spending
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 21:43:20.135046
Last Completion:
2025-04-21 02:04:52.622276
Last Success:
2025-04-21 02:04:52.622276

Dirty dependency :Cannot run until dependency is executed: ./procurement/spending/latest-contract-spending

Pipeline ID: budgetkey/elasticsearch/index_contract_spending

budgetkey/elasticsearch/index_entities
Running

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 22:02:04.754584
Last Completion:
Last Success:
2025-04-16 21:40:55.402732

Pipeline ID: budgetkey/elasticsearch/index_entities

budgetkey/elasticsearch/index_gov_decisions
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 17:51:33.635752
Last Completion:
2025-04-20 18:07:33.733510
Last Success:
2025-04-20 18:07:33.733510

Pipeline ID: budgetkey/elasticsearch/index_gov_decisions

budgetkey/elasticsearch/index_muni_budgets
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 17:58:06.453403
Last Completion:
2025-04-20 18:28:45.919682
Last Success:
2025-04-20 18:28:45.919682

Pipeline ID: budgetkey/elasticsearch/index_muni_budgets

budgetkey/elasticsearch/index_muni_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:49:44.123806
Last Completion:
2025-04-21 00:50:28.931432
Last Success:
2025-04-21 00:50:28.931432

Pipeline ID: budgetkey/elasticsearch/index_muni_tenders

budgetkey/elasticsearch/index_national_budget_changes
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 18:28:46.042388
Last Completion:
2025-04-20 18:41:59.553100
Last Success:
2025-04-20 18:41:59.553100

Pipeline ID: budgetkey/elasticsearch/index_national_budget_changes

budgetkey/elasticsearch/index_people
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/aggregated
From ./people/aggregated :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/all']
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/state_owned/state-owned-nominations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/state_owned/state-owned-nominations', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/state_owned/correlate" is successfully executed']]]]
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/procurement/procurement-individuals']]
From ./people/aggregated :['From ./people/all', ['From ./people/procurement/procurement-individuals', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/spending/latest-contract-spending" is successfully executed']]]
From ./people/aggregated :['From ./people/all', ['Dependency unsuccessful', 'Cannot run until dependency "./people/political_donations/political_donations" is successfully executed']]
From ./people/aggregated :['From ./people/all', ['Dependency unsuccessful', 'Cannot run until dependency "./people/political_candidates/election_candidates21" is successfully executed']]

Pipeline ID: budgetkey/elasticsearch/index_people

budgetkey/elasticsearch/index_reports
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 18:34:47.825225
Last Completion:
2025-04-20 18:35:11.131825
Last Success:
2025-04-10 22:16:21.334035

enrich_ngo_reports
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/enrich_ngo_reports.py", line 91, in <module>
    spew(dp, process_resources(res_iter))
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/enrich_ngo_reports.py", line 69, in process_resource
    for k, v in di[district].items():
KeyError: 'אזור יהודה ושומרון'

Pipeline ID: budgetkey/elasticsearch/index_reports

budgetkey/elasticsearch/index_support_criteria
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./supports/criteria/support-criteria" is successfully executed

Pipeline ID: budgetkey/elasticsearch/index_support_criteria

budgetkey/elasticsearch/index_supports
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 03:24:55.644540
Last Completion:
2025-04-21 04:35:59.180681
Last Success:
2025-04-21 04:35:59.180681

Pipeline ID: budgetkey/elasticsearch/index_supports

budgetkey/elasticsearch/index_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 03:39:09.069420
Last Completion:
2025-04-21 04:23:21.936025
Last Success:
2025-04-21 04:23:21.936025

Pipeline ID: budgetkey/elasticsearch/index_tenders

budgetkey/elasticsearch/index_units
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:19:58.187472
Last Completion:
2025-04-21 02:20:31.130016
Last Success:
2025-04-21 02:20:31.130016

Pipeline ID: budgetkey/elasticsearch/index_units

budgetkey/elasticsearch/sitemaps
Invalid

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-04-16 23:01:05.725148
Last Completion:
2025-04-17 00:11:24.730331
Last Success:
2025-04-17 00:11:24.730331

Dependency unsuccessful :Cannot run until dependency "./budgetkey/elasticsearch/index_budget" is successfully executed
Dirty dependency :Cannot run until dependency is executed: ./budgetkey/elasticsearch/index_entities

Pipeline ID: budgetkey/elasticsearch/sitemaps

Send periodic emails (emails)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-11 05:01:02.667719
Last Completion:
2025-04-11 12:43:00.163232
Last Success:
2025-04-11 12:43:00.163232

Pipeline ID: budgetkey/emails/emails

donations/candidates
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-02-20 14:24:37.288272
Last Completion:
2025-02-20 14:24:43.803557
Last Success:
2025-02-20 14:24:43.803557

Pipeline ID: donations/candidates

donations/parties
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-02-20 14:18:33.997134
Last Completion:
2025-02-20 14:18:40.300836
Last Success:
2025-02-20 14:18:40.300836

Pipeline ID: donations/parties

donations/transactions
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 17:48:08.837828
Last Completion:
2025-04-20 17:48:27.431240
Last Success:
None

get_transactions
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 150, in <module>
    spew(dp, process_resources(res_iter))
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 109, in get_transactions
    for resp in self.get_for_candidate(cid):
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 95, in get_for_candidate
    resp = self.get_for_range(cid, range_start, range_end)
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 70, in get_for_range
    assert len(resp) == 6
AssertionError

Pipeline ID: donations/transactions

education/tochniyot/tochniyot
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 18:01:27.056885
Last Completion:
2025-04-20 18:01:31.423396
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 103, in flow
    return Flow(scrape(),
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 65, in scrape
    education_programs_count = get_education_programs_count()
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 56, in get_education_programs_count
    res = send_tochniyot_request()
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 80, in send_tochniyot_request
    resp.raise_for_status()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://apps.education.gov.il/TyhNet/ClientWs/TochnitCh.asmx/IturTochnitChByMeafyenim

Pipeline ID: education/tochniyot/tochniyot

entities/all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 03:13:20.651307
Last Completion:
2025-04-21 03:26:35.138201
Last Success:
2025-04-21 03:26:35.138201

Pipeline ID: entities/all

entities/associations/guidestar/guidestar
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-13 05:52:47.361902
Last Completion:
2025-01-13 05:53:38.656055
Last Success:
2025-01-13 05:53:38.656055

Pipeline ID: entities/associations/guidestar/guidestar

entities/associations/guidestar/guidestar-scraper
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 20:00:39.332043
Last Completion:
2025-01-13 05:52:47.252362
Last Success:
2025-01-13 05:52:47.252362

Pipeline ID: entities/associations/guidestar/guidestar-scraper

עמותות פעילות מרשם העמותות (registry)
Succeeded

רשימת כלל העמותות הפעילות, מתעדכן שבועית.


Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 15:15:01.148215
Last Completion:
2025-01-31 15:15:16.766520
Last Success:
2025-01-31 15:15:16.766520

Pipeline ID: entities/associations/registrar/registry

entities/companies/registrar/details
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:14:55.453223
Last Completion:
2025-04-21 02:19:58.159421
Last Success:
2025-04-21 02:19:58.159421

Pipeline ID: entities/companies/registrar/details

חברות פעילות מרשם החברות (scraper)
Succeeded

רשימת כלל החברות הפעילות, מתעדכן שבועית.


Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:00:13.764437
Last Completion:
2025-04-21 00:15:09.657790
Last Success:
2025-04-21 00:15:09.657790

Pipeline ID: entities/companies/registrar/scraper

רשימת אגודות שיתופיות (cooperatives)
Succeeded

רשימת אגודות שיתופיות, מתוך ממשק נתונים של מאגר של משרד הכלכלה / האגף לאיגוד שיתופי, מתעדכן שבועית


Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 00:15:17.258218
Last Completion:
2025-01-31 00:19:09.911632
Last Success:
2025-01-31 00:19:09.911632

Pipeline ID: entities/cooperatives/cooperatives

רשימת הקדשים (endowments)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 08:03:04.519448
Last Completion:
2025-01-12 08:03:18.988162
Last Success:
2025-01-12 08:03:18.988162

Pipeline ID: entities/endowments/endowments

entities/entities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 03:28:12.631294
Last Completion:
2025-04-21 03:39:08.980699
Last Success:
2025-04-21 03:39:08.980699

Pipeline ID: entities/entities

entities/fingerprints
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 03:26:41.063133
Last Completion:
2025-04-21 04:57:43.733459
Last Success:
2025-04-21 04:57:43.733459

Pipeline ID: entities/fingerprints

entities/foi_orgs/foi_orgs
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:48:45.005971
Last Completion:
2025-01-12 07:49:49.509880
Last Success:
2025-01-12 07:49:49.509880

Pipeline ID: entities/foi_orgs/foi_orgs

entities/moital/moital_service_providers
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 17:48:55.429540
Last Completion:
2025-04-20 17:48:58.755692
Last Success:
None

scraper
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/entities/moital/scraper.py", line 79, in <module>
    spew(datapackage, [scrape()])
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/entities/moital/scraper.py", line 32, in scrape
    desired_capabilities=DesiredCapabilities.PHANTOMJS)
AttributeError: type object 'DesiredCapabilities' has no attribute 'PHANTOMJS'

Pipeline ID: entities/moital/moital_service_providers

רשימת אגודות עותומניות (ottoman-association-registry)
Succeeded

רשימת אגודות עותומניות, מתוך תשובה לבקשת חופש מידע


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:49:49.514262
Last Completion:
2025-01-12 07:50:10.403331
Last Success:
2025-01-12 07:50:10.403331

Pipeline ID: entities/ottoman/ottoman-association-registry

רשימת שותפויות (partnerships)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:49:40.695054
Last Completion:
2025-01-12 07:50:32.797033
Last Success:
2025-01-12 07:50:32.797033

Pipeline ID: entities/partnerships/partnerships

entities/safety-orders/safety-orders
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:27:44.341939
Last Completion:
2025-04-21 00:28:04.046459
Last Success:
None

stream_remote_resources
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 174, in _new_conn
    conn = connection.create_connection(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/connection.py", line 72, in create_connection
    for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
  File "/usr/local/lib/python3.9/socket.py", line 954, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -2] Name or service not known
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 714, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 415, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 244, in request
    super(HTTPConnection, self).request(method, url, body=body, headers=headers)
  File "/usr/local/lib/python3.9/http/client.py", line 1285, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/lib/python3.9/http/client.py", line 1331, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.9/http/client.py", line 1280, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.9/http/client.py", line 1040, in _send_output
    self.send(msg)
  File "/usr/local/lib/python3.9/http/client.py", line 980, in send
    self.connect()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 205, in connect
    conn = self._new_conn()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 186, in _new_conn
    raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f1ecfbc7580>: Failed to establish a new connection: [Errno -2] Name or service not known
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 486, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 798, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='employment.molsa.gov.il', port=80): Max retries exceeded with url: /Employment/SafetyAndHealth/Enforcement/Documents/%D7%A6%D7%95%D7%95%D7%99%20%D7%91%D7%98%D7%99%D7%97%D7%95%D7%AA.xlsx (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f1ecfbc7580>: Failed to establish a new connection: [Errno -2] Name or service not known'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 63, in load
    bytes = _RemoteStream(source, self.__http_session, self.__http_timeout).open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 121, in open
    self.seek(0)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 142, in seek
    self.__response = self.__session.get(self.__source, stream=True, timeout=self.__timeout)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 602, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 519, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPConnectionPool(host='employment.molsa.gov.il', port=80): Max retries exceeded with url: /Employment/SafetyAndHealth/Enforcement/Documents/%D7%A6%D7%95%D7%95%D7%99%20%D7%91%D7%98%D7%99%D7%97%D7%95%D7%AA.xlsx (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f1ecfbc7580>: Failed to establish a new connection: [Errno -2] Name or service not known'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 244, in <module>
    rows = stream_reader(resource, url, ignore_missing or url == "", limit_rows,
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 199, in stream_reader
    schema, headers, columns, stream, close = get_opener(url, _resource)()
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 175, in opener
    _stream.open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/stream.py", line 423, in open
    self.__parser.open(source, encoding=self.__encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/parsers/xlsx.py", line 81, in open
    source_bytes = self.__loader.load(source, mode="b", encoding=encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 72, in load
    raise exceptions.HTTPError(str(exception))
tabulator.exceptions.HTTPError: HTTPConnectionPool(host='employment.molsa.gov.il', port=80): Max retries exceeded with url: /Employment/SafetyAndHealth/Enforcement/Documents/%D7%A6%D7%95%D7%95%D7%99%20%D7%91%D7%98%D7%99%D7%97%D7%95%D7%AA.xlsx (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f1ecfbc7580>: Failed to establish a new connection: [Errno -2] Name or service not known'))

Pipeline ID: entities/safety-orders/safety-orders

entities/safety-orders/safety-orders-by-entity
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./entities/safety-orders/safety-orders" is successfully executed

Pipeline ID: entities/safety-orders/safety-orders-by-entity

entities/special/registry
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:15:24.542678
Last Completion:
2025-04-21 00:27:44.246805
Last Success:
2025-04-21 00:27:44.246805

Pipeline ID: entities/special/registry

ezvonot/ezvonot_accounts
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:21:33.873984
Last Completion:
2025-04-21 02:21:53.672368
Last Success:
2025-04-21 02:21:53.672368

Pipeline ID: ezvonot/ezvonot_accounts

ezvonot/ezvonot_cases
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:21:53.735916
Last Completion:
2025-04-21 02:22:09.143833
Last Success:
2025-04-21 02:22:09.143833

Pipeline ID: ezvonot/ezvonot_cases

ezvonot/ezvonot_crontab
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:28:04.054785
Last Completion:
2025-04-21 00:28:07.240132
Last Success:
2025-04-21 00:28:07.240132

Pipeline ID: ezvonot/ezvonot_crontab

ezvonot/ezvonot_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:22:21.534143
Last Completion:
2025-04-21 02:22:41.034924
Last Success:
2025-04-21 02:22:41.034924

Pipeline ID: ezvonot/ezvonot_decisions

ezvonot/ezvonot_decisions_join
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 03:23:45.235103
Last Completion:
2025-04-21 03:24:50.958631
Last Success:
2025-04-21 03:24:50.958631

Pipeline ID: ezvonot/ezvonot_decisions_join

ezvonot/ezvonot_deposits
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:21:10.438626
Last Completion:
2025-04-21 02:21:33.863087
Last Success:
2025-04-21 02:21:33.863087

Pipeline ID: ezvonot/ezvonot_deposits

ezvonot/ezvonot_purposes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:22:09.222936
Last Completion:
2025-04-21 02:22:21.520205
Last Success:
2025-04-21 02:22:21.520205

Pipeline ID: ezvonot/ezvonot_purposes

government_decisions/government_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-16 12:14:16.653345
Last Completion:
2025-04-16 12:14:29.645998
Last Success:
2025-04-16 12:14:29.645998

Pipeline ID: government_decisions/government_decisions

government_decisions/scraper
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-16 12:00:01.911956
Last Completion:
2025-04-16 12:14:16.427283
Last Success:
2025-04-16 12:14:16.427283

Pipeline ID: government_decisions/scraper

lamas/municipal-data
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:20:31.162155
Last Completion:
2025-04-21 02:21:10.420268
Last Success:
2025-04-21 02:21:10.420268

Pipeline ID: lamas/municipal-data

קובץ התאמת רשויות אזוריות לישובים בשטחן (municipality-to-city)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:40:08.360375
Last Completion:
2025-01-12 07:40:11.026212
Last Success:
2025-01-12 07:40:11.026212

Pipeline ID: lamas/municipality-to-city

maya/maya-bonds-and-options-holdings-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 05:35:38.592809
Last Completion:
2025-01-31 05:43:51.790820
Last Success:
2025-01-31 05:43:51.790820

Pipeline ID: maya/maya-bonds-and-options-holdings-changes

maya/maya-company-director-appointments
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 05:30:12.003986
Last Completion:
2025-01-31 05:38:11.497124
Last Success:
2025-01-31 05:38:11.497124

Pipeline ID: maya/maya-company-director-appointments

maya/maya-company-officer-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 05:21:09.586058
Last Completion:
2025-01-31 05:30:11.997755
Last Success:
2025-01-31 05:30:11.997755

Pipeline ID: maya/maya-company-officer-list

maya/maya-company-stakeholder-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 05:43:51.796983
Last Completion:
2025-01-31 06:02:29.485309
Last Success:
2025-01-31 06:02:29.485309

Pipeline ID: maya/maya-company-stakeholder-list

maya/maya-company-vip-appointments
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 05:27:35.780647
Last Completion:
2025-01-31 05:35:38.577891
Last Success:
2025-01-31 05:35:38.577891

Pipeline ID: maya/maya-company-vip-appointments

maya/maya-complete-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 04:06:10.997230
Last Completion:
2025-01-31 05:03:07.007268
Last Success:
2025-01-31 05:03:07.007268

Pipeline ID: maya/maya-complete-notification-list

maya/maya-holdings-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 05:38:11.505037
Last Completion:
2025-01-31 05:46:39.313761
Last Success:
2025-01-31 05:46:39.313761

Pipeline ID: maya/maya-holdings-changes

maya/maya-notification-parse-updates
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 02:58:35.591193
Last Completion:
2025-01-31 03:27:44.316527
Last Success:
2025-01-31 03:27:44.316527

Pipeline ID: maya/maya-notification-parse-updates

maya/maya-reported-academic-degrees
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 05:46:39.378074
Last Completion:
2025-01-31 05:55:15.790237
Last Success:
2025-01-31 05:55:15.790237

Pipeline ID: maya/maya-reported-academic-degrees

maya/maya-reported-work-record
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 05:55:15.802003
Last Completion:
2025-01-31 06:03:32.979052
Last Success:
2025-01-31 06:03:32.979052

Pipeline ID: maya/maya-reported-work-record

maya/maya-tase-companies-current-management
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./maya/scrape-maya-tase-companies" is successfully executed

Pipeline ID: maya/maya-tase-companies-current-management

maya/maya-tase-companies-current-shareholders
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./maya/scrape-maya-tase-companies" is successfully executed

Pipeline ID: maya/maya-tase-companies-current-shareholders

maya/scrape-maya-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 00:19:09.919764
Last Completion:
2025-01-31 02:03:24.201900
Last Success:
2025-01-31 02:03:24.201900

Pipeline ID: maya/scrape-maya-notification-list

maya/scrape-maya-tase-companies
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 17:51:24.051222
Last Completion:
2025-04-20 17:51:33.624811
Last Success:
None

dump_to_path
ERROR   :Data Package validation error: Descriptor validation error: [] is too short at "schema/fields" in descriptor and at "properties/schema/properties/fields/minItems" in profile
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/dump_to_path.py", line 22, in <module>
    with ingest() as ctx:
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 186, in ingest
    params, datapackage, resource_iterator = _ingest(debug=debug)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 44, in _ingest
    datapackage, resource_iterator, dependency_dp = process_input(sys.stdin, validate, debug)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/input_processor.py", line 88, in process_input
    datapackage.validate(dp_to_validate)
  File "/usr/local/lib/python3.9/site-packages/datapackage/validate.py", line 28, in validate
    Package(descriptor, strict=True)
  File "/usr/local/lib/python3.9/site-packages/datapackage/package.py", line 126, in __init__
    self.__build()
  File "/usr/local/lib/python3.9/site-packages/datapackage/package.py", line 534, in __build
    updated_resource = Resource(descriptor,
  File "/usr/local/lib/python3.9/site-packages/datapackage/resource.py", line 90, in __init__
    self.__build()
  File "/usr/local/lib/python3.9/site-packages/datapackage/resource.py", line 648, in __build
    raise exception
  File "/usr/local/lib/python3.9/site-packages/datapackage/resource.py", line 643, in __build
    self.__profile.validate(self.__current_descriptor)
  File "/usr/local/lib/python3.9/site-packages/datapackage/profile.py", line 89, in validate
    raise exceptions.ValidationError(message, errors=errors)
datapackage.exceptions.ValidationError: There are 1 validation errors (see exception.errors)

Pipeline ID: maya/scrape-maya-tase-companies

people/aggregated
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/all
From ./people/all :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']
From ./people/all :['From ./people/company_appointments/all-appointments', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/state_owned/state-owned-nominations']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/state_owned/state-owned-nominations', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/state_owned/correlate" is successfully executed']]]
From ./people/all :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/procurement/procurement-individuals']
From ./people/all :['From ./people/procurement/procurement-individuals', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/spending/latest-contract-spending" is successfully executed']]
From ./people/all :['Dependency unsuccessful', 'Cannot run until dependency "./people/political_donations/political_donations" is successfully executed']
From ./people/all :['Dependency unsuccessful', 'Cannot run until dependency "./people/political_candidates/election_candidates21" is successfully executed']

Pipeline ID: people/aggregated

people/all
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/all-appointments
From ./people/company_appointments/all-appointments :['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed']
From ./people/company_appointments/all-appointments :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]
From ./people/company_appointments/all-appointments :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]
Dependency unsuccessful :Cannot run until dependency "./people/political_donations/political_donations" is successfully executed
Dependency unsuccessful :Cannot run until dependency "./people/political_candidates/election_candidates21" is successfully executed

Pipeline ID: people/all

people/association_founders/association-founders
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-13 05:53:38.848122
Last Completion:
2025-01-13 05:54:54.692657
Last Success:
2025-01-13 05:54:54.692657

Pipeline ID: people/association_founders/association-founders

people/company_appointments/all-appointments
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed
Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations
From ./people/company_appointments/maya/maya-nominations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]
Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations
From ./people/company_appointments/maya/maya-resignations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]

Pipeline ID: people/company_appointments/all-appointments

people/company_appointments/maya/collect-maya-forms-debug-stats
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed

Pipeline ID: people/company_appointments/maya/collect-maya-forms-debug-stats

Join the parsed PDF to get start and end time for each person (correlate)
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations
From ./people/company_appointments/maya/maya-nominations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]
Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations
From ./people/company_appointments/maya/maya-resignations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]

Pipeline ID: people/company_appointments/maya/correlate

people/company_appointments/maya/maya-list
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates
From ./people/company_appointments/maya/maya-notification-updates :['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']

Pipeline ID: people/company_appointments/maya/maya-list

Appointment notices from Maya (maya-nominations)
Invalid

Name, job and company description.


Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list
From ./people/company_appointments/maya/maya-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']
From ./people/company_appointments/maya/maya-list :['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]

Pipeline ID: people/company_appointments/maya/maya-nominations

people/company_appointments/maya/maya-notification-list
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:01:28.055369
Last Completion:
2025-04-21 00:01:32.031601
Last Success:
None

scrape-notification-list
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 971, in json
    return complexjson.loads(self.text, **kwargs)
  File "/usr/local/lib/python3.9/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "/usr/local/lib/python3.9/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/local/lib/python3.9/json/decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 55, in _maya_api_call
    return res.json()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 975, in json
    raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 130, in <module>
    spew(datapackage, [collect()])
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 113, in collect
    yield from _collect_date_range(year_start, year_end)
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 75, in _collect_date_range
    res = _maya_api_call(date_from, date_to, current_page)
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 57, in _maya_api_call
    raise Exception("Failed to Call Maya API for date_from:{} date_to:{} page_num:{}".format(date_from, date_to, page_num)) from e
Exception: Failed to Call Maya API for date_from:2006-01-01 date_to:2007-01-01 page_num:0

Pipeline ID: people/company_appointments/maya/maya-notification-list

List all notifications from maya system (maya-notification-updates)
Invalid

id, date, company, notification_type, s3_object_name, url


Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed

Pipeline ID: people/company_appointments/maya/maya-notification-updates

Appointment notices from Maya (maya-resignations)
Invalid

Name, job and company description.


Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list
From ./people/company_appointments/maya/maya-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']
From ./people/company_appointments/maya/maya-list :['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]

Pipeline ID: people/company_appointments/maya/maya-resignations

מינויים בכלכליסט (calcalist)
Succeeded

רשימת כל המינויים והחברות מאתר כלכליסט


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:46:06.894635
Last Completion:
2025-01-12 07:46:11.093162
Last Success:
2025-01-12 07:46:11.093162

Pipeline ID: people/company_appointments/media/calcalist/calcalist

Appointment notices from TheMarker (themarker)
Failed

Name, job and company description.


Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:01:32.041150
Last Completion:
2025-04-21 00:01:54.323535
Last Success:
None

stream_remote_resources
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 63, in load
    bytes = _RemoteStream(source, self.__http_session, self.__http_timeout).open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 121, in open
    self.seek(0)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 143, in seek
    self.__response.raise_for_status()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.themarker.com/st/inter/DB/tm/2015/minuyim30.xlsx
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 244, in <module>
    rows = stream_reader(resource, url, ignore_missing or url == "", limit_rows,
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 199, in stream_reader
    schema, headers, columns, stream, close = get_opener(url, _resource)()
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 175, in opener
    _stream.open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/stream.py", line 423, in open
    self.__parser.open(source, encoding=self.__encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/parsers/xlsx.py", line 81, in open
    source_bytes = self.__loader.load(source, mode="b", encoding=encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 72, in load
    raise exceptions.HTTPError(str(exception))
tabulator.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.themarker.com/st/inter/DB/tm/2015/minuyim30.xlsx

Pipeline ID: people/company_appointments/media/themarker/themarker

Join the parsed PDF to get start and end time for each person (correlate)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 03:24:51.035902
Last Completion:
2025-04-21 03:24:55.547427
Last Success:
2025-04-21 03:24:55.547427

Pipeline ID: people/company_appointments/state_owned/correlate

Parse and concatenate all PDF reports (parse_pdf_resources)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:22:45.737947
Last Completion:
2025-04-21 02:22:48.546657
Last Success:
2025-04-21 02:22:48.546657

Pipeline ID: people/company_appointments/state_owned/parse_pdf_resources

collect links to all pdf reports on https://mof.gov.il/GCA/Directors/Pages/DirectorsManningReport.aspx (reports)
Succeeded

columns: date, url


Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:38:06.128065
Last Completion:
2025-04-21 00:38:13.127887
Last Success:
2025-04-21 00:38:13.127887

Pipeline ID: people/company_appointments/state_owned/reports

people/company_appointments/state_owned/state-owned-nominations
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 03:26:35.340768
Last Completion:
2025-04-21 03:26:41.040592
Last Success:
2025-04-21 03:26:41.040592

Pipeline ID: people/company_appointments/state_owned/state-owned-nominations

people/municipal_appointments/municipal_representitives
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:46:03.722638
Last Completion:
2025-01-12 07:46:06.889323
Last Success:
2025-01-12 07:46:06.889323

Pipeline ID: people/municipal_appointments/municipal_representitives

people/political_candidates/election_candidates21
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 17:48:21.124228
Last Completion:
2025-04-20 17:48:25.921809
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
    self.datapackage = self.process_datapackage(self.datapackage)
  File "/usr/local/lib/python3.9/site-packages/dataflows/processors/set_type.py", line 71, in process_datapackage
    assert added, 'Failed to find field {} in schema'.format(self.name)
AssertionError: Failed to find field re.compile('^party_letter$') in schema
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
    spew_flow(flow, ctx)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
    datastream = flow.datastream()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/flow.py", line 18, in datastream
    return self._chain(ds)._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  [Previous line repeated 4 more times]
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
    self.raise_exception(exception)
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
    raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor set_type in position #3: Failed to find field re.compile('^party_letter$') in schema

Pipeline ID: people/political_candidates/election_candidates21

people/political_donations/political_donations
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 17:48:17.054854
Last Completion:
2025-04-20 17:48:21.047258
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 971, in json
    return complexjson.loads(self.text, **kwargs)
  File "/usr/local/lib/python3.9/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "/usr/local/lib/python3.9/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/local/lib/python3.9/json/decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage/helpers.py", line 59, in retrieve_descriptor
    the_descriptor = req.json()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 975, in json
    raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/processors/load.py", line 121, in process_datapackage
    return self.safe_process_datapackage(dp)
  File "/usr/local/lib/python3.9/site-packages/dataflows/processors/load.py", line 159, in safe_process_datapackage
    self.load_dp = Package(self.load_source)
  File "/usr/local/lib/python3.9/site-packages/datapackage/package.py", line 102, in __init__
    descriptor = helpers.retrieve_descriptor(descriptor)
  File "/usr/local/lib/python3.9/site-packages/datapackage/helpers.py", line 62, in retrieve_descriptor
    six.raise_from(exceptions.DataPackageException(message), error)
  File "<string>", line 3, in raise_from
datapackage.exceptions.DataPackageException: Unable to load JSON at "https://next.obudget.org/datapackages/donations/transactions/datapackage.json"
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
    self.datapackage = self.process_datapackage(self.datapackage)
  File "/usr/local/lib/python3.9/site-packages/dataflows/processors/load.py", line 123, in process_datapackage
    raise SourceLoadError('Failed to load source {!r} and options {!r}: {}'
dataflows.base.exceptions.SourceLoadError: Failed to load source 'https://next.obudget.org/datapackages/donations/transactions/datapackage.json' and options {}: Unable to load JSON at "https://next.obudget.org/datapackages/donations/transactions/datapackage.json"
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
    spew_flow(flow, ctx)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
    datastream = flow.datastream()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/flow.py", line 18, in datastream
    return self._chain(ds)._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
    self.raise_exception(exception)
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
    raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor load in position #1: Failed to load source 'https://next.obudget.org/datapackages/donations/transactions/datapackage.json' and options {}: Unable to load JSON at "https://next.obudget.org/datapackages/donations/transactions/datapackage.json"

Pipeline ID: people/political_donations/political_donations

people/procurement/procurement-individuals
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 21:43:19.914376
Last Completion:
2025-04-20 21:53:30.561408
Last Success:
2025-04-20 21:53:30.561408

Dirty dependency :Cannot run until dependency is executed: ./procurement/spending/latest-contract-spending

Pipeline ID: people/procurement/procurement-individuals

procurement/calls_for_bids/calls-for-bids-all
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-calls-for-bids
From ./procurement/calls_for_bids/jobiz-calls-for-bids :['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-all']
From ./procurement/calls_for_bids/jobiz-calls-for-bids :['From ./procurement/calls_for_bids/jobiz-all', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed']]

Pipeline ID: procurement/calls_for_bids/calls-for-bids-all

procurement/calls_for_bids/calls-for-bids-moh
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:00:32.354724
Last Completion:
2025-04-21 00:00:37.028609
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
    self.datapackage = self.process_datapackage(self.datapackage)
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 112, in process_datapackage
    raise self.exc
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 60, in describe
    sample = list(itertools.islice(self.iterable, self.SAMPLE_SIZE))
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 89, in handle_iterable
    for x in self.iterable:
  File "/datapackage_pipelines_budgetkey/pipelines/procurement/calls_for_bids/m_tmicha.py", line 47, in m_tmicha_scraper
    assert total > 0
AssertionError
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
    spew_flow(flow, ctx)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
    datastream = flow.datastream()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/flow.py", line 18, in datastream
    return self._chain(ds)._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
    self.raise_exception(exception)
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
    raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor iterable_loader in position #1:

Pipeline ID: procurement/calls_for_bids/calls-for-bids-moh

procurement/calls_for_bids/gov-publications
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:31:50.894794
Last Completion:
2025-01-12 07:33:06.161066
Last Success:
2025-01-12 07:33:06.161066

Pipeline ID: procurement/calls_for_bids/gov-publications

procurement/calls_for_bids/gov-publications-ministry-of-immigration
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:31:50.907459
Last Completion:
2025-01-12 07:32:01.001741
Last Success:
2025-01-12 07:32:01.001741

Pipeline ID: procurement/calls_for_bids/gov-publications-ministry-of-immigration

procurement/calls_for_bids/gov-publications2
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:31:50.902154
Last Completion:
2025-01-12 07:32:16.840661
Last Success:
2025-01-12 07:32:16.840661

Pipeline ID: procurement/calls_for_bids/gov-publications2

procurement/calls_for_bids/jobiz-all
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed

Pipeline ID: procurement/calls_for_bids/jobiz-all

procurement/calls_for_bids/jobiz-calls-for-bids
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-all
From ./procurement/calls_for_bids/jobiz-all :['Dependency unsuccessful', 'Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed']

Pipeline ID: procurement/calls_for_bids/jobiz-calls-for-bids

procurement/calls_for_bids/jobiz-scraper
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 17:47:55.399491
Last Completion:
2025-04-20 17:48:08.821109
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 174, in _new_conn
    conn = connection.create_connection(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/connection.py", line 72, in create_connection
    for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
  File "/usr/local/lib/python3.9/socket.py", line 954, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -5] No address associated with hostname
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 714, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 403, in _make_request
    self._validate_conn(conn)
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1053, in _validate_conn
    conn.connect()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 363, in connect
    self.sock = conn = self._new_conn()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 186, in _new_conn
    raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPSConnection object at 0x7f4cbee159d0>: Failed to establish a new connection: [Errno -5] No address associated with hostname
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 486, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 798, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='jobiz.gov.il', port=443): Max retries exceeded with url: /ajax/results/%D7%94%D7%95%D7%93%D7%A2%D7%94%20%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA/0?ie=0&typeie=%D7%94%D7%95%D7%93%D7%A2%D7%94+%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA&search=Array (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f4cbee159d0>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
    self.datapackage = self.process_datapackage(self.datapackage)
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 112, in process_datapackage
    raise self.exc
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 60, in describe
    sample = list(itertools.islice(self.iterable, self.SAMPLE_SIZE))
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 89, in handle_iterable
    for x in self.iterable:
  File "/datapackage_pipelines_budgetkey/pipelines/procurement/calls_for_bids/jobiz.py", line 19, in fetch_results
    content = requests.get(URL.format(index)).json()
  File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 73, in get
    return request("get", url, params=params, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 59, in request
    return session.request(method=method, url=url, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 519, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='jobiz.gov.il', port=443): Max retries exceeded with url: /ajax/results/%D7%94%D7%95%D7%93%D7%A2%D7%94%20%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA/0?ie=0&typeie=%D7%94%D7%95%D7%93%D7%A2%D7%94+%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA&search=Array (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f4cbee159d0>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
    spew_flow(flow, ctx)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
    datastream = flow.datastream()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/flow.py", line 18, in datastream
    return self._chain(ds)._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  [Previous line repeated 5 more times]
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
    self.raise_exception(exception)
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
    raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor iterable_loader in position #1: HTTPSConnectionPool(host='jobiz.gov.il', port=443): Max retries exceeded with url: /ajax/results/%D7%94%D7%95%D7%93%D7%A2%D7%94%20%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA/0?ie=0&typeie=%D7%94%D7%95%D7%93%D7%A2%D7%94+%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA&search=Array (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f4cbee159d0>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))

Pipeline ID: procurement/calls_for_bids/jobiz-scraper

procurement/municipal/fetcher
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:00:14.931261
Last Completion:
2025-04-21 00:00:32.331710
Last Success:
2025-04-21 00:00:32.331710

Pipeline ID: procurement/municipal/fetcher

התקשרויות רכש ממשלתיות (latest-contract-spending)
Running

אנו סוכמים מידע מתוך הדוחות הרבעוניים לתוך טבלה המכילה את המידע העדכני ביותר.


Last Run triggered by:
dirty-task-update
Last Run started at:
2025-04-21 04:41:00.169619
Last Completion:
Last Success:
2025-04-21 04:40:42.977992

Pipeline ID: procurement/spending/latest-contract-spending

procurement/spending/quarterly-contract-spending-report-uris
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-20 23:00:02.168980
Last Completion:
2025-04-20 23:00:26.079807
Last Success:
2025-04-20 23:00:26.079807

Pipeline ID: procurement/spending/quarterly-contract-spending-report-uris

דוחות רבעוניים מתוך מרכבה, לפי נוהל היחידה לחופש המידע. (quarterly-contract-spending-reports)
Succeeded

כל משרדי הממשלה ויחידות הסמך (שמחוברות למערכת מרכבה) צריכים לפרסם אחת לרבעון (תוך 45 יום מסוף הרבעון) דו״ח התקשרויות לפי פורמט מוגדר היטב הממומש כדו״ח מובנה במערכת המרכבה. כל המשרדים מדווחים עצמאית והדו״חות עולים לאתר היחידה לחופש המידע, משם אנו אוספים אותם. התוצר של השרשר הזה הוא פירוט כל הדיווחים של כל המשרדים.


Last Run triggered by:
scheduled
Last Run started at:
2025-04-20 23:00:26.408714
Last Completion:
2025-04-20 23:28:24.350318
Last Success:
2025-04-20 23:28:24.350318

Pipeline ID: procurement/spending/quarterly-contract-spending-reports

procurement/spending/quarterly-contract-spending-reports-data
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-20 23:28:24.553631
Last Completion:
2025-04-21 01:08:57.642166
Last Success:
2025-04-21 01:08:57.642166

Pipeline ID: procurement/spending/quarterly-contract-spending-reports-data

procurement/spending/spending-by-entity
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 21:43:19.891663
Last Completion:
2025-04-20 21:53:47.108280
Last Success:
2025-04-20 21:53:47.108280

Dirty dependency :Cannot run until dependency is executed: ./procurement/spending/latest-contract-spending

Pipeline ID: procurement/spending/spending-by-entity

Load all tenders data from data.gov.il/procurement agency to a flat file (all)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:28:07.335634
Last Completion:
2025-04-21 00:37:57.242291
Last Success:
2025-04-21 00:37:57.242291

Pipeline ID: procurement/tenders/all

procurement/tenders/processed
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 03:08:57.162830
Last Completion:
2025-04-21 03:28:12.565357
Last Success:
2025-04-21 03:28:12.565357

Pipeline ID: procurement/tenders/processed

reports/all
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-13 05:56:39.882883
Last Completion:
2025-01-13 05:56:47.078992
Last Success:
2025-01-13 05:56:47.078992

Pipeline ID: reports/all

reports/ngos/ngo-activity-report
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-13 05:53:38.835488
Last Completion:
2025-01-13 05:56:39.504309
Last Success:
2025-01-13 05:56:39.504309

Pipeline ID: reports/ngos/ngo-activity-report

reports/ngos/ngo-district-report
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-13 05:53:38.829893
Last Completion:
2025-01-13 05:56:14.480023
Last Success:
2025-01-13 05:56:14.480023

Pipeline ID: reports/ngos/ngo-district-report

simpledb/process_simple_dbs
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-03 20:41:56.853947
Last Completion:
2025-04-03 21:05:06.363413
Last Success:
2025-04-03 21:05:06.363413

Pipeline ID: simpledb/process_simple_dbs

supports/all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-16 22:15:06.785315
Last Completion:
2025-04-16 22:20:14.519512
Last Success:
2025-04-16 22:20:14.519512

Pipeline ID: supports/all

supports/by-payment-year
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:22:48.622769
Last Completion:
2025-04-21 02:31:43.248481
Last Success:
2025-04-21 02:31:43.248481

Pipeline ID: supports/by-payment-year

supports/by-request-year
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:31:43.321101
Last Completion:
2025-04-21 03:05:50.752262
Last Success:
2025-04-21 03:05:50.752262

Pipeline ID: supports/by-request-year

supports/criteria/support-criteria
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:22:41.045877
Last Completion:
2025-04-21 02:22:45.732798
Last Success:
None

sample
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/processors/sample.py", line 11, in <module>
    res_name = parameters.get('resource', datapackage['resources'][0]['name'])
IndexError: list index out of range

Pipeline ID: supports/criteria/support-criteria

supports/criteria/support-criteria-doj
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:37:57.342062
Last Completion:
2025-04-21 00:38:06.037843
Last Success:
2025-04-21 00:38:06.037843

Pipeline ID: supports/criteria/support-criteria-doj

supports/supports-2004
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:02.289487
Last Completion:
2025-01-12 07:32:04.068455
Last Success:
2025-01-12 07:32:04.068455

Pipeline ID: supports/supports-2004

supports/supports-2005
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:04.072370
Last Completion:
2025-01-12 07:32:05.185676
Last Success:
2025-01-12 07:32:05.185676

Pipeline ID: supports/supports-2005

supports/supports-2006
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:05.189726
Last Completion:
2025-01-12 07:32:06.378048
Last Success:
2025-01-12 07:32:06.378048

Pipeline ID: supports/supports-2006

supports/supports-2007
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:06.381412
Last Completion:
2025-01-12 07:32:07.514941
Last Success:
2025-01-12 07:32:07.514941

Pipeline ID: supports/supports-2007

supports/supports-2008
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:07.498416
Last Completion:
2025-01-12 07:32:08.900117
Last Success:
2025-01-12 07:32:08.900117

Pipeline ID: supports/supports-2008

supports/supports-2009
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:07.520290
Last Completion:
2025-01-12 07:32:08.933760
Last Success:
2025-01-12 07:32:08.933760

Pipeline ID: supports/supports-2009

supports/supports-2010
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:08.903230
Last Completion:
2025-01-12 07:32:10.258572
Last Success:
2025-01-12 07:32:10.258572

Pipeline ID: supports/supports-2010

supports/supports-2011
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:08.938603
Last Completion:
2025-01-12 07:32:10.296586
Last Success:
2025-01-12 07:32:10.296586

Pipeline ID: supports/supports-2011

supports/supports-2012
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:10.261765
Last Completion:
2025-01-12 07:32:11.553535
Last Success:
2025-01-12 07:32:11.553535

Pipeline ID: supports/supports-2012

supports/supports-2013
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:10.300914
Last Completion:
2025-01-12 07:32:11.592572
Last Success:
2025-01-12 07:32:11.592572

Pipeline ID: supports/supports-2013

supports/supports-2014
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:11.556882
Last Completion:
2025-01-12 07:32:12.887014
Last Success:
2025-01-12 07:32:12.887014

Pipeline ID: supports/supports-2014

supports/supports-2015
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:11.596958
Last Completion:
2025-01-12 07:32:12.894256
Last Success:
2025-01-12 07:32:12.894256

Pipeline ID: supports/supports-2015

supports/supports-2016
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:12.890988
Last Completion:
2025-01-12 07:32:14.210883
Last Success:
2025-01-12 07:32:14.210883

Pipeline ID: supports/supports-2016

supports/supports-2017
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:12.899133
Last Completion:
2025-01-12 07:32:14.195884
Last Success:
2025-01-12 07:32:14.195884

Pipeline ID: supports/supports-2017

supports/supports-2018
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-26 14:00:20.490452
Last Completion:
2025-01-26 14:00:23.889181
Last Success:
2025-01-26 14:00:23.889181

Pipeline ID: supports/supports-2018

supports/supports-2019
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-26 14:00:20.580323
Last Completion:
2025-01-26 14:00:23.797337
Last Success:
2025-01-26 14:00:23.797337

Pipeline ID: supports/supports-2019

supports/supports-2020
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-26 14:00:20.590431
Last Completion:
2025-01-26 14:00:24.681716
Last Success:
2025-01-26 14:00:24.681716

Pipeline ID: supports/supports-2020

supports/supports-2021
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-26 14:00:20.607244
Last Completion:
2025-01-26 14:00:24.185014
Last Success:
2025-01-26 14:00:24.185014

Pipeline ID: supports/supports-2021

supports/supports-2022
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-26 14:00:23.806617
Last Completion:
2025-01-26 14:00:27.401957
Last Success:
2025-01-26 14:00:27.401957

Pipeline ID: supports/supports-2022

supports/supports-2023
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-04-20 20:00:02.389431
Last Completion:
2025-04-20 20:09:27.072760
Last Success:
2025-04-16 20:10:36.639773

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
    DF.load(wrapper(year), format='csv',
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
    return scraper(gcd, year)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
    chart = get_chart(driver)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 34, in get_chart
    chart = WebDriverWait(driver, 60).until(
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
    raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x55767b38f199 <unknown>
WARNING :FAILED to teardown google-chrome

Pipeline ID: supports/supports-2023

supports/supports-2024
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-04-20 21:00:02.682172
Last Completion:
2025-04-20 21:12:48.011560
Last Success:
2025-04-16 21:07:48.266414

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
DEBUG   :Dropping user packet because connection is dead.
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
    DF.load(wrapper(year), format='csv',
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
    return scraper(gcd, year)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
    chart = get_chart(driver)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 34, in get_chart
    chart = WebDriverWait(driver, 60).until(
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
    raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x562dfabda199 <unknown>
WARNING :FAILED to teardown google-chrome

Pipeline ID: supports/supports-2024

supports/supports-2025
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-04-20 22:00:04.549254
Last Completion:
2025-04-20 22:07:47.485519
Last Success:
2025-04-16 22:15:06.705080

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
    DF.load(wrapper(year), format='csv',
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
    return scraper(gcd, year)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
    chart = get_chart(driver)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 34, in get_chart
    chart = WebDriverWait(driver, 60).until(
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
    raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x563fda8fa199 <unknown>
WARNING :FAILED to teardown google-chrome

Pipeline ID: supports/supports-2025

supports/supports-by-entity
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 03:05:50.834879
Last Completion:
2025-04-21 03:08:51.363172
Last Success:
2025-04-21 03:08:51.363172

Pipeline ID: supports/supports-by-entity

supports/with-entities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:01:54.333841
Last Completion:
2025-04-21 00:49:44.022750
Last Success:
2025-04-21 00:49:44.022750

Pipeline ID: supports/with-entities

units/social_services/social_services
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:15:09.757552
Last Completion:
2025-04-21 00:15:24.431834
Last Success:
2025-04-21 00:15:24.431834

Pipeline ID: units/social_services/social_services

budgetkey/elasticsearch/index_calls_for_bids
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./procurement/calls_for_bids/calls-for-bids-all
From ./procurement/calls_for_bids/calls-for-bids-all :['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-calls-for-bids']
From ./procurement/calls_for_bids/calls-for-bids-all :['From ./procurement/calls_for_bids/jobiz-calls-for-bids', ['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-all']]
From ./procurement/calls_for_bids/calls-for-bids-all :['From ./procurement/calls_for_bids/jobiz-calls-for-bids', ['From ./procurement/calls_for_bids/jobiz-all', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed']]]

Pipeline ID: budgetkey/elasticsearch/index_calls_for_bids

budgetkey/elasticsearch/index_contract_spending
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 21:43:20.135046
Last Completion:
2025-04-21 02:04:52.622276
Last Success:
2025-04-21 02:04:52.622276

Dirty dependency :Cannot run until dependency is executed: ./procurement/spending/latest-contract-spending

Pipeline ID: budgetkey/elasticsearch/index_contract_spending

budgetkey/elasticsearch/index_people
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/aggregated
From ./people/aggregated :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/all']
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/state_owned/state-owned-nominations']]]
From ./people/aggregated :['From ./people/all', ['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/state_owned/state-owned-nominations', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/state_owned/correlate" is successfully executed']]]]
From ./people/aggregated :['From ./people/all', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/procurement/procurement-individuals']]
From ./people/aggregated :['From ./people/all', ['From ./people/procurement/procurement-individuals', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/spending/latest-contract-spending" is successfully executed']]]
From ./people/aggregated :['From ./people/all', ['Dependency unsuccessful', 'Cannot run until dependency "./people/political_donations/political_donations" is successfully executed']]
From ./people/aggregated :['From ./people/all', ['Dependency unsuccessful', 'Cannot run until dependency "./people/political_candidates/election_candidates21" is successfully executed']]

Pipeline ID: budgetkey/elasticsearch/index_people

budgetkey/elasticsearch/index_support_criteria
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./supports/criteria/support-criteria" is successfully executed

Pipeline ID: budgetkey/elasticsearch/index_support_criteria

budgetkey/elasticsearch/sitemaps
Invalid

Last Run triggered by:
dirty-task-update
Last Run started at:
2025-04-16 23:01:05.725148
Last Completion:
2025-04-17 00:11:24.730331
Last Success:
2025-04-17 00:11:24.730331

Dependency unsuccessful :Cannot run until dependency "./budgetkey/elasticsearch/index_budget" is successfully executed
Dirty dependency :Cannot run until dependency is executed: ./budgetkey/elasticsearch/index_entities

Pipeline ID: budgetkey/elasticsearch/sitemaps

entities/safety-orders/safety-orders-by-entity
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./entities/safety-orders/safety-orders" is successfully executed

Pipeline ID: entities/safety-orders/safety-orders-by-entity

maya/maya-tase-companies-current-management
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./maya/scrape-maya-tase-companies" is successfully executed

Pipeline ID: maya/maya-tase-companies-current-management

maya/maya-tase-companies-current-shareholders
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./maya/scrape-maya-tase-companies" is successfully executed

Pipeline ID: maya/maya-tase-companies-current-shareholders

people/aggregated
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/all
From ./people/all :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/all-appointments']
From ./people/all :['From ./people/company_appointments/all-appointments', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]]
From ./people/all :['From ./people/company_appointments/all-appointments', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/state_owned/state-owned-nominations']]
From ./people/all :['From ./people/company_appointments/all-appointments', ['From ./people/company_appointments/state_owned/state-owned-nominations', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/state_owned/correlate" is successfully executed']]]
From ./people/all :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/procurement/procurement-individuals']
From ./people/all :['From ./people/procurement/procurement-individuals', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/spending/latest-contract-spending" is successfully executed']]
From ./people/all :['Dependency unsuccessful', 'Cannot run until dependency "./people/political_donations/political_donations" is successfully executed']
From ./people/all :['Dependency unsuccessful', 'Cannot run until dependency "./people/political_candidates/election_candidates21" is successfully executed']

Pipeline ID: people/aggregated

people/all
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/all-appointments
From ./people/company_appointments/all-appointments :['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed']
From ./people/company_appointments/all-appointments :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations']
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-nominations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-nominations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]
From ./people/company_appointments/all-appointments :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations']
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-resignations', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]]
From ./people/company_appointments/all-appointments :['From ./people/company_appointments/maya/maya-resignations', ['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]]
Dependency unsuccessful :Cannot run until dependency "./people/political_donations/political_donations" is successfully executed
Dependency unsuccessful :Cannot run until dependency "./people/political_candidates/election_candidates21" is successfully executed

Pipeline ID: people/all

people/company_appointments/all-appointments
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./people/company_appointments/media/themarker/themarker" is successfully executed
Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations
From ./people/company_appointments/maya/maya-nominations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]
Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations
From ./people/company_appointments/maya/maya-resignations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]

Pipeline ID: people/company_appointments/all-appointments

people/company_appointments/maya/collect-maya-forms-debug-stats
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed

Pipeline ID: people/company_appointments/maya/collect-maya-forms-debug-stats

Join the parsed PDF to get start and end time for each person (correlate)
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-nominations
From ./people/company_appointments/maya/maya-nominations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-nominations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]
Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-resignations
From ./people/company_appointments/maya/maya-resignations :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list']
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']]
From ./people/company_appointments/maya/maya-resignations :['From ./people/company_appointments/maya/maya-list', ['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]]

Pipeline ID: people/company_appointments/maya/correlate

people/company_appointments/maya/maya-list
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates
From ./people/company_appointments/maya/maya-notification-updates :['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']

Pipeline ID: people/company_appointments/maya/maya-list

Appointment notices from Maya (maya-nominations)
Invalid

Name, job and company description.


Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list
From ./people/company_appointments/maya/maya-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']
From ./people/company_appointments/maya/maya-list :['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]

Pipeline ID: people/company_appointments/maya/maya-nominations

List all notifications from maya system (maya-notification-updates)
Invalid

id, date, company, notification_type, s3_object_name, url


Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed

Pipeline ID: people/company_appointments/maya/maya-notification-updates

Appointment notices from Maya (maya-resignations)
Invalid

Name, job and company description.


Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-list
From ./people/company_appointments/maya/maya-list :['Invalid dependency', 'Cannot run until dependency passes validation: ./people/company_appointments/maya/maya-notification-updates']
From ./people/company_appointments/maya/maya-list :['From ./people/company_appointments/maya/maya-notification-updates', ['Dependency unsuccessful', 'Cannot run until dependency "./people/company_appointments/maya/maya-notification-list" is successfully executed']]

Pipeline ID: people/company_appointments/maya/maya-resignations

people/procurement/procurement-individuals
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 21:43:19.914376
Last Completion:
2025-04-20 21:53:30.561408
Last Success:
2025-04-20 21:53:30.561408

Dirty dependency :Cannot run until dependency is executed: ./procurement/spending/latest-contract-spending

Pipeline ID: people/procurement/procurement-individuals

procurement/calls_for_bids/calls-for-bids-all
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-calls-for-bids
From ./procurement/calls_for_bids/jobiz-calls-for-bids :['Invalid dependency', 'Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-all']
From ./procurement/calls_for_bids/jobiz-calls-for-bids :['From ./procurement/calls_for_bids/jobiz-all', ['Dependency unsuccessful', 'Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed']]

Pipeline ID: procurement/calls_for_bids/calls-for-bids-all

procurement/calls_for_bids/jobiz-all
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed

Pipeline ID: procurement/calls_for_bids/jobiz-all

procurement/calls_for_bids/jobiz-calls-for-bids
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./procurement/calls_for_bids/jobiz-all
From ./procurement/calls_for_bids/jobiz-all :['Dependency unsuccessful', 'Cannot run until dependency "./procurement/calls_for_bids/jobiz-scraper" is successfully executed']

Pipeline ID: procurement/calls_for_bids/jobiz-calls-for-bids

procurement/spending/spending-by-entity
Invalid

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 21:43:19.891663
Last Completion:
2025-04-20 21:53:47.108280
Last Success:
2025-04-20 21:53:47.108280

Dirty dependency :Cannot run until dependency is executed: ./procurement/spending/latest-contract-spending

Pipeline ID: procurement/spending/spending-by-entity

budget/municipal/fetcher
Running

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:38:18.138586
Last Completion:
Last Success:
2025-04-17 00:25:39.129523

Pipeline ID: budget/municipal/fetcher

התקשרויות רכש ממשלתיות (latest-contract-spending)
Running

אנו סוכמים מידע מתוך הדוחות הרבעוניים לתוך טבלה המכילה את המידע העדכני ביותר.


Last Run triggered by:
dirty-task-update
Last Run started at:
2025-04-21 04:41:00.169619
Last Completion:
Last Success:
2025-04-21 04:40:42.977992

Pipeline ID: procurement/spending/latest-contract-spending

bank_of_israel/bank_of_israel
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 17:49:18.157655
Last Completion:
2025-04-20 17:49:22.642511
Last Success:
None

scraper
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/pyquery/pyquery.py", line 77, in fromstring
    result = getattr(etree, meth)(context)
  File "src/lxml/etree.pyx", line 3307, in lxml.etree.fromstring
  File "src/lxml/parser.pxi", line 1995, in lxml.etree._parseMemoryDocument
  File "src/lxml/parser.pxi", line 1875, in lxml.etree._parseDoc
  File "src/lxml/parser.pxi", line 1105, in lxml.etree._BaseParser._parseUnicodeDoc
  File "src/lxml/parser.pxi", line 633, in lxml.etree._ParserContext._handleParseResultDoc
  File "src/lxml/parser.pxi", line 743, in lxml.etree._handleParseResult
  File "src/lxml/parser.pxi", line 672, in lxml.etree._raiseParseError
  File "<string>", line 1
lxml.etree.XMLSyntaxError: Document is empty, line 1, column 1
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/bank_of_israel/scraper.py", line 124, in <module>
    series_sum = get_all_series()
  File "/datapackage_pipelines_budgetkey/pipelines/bank_of_israel/scraper.py", line 23, in get_all_series
    series = get_series(sid)
  File "/datapackage_pipelines_budgetkey/pipelines/bank_of_israel/scraper.py", line 36, in get_series
    resp = pq(data.decode(response.encoding or 'utf8'))
  File "/usr/local/lib/python3.9/site-packages/pyquery/pyquery.py", line 230, in __init__
    elements = fromstring(context, self.parser)
  File "/usr/local/lib/python3.9/site-packages/pyquery/pyquery.py", line 81, in fromstring
    result = getattr(lxml.html, meth)(context)
  File "/usr/local/lib/python3.9/site-packages/lxml/html/__init__.py", line 850, in fromstring
    doc = document_fromstring(html, parser=parser, base_url=base_url, **kw)
  File "/usr/local/lib/python3.9/site-packages/lxml/html/__init__.py", line 738, in document_fromstring
    raise etree.ParserError(
lxml.etree.ParserError: Document is empty

Pipeline ID: bank_of_israel/bank_of_israel

budgetkey/elasticsearch/index_budget
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 18:08:19.635234
Last Completion:
2025-04-20 18:55:01.742296
Last Success:
2025-04-11 01:36:40.239562

dump_to_es
ERROR   :DUMP TO ES ERROR ConnectionTimeout caused by - ReadTimeoutError(HTTPConnectionPool(host='elasticsearch-new', port=9200): Read timed out. (read timeout=10))
ERROR   :TB
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 466, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 461, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/local/lib/python3.9/http/client.py", line 1377, in getresponse
    response.begin()
  File "/usr/local/lib/python3.9/http/client.py", line 320, in begin
    version, status, reason = self._read_status()
  File "/usr/local/lib/python3.9/http/client.py", line 281, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/local/lib/python3.9/socket.py", line 704, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/connection/http_urllib3.py", line 251, in perform_request
    response = self.pool.urlopen(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 798, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/retry.py", line 525, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.9/site-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 714, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 468, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 357, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPConnectionPool(host='elasticsearch-new', port=9200): Read timed out. (read timeout=10)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/processors/dump_to_es.py", line 112, in <module>
    spew_flow(flow(ctx.parameters), ctx)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
    spew(self.datapackage, self.resource_iterator, stats=self.stats)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/usr/local/lib/python3.9/site-packages/dataflows/processors/dumpers/dumper_base.py", line 69, in row_counter
    for row in iterator:
  File "/usr/local/lib/python3.9/site-packages/tableschema_elasticsearch/storage.py", line 224, in write
    for result, row in iter:
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 329, in streaming_bulk
    for data, (ok, info) in zip(
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 256, in _process_bulk_chunk
    for item in gen:
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 195, in _process_bulk_chunk_error
    raise error
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 240, in _process_bulk_chunk
    resp = client.bulk("\n".join(bulk_actions) + "\n", *args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/client/utils.py", line 168, in _wrapped
    return func(*args, params=params, headers=headers, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/client/__init__.py", line 463, in bulk
    return self.transport.perform_request(
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/transport.py", line 415, in perform_request
    raise e
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/transport.py", line 381, in perform_request
    status, headers_response, data = connection.perform_request(
  File "/usr/local/lib/python3.9/site-packages/elasticsearch/connection/http_urllib3.py", line 265, in perform_request
    raise ConnectionTimeout("TIMEOUT", str(e), e)
elasticsearch.exceptions.ConnectionTimeout: ConnectionTimeout caused by - ReadTimeoutError(HTTPConnectionPool(host='elasticsearch-new', port=9200): Read timed out. (read timeout=10))
ERROR   :Traceback (most recent call last):
ERROR   :File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 466, in _make_request
ERROR   :six.raise_from(e, None)
ERROR   :File "<string>", line 3, in raise_from
ERROR   :File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 461, in _make_request
ERROR   :httplib_response = conn.getresponse()
ERROR   :File "/usr/local/lib/python3.9/http/client.py", line 1377, in getresponse
ERROR   :response.begin()
ERROR   :File "/usr/local/lib/python3.9/http/client.py", line 320, in begin
ERROR   :version, status, reason = self._read_status()
ERROR   :File "/usr/local/lib/python3.9/http/client.py", line 281, in _read_status
ERROR   :line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
ERROR   :File "/usr/local/lib/python3.9/socket.py", line 704, in readinto
ERROR   :return self._sock.recv_into(b)
ERROR   :socket
ERROR   :.
ERROR   :timeout
ERROR   ::
ERROR   :timed out
ERROR   :During handling of the above exception, another exception occurred:
ERROR   :Traceback (most recent call last):
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/connection/http_urllib3.py", line 251, in perform_request
ERROR   :response = self.pool.urlopen(
ERROR   :File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 798, in urlopen
ERROR   :retries = retries.increment(
ERROR   :File "/usr/local/lib/python3.9/site-packages/urllib3/util/retry.py", line 525, in increment
ERROR   :raise six.reraise(type(error), error, _stacktrace)
ERROR   :File "/usr/local/lib/python3.9/site-packages/urllib3/packages/six.py", line 770, in reraise
ERROR   :raise value
ERROR   :File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 714, in urlopen
ERROR   :httplib_response = self._make_request(
ERROR   :File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 468, in _make_request
ERROR   :self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
ERROR   :File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 357, in _raise_timeout
ERROR   :raise ReadTimeoutError(
ERROR   :urllib3.exceptions
ERROR   :.
ERROR   :ReadTimeoutError
ERROR   ::
ERROR   :HTTPConnectionPool(host='elasticsearch-new', port=9200): Read timed out. (read timeout=10)
ERROR   :During handling of the above exception, another exception occurred:
ERROR   :Traceback (most recent call last):
ERROR   :File "/datapackage_pipelines_budgetkey/processors/dump_to_es.py", line 112, in <module>
ERROR   :spew_flow(flow(ctx.parameters), ctx)
ERROR   :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
ERROR   :spew(self.datapackage, self.resource_iterator, stats=self.stats)
ERROR   :File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
ERROR   :for rec in res:
ERROR   :File "/usr/local/lib/python3.9/site-packages/dataflows/processors/dumpers/dumper_base.py", line 69, in row_counter
ERROR   :for row in iterator:
ERROR   :File "/usr/local/lib/python3.9/site-packages/tableschema_elasticsearch/storage.py", line 224, in write
ERROR   :for result, row in iter:
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 329, in streaming_bulk
ERROR   :for data, (ok, info) in zip(
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 256, in _process_bulk_chunk
ERROR   :for item in gen:
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 195, in _process_bulk_chunk_error
ERROR   :raise error
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/helpers/actions.py", line 240, in _process_bulk_chunk
ERROR   :resp = client.bulk("\n".join(bulk_actions) + "\n", *args, **kwargs)
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/client/utils.py", line 168, in _wrapped
ERROR   :return func(*args, params=params, headers=headers, **kwargs)
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/client/__init__.py", line 463, in bulk
ERROR   :return self.transport.perform_request(
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/transport.py", line 415, in perform_request
ERROR   :raise e
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/transport.py", line 381, in perform_request
ERROR   :status, headers_response, data = connection.perform_request(
ERROR   :File "/usr/local/lib/python3.9/site-packages/elasticsearch/connection/http_urllib3.py", line 265, in perform_request
ERROR   :raise ConnectionTimeout("TIMEOUT", str(e), e)
ERROR   :elasticsearch.exceptions
ERROR   :.
ERROR   :ConnectionTimeout
ERROR   ::
ERROR   :ConnectionTimeout caused by - ReadTimeoutError(HTTPConnectionPool(host='elasticsearch-new', port=9200): Read timed out. (read timeout=10))

Pipeline ID: budgetkey/elasticsearch/index_budget

budgetkey/elasticsearch/index_reports
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 18:34:47.825225
Last Completion:
2025-04-20 18:35:11.131825
Last Success:
2025-04-10 22:16:21.334035

enrich_ngo_reports
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/enrich_ngo_reports.py", line 91, in <module>
    spew(dp, process_resources(res_iter))
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/budgetkey/elasticsearch/enrich_ngo_reports.py", line 69, in process_resource
    for k, v in di[district].items():
KeyError: 'אזור יהודה ושומרון'

Pipeline ID: budgetkey/elasticsearch/index_reports

donations/transactions
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 17:48:08.837828
Last Completion:
2025-04-20 17:48:27.431240
Last Success:
None

get_transactions
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 150, in <module>
    spew(dp, process_resources(res_iter))
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 109, in get_transactions
    for resp in self.get_for_candidate(cid):
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 95, in get_for_candidate
    resp = self.get_for_range(cid, range_start, range_end)
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 70, in get_for_range
    assert len(resp) == 6
AssertionError

Pipeline ID: donations/transactions

education/tochniyot/tochniyot
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 18:01:27.056885
Last Completion:
2025-04-20 18:01:31.423396
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 103, in flow
    return Flow(scrape(),
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 65, in scrape
    education_programs_count = get_education_programs_count()
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 56, in get_education_programs_count
    res = send_tochniyot_request()
  File "/datapackage_pipelines_budgetkey/pipelines/education/tochniyot/scraper.py", line 80, in send_tochniyot_request
    resp.raise_for_status()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://apps.education.gov.il/TyhNet/ClientWs/TochnitCh.asmx/IturTochnitChByMeafyenim

Pipeline ID: education/tochniyot/tochniyot

entities/moital/moital_service_providers
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 17:48:55.429540
Last Completion:
2025-04-20 17:48:58.755692
Last Success:
None

scraper
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/entities/moital/scraper.py", line 79, in <module>
    spew(datapackage, [scrape()])
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/entities/moital/scraper.py", line 32, in scrape
    desired_capabilities=DesiredCapabilities.PHANTOMJS)
AttributeError: type object 'DesiredCapabilities' has no attribute 'PHANTOMJS'

Pipeline ID: entities/moital/moital_service_providers

entities/safety-orders/safety-orders
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:27:44.341939
Last Completion:
2025-04-21 00:28:04.046459
Last Success:
None

stream_remote_resources
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 174, in _new_conn
    conn = connection.create_connection(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/connection.py", line 72, in create_connection
    for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
  File "/usr/local/lib/python3.9/socket.py", line 954, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -2] Name or service not known
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 714, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 415, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 244, in request
    super(HTTPConnection, self).request(method, url, body=body, headers=headers)
  File "/usr/local/lib/python3.9/http/client.py", line 1285, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/lib/python3.9/http/client.py", line 1331, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.9/http/client.py", line 1280, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.9/http/client.py", line 1040, in _send_output
    self.send(msg)
  File "/usr/local/lib/python3.9/http/client.py", line 980, in send
    self.connect()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 205, in connect
    conn = self._new_conn()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 186, in _new_conn
    raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f1ecfbc7580>: Failed to establish a new connection: [Errno -2] Name or service not known
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 486, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 798, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='employment.molsa.gov.il', port=80): Max retries exceeded with url: /Employment/SafetyAndHealth/Enforcement/Documents/%D7%A6%D7%95%D7%95%D7%99%20%D7%91%D7%98%D7%99%D7%97%D7%95%D7%AA.xlsx (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f1ecfbc7580>: Failed to establish a new connection: [Errno -2] Name or service not known'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 63, in load
    bytes = _RemoteStream(source, self.__http_session, self.__http_timeout).open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 121, in open
    self.seek(0)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 142, in seek
    self.__response = self.__session.get(self.__source, stream=True, timeout=self.__timeout)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 602, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 519, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPConnectionPool(host='employment.molsa.gov.il', port=80): Max retries exceeded with url: /Employment/SafetyAndHealth/Enforcement/Documents/%D7%A6%D7%95%D7%95%D7%99%20%D7%91%D7%98%D7%99%D7%97%D7%95%D7%AA.xlsx (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f1ecfbc7580>: Failed to establish a new connection: [Errno -2] Name or service not known'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 244, in <module>
    rows = stream_reader(resource, url, ignore_missing or url == "", limit_rows,
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 199, in stream_reader
    schema, headers, columns, stream, close = get_opener(url, _resource)()
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 175, in opener
    _stream.open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/stream.py", line 423, in open
    self.__parser.open(source, encoding=self.__encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/parsers/xlsx.py", line 81, in open
    source_bytes = self.__loader.load(source, mode="b", encoding=encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 72, in load
    raise exceptions.HTTPError(str(exception))
tabulator.exceptions.HTTPError: HTTPConnectionPool(host='employment.molsa.gov.il', port=80): Max retries exceeded with url: /Employment/SafetyAndHealth/Enforcement/Documents/%D7%A6%D7%95%D7%95%D7%99%20%D7%91%D7%98%D7%99%D7%97%D7%95%D7%AA.xlsx (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f1ecfbc7580>: Failed to establish a new connection: [Errno -2] Name or service not known'))

Pipeline ID: entities/safety-orders/safety-orders

maya/scrape-maya-tase-companies
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 17:51:24.051222
Last Completion:
2025-04-20 17:51:33.624811
Last Success:
None

dump_to_path
ERROR   :Data Package validation error: Descriptor validation error: [] is too short at "schema/fields" in descriptor and at "properties/schema/properties/fields/minItems" in profile
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/dump_to_path.py", line 22, in <module>
    with ingest() as ctx:
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 186, in ingest
    params, datapackage, resource_iterator = _ingest(debug=debug)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 44, in _ingest
    datapackage, resource_iterator, dependency_dp = process_input(sys.stdin, validate, debug)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/input_processor.py", line 88, in process_input
    datapackage.validate(dp_to_validate)
  File "/usr/local/lib/python3.9/site-packages/datapackage/validate.py", line 28, in validate
    Package(descriptor, strict=True)
  File "/usr/local/lib/python3.9/site-packages/datapackage/package.py", line 126, in __init__
    self.__build()
  File "/usr/local/lib/python3.9/site-packages/datapackage/package.py", line 534, in __build
    updated_resource = Resource(descriptor,
  File "/usr/local/lib/python3.9/site-packages/datapackage/resource.py", line 90, in __init__
    self.__build()
  File "/usr/local/lib/python3.9/site-packages/datapackage/resource.py", line 648, in __build
    raise exception
  File "/usr/local/lib/python3.9/site-packages/datapackage/resource.py", line 643, in __build
    self.__profile.validate(self.__current_descriptor)
  File "/usr/local/lib/python3.9/site-packages/datapackage/profile.py", line 89, in validate
    raise exceptions.ValidationError(message, errors=errors)
datapackage.exceptions.ValidationError: There are 1 validation errors (see exception.errors)

Pipeline ID: maya/scrape-maya-tase-companies

people/company_appointments/maya/maya-notification-list
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:01:28.055369
Last Completion:
2025-04-21 00:01:32.031601
Last Success:
None

scrape-notification-list
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 971, in json
    return complexjson.loads(self.text, **kwargs)
  File "/usr/local/lib/python3.9/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "/usr/local/lib/python3.9/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/local/lib/python3.9/json/decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 55, in _maya_api_call
    return res.json()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 975, in json
    raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 130, in <module>
    spew(datapackage, [collect()])
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 113, in collect
    yield from _collect_date_range(year_start, year_end)
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 75, in _collect_date_range
    res = _maya_api_call(date_from, date_to, current_page)
  File "/datapackage_pipelines_budgetkey/pipelines/people/company_appointments/maya/scrape-notification-list.py", line 57, in _maya_api_call
    raise Exception("Failed to Call Maya API for date_from:{} date_to:{} page_num:{}".format(date_from, date_to, page_num)) from e
Exception: Failed to Call Maya API for date_from:2006-01-01 date_to:2007-01-01 page_num:0

Pipeline ID: people/company_appointments/maya/maya-notification-list

Appointment notices from TheMarker (themarker)
Failed

Name, job and company description.


Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:01:32.041150
Last Completion:
2025-04-21 00:01:54.323535
Last Success:
None

stream_remote_resources
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 63, in load
    bytes = _RemoteStream(source, self.__http_session, self.__http_timeout).open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 121, in open
    self.seek(0)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 143, in seek
    self.__response.raise_for_status()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.themarker.com/st/inter/DB/tm/2015/minuyim30.xlsx
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 244, in <module>
    rows = stream_reader(resource, url, ignore_missing or url == "", limit_rows,
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 199, in stream_reader
    schema, headers, columns, stream, close = get_opener(url, _resource)()
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 175, in opener
    _stream.open()
  File "/usr/local/lib/python3.9/site-packages/tabulator/stream.py", line 423, in open
    self.__parser.open(source, encoding=self.__encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/parsers/xlsx.py", line 81, in open
    source_bytes = self.__loader.load(source, mode="b", encoding=encoding)
  File "/usr/local/lib/python3.9/site-packages/tabulator/loaders/remote.py", line 72, in load
    raise exceptions.HTTPError(str(exception))
tabulator.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.themarker.com/st/inter/DB/tm/2015/minuyim30.xlsx

Pipeline ID: people/company_appointments/media/themarker/themarker

people/political_candidates/election_candidates21
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 17:48:21.124228
Last Completion:
2025-04-20 17:48:25.921809
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
    self.datapackage = self.process_datapackage(self.datapackage)
  File "/usr/local/lib/python3.9/site-packages/dataflows/processors/set_type.py", line 71, in process_datapackage
    assert added, 'Failed to find field {} in schema'.format(self.name)
AssertionError: Failed to find field re.compile('^party_letter$') in schema
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
    spew_flow(flow, ctx)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
    datastream = flow.datastream()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/flow.py", line 18, in datastream
    return self._chain(ds)._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  [Previous line repeated 4 more times]
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
    self.raise_exception(exception)
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
    raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor set_type in position #3: Failed to find field re.compile('^party_letter$') in schema

Pipeline ID: people/political_candidates/election_candidates21

people/political_donations/political_donations
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 17:48:17.054854
Last Completion:
2025-04-20 17:48:21.047258
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 971, in json
    return complexjson.loads(self.text, **kwargs)
  File "/usr/local/lib/python3.9/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "/usr/local/lib/python3.9/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/local/lib/python3.9/json/decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage/helpers.py", line 59, in retrieve_descriptor
    the_descriptor = req.json()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 975, in json
    raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/processors/load.py", line 121, in process_datapackage
    return self.safe_process_datapackage(dp)
  File "/usr/local/lib/python3.9/site-packages/dataflows/processors/load.py", line 159, in safe_process_datapackage
    self.load_dp = Package(self.load_source)
  File "/usr/local/lib/python3.9/site-packages/datapackage/package.py", line 102, in __init__
    descriptor = helpers.retrieve_descriptor(descriptor)
  File "/usr/local/lib/python3.9/site-packages/datapackage/helpers.py", line 62, in retrieve_descriptor
    six.raise_from(exceptions.DataPackageException(message), error)
  File "<string>", line 3, in raise_from
datapackage.exceptions.DataPackageException: Unable to load JSON at "https://next.obudget.org/datapackages/donations/transactions/datapackage.json"
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
    self.datapackage = self.process_datapackage(self.datapackage)
  File "/usr/local/lib/python3.9/site-packages/dataflows/processors/load.py", line 123, in process_datapackage
    raise SourceLoadError('Failed to load source {!r} and options {!r}: {}'
dataflows.base.exceptions.SourceLoadError: Failed to load source 'https://next.obudget.org/datapackages/donations/transactions/datapackage.json' and options {}: Unable to load JSON at "https://next.obudget.org/datapackages/donations/transactions/datapackage.json"
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
    spew_flow(flow, ctx)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
    datastream = flow.datastream()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/flow.py", line 18, in datastream
    return self._chain(ds)._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
    self.raise_exception(exception)
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
    raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor load in position #1: Failed to load source 'https://next.obudget.org/datapackages/donations/transactions/datapackage.json' and options {}: Unable to load JSON at "https://next.obudget.org/datapackages/donations/transactions/datapackage.json"

Pipeline ID: people/political_donations/political_donations

procurement/calls_for_bids/calls-for-bids-moh
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:00:32.354724
Last Completion:
2025-04-21 00:00:37.028609
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
    self.datapackage = self.process_datapackage(self.datapackage)
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 112, in process_datapackage
    raise self.exc
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 60, in describe
    sample = list(itertools.islice(self.iterable, self.SAMPLE_SIZE))
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 89, in handle_iterable
    for x in self.iterable:
  File "/datapackage_pipelines_budgetkey/pipelines/procurement/calls_for_bids/m_tmicha.py", line 47, in m_tmicha_scraper
    assert total > 0
AssertionError
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
    spew_flow(flow, ctx)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
    datastream = flow.datastream()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/flow.py", line 18, in datastream
    return self._chain(ds)._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
    self.raise_exception(exception)
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
    raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor iterable_loader in position #1:

Pipeline ID: procurement/calls_for_bids/calls-for-bids-moh

procurement/calls_for_bids/jobiz-scraper
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 17:47:55.399491
Last Completion:
2025-04-20 17:48:08.821109
Last Success:
None

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 174, in _new_conn
    conn = connection.create_connection(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/connection.py", line 72, in create_connection
    for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
  File "/usr/local/lib/python3.9/socket.py", line 954, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -5] No address associated with hostname
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 714, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 403, in _make_request
    self._validate_conn(conn)
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1053, in _validate_conn
    conn.connect()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 363, in connect
    self.sock = conn = self._new_conn()
  File "/usr/local/lib/python3.9/site-packages/urllib3/connection.py", line 186, in _new_conn
    raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPSConnection object at 0x7f4cbee159d0>: Failed to establish a new connection: [Errno -5] No address associated with hostname
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 486, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 798, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.9/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='jobiz.gov.il', port=443): Max retries exceeded with url: /ajax/results/%D7%94%D7%95%D7%93%D7%A2%D7%94%20%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA/0?ie=0&typeie=%D7%94%D7%95%D7%93%D7%A2%D7%94+%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA&search=Array (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f4cbee159d0>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
    self.datapackage = self.process_datapackage(self.datapackage)
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 112, in process_datapackage
    raise self.exc
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 60, in describe
    sample = list(itertools.islice(self.iterable, self.SAMPLE_SIZE))
  File "/usr/local/lib/python3.9/site-packages/dataflows/helpers/iterable_loader.py", line 89, in handle_iterable
    for x in self.iterable:
  File "/datapackage_pipelines_budgetkey/pipelines/procurement/calls_for_bids/jobiz.py", line 19, in fetch_results
    content = requests.get(URL.format(index)).json()
  File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 73, in get
    return request("get", url, params=params, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 59, in request
    return session.request(method=method, url=url, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 519, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='jobiz.gov.il', port=443): Max retries exceeded with url: /ajax/results/%D7%94%D7%95%D7%93%D7%A2%D7%94%20%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA/0?ie=0&typeie=%D7%94%D7%95%D7%93%D7%A2%D7%94+%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA&search=Array (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f4cbee159d0>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
    spew_flow(flow, ctx)
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
    datastream = flow.datastream()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/flow.py", line 18, in datastream
    return self._chain(ds)._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  [Previous line repeated 5 more times]
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
    self.raise_exception(exception)
  File "/usr/local/lib/python3.9/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
    raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor iterable_loader in position #1: HTTPSConnectionPool(host='jobiz.gov.il', port=443): Max retries exceeded with url: /ajax/results/%D7%94%D7%95%D7%93%D7%A2%D7%94%20%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA/0?ie=0&typeie=%D7%94%D7%95%D7%93%D7%A2%D7%94+%D7%A6%D7%99%D7%91%D7%95%D7%A8%D7%99%D7%AA&search=Array (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f4cbee159d0>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))

Pipeline ID: procurement/calls_for_bids/jobiz-scraper

supports/criteria/support-criteria
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:22:41.045877
Last Completion:
2025-04-21 02:22:45.732798
Last Success:
None

sample
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/processors/sample.py", line 11, in <module>
    res_name = parameters.get('resource', datapackage['resources'][0]['name'])
IndexError: list index out of range

Pipeline ID: supports/criteria/support-criteria

supports/supports-2023
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-04-20 20:00:02.389431
Last Completion:
2025-04-20 20:09:27.072760
Last Success:
2025-04-16 20:10:36.639773

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
    DF.load(wrapper(year), format='csv',
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
    return scraper(gcd, year)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
    chart = get_chart(driver)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 34, in get_chart
    chart = WebDriverWait(driver, 60).until(
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
    raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x55767b38f199 <unknown>
WARNING :FAILED to teardown google-chrome

Pipeline ID: supports/supports-2023

supports/supports-2024
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-04-20 21:00:02.682172
Last Completion:
2025-04-20 21:12:48.011560
Last Success:
2025-04-16 21:07:48.266414

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
DEBUG   :Dropping user packet because connection is dead.
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
    DF.load(wrapper(year), format='csv',
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
    return scraper(gcd, year)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
    chart = get_chart(driver)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 34, in get_chart
    chart = WebDriverWait(driver, 60).until(
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
    raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x562dfabda199 <unknown>
WARNING :FAILED to teardown google-chrome

Pipeline ID: supports/supports-2024

supports/supports-2025
Failed

Last Run triggered by:
scheduled
Last Run started at:
2025-04-20 22:00:04.549254
Last Completion:
2025-04-20 22:07:47.485519
Last Success:
2025-04-16 22:15:06.705080

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 180, in flow
    DF.load(wrapper(year), format='csv',
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
    return scraper(gcd, year)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 142, in scraper
    chart = get_chart(driver)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 34, in get_chart
    chart = WebDriverWait(driver, 60).until(
  File "/usr/local/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 87, in until
    raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
#0 0x563fda8fa199 <unknown>
WARNING :FAILED to teardown google-chrome

Pipeline ID: supports/supports-2025

activities/social_services/social_service_reports
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:05:01.268439
Last Completion:
2025-04-21 02:07:13.359674
Last Success:
2025-04-21 02:07:13.359674

Pipeline ID: activities/social_services/social_service_reports

activities/social_services/social_service_suppliers
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:04:52.651825
Last Completion:
2025-04-21 02:04:56.980608
Last Success:
2025-04-21 02:04:56.980608

Pipeline ID: activities/social_services/social_service_suppliers

activities/social_services/social_service_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:04:56.990123
Last Completion:
2025-04-21 02:05:01.151858
Last Success:
2025-04-21 02:05:01.151858

Pipeline ID: activities/social_services/social_service_tenders

Fetch social services from data input (social_services)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:00:37.038062
Last Completion:
2025-04-21 00:01:27.955414
Last Success:
2025-04-21 00:01:27.955414

Pipeline ID: activities/social_services/social_services

budget/national/changes/explanations/all
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:42:30.271348
Last Completion:
2025-01-12 07:45:55.696978
Last Success:
2025-01-12 07:45:55.696978

Pipeline ID: budget/national/changes/explanations/all

budget/national/changes/original/committee-zipfile
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:38:13.147958
Last Completion:
2025-04-21 00:38:18.061934
Last Success:
2025-04-21 00:38:18.061934

Pipeline ID: budget/national/changes/original/committee-zipfile

budget/national/changes/original/current-year-fixes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-11 01:37:14.334031
Last Completion:
2025-04-11 01:37:37.730582
Last Success:
2025-04-11 01:37:37.730582

Pipeline ID: budget/national/changes/original/current-year-fixes

budget/national/changes/original/national-budget-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-11 00:11:20.150852
Last Completion:
2025-04-11 00:14:11.355309
Last Success:
2025-04-11 00:14:11.355309

Pipeline ID: budget/national/changes/original/national-budget-changes

Changes, grouped by transaction_id, with explanations (national-budget-changes-aggregated)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-11 05:33:23.915698
Last Completion:
2025-04-11 05:35:48.098845
Last Success:
2025-04-11 05:35:48.098845

Pipeline ID: budget/national/changes/processed/national-budget-changes-aggregated

budget/national/changes/processed/transactions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-11 01:37:37.744659
Last Completion:
2025-04-11 05:33:23.783387
Last Success:
2025-04-11 05:33:23.783387

Pipeline ID: budget/national/changes/processed/transactions

National Yearly Budgets (national-budgets)
Succeeded

We get the data the Ministry of Finance publishes in data.gov.il every year. It comes in XLS format, with one row per TAKANA and phase (original, approved, executed). In this pipeline we create from each triplet a single row that has all the data.


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-03 18:45:03.048448
Last Completion:
2025-04-03 19:40:14.105250
Last Success:
2025-04-03 19:40:14.105250

Pipeline ID: budget/national/original/national-budgets

National Yearly Budgets - Processed (aggregated-yearly)
Succeeded

This pipeline joins the different phases of the budget (allocated, revised and executed). In the original file there's a separate row for each of the phases. We like it better as a single row with all phase info. Another thing this pipeline does is to rename the column titles - to more friendly English names. Also, it create rows for all hierarchies - where upper hierarchies (2, 4 & 6 digits) are plain aggregations of the 8-digit items they contain.


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-03 19:40:14.607980
Last Completion:
2025-04-03 20:31:41.656835
Last Success:
2025-04-03 20:31:41.656835

Pipeline ID: budget/national/processed/aggregated-yearly

budget/national/processed/category-explanations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:43:09.618503
Last Completion:
2025-01-12 07:43:10.527802
Last Success:
2025-01-12 07:43:10.527802

Pipeline ID: budget/national/processed/category-explanations

National Yearly Budgets - Joined with category-explanations (connected-items-explained)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-03 20:56:29.327098
Last Completion:
2025-04-03 20:58:53.720601
Last Success:
2025-04-03 20:58:53.720601

Pipeline ID: budget/national/processed/connected-items-explained

National Yearly Budgets - Connected Items (connected-national-budgets)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-03 20:45:25.440648
Last Completion:
2025-04-03 20:56:28.979139
Last Success:
2025-04-03 20:56:28.979139

Pipeline ID: budget/national/processed/connected-national-budgets

National Yearly Budgets - Just the total (item 00) (just-the-total)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-03 20:41:56.523059
Last Completion:
2025-04-03 20:45:26.746811
Last Success:
2025-04-03 20:45:26.746811

Pipeline ID: budget/national/processed/just-the-total

National Yearly Budgets - Main Item Names (roof-names)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-03 20:41:56.529251
Last Completion:
2025-04-03 20:45:25.427507
Last Success:
2025-04-03 20:45:25.427507

Pipeline ID: budget/national/processed/roof-names

National Yearly Budgets - With Extras (with-extras)
Succeeded

This pipeline joins the budget data to itself so that each item has a list of its immediate children.


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-03 20:31:41.886456
Last Completion:
2025-04-03 20:41:56.367662
Last Success:
2025-04-03 20:41:56.367662

Pipeline ID: budget/national/processed/with-extras

budgetkey/analysis/spending/publisher_entity_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-16 10:14:45.790470
Last Completion:
2025-04-16 10:50:31.476451
Last Success:
2025-04-16 10:50:31.476451

Pipeline ID: budgetkey/analysis/spending/publisher_entity_analysis

budgetkey/analysis/spending/publisher_foa_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-16 10:14:45.801760
Last Completion:
2025-04-16 10:17:59.663245
Last Success:
2025-04-16 10:17:59.663245

Pipeline ID: budgetkey/analysis/spending/publisher_foa_analysis

budgetkey/analysis/spending/united
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-16 10:00:02.188671
Last Completion:
2025-04-16 10:14:45.507738
Last Success:
2025-04-16 10:14:45.507738

Pipeline ID: budgetkey/analysis/spending/united

Main Page - Aggregated budget by functional classification (budget-functional-aggregates)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-03 20:31:42.034413
Last Completion:
2025-04-03 20:35:08.959877
Last Success:
2025-04-03 20:35:08.959877

Pipeline ID: budgetkey/budget-functional-aggregates

budgetkey/documents
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-03 20:35:09.229687
Last Completion:
2025-04-03 20:35:12.153264
Last Success:
2025-04-03 20:35:12.153264

Pipeline ID: budgetkey/documents

budgetkey/elasticsearch/index_activities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:07:13.429335
Last Completion:
2025-04-21 02:07:47.566730
Last Success:
2025-04-21 02:07:47.566730

Pipeline ID: budgetkey/elasticsearch/index_activities

budgetkey/elasticsearch/index_gov_decisions
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 17:51:33.635752
Last Completion:
2025-04-20 18:07:33.733510
Last Success:
2025-04-20 18:07:33.733510

Pipeline ID: budgetkey/elasticsearch/index_gov_decisions

budgetkey/elasticsearch/index_muni_budgets
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 17:58:06.453403
Last Completion:
2025-04-20 18:28:45.919682
Last Success:
2025-04-20 18:28:45.919682

Pipeline ID: budgetkey/elasticsearch/index_muni_budgets

budgetkey/elasticsearch/index_muni_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:49:44.123806
Last Completion:
2025-04-21 00:50:28.931432
Last Success:
2025-04-21 00:50:28.931432

Pipeline ID: budgetkey/elasticsearch/index_muni_tenders

budgetkey/elasticsearch/index_national_budget_changes
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-20 18:28:46.042388
Last Completion:
2025-04-20 18:41:59.553100
Last Success:
2025-04-20 18:41:59.553100

Pipeline ID: budgetkey/elasticsearch/index_national_budget_changes

budgetkey/elasticsearch/index_supports
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 03:24:55.644540
Last Completion:
2025-04-21 04:35:59.180681
Last Success:
2025-04-21 04:35:59.180681

Pipeline ID: budgetkey/elasticsearch/index_supports

budgetkey/elasticsearch/index_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 03:39:09.069420
Last Completion:
2025-04-21 04:23:21.936025
Last Success:
2025-04-21 04:23:21.936025

Pipeline ID: budgetkey/elasticsearch/index_tenders

budgetkey/elasticsearch/index_units
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:19:58.187472
Last Completion:
2025-04-21 02:20:31.130016
Last Success:
2025-04-21 02:20:31.130016

Pipeline ID: budgetkey/elasticsearch/index_units

Send periodic emails (emails)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-11 05:01:02.667719
Last Completion:
2025-04-11 12:43:00.163232
Last Success:
2025-04-11 12:43:00.163232

Pipeline ID: budgetkey/emails/emails

donations/candidates
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-02-20 14:24:37.288272
Last Completion:
2025-02-20 14:24:43.803557
Last Success:
2025-02-20 14:24:43.803557

Pipeline ID: donations/candidates

donations/parties
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-02-20 14:18:33.997134
Last Completion:
2025-02-20 14:18:40.300836
Last Success:
2025-02-20 14:18:40.300836

Pipeline ID: donations/parties

entities/all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 03:13:20.651307
Last Completion:
2025-04-21 03:26:35.138201
Last Success:
2025-04-21 03:26:35.138201

Pipeline ID: entities/all

entities/associations/guidestar/guidestar
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-13 05:52:47.361902
Last Completion:
2025-01-13 05:53:38.656055
Last Success:
2025-01-13 05:53:38.656055

Pipeline ID: entities/associations/guidestar/guidestar

entities/associations/guidestar/guidestar-scraper
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 20:00:39.332043
Last Completion:
2025-01-13 05:52:47.252362
Last Success:
2025-01-13 05:52:47.252362

Pipeline ID: entities/associations/guidestar/guidestar-scraper

עמותות פעילות מרשם העמותות (registry)
Succeeded

רשימת כלל העמותות הפעילות, מתעדכן שבועית.


Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 15:15:01.148215
Last Completion:
2025-01-31 15:15:16.766520
Last Success:
2025-01-31 15:15:16.766520

Pipeline ID: entities/associations/registrar/registry

entities/companies/registrar/details
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:14:55.453223
Last Completion:
2025-04-21 02:19:58.159421
Last Success:
2025-04-21 02:19:58.159421

Pipeline ID: entities/companies/registrar/details

חברות פעילות מרשם החברות (scraper)
Succeeded

רשימת כלל החברות הפעילות, מתעדכן שבועית.


Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:00:13.764437
Last Completion:
2025-04-21 00:15:09.657790
Last Success:
2025-04-21 00:15:09.657790

Pipeline ID: entities/companies/registrar/scraper

רשימת אגודות שיתופיות (cooperatives)
Succeeded

רשימת אגודות שיתופיות, מתוך ממשק נתונים של מאגר של משרד הכלכלה / האגף לאיגוד שיתופי, מתעדכן שבועית


Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 00:15:17.258218
Last Completion:
2025-01-31 00:19:09.911632
Last Success:
2025-01-31 00:19:09.911632

Pipeline ID: entities/cooperatives/cooperatives

רשימת הקדשים (endowments)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 08:03:04.519448
Last Completion:
2025-01-12 08:03:18.988162
Last Success:
2025-01-12 08:03:18.988162

Pipeline ID: entities/endowments/endowments

entities/entities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 03:28:12.631294
Last Completion:
2025-04-21 03:39:08.980699
Last Success:
2025-04-21 03:39:08.980699

Pipeline ID: entities/entities

entities/fingerprints
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 03:26:41.063133
Last Completion:
2025-04-21 04:57:43.733459
Last Success:
2025-04-21 04:57:43.733459

Pipeline ID: entities/fingerprints

entities/foi_orgs/foi_orgs
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:48:45.005971
Last Completion:
2025-01-12 07:49:49.509880
Last Success:
2025-01-12 07:49:49.509880

Pipeline ID: entities/foi_orgs/foi_orgs

רשימת אגודות עותומניות (ottoman-association-registry)
Succeeded

רשימת אגודות עותומניות, מתוך תשובה לבקשת חופש מידע


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:49:49.514262
Last Completion:
2025-01-12 07:50:10.403331
Last Success:
2025-01-12 07:50:10.403331

Pipeline ID: entities/ottoman/ottoman-association-registry

רשימת שותפויות (partnerships)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:49:40.695054
Last Completion:
2025-01-12 07:50:32.797033
Last Success:
2025-01-12 07:50:32.797033

Pipeline ID: entities/partnerships/partnerships

entities/special/registry
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:15:24.542678
Last Completion:
2025-04-21 00:27:44.246805
Last Success:
2025-04-21 00:27:44.246805

Pipeline ID: entities/special/registry

ezvonot/ezvonot_accounts
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:21:33.873984
Last Completion:
2025-04-21 02:21:53.672368
Last Success:
2025-04-21 02:21:53.672368

Pipeline ID: ezvonot/ezvonot_accounts

ezvonot/ezvonot_cases
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:21:53.735916
Last Completion:
2025-04-21 02:22:09.143833
Last Success:
2025-04-21 02:22:09.143833

Pipeline ID: ezvonot/ezvonot_cases

ezvonot/ezvonot_crontab
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:28:04.054785
Last Completion:
2025-04-21 00:28:07.240132
Last Success:
2025-04-21 00:28:07.240132

Pipeline ID: ezvonot/ezvonot_crontab

ezvonot/ezvonot_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:22:21.534143
Last Completion:
2025-04-21 02:22:41.034924
Last Success:
2025-04-21 02:22:41.034924

Pipeline ID: ezvonot/ezvonot_decisions

ezvonot/ezvonot_decisions_join
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 03:23:45.235103
Last Completion:
2025-04-21 03:24:50.958631
Last Success:
2025-04-21 03:24:50.958631

Pipeline ID: ezvonot/ezvonot_decisions_join

ezvonot/ezvonot_deposits
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:21:10.438626
Last Completion:
2025-04-21 02:21:33.863087
Last Success:
2025-04-21 02:21:33.863087

Pipeline ID: ezvonot/ezvonot_deposits

ezvonot/ezvonot_purposes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:22:09.222936
Last Completion:
2025-04-21 02:22:21.520205
Last Success:
2025-04-21 02:22:21.520205

Pipeline ID: ezvonot/ezvonot_purposes

government_decisions/government_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-16 12:14:16.653345
Last Completion:
2025-04-16 12:14:29.645998
Last Success:
2025-04-16 12:14:29.645998

Pipeline ID: government_decisions/government_decisions

government_decisions/scraper
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-16 12:00:01.911956
Last Completion:
2025-04-16 12:14:16.427283
Last Success:
2025-04-16 12:14:16.427283

Pipeline ID: government_decisions/scraper

lamas/municipal-data
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:20:31.162155
Last Completion:
2025-04-21 02:21:10.420268
Last Success:
2025-04-21 02:21:10.420268

Pipeline ID: lamas/municipal-data

קובץ התאמת רשויות אזוריות לישובים בשטחן (municipality-to-city)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:40:08.360375
Last Completion:
2025-01-12 07:40:11.026212
Last Success:
2025-01-12 07:40:11.026212

Pipeline ID: lamas/municipality-to-city

maya/maya-bonds-and-options-holdings-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 05:35:38.592809
Last Completion:
2025-01-31 05:43:51.790820
Last Success:
2025-01-31 05:43:51.790820

Pipeline ID: maya/maya-bonds-and-options-holdings-changes

maya/maya-company-director-appointments
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 05:30:12.003986
Last Completion:
2025-01-31 05:38:11.497124
Last Success:
2025-01-31 05:38:11.497124

Pipeline ID: maya/maya-company-director-appointments

maya/maya-company-officer-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 05:21:09.586058
Last Completion:
2025-01-31 05:30:11.997755
Last Success:
2025-01-31 05:30:11.997755

Pipeline ID: maya/maya-company-officer-list

maya/maya-company-stakeholder-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 05:43:51.796983
Last Completion:
2025-01-31 06:02:29.485309
Last Success:
2025-01-31 06:02:29.485309

Pipeline ID: maya/maya-company-stakeholder-list

maya/maya-company-vip-appointments
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 05:27:35.780647
Last Completion:
2025-01-31 05:35:38.577891
Last Success:
2025-01-31 05:35:38.577891

Pipeline ID: maya/maya-company-vip-appointments

maya/maya-complete-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 04:06:10.997230
Last Completion:
2025-01-31 05:03:07.007268
Last Success:
2025-01-31 05:03:07.007268

Pipeline ID: maya/maya-complete-notification-list

maya/maya-holdings-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 05:38:11.505037
Last Completion:
2025-01-31 05:46:39.313761
Last Success:
2025-01-31 05:46:39.313761

Pipeline ID: maya/maya-holdings-changes

maya/maya-notification-parse-updates
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 02:58:35.591193
Last Completion:
2025-01-31 03:27:44.316527
Last Success:
2025-01-31 03:27:44.316527

Pipeline ID: maya/maya-notification-parse-updates

maya/maya-reported-academic-degrees
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 05:46:39.378074
Last Completion:
2025-01-31 05:55:15.790237
Last Success:
2025-01-31 05:55:15.790237

Pipeline ID: maya/maya-reported-academic-degrees

maya/maya-reported-work-record
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 05:55:15.802003
Last Completion:
2025-01-31 06:03:32.979052
Last Success:
2025-01-31 06:03:32.979052

Pipeline ID: maya/maya-reported-work-record

maya/scrape-maya-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-01-31 00:19:09.919764
Last Completion:
2025-01-31 02:03:24.201900
Last Success:
2025-01-31 02:03:24.201900

Pipeline ID: maya/scrape-maya-notification-list

people/association_founders/association-founders
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-13 05:53:38.848122
Last Completion:
2025-01-13 05:54:54.692657
Last Success:
2025-01-13 05:54:54.692657

Pipeline ID: people/association_founders/association-founders

מינויים בכלכליסט (calcalist)
Succeeded

רשימת כל המינויים והחברות מאתר כלכליסט


Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:46:06.894635
Last Completion:
2025-01-12 07:46:11.093162
Last Success:
2025-01-12 07:46:11.093162

Pipeline ID: people/company_appointments/media/calcalist/calcalist

Join the parsed PDF to get start and end time for each person (correlate)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 03:24:51.035902
Last Completion:
2025-04-21 03:24:55.547427
Last Success:
2025-04-21 03:24:55.547427

Pipeline ID: people/company_appointments/state_owned/correlate

Parse and concatenate all PDF reports (parse_pdf_resources)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:22:45.737947
Last Completion:
2025-04-21 02:22:48.546657
Last Success:
2025-04-21 02:22:48.546657

Pipeline ID: people/company_appointments/state_owned/parse_pdf_resources

collect links to all pdf reports on https://mof.gov.il/GCA/Directors/Pages/DirectorsManningReport.aspx (reports)
Succeeded

columns: date, url


Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:38:06.128065
Last Completion:
2025-04-21 00:38:13.127887
Last Success:
2025-04-21 00:38:13.127887

Pipeline ID: people/company_appointments/state_owned/reports

people/company_appointments/state_owned/state-owned-nominations
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 03:26:35.340768
Last Completion:
2025-04-21 03:26:41.040592
Last Success:
2025-04-21 03:26:41.040592

Pipeline ID: people/company_appointments/state_owned/state-owned-nominations

people/municipal_appointments/municipal_representitives
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:46:03.722638
Last Completion:
2025-01-12 07:46:06.889323
Last Success:
2025-01-12 07:46:06.889323

Pipeline ID: people/municipal_appointments/municipal_representitives

procurement/calls_for_bids/gov-publications
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:31:50.894794
Last Completion:
2025-01-12 07:33:06.161066
Last Success:
2025-01-12 07:33:06.161066

Pipeline ID: procurement/calls_for_bids/gov-publications

procurement/calls_for_bids/gov-publications-ministry-of-immigration
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:31:50.907459
Last Completion:
2025-01-12 07:32:01.001741
Last Success:
2025-01-12 07:32:01.001741

Pipeline ID: procurement/calls_for_bids/gov-publications-ministry-of-immigration

procurement/calls_for_bids/gov-publications2
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:31:50.902154
Last Completion:
2025-01-12 07:32:16.840661
Last Success:
2025-01-12 07:32:16.840661

Pipeline ID: procurement/calls_for_bids/gov-publications2

procurement/municipal/fetcher
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:00:14.931261
Last Completion:
2025-04-21 00:00:32.331710
Last Success:
2025-04-21 00:00:32.331710

Pipeline ID: procurement/municipal/fetcher

procurement/spending/quarterly-contract-spending-report-uris
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-20 23:00:02.168980
Last Completion:
2025-04-20 23:00:26.079807
Last Success:
2025-04-20 23:00:26.079807

Pipeline ID: procurement/spending/quarterly-contract-spending-report-uris

דוחות רבעוניים מתוך מרכבה, לפי נוהל היחידה לחופש המידע. (quarterly-contract-spending-reports)
Succeeded

כל משרדי הממשלה ויחידות הסמך (שמחוברות למערכת מרכבה) צריכים לפרסם אחת לרבעון (תוך 45 יום מסוף הרבעון) דו״ח התקשרויות לפי פורמט מוגדר היטב הממומש כדו״ח מובנה במערכת המרכבה. כל המשרדים מדווחים עצמאית והדו״חות עולים לאתר היחידה לחופש המידע, משם אנו אוספים אותם. התוצר של השרשר הזה הוא פירוט כל הדיווחים של כל המשרדים.


Last Run triggered by:
scheduled
Last Run started at:
2025-04-20 23:00:26.408714
Last Completion:
2025-04-20 23:28:24.350318
Last Success:
2025-04-20 23:28:24.350318

Pipeline ID: procurement/spending/quarterly-contract-spending-reports

procurement/spending/quarterly-contract-spending-reports-data
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-20 23:28:24.553631
Last Completion:
2025-04-21 01:08:57.642166
Last Success:
2025-04-21 01:08:57.642166

Pipeline ID: procurement/spending/quarterly-contract-spending-reports-data

Load all tenders data from data.gov.il/procurement agency to a flat file (all)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:28:07.335634
Last Completion:
2025-04-21 00:37:57.242291
Last Success:
2025-04-21 00:37:57.242291

Pipeline ID: procurement/tenders/all

procurement/tenders/processed
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 03:08:57.162830
Last Completion:
2025-04-21 03:28:12.565357
Last Success:
2025-04-21 03:28:12.565357

Pipeline ID: procurement/tenders/processed

reports/all
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-13 05:56:39.882883
Last Completion:
2025-01-13 05:56:47.078992
Last Success:
2025-01-13 05:56:47.078992

Pipeline ID: reports/all

reports/ngos/ngo-activity-report
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-13 05:53:38.835488
Last Completion:
2025-01-13 05:56:39.504309
Last Success:
2025-01-13 05:56:39.504309

Pipeline ID: reports/ngos/ngo-activity-report

reports/ngos/ngo-district-report
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-13 05:53:38.829893
Last Completion:
2025-01-13 05:56:14.480023
Last Success:
2025-01-13 05:56:14.480023

Pipeline ID: reports/ngos/ngo-district-report

simpledb/process_simple_dbs
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-04-03 20:41:56.853947
Last Completion:
2025-04-03 21:05:06.363413
Last Success:
2025-04-03 21:05:06.363413

Pipeline ID: simpledb/process_simple_dbs

supports/all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-16 22:15:06.785315
Last Completion:
2025-04-16 22:20:14.519512
Last Success:
2025-04-16 22:20:14.519512

Pipeline ID: supports/all

supports/by-payment-year
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:22:48.622769
Last Completion:
2025-04-21 02:31:43.248481
Last Success:
2025-04-21 02:31:43.248481

Pipeline ID: supports/by-payment-year

supports/by-request-year
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 02:31:43.321101
Last Completion:
2025-04-21 03:05:50.752262
Last Success:
2025-04-21 03:05:50.752262

Pipeline ID: supports/by-request-year

supports/criteria/support-criteria-doj
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:37:57.342062
Last Completion:
2025-04-21 00:38:06.037843
Last Success:
2025-04-21 00:38:06.037843

Pipeline ID: supports/criteria/support-criteria-doj

supports/supports-2004
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:02.289487
Last Completion:
2025-01-12 07:32:04.068455
Last Success:
2025-01-12 07:32:04.068455

Pipeline ID: supports/supports-2004

supports/supports-2005
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:04.072370
Last Completion:
2025-01-12 07:32:05.185676
Last Success:
2025-01-12 07:32:05.185676

Pipeline ID: supports/supports-2005

supports/supports-2006
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:05.189726
Last Completion:
2025-01-12 07:32:06.378048
Last Success:
2025-01-12 07:32:06.378048

Pipeline ID: supports/supports-2006

supports/supports-2007
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:06.381412
Last Completion:
2025-01-12 07:32:07.514941
Last Success:
2025-01-12 07:32:07.514941

Pipeline ID: supports/supports-2007

supports/supports-2008
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:07.498416
Last Completion:
2025-01-12 07:32:08.900117
Last Success:
2025-01-12 07:32:08.900117

Pipeline ID: supports/supports-2008

supports/supports-2009
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:07.520290
Last Completion:
2025-01-12 07:32:08.933760
Last Success:
2025-01-12 07:32:08.933760

Pipeline ID: supports/supports-2009

supports/supports-2010
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:08.903230
Last Completion:
2025-01-12 07:32:10.258572
Last Success:
2025-01-12 07:32:10.258572

Pipeline ID: supports/supports-2010

supports/supports-2011
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:08.938603
Last Completion:
2025-01-12 07:32:10.296586
Last Success:
2025-01-12 07:32:10.296586

Pipeline ID: supports/supports-2011

supports/supports-2012
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:10.261765
Last Completion:
2025-01-12 07:32:11.553535
Last Success:
2025-01-12 07:32:11.553535

Pipeline ID: supports/supports-2012

supports/supports-2013
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:10.300914
Last Completion:
2025-01-12 07:32:11.592572
Last Success:
2025-01-12 07:32:11.592572

Pipeline ID: supports/supports-2013

supports/supports-2014
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:11.556882
Last Completion:
2025-01-12 07:32:12.887014
Last Success:
2025-01-12 07:32:12.887014

Pipeline ID: supports/supports-2014

supports/supports-2015
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:11.596958
Last Completion:
2025-01-12 07:32:12.894256
Last Success:
2025-01-12 07:32:12.894256

Pipeline ID: supports/supports-2015

supports/supports-2016
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:12.890988
Last Completion:
2025-01-12 07:32:14.210883
Last Success:
2025-01-12 07:32:14.210883

Pipeline ID: supports/supports-2016

supports/supports-2017
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-12 07:32:12.899133
Last Completion:
2025-01-12 07:32:14.195884
Last Success:
2025-01-12 07:32:14.195884

Pipeline ID: supports/supports-2017

supports/supports-2018
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-26 14:00:20.490452
Last Completion:
2025-01-26 14:00:23.889181
Last Success:
2025-01-26 14:00:23.889181

Pipeline ID: supports/supports-2018

supports/supports-2019
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-26 14:00:20.580323
Last Completion:
2025-01-26 14:00:23.797337
Last Success:
2025-01-26 14:00:23.797337

Pipeline ID: supports/supports-2019

supports/supports-2020
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-26 14:00:20.590431
Last Completion:
2025-01-26 14:00:24.681716
Last Success:
2025-01-26 14:00:24.681716

Pipeline ID: supports/supports-2020

supports/supports-2021
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-26 14:00:20.607244
Last Completion:
2025-01-26 14:00:24.185014
Last Success:
2025-01-26 14:00:24.185014

Pipeline ID: supports/supports-2021

supports/supports-2022
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2025-01-26 14:00:23.806617
Last Completion:
2025-01-26 14:00:27.401957
Last Success:
2025-01-26 14:00:27.401957

Pipeline ID: supports/supports-2022

supports/supports-by-entity
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 03:05:50.834879
Last Completion:
2025-04-21 03:08:51.363172
Last Success:
2025-04-21 03:08:51.363172

Pipeline ID: supports/supports-by-entity

supports/with-entities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:01:54.333841
Last Completion:
2025-04-21 00:49:44.022750
Last Success:
2025-04-21 00:49:44.022750

Pipeline ID: supports/with-entities

units/social_services/social_services
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2025-04-21 00:15:09.757552
Last Completion:
2025-04-21 00:15:24.431834
Last Success:
2025-04-21 00:15:24.431834

Pipeline ID: units/social_services/social_services