activities/all
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-28 16:47:39.677220
Last Completion:
2021-01-28 16:47:41.491175
Last Success:
2021-01-28 16:47:41.491175

Pipeline ID: activities/all

activities/social_services/historic_data
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-28 16:43:28.774625
Last Completion:
2021-01-28 16:43:40.309369
Last Success:
2021-01-28 16:43:40.309369

Pipeline ID: activities/social_services/historic_data

bank_of_israel/bank_of_israel
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 07:15:29.804876
Last Completion:
2021-01-27 07:20:03.518586
Last Success:
2021-01-27 07:20:03.518586

Pipeline ID: bank_of_israel/bank_of_israel

budget/national/changes/explanations/all
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-03-02 20:24:34.023030
Last Completion:
2021-03-03 00:38:08.300252
Last Success:
None

explanation_fetcher
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/budget/national/changes/explanations/explanation_fetcher.py", line 64, in <module>
    spew(dp, itertools.chain(res_iter, [get_explanations(parameters['url'])]))
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/budget/national/changes/explanations/explanation_fetcher.py", line 32, in get_explanations
    archive = gcl.download(url)
  File "/datapackage_pipelines_budgetkey/common/google_chrome.py", line 111, in download
    self.driver.get(url)
  File "/usr/local/lib/python3.7/site-packages/selenium/webdriver/remote/webdriver.py", line 333, in get
    self.execute(Command.GET, {'url': url})
  File "/usr/local/lib/python3.7/site-packages/selenium/webdriver/remote/webdriver.py", line 321, in execute
    self.error_handler.check_response(response)
  File "/usr/local/lib/python3.7/site-packages/selenium/webdriver/remote/errorhandler.py", line 242, in check_response
    raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.WebDriverException: Message: chrome not reachable
  (Session info: chrome=88.0.4324.96)
DEBUG   :[chan 482] Max packet in: 32768 bytes
DEBUG   :[chan 482] Max packet out: 32768 bytes
DEBUG   :Secsh channel 482 opened.
DEBUG   :[chan 482] Sesch channel 482 request ok
DEBUG   :[chan 482] EOF received (482)
DEBUG   :[chan 482] EOF sent (482)
DEBUG   :Dropping user packet because connection is dead.

Pipeline ID: budget/national/changes/explanations/all

budget/national/changes/original/current-year-fixes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-02-26 04:19:59.047599
Last Completion:
2021-02-26 04:20:25.925852
Last Success:
2021-02-26 04:20:25.925852

Pipeline ID: budget/national/changes/original/current-year-fixes

budget/national/changes/original/national-budget-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-02-26 01:51:38.130631
Last Completion:
2021-02-26 01:56:16.911222
Last Success:
2021-02-26 01:56:16.911222

Pipeline ID: budget/national/changes/original/national-budget-changes

Changes, grouped by transaction_id, with explanations (national-budget-changes-aggregated)
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./budget/national/changes/explanations/all" is successfully executed

Pipeline ID: budget/national/changes/processed/national-budget-changes-aggregated

budget/national/changes/processed/transactions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-02-26 04:20:25.938037
Last Completion:
2021-02-26 11:09:55.794753
Last Success:
2021-02-26 11:09:55.794753

Pipeline ID: budget/national/changes/processed/transactions

National Yearly Budgets (national-budgets)
Succeeded

We get the data the Ministry of Finance publishes in data.gov.il every year. It comes in XLS format, with one row per TAKANA and phase (original, approved, executed). In this pipeline we create from each triplet a single row that has all the data.


Last Run triggered by:
manual
Last Run started at:
2021-02-11 11:30:59.021871
Last Completion:
2021-02-11 13:23:27.126360
Last Success:
2021-02-11 13:23:27.126360

Pipeline ID: budget/national/original/national-budgets

National Yearly Budgets - Processed (aggregated-yearly)
Succeeded

This pipeline joins the different phases of the budget (allocated, revised and executed). In the original file there's a separate row for each of the phases. We like it better as a single row with all phase info. Another thing this pipeline does is to rename the column titles - to more friendly English names. Also, it create rows for all hierarchies - where upper hierarchies (2, 4 & 6 digits) are plain aggregations of the 8-digit items they contain.


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-12 15:46:11.498646
Last Completion:
2021-02-12 17:30:10.408804
Last Success:
2021-02-12 17:30:10.408804

Pipeline ID: budget/national/processed/aggregated-yearly

budget/national/processed/category-explanations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 06:54:17.996534
Last Completion:
2021-01-27 06:54:19.159029
Last Success:
2021-01-27 06:54:19.159029

Pipeline ID: budget/national/processed/category-explanations

National Yearly Budgets - Joined with category-explanations (connected-items-explained)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-update
Last Run started at:
2021-02-12 18:09:03.592044
Last Completion:
2021-02-12 18:11:51.305074
Last Success:
2021-02-12 18:11:51.305074

Pipeline ID: budget/national/processed/connected-items-explained

National Yearly Budgets - Connected Items (connected-national-budgets)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-12 17:47:58.246916
Last Completion:
2021-02-12 18:09:00.103959
Last Success:
2021-02-12 18:09:00.103959

Pipeline ID: budget/national/processed/connected-national-budgets

National Yearly Budgets - Just the total (item 00) (just-the-total)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-12 17:47:56.248465
Last Completion:
2021-02-12 17:56:34.897333
Last Success:
2021-02-12 17:56:34.897333

Pipeline ID: budget/national/processed/just-the-total

National Yearly Budgets - Main Item Names (roof-names)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-12 17:47:56.255357
Last Completion:
2021-02-12 17:56:29.915753
Last Success:
2021-02-12 17:56:29.915753

Pipeline ID: budget/national/processed/roof-names

National Yearly Budgets - With Extras (with-extras)
Succeeded

This pipeline joins the budget data to itself so that each item has a list of its immediate children.


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-12 17:30:11.430173
Last Completion:
2021-02-12 17:47:55.459699
Last Success:
2021-02-12 17:47:55.459699

Pipeline ID: budget/national/processed/with-extras

budgetkey/analysis/spending/publisher_entity_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 10:32:19.501911
Last Completion:
2021-03-04 11:54:17.699845
Last Success:
2021-03-04 11:54:17.699845

Pipeline ID: budgetkey/analysis/spending/publisher_entity_analysis

budgetkey/analysis/spending/publisher_foa_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 11:14:49.306694
Last Completion:
2021-03-04 11:28:48.546728
Last Success:
2021-03-04 11:28:48.546728

Pipeline ID: budgetkey/analysis/spending/publisher_foa_analysis

budgetkey/analysis/spending/united
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 10:00:13.499733
Last Completion:
2021-03-04 10:32:17.120130
Last Success:
2021-03-04 10:32:17.120130

Pipeline ID: budgetkey/analysis/spending/united

Main Page - Aggregated budget by functional classification (budget-functional-aggregates)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-12 17:30:13.822566
Last Completion:
2021-02-12 17:35:31.498952
Last Success:
2021-02-12 17:35:31.498952

Pipeline ID: budgetkey/budget-functional-aggregates

budgetkey/documents
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-12 17:35:33.440667
Last Completion:
2021-02-12 17:35:35.132982
Last Success:
2021-02-12 17:35:35.132982

Pipeline ID: budgetkey/documents

budgetkey/elasticsearch/index_activities
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-02-26 03:23:23.585530
Last Completion:
2021-02-26 03:23:33.824460
Last Success:
2021-02-26 03:23:33.824460

Pipeline ID: budgetkey/elasticsearch/index_activities

budgetkey/elasticsearch/index_budget
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-02-26 01:41:15.345743
Last Completion:
2021-02-26 02:00:53.337513
Last Success:
2021-02-26 02:00:53.337513

Pipeline ID: budgetkey/elasticsearch/index_budget

budgetkey/elasticsearch/index_calls_for_bids
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-03 16:04:20.941128
Last Completion:
2021-03-03 16:04:34.547316
Last Success:
2021-03-03 16:04:34.547316

Pipeline ID: budgetkey/elasticsearch/index_calls_for_bids

budgetkey/elasticsearch/index_contract_spending
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 08:52:11.701588
Last Completion:
2021-03-04 11:29:09.891906
Last Success:
2021-03-04 11:29:09.891906

Pipeline ID: budgetkey/elasticsearch/index_contract_spending

budgetkey/elasticsearch/index_entities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 09:22:47.020799
Last Completion:
2021-03-04 11:14:49.292418
Last Success:
2021-03-04 11:14:49.292418

Pipeline ID: budgetkey/elasticsearch/index_entities

budgetkey/elasticsearch/index_gov_decisions
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./government_decisions/government_decisions
From ./government_decisions/government_decisions :['Dependency unsuccessful', 'Cannot run until dependency "./government_decisions/scraper" is successfully executed']

Pipeline ID: budgetkey/elasticsearch/index_gov_decisions

budgetkey/elasticsearch/index_national_budget_changes
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./budget/national/changes/processed/national-budget-changes-aggregated
From ./budget/national/changes/processed/national-budget-changes-aggregated :['Dependency unsuccessful', 'Cannot run until dependency "./budget/national/changes/explanations/all" is successfully executed']

Pipeline ID: budgetkey/elasticsearch/index_national_budget_changes

budgetkey/elasticsearch/index_people
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 09:48:10.192817
Last Completion:
2021-03-04 09:52:30.546164
Last Success:
2021-03-04 09:52:30.546164

Pipeline ID: budgetkey/elasticsearch/index_people

budgetkey/elasticsearch/index_reports
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 07:47:28.836489
Last Completion:
2021-03-04 07:48:30.987067
Last Success:
2021-03-04 07:48:30.987067

Pipeline ID: budgetkey/elasticsearch/index_reports

budgetkey/elasticsearch/index_support_criteria
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 06:04:53.813794
Last Completion:
2021-03-04 06:05:06.616528
Last Success:
2021-03-04 06:05:06.616528

Pipeline ID: budgetkey/elasticsearch/index_support_criteria

budgetkey/elasticsearch/index_supports
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 06:05:06.629941
Last Completion:
2021-03-04 06:35:56.695650
Last Success:
2021-03-04 06:35:56.695650

Pipeline ID: budgetkey/elasticsearch/index_supports

budgetkey/elasticsearch/index_tenders
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Missing dependency :Failed to find a dependency: ./procurement/tenders/processed

Pipeline ID: budgetkey/elasticsearch/index_tenders

budgetkey/elasticsearch/sitemaps
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Missing dependency :Failed to find a dependency: ./budgetkey/elasticsearch/index_tenders

Pipeline ID: budgetkey/elasticsearch/sitemaps

Send periodic emails (1) (emails)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-02-26 11:57:58.541780
Last Completion:
2021-02-26 11:58:18.301609
Last Success:
2021-02-26 11:58:18.301609

Pipeline ID: budgetkey/emails/emails

donations/candidates
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 08:30:27.276695
Last Completion:
2021-01-27 08:30:36.015585
Last Success:
2021-01-27 08:30:36.015585

Pipeline ID: donations/candidates

donations/parties
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 06:54:19.213742
Last Completion:
2021-01-27 06:54:30.615402
Last Success:
2021-01-27 06:54:30.615402

Pipeline ID: donations/parties

donations/transactions
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-03-02 20:24:34.717038
Last Completion:
2021-03-02 20:24:46.803471
Last Success:
None

dump.to_path
ERROR   :Failed to transform row {'CandidateName': 'בוארון אביחי', 'City': 'עופרה', 'Country': 'ישראל', 'GD_Date': '/Date(1423432800000)/', 'GD_Name': 'אביחי בוארון תרומה עצמית', 'GD_Sum': '130000.00', 'GuaranteeOrDonation': 'תרומה', 'ID': None, 'IsControl': False, 'IsDeficitCoverage': 'לא', 'IsUpdate': False, 'Party': 'הבית היהודי, מיסודה של המפד"ל – המפלגה הדתית לאומית המזרחי הפועל המזרחי בארץ ישראל', 'PublisherTypeID': 2, 'State': 0, 'SumInCurrency': '0.00', 'URL': None}
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/file_formats.py", line 31, in __transform_row
    for k, v in row.items())
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/file_formats.py", line 31, in <genexpr>
    for k, v in row.items())
KeyError: 'IsDeficitCoverage'
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/dump/to_path.py", line 37, in <module>
    PathDumper()()
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/dumper_base.py", line 53, in __call__
    finalizer=self.finalize
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/dumper_base.py", line 128, in row_counter
    for row in resource:
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/dumper_base.py", line 258, in rows_processor
    file_formatter.write_row(writer, row, fields)
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/file_formats.py", line 44, in write_row
    transformed_row = self.__transform_row(row, fields)
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/file_formats.py", line 31, in __transform_row
    for k, v in row.items())
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/file_formats.py", line 31, in <genexpr>
    for k, v in row.items())
KeyError: 'IsDeficitCoverage'

Pipeline ID: donations/transactions

education/tochniyot/tochniyot
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-14 07:05:26.894900
Last Completion:
2021-02-14 07:05:59.491425
Last Success:
2021-02-14 07:05:59.491425

Pipeline ID: education/tochniyot/tochniyot

entities/all
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-03-04 06:43:35.197647
Last Completion:
2021-03-04 07:10:28.824444
Last Success:
2021-03-04 07:10:28.824444

Pipeline ID: entities/all

entities/associations/guidestar/guidestar
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 03:53:17.631510
Last Completion:
2021-03-04 03:58:59.866904
Last Success:
2021-03-04 03:58:59.866904

Pipeline ID: entities/associations/guidestar/guidestar

entities/associations/guidestar/guidestar-scraper
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 01:09:54.408823
Last Completion:
2021-03-04 01:26:32.329173
Last Success:
2021-03-04 01:26:32.329173

Pipeline ID: entities/associations/guidestar/guidestar-scraper

עמותות פעילות מרשם העמותות (registry)
Succeeded

רשימת כלל העמותות הפעילות, מתעדכן שבועית.


Last Run triggered by:
scheduled
Last Run started at:
2021-01-31 15:15:05.322236
Last Completion:
2021-01-31 15:15:47.074895
Last Success:
2021-01-31 15:15:47.074895

Pipeline ID: entities/associations/registrar/registry

entities/companies/registrar/details
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 03:53:20.503946
Last Completion:
2021-03-04 03:58:27.816026
Last Success:
2021-03-04 03:58:27.816026

Pipeline ID: entities/companies/registrar/details

חברות פעילות מרשם החברות (scraper)
Succeeded

רשימת כלל החברות הפעילות, מתעדכן שבועית.


Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 01:26:32.347706
Last Completion:
2021-03-04 01:39:51.047580
Last Success:
2021-03-04 01:39:51.047580

Pipeline ID: entities/companies/registrar/scraper

רשימת אגודות שיתופיות (cooperatives)
Succeeded

רשימת אגודות שיתופיות, מתוך ממשק נתונים של מאגר של משרד הכלכלה / האגף לאיגוד שיתופי, מתעדכן שבועית


Last Run triggered by:
scheduled
Last Run started at:
2021-01-31 00:21:34.196879
Last Completion:
2021-01-31 01:20:27.934359
Last Success:
2021-01-31 01:20:27.934359

Pipeline ID: entities/cooperatives/cooperatives

entities/entities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 09:03:03.590625
Last Completion:
2021-03-04 09:22:44.059962
Last Success:
2021-03-04 09:22:44.059962

Pipeline ID: entities/entities

entities/fingerprints
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-03-04 07:14:55.422019
Last Completion:
2021-03-04 08:20:31.891893
Last Success:
2021-03-04 08:20:31.891893

Pipeline ID: entities/fingerprints

entities/foi_orgs/foi_orgs
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 06:55:16.101269
Last Completion:
2021-01-27 06:55:54.018618
Last Success:
2021-01-27 06:55:54.018618

Pipeline ID: entities/foi_orgs/foi_orgs

entities/moital/moital_service_providers
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 07:04:33.004134
Last Completion:
2021-01-27 07:11:30.001751
Last Success:
2021-01-27 07:11:30.001751

Pipeline ID: entities/moital/moital_service_providers

רשימת אגודות עותומניות (ottoman-association-registry)
Succeeded

רשימת אגודות עותומניות, מתוך תשובה לבקשת חופש מידע


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-01 07:22:14.166182
Last Completion:
2021-02-01 07:23:31.140076
Last Success:
2021-02-01 07:23:31.140076

Pipeline ID: entities/ottoman/ottoman-association-registry

entities/safety-orders/safety-orders
Failed

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 02:05:44.864132
Last Completion:
2021-03-04 02:06:11.527877
Last Success:
None

stream_remote_resources
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/tabulator/loaders/remote.py", line 63, in load
    bytes = _RemoteStream(source, self.__http_session, self.__http_timeout).open()
  File "/usr/local/lib/python3.7/site-packages/tabulator/loaders/remote.py", line 121, in open
    self.seek(0)
  File "/usr/local/lib/python3.7/site-packages/tabulator/loaders/remote.py", line 143, in seek
    self.__response.raise_for_status()
  File "/usr/local/lib/python3.7/site-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.gov.il/he/error
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 243, in <module>
    resource.pop('http_headers', None))
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 197, in stream_reader
    schema, headers, columns, stream, close = get_opener(url, _resource)()
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 173, in opener
    _stream.open()
  File "/usr/local/lib/python3.7/site-packages/tabulator/stream.py", line 423, in open
    self.__parser.open(source, encoding=self.__encoding)
  File "/usr/local/lib/python3.7/site-packages/tabulator/parsers/xlsx.py", line 80, in open
    source_bytes = self.__loader.load(source, mode="b", encoding=encoding)
  File "/usr/local/lib/python3.7/site-packages/tabulator/loaders/remote.py", line 72, in load
    raise exceptions.HTTPError(str(exception))
tabulator.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.gov.il/he/error

Pipeline ID: entities/safety-orders/safety-orders

entities/safety-orders/safety-orders-by-entity
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./entities/safety-orders/safety-orders" is successfully executed

Pipeline ID: entities/safety-orders/safety-orders-by-entity

entities/special/registry
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 00:50:39.322763
Last Completion:
2021-03-04 01:09:44.962770
Last Success:
2021-03-04 01:09:44.962770

Pipeline ID: entities/special/registry

ezvonot/ezvonot_accounts
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 03:52:22.297556
Last Completion:
2021-03-04 03:53:12.426906
Last Success:
2021-03-04 03:53:12.426906

Pipeline ID: ezvonot/ezvonot_accounts

ezvonot/ezvonot_cases
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 03:52:30.591095
Last Completion:
2021-03-04 03:52:49.713998
Last Success:
2021-03-04 03:52:49.713998

Pipeline ID: ezvonot/ezvonot_cases

ezvonot/ezvonot_crontab
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 01:09:46.462733
Last Completion:
2021-03-04 01:09:47.198401
Last Success:
2021-03-04 01:09:47.198401

Pipeline ID: ezvonot/ezvonot_crontab

ezvonot/ezvonot_decisions
Failed

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 03:53:12.510801
Last Completion:
2021-03-04 03:53:20.491689
Last Success:
None

data_gov_il_resource
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/processors/data_gov_il_resource.py", line 59, in <module>
    spew_flow(flow(ctx.parameters), ctx)
  File "/datapackage_pipelines_budgetkey/processors/data_gov_il_resource.py", line 40, in flow
    url, path = get_resource(gcd, dataset_name, resource_name)
  File "/datapackage_pipelines_budgetkey/common/data_gov_il.py", line 101, in get_resource
    assert False, 'Failed to find resource for name %s: possibilities are %r' % (resource_name, [r['name'] for r in dataset['resources']])
AssertionError: Failed to find resource for name קובץ החלטות וועדה : possibilities are ['קובץ הפקדות', 'קובץ חשבונות המרכיבים את החלטות הועדה', 'קובץ תיקים', 'קובץ ייעודים', 'קובץ החלטות וועדה ']

Pipeline ID: ezvonot/ezvonot_decisions

ezvonot/ezvonot_decisions_join
Invalid

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-02-22 02:38:33.389731
Last Completion:
2021-02-22 02:39:02.384578
Last Success:
2021-02-22 02:39:02.384578

Dependency unsuccessful :Cannot run until dependency "./ezvonot/ezvonot_decisions" is successfully executed

Pipeline ID: ezvonot/ezvonot_decisions_join

ezvonot/ezvonot_deposits
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 03:51:35.220855
Last Completion:
2021-03-04 03:52:22.247526
Last Success:
2021-03-04 03:52:22.247526

Pipeline ID: ezvonot/ezvonot_deposits

ezvonot/ezvonot_purposes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 03:52:49.793537
Last Completion:
2021-03-04 03:53:11.831927
Last Success:
2021-03-04 03:53:11.831927

Pipeline ID: ezvonot/ezvonot_purposes

government_decisions/government_decisions
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./government_decisions/scraper" is successfully executed

Pipeline ID: government_decisions/government_decisions

government_decisions/scraper
Failed

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 12:00:11.464652
Last Completion:
2021-03-04 12:00:47.044468
Last Success:
None

scraper
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 677, in urlopen
    chunked=chunked,
  File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 381, in _make_request
    self._validate_conn(conn)
  File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 978, in _validate_conn
    conn.connect()
  File "/usr/local/lib/python3.7/site-packages/urllib3/connection.py", line 371, in connect
    ssl_context=context,
  File "/usr/local/lib/python3.7/site-packages/urllib3/util/ssl_.py", line 386, in ssl_wrap_socket
    return context.wrap_socket(sock, server_hostname=server_hostname)
  File "/usr/local/lib/python3.7/ssl.py", line 423, in wrap_socket
    session=session
  File "/usr/local/lib/python3.7/ssl.py", line 870, in _create
    self.do_handshake()
  File "/usr/local/lib/python3.7/ssl.py", line 1139, in do_handshake
    self._sslobj.do_handshake()
ConnectionResetError: [Errno 104] Connection reset by peer
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 727, in urlopen
    method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
  File "/usr/local/lib/python3.7/site-packages/urllib3/util/retry.py", line 410, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.7/site-packages/urllib3/packages/six.py", line 734, in reraise
    raise value.with_traceback(tb)
  File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 677, in urlopen
    chunked=chunked,
  File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 381, in _make_request
    self._validate_conn(conn)
  File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 978, in _validate_conn
    conn.connect()
  File "/usr/local/lib/python3.7/site-packages/urllib3/connection.py", line 371, in connect
    ssl_context=context,
  File "/usr/local/lib/python3.7/site-packages/urllib3/util/ssl_.py", line 386, in ssl_wrap_socket
    return context.wrap_socket(sock, server_hostname=server_hostname)
  File "/usr/local/lib/python3.7/ssl.py", line 423, in wrap_socket
    session=session
  File "/usr/local/lib/python3.7/ssl.py", line 870, in _create
    self.do_handshake()
  File "/usr/local/lib/python3.7/ssl.py", line 1139, in do_handshake
    self._sslobj.do_handshake()
urllib3.exceptions.ProtocolError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/government_decisions/scraper.py", line 122, in <module>
    spew(datapackage, chain(res_iter, [get_decision_list()]))
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/government_decisions/scraper.py", line 55, in get_decision_list
    response = session.get(SEARCH_PAGE_RESULTS_URL.format(skip=0), timeout=TIMEOUT).json()
  File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/requests/adapters.py", line 498, in send
    raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))

Pipeline ID: government_decisions/scraper

lamas/municipal-data
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 03:48:01.149565
Last Completion:
2021-03-04 03:48:33.162175
Last Success:
2021-03-04 03:48:33.162175

Pipeline ID: lamas/municipal-data

קובץ התאמת רשויות אזוריות לישובים בשטחן (municipality-to-city)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 06:52:09.494326
Last Completion:
2021-01-27 06:52:12.978137
Last Success:
2021-01-27 06:52:12.978137

Pipeline ID: lamas/municipality-to-city

maya/maya-bonds-and-options-holdings-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 08:11:30.750051
Last Completion:
2021-03-04 08:18:21.730779
Last Success:
2021-03-04 08:18:21.730779

Pipeline ID: maya/maya-bonds-and-options-holdings-changes

maya/maya-company-officer-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 08:03:15.936861
Last Completion:
2021-03-04 08:11:30.741357
Last Success:
2021-03-04 08:11:30.741357

Pipeline ID: maya/maya-company-officer-list

maya/maya-company-stakeholder-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 08:18:21.797812
Last Completion:
2021-03-04 08:49:18.495190
Last Success:
2021-03-04 08:49:18.495190

Pipeline ID: maya/maya-company-stakeholder-list

maya/maya-company-vip-appointments
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 08:08:56.226881
Last Completion:
2021-03-04 08:15:46.132347
Last Success:
2021-03-04 08:15:46.132347

Pipeline ID: maya/maya-company-vip-appointments

maya/maya-complete-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 06:50:59.214520
Last Completion:
2021-03-04 07:30:52.699219
Last Success:
2021-03-04 07:30:52.699219

Pipeline ID: maya/maya-complete-notification-list

maya/maya-holdings-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 08:15:46.142127
Last Completion:
2021-03-04 08:27:15.614414
Last Success:
2021-03-04 08:27:15.614414

Pipeline ID: maya/maya-holdings-changes

maya/maya-notification-parse-updates
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 03:58:27.824516
Last Completion:
2021-03-04 05:59:46.895009
Last Success:
2021-03-04 05:59:46.895009

Pipeline ID: maya/maya-notification-parse-updates

maya/maya-reported-academic-degrees
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 08:20:31.903874
Last Completion:
2021-03-04 08:33:26.208333
Last Success:
2021-03-04 08:33:26.208333

Pipeline ID: maya/maya-reported-academic-degrees

maya/maya-reported-work-record
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 08:27:15.626781
Last Completion:
2021-03-04 08:38:58.537711
Last Success:
2021-03-04 08:38:58.537711

Pipeline ID: maya/maya-reported-work-record

maya/maya-tase-companies-current-management
Failed

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 08:33:35.916095
Last Completion:
2021-03-04 08:33:45.709970
Last Success:
2021-03-03 07:02:40.536885

flow
ERROR   :Traceback (most recent call last):
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
ERROR   :spew_flow(flow, ctx)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
ERROR   :spew(self.datapackage, self.resource_iterator, stats=self.stats)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
ERROR   :for rec in res:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource
ERROR   :yield from self.func(resource)
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_tase_companies_current_management.py", line 61, in process_companies
ERROR   :for manager in get_company_management(int(row['CompanyTaseId'])):
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_tase_companies_current_management.py", line 53, in get_company_management
ERROR   :json = res.json()['Data']
ERROR   :KeyError
ERROR   ::
ERROR   :'Data'

Pipeline ID: maya/maya-tase-companies-current-management

maya/maya-tase-companies-current-shareholders
Failed

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 08:33:26.215693
Last Completion:
2021-03-04 08:33:35.908730
Last Success:
2021-03-03 07:02:16.949996

flow
ERROR   :Traceback (most recent call last):
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
ERROR   :spew_flow(flow, ctx)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
ERROR   :spew(self.datapackage, self.resource_iterator, stats=self.stats)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
ERROR   :for rec in res:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource
ERROR   :yield from self.func(resource)
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_tase_companies_current_shareholders.py", line 61, in process_companies
ERROR   :for shareholders in get_company_shareholders(int(row['CompanyTaseId'])):
ERROR   :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_tase_companies_current_shareholders.py", line 54, in get_company_shareholders
ERROR   :json = res.json()['Data']
ERROR   :KeyError
ERROR   ::
ERROR   :'Data'

Pipeline ID: maya/maya-tase-companies-current-shareholders

maya/scrape-maya-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 01:40:05.827647
Last Completion:
2021-03-04 02:05:39.346921
Last Success:
2021-03-04 02:05:39.346921

Pipeline ID: maya/scrape-maya-notification-list

maya/scrape-maya-tase-companies
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 00:28:50.122465
Last Completion:
2021-03-04 00:30:27.323523
Last Success:
2021-03-04 00:30:27.323523

Pipeline ID: maya/scrape-maya-tase-companies

people/aggregated
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 09:24:22.055902
Last Completion:
2021-03-04 09:48:07.457571
Last Success:
2021-03-04 09:48:07.457571

Pipeline ID: people/aggregated

people/all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 09:22:40.142896
Last Completion:
2021-03-04 09:24:19.725574
Last Success:
2021-03-04 09:24:19.725574

Pipeline ID: people/all

people/association_founders/association-founders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 06:40:16.047089
Last Completion:
2021-03-04 06:40:43.905717
Last Success:
2021-03-04 06:40:43.905717

Pipeline ID: people/association_founders/association-founders

people/company_appointments/all-appointments
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 08:01:52.348897
Last Completion:
2021-03-04 08:03:15.923793
Last Success:
2021-03-04 08:03:15.923793

Pipeline ID: people/company_appointments/all-appointments

people/company_appointments/maya/collect-maya-forms-debug-stats
Failed

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 04:58:22.882326
Last Completion:
2021-03-04 04:58:25.552439
Last Success:
None

dump_to_path
ERROR   :Traceback (most recent call last):
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/base/schema_validator.py", line 73, in schema_validator
ERROR   :row[field.name] = field.cast_value(row.get(field.name))
ERROR   :File "/usr/local/lib/python3.7/site-packages/tableschema/field.py", line 170, in cast_value
ERROR   :).format(field=self, value=value))
ERROR   :datapackage.exceptions
ERROR   :.
ERROR   :CastError
ERROR   ::
ERROR   :Field "HeaderProofValue_equals_HeaderProof" can't cast value "True" for type "number" with format "default"
ERROR   :During handling of the above exception, another exception occurred:
ERROR   :Traceback (most recent call last):
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/dump_to_path.py", line 23, in <module>
ERROR   :spew_flow(flow(ctx.parameters, ctx.stats), ctx)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
ERROR   :spew(self.datapackage, self.resource_iterator, stats=self.stats)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
ERROR   :for rec in res:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/processors/dumpers/dumper_base.py", line 69, in row_counter
ERROR   :for row in iterator:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/processors/dumpers/file_dumper.py", line 77, in rows_processor
ERROR   :for row in resource:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/base/schema_validator.py", line 75, in schema_validator
ERROR   :if not on_error(resource['name'], row, i, e, field):
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/base/schema_validator.py", line 49, in func
ERROR   :return on_error(res_name, row, i, e)
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/base/schema_validator.py", line 24, in raise_exception
ERROR   :raise ValidationError(res_name, row, i, e)
ERROR   :dataflows.base.schema_validator
ERROR   :.
ERROR   :ValidationError
ERROR   ::
ERROR   :ROW: {'HeaderEntityNameEB': Decimal('1'), 'HeaderFixtReport': 0, 'HeaderProof': Decimal('1'), 'HeaderProofFormat': 0, 'HeaderProofValue': Decimal('1'), 'HeaderProofValue_equals_HeaderProof': True, 'alias_stats': [{'FormSubject': '_________'}, {'KodSugYeshut': '1'}, {'ShemYeshutIvrit': 'מת"ב - מערכות תקשורת בכבלים בע"מ'}, {'MisparTofes': 'ת091'}, {'ShemYeshutLoazit': 'MATAV CABLE SYSTEMS MEDIA LTD'}, {'PumbiLoPumbi': 'פומבי'}, {'MezahehHotem': '5086'}, {'': 'מספר ברשם:'}, {'HeaderMisparBaRasham': '520040072'}, {'NeyarotErechReshumim': 'ניירות ערך של התאגיד רשומים למסחר בבורסה בתל-אביב'}, {'MezahehYeshut': '478'}, {'': 'שם מקוצר:'}, {'HeaderSemelBursa': 'מתב'}, {'MezahehTofes': '65'}, {'': 'רחוב:'}, {'HeaderRehov': 'בית ספרד, יורופארק, יקום'}, {'HeaderMisparBait': '1'}, {'HeaderYeshuv': 'יקום'}, {'HeaderMikud': '60972'}, {'HeaderPhone': 'טלפון:'}, {'HeaderTelephone1': '077-7077031'}, {'HeaderTelephone2': '077-7077037'}, {'': 'פקס:'}, {'HeaderFax1': '077-7078230'}, {'': 'דואר אלקטרוני:'}, {'HeaderDoarElectroniMedaveach': 'ori.gur[email protected]'}, {'HeaderSendDate': 'תאריך שידור:'}, {'HeaderSendTime': 'שעת שידור:'}, {'ShaaShidur': '19:06:46'}, {'': 'אתר החברה:'}, {'CompanyUrl': 'www.hot.co.il'}, {'': 'אסמכתא:'}, {'': 'לכבוד'}, {'': 'לכבוד'}, {'': 'רשות ניירות ערך'}, {'': 'הבורסה לניירות ערך בת"א בע"מ'}, {'DoarElectroniRashut': 'www.isa.gov.il'}, {'DoarElectroniBursa': 'www.tase.co.il'}, {'Hanadon': 'דוח מיידי על מינוי נושא משרה בכירה (למעט מינוי דירקטור ולמעט יחיד שמונה מטעם תאגיד שהוא דירקטור)'}, {'': 'תקנה 34 (ב) לתקנות ניירות ערך (דוחות תקופתיים ומיידיים), תש"ל - 1970'}, {'': 'הסבר: אם ממונה גם כדירקטור יש למלא טופס ת093 בלבד'}, {'': 'הסבר: בהתאם לתקנה 34 (ד) לתקנות ניירות ערך (דוחות תקופתיים ומיידים) תש"ל - 1970, יש להגיש במקביל להגשת טופס זה מצבת נושאי משרה בכירה במסגרת טופס ת097'}, {'': '1.'}, {'': 'שם משפחה ושם פרטי:'}, {'Shem': 'ברגמן דלי'}, {'': 'סוג מספר זיהוי:'}, {'SugMisparZihuy': 'מספר ת.ז.'}, {'': 'מספר זיהוי:'}, {'MisparZihuy': '027732304'}, {'': 'אזרחות/ ארץ התאגדות או רישום:'}, {'Ezrachut': 'אדם פרטי עם אזרחות ישראלית'}, {'': 'ארץ אזרחות / התאגדות או רישום:'}, {'EretzEzrachut': '_________'}, {'': '2.'}, {'': 'תאריך לידה:'}, {'TaarichLeida': '27/06/1970'}, {'': '3.'}, {'': 'מען להמצאת כתבי בית דין:'}, {'MaanLeHimatzutKitveyBeitDyn': 'בית ספרד, יורופארק, אזור תעשיה קיבוץ יקום'}, {'': '4.'}, {'': 'תאריך תחילת הכהונה:'}, {'TaarichTchilatHaKehuna': '01/01/2007'}, {'': '5.'}, {'': 'התפקיד לו מונה:'}, {'HaTafkidLoMuna': 'חשב'}, {'TeurHaTafkidLoMuna': '_________'}, {'': '6.'}, {'': 'תפקיד קודם בחברה טרם המינוי:'}, {'TafkidKodem': 'אין'}, {'TafkidKodemAher': '_________'}, {'': '7.'}, {'': 'השכלה אקדמית:'}, {'': 'תואר'}, {'': 'תחום'}, {'': 'שם המוסד האקדמי'}, {'Toar': 'בוגר'}, {'Tchum': 'חשבונאות וכלכלה'}, {'ShemHaMosadHaAcademi': 'אוניברסיטת תל- אביב'}, {'Toar': 'מוסמך'}, {'Tchum': 'מנהל עסקים'}, {'ShemHaMosadHaAcademi': 'אוניברסיטת תל- אביב'}, {'': 'השכלה אחרת ותעודות מקצועיות:'}, {'HaskalaAcheret': 'תעודת חשבות שכר'}, {'': '8.'}, {'': 'עיסוקים עיקריים ב – 5 השנים האחרונות:'}, {'': 'התפקיד שמילא'}, {'': 'מקום העבודה'}, {'': 'משך הזמן שמילא בתפקיד'}, {'HaTafkidSheMila': 'חשב'}, {'MekomHaAvoda': "ערוצי זהב ושות'"}, {'MeshechZmanSheMilaBaTafkid': '5 שנים'}, {'': '9.'}, {'': 'נושא משרה בכירה'}, {'NoseMisraBechira1': 'אינו ממלא'}, {'': 'בתפקידים אחרים בתאגיד,בחברת בת שלו, בחברה קשורה או אצל בעל העניין'}, {'': 'הסבר: אם הוא ממלא תפקידים אחרים בתאגיד, בחברה בת שלו או אצל בעל עניין בו נא לפרט.'}, {'Hesber1': '_________'}, {'': '10.'}, {'': 'נושא משרה בכירה'}, {'NoseMisraBechira2': 'אינו'}, {'': 'בן משפחה של נושא משרה בכירה אחר או של בעל עניין בתאגיד.'}, {'': 'הסבר: אם הוא בן משפחה של נושא משרה בכירה אחר או של בעל עניין בתאגיד, יש לפרט.'}, {'Hesber2': '_________'}, {'': '11.'}, {'': 'אם נושא המשרה הבכירה הוא מנכ"ל: הוא'}, {'NoseMisraBechira3': '_________'}, {'': 'בניירות ערך של התאגיד, של חברת בת או של חברה קשורה.'}, {'': 'הסבר: אם נושא המשרה הבכירה הוא מנכ"ל, יש לפרט אם הוא מחזיק ניירות ערך בתאגיד ,בחברת בת או בחברה קשורה. מילוי הערך מטבלה הוא לא שדה חובה.'}, {'Hesber3': '_________'}, {'TextHofshi': ''}, {'': 'מספרי אסמכתאות של מסמכים קודמים בנושא (אין האזכור מהווה הכללה על דרך הפניה):'}, {'FooterMisparAsmachta1': ''}, {'FooterMisparAsmachta2': ''}, {'FooterMisparAsmachta3': ''}, {'': 'שמות קודמים של ישות מדווחת:'}, {'ShemYeshutKodem': ''}, {'': 'תאריך עדכון מבנה הטופס:'}, {'TaarichIdkunMivne': '01/01/2007'}, {'': 'שם מדווח אלקטרוני:'}, {'FooterShemMedaveach': 'חריט אורית'}, {'FooterShemHevra': ''}, {'': 'תפקידו:'}, {'TafkidBaTaagid': 'עו"ד'}, {'Street': 'אזור התעשיה'}, {'StreetNumber': '-'}, {'City': 'יקום'}, {'ZipCode': '60972'}, {'': 'טלפון:'}, {'Telephone': '077-7077037'}, {'': 'פקס:'}, {'FooterFax1': '077-7078806'}, {'': 'דואר אלקטרוני:'}, {'FooterDoarElectroniMedaveach': '[email protected]'}], 'date': datetime.datetime(2007, 1, 1, 19, 14, 42), 'notification_type': 'ת091', 'positions': [['חשב', '_________']], 's3_object_name': 'maya.tase.co.il/2007_01/235402.htm', 'source': 'maya.tase.co.il', 'url': 'https://ams3.digitaloceanspaces.com/budgetkey-files/maya.tase.co.il/2007_01/235402.htm'}
----

Pipeline ID: people/company_appointments/maya/collect-maya-forms-debug-stats

Join the parsed PDF to get start and end time for each person (correlate)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 08:01:13.739846
Last Completion:
2021-03-04 08:01:52.329355
Last Success:
2021-03-04 08:01:52.329355

Pipeline ID: people/company_appointments/maya/correlate

people/company_appointments/maya/maya-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 06:49:53.724864
Last Completion:
2021-03-04 06:50:59.192482
Last Success:
2021-03-04 06:50:59.192482

Pipeline ID: people/company_appointments/maya/maya-list

Appointment notices from Maya (maya-nominations)
Succeeded

Name, job and company description.


Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 07:13:58.120378
Last Completion:
2021-03-04 07:14:27.530367
Last Success:
2021-03-04 07:14:27.530367

Pipeline ID: people/company_appointments/maya/maya-nominations

people/company_appointments/maya/maya-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 01:09:44.972593
Last Completion:
2021-03-04 02:51:48.691278
Last Success:
2021-03-04 02:51:48.691278

Pipeline ID: people/company_appointments/maya/maya-notification-list

List all notifications from maya system (maya-notification-updates)
Succeeded

id, date, company, notification_type, s3_object_name, url


Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 04:58:25.566906
Last Completion:
2021-03-04 05:34:04.101868
Last Success:
2021-03-04 05:34:04.101868

Pipeline ID: people/company_appointments/maya/maya-notification-updates

Appointment notices from Maya (maya-resignations)
Succeeded

Name, job and company description.


Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 07:14:27.550296
Last Completion:
2021-03-04 07:14:55.408202
Last Success:
2021-03-04 07:14:55.408202

Pipeline ID: people/company_appointments/maya/maya-resignations

מינויים בכלכליסט (calcalist)
Succeeded

רשימת כל המינויים והחברות מאתר כלכליסט


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 06:54:48.290900
Last Completion:
2021-01-27 07:02:36.712183
Last Success:
2021-01-27 07:02:36.712183

Pipeline ID: people/company_appointments/media/calcalist/calcalist

Appointment notices from TheMarker (themarker)
Succeeded

Name, job and company description.


Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 02:05:39.355480
Last Completion:
2021-03-04 02:05:44.855825
Last Success:
2021-03-04 02:05:44.855825

Pipeline ID: people/company_appointments/media/themarker/themarker

Join the parsed PDF to get start and end time for each person (correlate)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 06:35:56.704902
Last Completion:
2021-03-04 06:35:59.720329
Last Success:
2021-03-04 06:35:59.720329

Pipeline ID: people/company_appointments/state_owned/correlate

Parse and concatenate all PDF reports (parse_pdf_resources)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 03:53:13.303344
Last Completion:
2021-03-04 03:53:17.617456
Last Success:
2021-03-04 03:53:17.617456

Pipeline ID: people/company_appointments/state_owned/parse_pdf_resources

collect links to all pdf reports on https://mof.gov.il/GCA/Directors/Pages/DirectorsManningReport.aspx (reports)
Succeeded

columns: date, url


Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 01:09:47.207099
Last Completion:
2021-03-04 01:09:54.396758
Last Success:
2021-03-04 01:09:54.396758

Pipeline ID: people/company_appointments/state_owned/reports

people/company_appointments/state_owned/state-owned-nominations
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 07:10:28.924022
Last Completion:
2021-03-04 07:10:34.291796
Last Success:
2021-03-04 07:10:34.291796

Pipeline ID: people/company_appointments/state_owned/state-owned-nominations

people/municipal_appointments/municipal_representitives
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 06:54:41.821172
Last Completion:
2021-01-27 06:54:48.215585
Last Success:
2021-01-27 06:54:48.215585

Pipeline ID: people/municipal_appointments/municipal_representitives

people/political_candidates/election_candidates21
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 06:54:30.690244
Last Completion:
2021-01-27 06:55:11.193515
Last Success:
2021-01-27 06:55:11.193515

Pipeline ID: people/political_candidates/election_candidates21

people/political_donations/political_donations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 06:54:29.201834
Last Completion:
2021-01-27 06:54:57.068307
Last Success:
2021-01-27 06:54:57.068307

Pipeline ID: people/political_donations/political_donations

people/procurement/procurement-individuals
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 08:49:18.519731
Last Completion:
2021-03-04 08:58:11.893714
Last Success:
2021-03-04 08:58:11.893714

Pipeline ID: people/procurement/procurement-individuals

procurement/calls_for_bids/calls-for-bids-all
Failed

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 16:00:11.863102
Last Completion:
2021-03-04 16:06:52.667245
Last Success:
2021-03-03 16:04:19.536315

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
    self.datapackage = self.process_datapackage(self.datapackage)
  File "/usr/local/lib/python3.7/site-packages/dataflows/helpers/iterable_loader.py", line 112, in process_datapackage
    raise self.exc
  File "/usr/local/lib/python3.7/site-packages/dataflows/helpers/iterable_loader.py", line 60, in describe
    sample = list(itertools.islice(self.iterable, self.SAMPLE_SIZE))
  File "/usr/local/lib/python3.7/site-packages/dataflows/helpers/iterable_loader.py", line 89, in handle_iterable
    for x in self.iterable:
  File "/datapackage_pipelines_budgetkey/pipelines/procurement/calls_for_bids/class_action.py", line 36, in scrape
    if not link.startswith('http'):
AttributeError: 'NoneType' object has no attribute 'startswith'
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
    spew_flow(flow, ctx)
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
    datastream = flow.datastream()
  File "/usr/local/lib/python3.7/site-packages/dataflows/base/flow.py", line 18, in datastream
    return self._chain(ds)._process()
  File "/usr/local/lib/python3.7/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.7/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  File "/usr/local/lib/python3.7/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
    datastream = self.source._process()
  [Previous line repeated 1 more time]
  File "/usr/local/lib/python3.7/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
    self.raise_exception(exception)
  File "/usr/local/lib/python3.7/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
    raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor iterable_loader in position #1: 'NoneType' object has no attribute 'startswith'
DEBUG   :[chan 2] Max packet in: 32768 bytes
DEBUG   :[chan 2] Max packet out: 32768 bytes
DEBUG   :Secsh channel 2 opened.
DEBUG   :[chan 2] Sesch channel 2 request ok
DEBUG   :[chan 2] EOF received (2)
DEBUG   :[chan 2] EOF sent (2)
DEBUG   :Dropping user packet because connection is dead.

Pipeline ID: procurement/calls_for_bids/calls-for-bids-all

procurement/calls_for_bids/calls-for-bids-moh
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 01:39:51.056069
Last Completion:
2021-03-04 01:40:05.821587
Last Success:
2021-03-04 01:40:05.821587

Pipeline ID: procurement/calls_for_bids/calls-for-bids-moh

procurement/calls_for_bids/gov-publications
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-09 07:22:13.510287
Last Completion:
2021-02-09 07:35:29.385765
Last Success:
2021-02-09 07:35:29.385765

Pipeline ID: procurement/calls_for_bids/gov-publications

procurement/calls_for_bids/gov-publications-ministry-of-immigration
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 06:41:53.694579
Last Completion:
2021-01-27 06:42:01.591600
Last Success:
2021-01-27 06:42:01.591600

Pipeline ID: procurement/calls_for_bids/gov-publications-ministry-of-immigration

procurement/calls_for_bids/gov-publications2
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 06:41:53.691330
Last Completion:
2021-01-27 06:42:07.538577
Last Success:
2021-01-27 06:42:07.538577

Pipeline ID: procurement/calls_for_bids/gov-publications2

procurement/calls_for_bids/jobiz-all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 15:00:27.656423
Last Completion:
2021-03-04 15:00:30.971395
Last Success:
2021-03-04 15:00:30.971395

Pipeline ID: procurement/calls_for_bids/jobiz-all

procurement/calls_for_bids/jobiz-calls-for-bids
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 15:00:31.092556
Last Completion:
2021-03-04 15:00:33.480188
Last Success:
2021-03-04 15:00:33.480188

Pipeline ID: procurement/calls_for_bids/jobiz-calls-for-bids

procurement/calls_for_bids/jobiz-scraper
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 15:00:12.910687
Last Completion:
2021-03-04 15:00:27.519640
Last Success:
2021-03-04 15:00:27.519640

Pipeline ID: procurement/calls_for_bids/jobiz-scraper

התקשרויות רכש ממשלתיות (latest-contract-spending)
Succeeded

אנו סוכמים מידע מתוך הדוחות הרבעוניים לתוך טבלה המכילה את המידע העדכני ביותר.


Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 05:31:58.652143
Last Completion:
2021-03-04 08:01:13.728426
Last Success:
2021-03-04 08:01:13.728426

Pipeline ID: procurement/spending/latest-contract-spending

procurement/spending/quarterly-contract-spending-report-uris
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-03 23:00:06.445589
Last Completion:
2021-03-03 23:07:58.118149
Last Success:
2021-03-03 23:07:58.118149

Pipeline ID: procurement/spending/quarterly-contract-spending-report-uris

דוחות רבעוניים מתוך מרכבה, לפי נוהל היחידה לחופש המידע. (quarterly-contract-spending-reports)
Succeeded

כל משרדי הממשלה ויחידות הסמך (שמחוברות למערכת מרכבה) צריכים לפרסם אחת לרבעון (תוך 45 יום מסוף הרבעון) דו״ח התקשרויות לפי פורמט מוגדר היטב הממומש כדו״ח מובנה במערכת המרכבה. כל המשרדים מדווחים עצמאית והדו״חות עולים לאתר היחידה לחופש המידע, משם אנו אוספים אותם. התוצר של השרשר הזה הוא פירוט כל הדיווחים של כל המשרדים.


Last Run triggered by:
scheduled
Last Run started at:
2021-03-03 23:56:50.016080
Last Completion:
2021-03-04 00:05:49.603174
Last Success:
2021-03-04 00:05:49.603174

Pipeline ID: procurement/spending/quarterly-contract-spending-reports

procurement/spending/quarterly-contract-spending-reports-data
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 02:53:01.436115
Last Completion:
2021-03-04 03:20:41.948576
Last Success:
2021-03-04 03:20:41.948576

Pipeline ID: procurement/spending/quarterly-contract-spending-reports-data

procurement/spending/spending-by-entity
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 08:38:58.601007
Last Completion:
2021-03-04 08:52:11.624899
Last Success:
2021-03-04 08:52:11.624899

Pipeline ID: procurement/spending/spending-by-entity

Load all tenders data from data.gov.il to flat file (all)
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Missing dependency :Failed to find a dependency: ./procurement/tenders/scraper

Pipeline ID: procurement/tenders/all

procurement/tenders/processed
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Missing dependency :Failed to find a dependency: ./procurement/tenders/all

Pipeline ID: procurement/tenders/processed

reports/all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 07:10:34.395318
Last Completion:
2021-03-04 07:10:43.502636
Last Success:
2021-03-04 07:10:43.502636

Pipeline ID: reports/all

reports/ngos/ngo-activity-report
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 06:37:37.237828
Last Completion:
2021-03-04 06:40:16.035240
Last Success:
2021-03-04 06:40:16.035240

Pipeline ID: reports/ngos/ngo-activity-report

reports/ngos/ngo-district-report
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 06:35:59.747156
Last Completion:
2021-03-04 06:37:37.223437
Last Success:
2021-03-04 06:37:37.223437

Pipeline ID: reports/ngos/ngo-district-report

supports/all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 18:13:21.597458
Last Completion:
2021-03-04 18:20:35.439906
Last Success:
2021-03-04 18:20:35.439906

Pipeline ID: supports/all

supports/by-payment-year
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 03:36:20.849380
Last Completion:
2021-03-04 03:51:27.135122
Last Success:
2021-03-04 03:51:27.135122

Pipeline ID: supports/by-payment-year

supports/by-request-year
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 03:36:23.710631
Last Completion:
2021-03-04 03:52:30.530290
Last Success:
2021-03-04 03:52:30.530290

Pipeline ID: supports/by-request-year

supports/criteria/support-criteria
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 03:51:27.896338
Last Completion:
2021-03-04 03:51:35.204139
Last Success:
2021-03-04 03:51:35.204139

Pipeline ID: supports/criteria/support-criteria

supports/criteria/support-criteria-doj
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 01:09:34.011331
Last Completion:
2021-03-04 01:09:46.453983
Last Success:
2021-03-04 01:09:46.453983

Pipeline ID: supports/criteria/support-criteria-doj

supports/supports-2004
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-14 06:35:35.709262
Last Completion:
2021-02-14 06:54:40.521850
Last Success:
2021-02-14 06:54:40.521850

Pipeline ID: supports/supports-2004

supports/supports-2005
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-14 06:35:35.893518
Last Completion:
2021-02-14 06:54:44.507357
Last Success:
2021-02-14 06:54:44.507357

Pipeline ID: supports/supports-2005

supports/supports-2006
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-14 09:42:00.489312
Last Completion:
2021-02-14 09:48:46.967568
Last Success:
2021-02-14 09:48:46.967568

Pipeline ID: supports/supports-2006

supports/supports-2007
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-14 09:42:10.695837
Last Completion:
2021-02-14 09:57:52.112324
Last Success:
2021-02-14 09:57:52.112324

Pipeline ID: supports/supports-2007

supports/supports-2008
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-14 09:42:15.931719
Last Completion:
2021-02-14 09:53:53.644962
Last Success:
2021-02-14 09:53:53.644962

Pipeline ID: supports/supports-2008

supports/supports-2009
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-14 09:48:46.980107
Last Completion:
2021-02-14 10:05:07.608859
Last Success:
2021-02-14 10:05:07.608859

Pipeline ID: supports/supports-2009

supports/supports-2010
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-14 09:53:53.655913
Last Completion:
2021-02-14 10:02:54.369901
Last Success:
2021-02-14 10:02:54.369901

Pipeline ID: supports/supports-2010

supports/supports-2011
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-14 09:57:52.124692
Last Completion:
2021-02-14 10:13:43.967747
Last Success:
2021-02-14 10:13:43.967747

Pipeline ID: supports/supports-2011

supports/supports-2012
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-14 10:02:54.380671
Last Completion:
2021-02-14 10:13:41.587789
Last Success:
2021-02-14 10:13:41.587789

Pipeline ID: supports/supports-2012

supports/supports-2013
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-03-01 09:37:12.409042
Last Completion:
2021-03-01 09:49:59.347346
Last Success:
2021-03-01 09:49:59.347346

Pipeline ID: supports/supports-2013

supports/supports-2014
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-21 20:39:27.814289
Last Completion:
2021-02-21 20:51:40.176238
Last Success:
2021-02-21 20:51:40.176238

Pipeline ID: supports/supports-2014

supports/supports-2015
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-14 10:13:41.599566
Last Completion:
2021-02-14 10:29:22.788727
Last Success:
2021-02-14 10:29:22.788727

Pipeline ID: supports/supports-2015

supports/supports-2016
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-14 06:50:07.236185
Last Completion:
2021-02-14 07:09:35.013304
Last Success:
2021-02-14 07:09:35.013304

Pipeline ID: supports/supports-2016

supports/supports-2017
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-03-01 09:45:13.896591
Last Completion:
2021-03-01 09:58:35.291853
Last Success:
2021-03-01 09:58:35.291853

Pipeline ID: supports/supports-2017

supports/supports-2018
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-03-04 15:00:10.519671
Last Completion:
2021-03-04 15:11:08.131191
Last Success:
2021-03-04 15:11:08.131191

Pipeline ID: supports/supports-2018

supports/supports-2019
Succeeded