activities/all
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-04-08 11:18:26.013356
Last Completion:
2021-04-08 11:18:31.132990
Last Success:
2021-04-08 11:18:31.132990

Pipeline ID: activities/all

activities/social_services/historic_data
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-04-08 11:17:57.928216
Last Completion:
2021-04-08 11:18:24.197531
Last Success:
2021-04-08 11:18:24.197531

Pipeline ID: activities/social_services/historic_data

bank_of_israel/bank_of_israel
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 07:15:29.804876
Last Completion:
2021-01-27 07:20:03.518586
Last Success:
2021-01-27 07:20:03.518586

Pipeline ID: bank_of_israel/bank_of_israel

budget/national/changes/explanations/all
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-04-10 07:10:31.193635
Last Completion:
2021-04-10 11:36:54.820930
Last Success:
None

explanation_fetcher
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/budget/national/changes/explanations/explanation_fetcher.py", line 64, in <module>
    spew(dp, itertools.chain(res_iter, [get_explanations(parameters['url'])]))
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/budget/national/changes/explanations/explanation_fetcher.py", line 32, in get_explanations
    archive = gcl.download(url)
  File "/datapackage_pipelines_budgetkey/common/google_chrome.py", line 111, in download
    self.driver.get(url)
  File "/usr/local/lib/python3.7/site-packages/selenium/webdriver/remote/webdriver.py", line 333, in get
    self.execute(Command.GET, {'url': url})
  File "/usr/local/lib/python3.7/site-packages/selenium/webdriver/remote/webdriver.py", line 321, in execute
    self.error_handler.check_response(response)
  File "/usr/local/lib/python3.7/site-packages/selenium/webdriver/remote/errorhandler.py", line 242, in check_response
    raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.WebDriverException: Message: chrome not reachable
  (Session info: chrome=88.0.4324.96)
DEBUG   :[chan 482] Max packet in: 32768 bytes
DEBUG   :[chan 482] Max packet out: 32768 bytes
DEBUG   :Secsh channel 482 opened.
DEBUG   :[chan 482] Sesch channel 482 request ok
DEBUG   :[chan 482] EOF received (482)
DEBUG   :[chan 482] EOF sent (482)
DEBUG   :Dropping user packet because connection is dead.

Pipeline ID: budget/national/changes/explanations/all

budget/national/changes/original/current-year-fixes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-09 02:38:21.523888
Last Completion:
2021-04-09 02:39:01.431489
Last Success:
2021-04-09 02:39:01.431489

Pipeline ID: budget/national/changes/original/current-year-fixes

budget/national/changes/original/national-budget-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-09 00:55:46.598884
Last Completion:
2021-04-09 00:58:23.814455
Last Success:
2021-04-09 00:58:23.814455

Pipeline ID: budget/national/changes/original/national-budget-changes

Changes, grouped by transaction_id, with explanations (national-budget-changes-aggregated)
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./budget/national/changes/explanations/all" is successfully executed

Pipeline ID: budget/national/changes/processed/national-budget-changes-aggregated

budget/national/changes/processed/transactions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-09 02:39:01.720174
Last Completion:
2021-04-09 11:15:50.330360
Last Success:
2021-04-09 11:15:50.330360

Pipeline ID: budget/national/changes/processed/transactions

National Yearly Budgets (national-budgets)
Succeeded

We get the data the Ministry of Finance publishes in data.gov.il every year. It comes in XLS format, with one row per TAKANA and phase (original, approved, executed). In this pipeline we create from each triplet a single row that has all the data.


Last Run triggered by:
manual
Last Run started at:
2021-02-11 11:30:59.021871
Last Completion:
2021-02-11 13:23:27.126360
Last Success:
2021-02-11 13:23:27.126360

Pipeline ID: budget/national/original/national-budgets

National Yearly Budgets - Processed (aggregated-yearly)
Succeeded

This pipeline joins the different phases of the budget (allocated, revised and executed). In the original file there's a separate row for each of the phases. We like it better as a single row with all phase info. Another thing this pipeline does is to rename the column titles - to more friendly English names. Also, it create rows for all hierarchies - where upper hierarchies (2, 4 & 6 digits) are plain aggregations of the 8-digit items they contain.


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-12 15:46:11.498646
Last Completion:
2021-02-12 17:30:10.408804
Last Success:
2021-02-12 17:30:10.408804

Pipeline ID: budget/national/processed/aggregated-yearly

budget/national/processed/category-explanations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 06:54:17.996534
Last Completion:
2021-01-27 06:54:19.159029
Last Success:
2021-01-27 06:54:19.159029

Pipeline ID: budget/national/processed/category-explanations

National Yearly Budgets - Joined with category-explanations (connected-items-explained)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-update
Last Run started at:
2021-02-12 18:09:03.592044
Last Completion:
2021-02-12 18:11:51.305074
Last Success:
2021-02-12 18:11:51.305074

Pipeline ID: budget/national/processed/connected-items-explained

National Yearly Budgets - Connected Items (connected-national-budgets)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-12 17:47:58.246916
Last Completion:
2021-02-12 18:09:00.103959
Last Success:
2021-02-12 18:09:00.103959

Pipeline ID: budget/national/processed/connected-national-budgets

National Yearly Budgets - Just the total (item 00) (just-the-total)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-12 17:47:56.248465
Last Completion:
2021-02-12 17:56:34.897333
Last Success:
2021-02-12 17:56:34.897333

Pipeline ID: budget/national/processed/just-the-total

National Yearly Budgets - Main Item Names (roof-names)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-12 17:47:56.255357
Last Completion:
2021-02-12 17:56:29.915753
Last Success:
2021-02-12 17:56:29.915753

Pipeline ID: budget/national/processed/roof-names

National Yearly Budgets - With Extras (with-extras)
Succeeded

This pipeline joins the budget data to itself so that each item has a list of its immediate children.


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-12 17:30:11.430173
Last Completion:
2021-02-12 17:47:55.459699
Last Success:
2021-02-12 17:47:55.459699

Pipeline ID: budget/national/processed/with-extras

budgetkey/analysis/spending/publisher_entity_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-10 10:16:34.106004
Last Completion:
2021-04-10 11:08:51.025365
Last Success:
2021-04-10 11:08:51.025365

Pipeline ID: budgetkey/analysis/spending/publisher_entity_analysis

budgetkey/analysis/spending/publisher_foa_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-10 10:16:34.114710
Last Completion:
2021-04-10 10:24:18.813045
Last Success:
2021-04-10 10:24:18.813045

Pipeline ID: budgetkey/analysis/spending/publisher_foa_analysis

budgetkey/analysis/spending/united
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-10 10:00:03.222177
Last Completion:
2021-04-10 10:16:33.935204
Last Success:
2021-04-10 10:16:33.935204

Pipeline ID: budgetkey/analysis/spending/united

Main Page - Aggregated budget by functional classification (budget-functional-aggregates)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-12 17:30:13.822566
Last Completion:
2021-02-12 17:35:31.498952
Last Success:
2021-02-12 17:35:31.498952

Pipeline ID: budgetkey/budget-functional-aggregates

budgetkey/documents
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-12 17:35:33.440667
Last Completion:
2021-02-12 17:35:35.132982
Last Success:
2021-02-12 17:35:35.132982

Pipeline ID: budgetkey/documents

budgetkey/elasticsearch/index_activities
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-09 01:59:15.407440
Last Completion:
2021-04-09 01:59:38.192347
Last Success:
2021-04-09 01:59:38.192347

Pipeline ID: budgetkey/elasticsearch/index_activities

budgetkey/elasticsearch/index_budget
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-09 01:58:54.216898
Last Completion:
2021-04-09 02:33:51.823878
Last Success:
2021-04-09 02:33:51.823878

Pipeline ID: budgetkey/elasticsearch/index_budget

budgetkey/elasticsearch/index_calls_for_bids
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-10 16:02:29.505048
Last Completion:
2021-04-10 16:02:41.665025
Last Success:
2021-04-10 16:02:41.665025

Pipeline ID: budgetkey/elasticsearch/index_calls_for_bids

budgetkey/elasticsearch/index_contract_spending
Running

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-11 06:56:20.604253
Last Completion:
Last Success:
2021-04-11 02:24:04.517105

Pipeline ID: budgetkey/elasticsearch/index_contract_spending

budgetkey/elasticsearch/index_entities
Running

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-11 07:32:44.309488
Last Completion:
Last Success:
2021-04-11 06:38:11.674228

Pipeline ID: budgetkey/elasticsearch/index_entities

budgetkey/elasticsearch/index_gov_decisions
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./government_decisions/government_decisions
From ./government_decisions/government_decisions :['Dependency unsuccessful', 'Cannot run until dependency "./government_decisions/scraper" is successfully executed']

Pipeline ID: budgetkey/elasticsearch/index_gov_decisions

budgetkey/elasticsearch/index_national_budget_changes
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./budget/national/changes/processed/national-budget-changes-aggregated
From ./budget/national/changes/processed/national-budget-changes-aggregated :['Dependency unsuccessful', 'Cannot run until dependency "./budget/national/changes/explanations/all" is successfully executed']

Pipeline ID: budgetkey/elasticsearch/index_national_budget_changes

budgetkey/elasticsearch/index_people
Running

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-11 07:50:25.886443
Last Completion:
Last Success:
2021-04-11 05:10:39.300271

Pipeline ID: budgetkey/elasticsearch/index_people

budgetkey/elasticsearch/index_reports
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-11 03:45:00.012787
Last Completion:
2021-04-11 03:45:55.404949
Last Success:
2021-04-11 03:45:55.404949

Pipeline ID: budgetkey/elasticsearch/index_reports

budgetkey/elasticsearch/index_support_criteria
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 03:01:10.872146
Last Completion:
2021-04-11 03:01:19.417348
Last Success:
2021-04-11 03:01:19.417348

Pipeline ID: budgetkey/elasticsearch/index_support_criteria

budgetkey/elasticsearch/index_supports
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 03:01:19.448239
Last Completion:
2021-04-11 03:25:17.529935
Last Success:
2021-04-11 03:25:17.529935

Pipeline ID: budgetkey/elasticsearch/index_supports

budgetkey/elasticsearch/index_tenders
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-09 00:00:09.908930
Last Completion:
2021-04-09 00:47:28.345254
Last Success:
2021-04-09 00:47:28.345254

Pipeline ID: budgetkey/elasticsearch/index_tenders

budgetkey/elasticsearch/sitemaps
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./budgetkey/elasticsearch/index_national_budget_changes
From ./budgetkey/elasticsearch/index_national_budget_changes :['Invalid dependency', 'Cannot run until dependency passes validation: ./budget/national/changes/processed/national-budget-changes-aggregated']
From ./budgetkey/elasticsearch/index_national_budget_changes :['From ./budget/national/changes/processed/national-budget-changes-aggregated', ['Dependency unsuccessful', 'Cannot run until dependency "./budget/national/changes/explanations/all" is successfully executed']]
Invalid dependency :Cannot run until dependency passes validation: ./budgetkey/elasticsearch/index_gov_decisions
From ./budgetkey/elasticsearch/index_gov_decisions :['Invalid dependency', 'Cannot run until dependency passes validation: ./government_decisions/government_decisions']
From ./budgetkey/elasticsearch/index_gov_decisions :['From ./government_decisions/government_decisions', ['Dependency unsuccessful', 'Cannot run until dependency "./government_decisions/scraper" is successfully executed']]

Pipeline ID: budgetkey/elasticsearch/sitemaps

Send periodic emails (1) (emails)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-04-10 07:23:47.476157
Last Completion:
2021-04-10 11:26:42.653692
Last Success:
2021-04-10 11:26:42.653692

Pipeline ID: budgetkey/emails/emails

donations/candidates
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 08:30:27.276695
Last Completion:
2021-01-27 08:30:36.015585
Last Success:
2021-01-27 08:30:36.015585

Pipeline ID: donations/candidates

donations/parties
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 06:54:19.213742
Last Completion:
2021-01-27 06:54:30.615402
Last Success:
2021-01-27 06:54:30.615402

Pipeline ID: donations/parties

donations/transactions
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-04-10 07:10:31.298639
Last Completion:
2021-04-10 07:10:47.917294
Last Success:
None

dump.to_path
ERROR   :Failed to transform row {'CandidateName': 'בוארון אביחי', 'City': 'עופרה', 'Country': 'ישראל', 'GD_Date': '/Date(1423432800000)/', 'GD_Name': 'אביחי בוארון תרומה עצמית', 'GD_Sum': '130000.00', 'GuaranteeOrDonation': 'תרומה', 'ID': None, 'IsControl': False, 'IsDeficitCoverage': 'לא', 'IsUpdate': False, 'Party': 'הבית היהודי, מיסודה של המפד"ל – המפלגה הדתית לאומית המזרחי הפועל המזרחי בארץ ישראל', 'PublisherTypeID': 2, 'State': 0, 'SumInCurrency': '0.00', 'URL': None}
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/file_formats.py", line 31, in __transform_row
    for k, v in row.items())
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/file_formats.py", line 31, in <genexpr>
    for k, v in row.items())
KeyError: 'IsDeficitCoverage'
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/dump/to_path.py", line 37, in <module>
    PathDumper()()
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/dumper_base.py", line 53, in __call__
    finalizer=self.finalize
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/dumper_base.py", line 128, in row_counter
    for row in resource:
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/dumper_base.py", line 258, in rows_processor
    file_formatter.write_row(writer, row, fields)
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/file_formats.py", line 44, in write_row
    transformed_row = self.__transform_row(row, fields)
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/file_formats.py", line 31, in __transform_row
    for k, v in row.items())
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/file_formats.py", line 31, in <genexpr>
    for k, v in row.items())
KeyError: 'IsDeficitCoverage'

Pipeline ID: donations/transactions

education/tochniyot/tochniyot
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-14 07:05:26.894900
Last Completion:
2021-02-14 07:05:59.491425
Last Success:
2021-02-14 07:05:59.491425

Pipeline ID: education/tochniyot/tochniyot

entities/all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 03:30:56.721736
Last Completion:
2021-04-11 04:06:34.308912
Last Success:
2021-04-11 04:06:34.308912

Pipeline ID: entities/all

entities/associations/guidestar/guidestar
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 02:17:28.591172
Last Completion:
2021-04-11 02:25:06.423443
Last Success:
2021-04-11 02:25:06.423443

Pipeline ID: entities/associations/guidestar/guidestar

entities/associations/guidestar/guidestar-scraper
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 00:27:06.107480
Last Completion:
2021-04-11 00:29:39.717025
Last Success:
2021-04-11 00:29:39.717025

Pipeline ID: entities/associations/guidestar/guidestar-scraper

עמותות פעילות מרשם העמותות (registry)
Succeeded

רשימת כלל העמותות הפעילות, מתעדכן שבועית.


Last Run triggered by:
scheduled
Last Run started at:
2021-01-31 15:15:05.322236
Last Completion:
2021-01-31 15:15:47.074895
Last Success:
2021-01-31 15:15:47.074895

Pipeline ID: entities/associations/registrar/registry

entities/companies/registrar/details
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 01:39:19.210200
Last Completion:
2021-04-11 01:48:28.815715
Last Success:
2021-04-11 01:48:28.815715

Pipeline ID: entities/companies/registrar/details

חברות פעילות מרשם החברות (scraper)
Succeeded

רשימת כלל החברות הפעילות, מתעדכן שבועית.


Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 00:00:44.599601
Last Completion:
2021-04-11 00:16:58.018799
Last Success:
2021-04-11 00:16:58.018799

Pipeline ID: entities/companies/registrar/scraper

רשימת אגודות שיתופיות (cooperatives)
Succeeded

רשימת אגודות שיתופיות, מתוך ממשק נתונים של מאגר של משרד הכלכלה / האגף לאיגוד שיתופי, מתעדכן שבועית


Last Run triggered by:
scheduled
Last Run started at:
2021-01-31 00:21:34.196879
Last Completion:
2021-01-31 01:20:27.934359
Last Success:
2021-01-31 01:20:27.934359

Pipeline ID: entities/cooperatives/cooperatives

entities/entities
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-11 07:10:31.921371
Last Completion:
2021-04-11 07:32:43.915628
Last Success:
2021-04-11 07:32:43.915628

Pipeline ID: entities/entities

entities/fingerprints
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 04:06:34.827300
Last Completion:
2021-04-11 06:06:45.407410
Last Success:
2021-04-11 06:06:45.407410

Pipeline ID: entities/fingerprints

entities/foi_orgs/foi_orgs
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 06:55:16.101269
Last Completion:
2021-01-27 06:55:54.018618
Last Success:
2021-01-27 06:55:54.018618

Pipeline ID: entities/foi_orgs/foi_orgs

entities/moital/moital_service_providers
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 07:04:33.004134
Last Completion:
2021-01-27 07:11:30.001751
Last Success:
2021-01-27 07:11:30.001751

Pipeline ID: entities/moital/moital_service_providers

רשימת אגודות עותומניות (ottoman-association-registry)
Succeeded

רשימת אגודות עותומניות, מתוך תשובה לבקשת חופש מידע


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-01 07:22:14.166182
Last Completion:
2021-02-01 07:23:31.140076
Last Success:
2021-02-01 07:23:31.140076

Pipeline ID: entities/ottoman/ottoman-association-registry

entities/safety-orders/safety-orders
Failed

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 00:00:14.614418
Last Completion:
2021-04-11 00:00:44.538069
Last Success:
None

stream_remote_resources
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/tabulator/loaders/remote.py", line 63, in load
    bytes = _RemoteStream(source, self.__http_session, self.__http_timeout).open()
  File "/usr/local/lib/python3.7/site-packages/tabulator/loaders/remote.py", line 121, in open
    self.seek(0)
  File "/usr/local/lib/python3.7/site-packages/tabulator/loaders/remote.py", line 143, in seek
    self.__response.raise_for_status()
  File "/usr/local/lib/python3.7/site-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.gov.il/he/error
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 243, in <module>
    resource.pop('http_headers', None))
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 197, in stream_reader
    schema, headers, columns, stream, close = get_opener(url, _resource)()
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 173, in opener
    _stream.open()
  File "/usr/local/lib/python3.7/site-packages/tabulator/stream.py", line 423, in open
    self.__parser.open(source, encoding=self.__encoding)
  File "/usr/local/lib/python3.7/site-packages/tabulator/parsers/xlsx.py", line 81, in open
    source_bytes = self.__loader.load(source, mode="b", encoding=encoding)
  File "/usr/local/lib/python3.7/site-packages/tabulator/loaders/remote.py", line 72, in load
    raise exceptions.HTTPError(str(exception))
tabulator.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.gov.il/he/error

Pipeline ID: entities/safety-orders/safety-orders

entities/safety-orders/safety-orders-by-entity
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./entities/safety-orders/safety-orders" is successfully executed

Pipeline ID: entities/safety-orders/safety-orders-by-entity

entities/special/registry
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 00:04:33.312127
Last Completion:
2021-04-11 00:27:03.022269
Last Success:
2021-04-11 00:27:03.022269

Pipeline ID: entities/special/registry

ezvonot/ezvonot_accounts
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 01:46:35.192440
Last Completion:
2021-04-11 01:47:50.804400
Last Success:
2021-04-11 01:47:50.804400

Pipeline ID: ezvonot/ezvonot_accounts

ezvonot/ezvonot_cases
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 01:47:50.896055
Last Completion:
2021-04-11 01:48:25.191741
Last Success:
2021-04-11 01:48:25.191741

Pipeline ID: ezvonot/ezvonot_cases

ezvonot/ezvonot_crontab
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 00:18:37.843702
Last Completion:
2021-04-11 00:18:39.142612
Last Success:
2021-04-11 00:18:39.142612

Pipeline ID: ezvonot/ezvonot_crontab

ezvonot/ezvonot_decisions
Failed

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 01:48:28.893408
Last Completion:
2021-04-11 01:48:35.991516
Last Success:
None

data_gov_il_resource
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/processors/data_gov_il_resource.py", line 59, in <module>
    spew_flow(flow(ctx.parameters), ctx)
  File "/datapackage_pipelines_budgetkey/processors/data_gov_il_resource.py", line 40, in flow
    url, path = get_resource(gcd, dataset_name, resource_name)
  File "/datapackage_pipelines_budgetkey/common/data_gov_il.py", line 101, in get_resource
    assert False, 'Failed to find resource for name %s: possibilities are %r' % (resource_name, [r['name'] for r in dataset['resources']])
AssertionError: Failed to find resource for name קובץ החלטות וועדה : possibilities are ['קובץ הפקדות', 'קובץ חשבונות המרכיבים את החלטות הועדה', 'קובץ תיקים', 'קובץ ייעודים', 'קובץ החלטות וועדה ', 'הוראות לפתיחת קובץ מאגר באמצעות תוכנת excel']

Pipeline ID: ezvonot/ezvonot_decisions

ezvonot/ezvonot_decisions_join
Invalid

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-02-22 02:38:33.389731
Last Completion:
2021-02-22 02:39:02.384578
Last Success:
2021-02-22 02:39:02.384578

Dependency unsuccessful :Cannot run until dependency "./ezvonot/ezvonot_decisions" is successfully executed

Pipeline ID: ezvonot/ezvonot_decisions_join

ezvonot/ezvonot_deposits
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 01:45:10.716684
Last Completion:
2021-04-11 01:46:35.106679
Last Success:
2021-04-11 01:46:35.106679

Pipeline ID: ezvonot/ezvonot_deposits

ezvonot/ezvonot_purposes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 01:48:25.221836
Last Completion:
2021-04-11 01:48:56.021611
Last Success:
2021-04-11 01:48:56.021611

Pipeline ID: ezvonot/ezvonot_purposes

government_decisions/government_decisions
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./government_decisions/scraper" is successfully executed

Pipeline ID: government_decisions/government_decisions

government_decisions/scraper
Failed

Last Run triggered by:
scheduled
Last Run started at:
2021-04-10 12:00:02.905557
Last Completion:
2021-04-10 12:00:42.749063
Last Success:
None

scraper
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/government_decisions/scraper.py", line 122, in <module>
    spew(datapackage, chain(res_iter, [get_decision_list()]))
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/government_decisions/scraper.py", line 85, in get_decision_list
    results = response['results']
KeyError: 'results'

Pipeline ID: government_decisions/scraper

lamas/municipal-data
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 01:48:47.105453
Last Completion:
2021-04-11 01:49:48.818745
Last Success:
2021-04-11 01:49:48.818745

Pipeline ID: lamas/municipal-data

קובץ התאמת רשויות אזוריות לישובים בשטחן (municipality-to-city)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 06:52:09.494326
Last Completion:
2021-01-27 06:52:12.978137
Last Success:
2021-01-27 06:52:12.978137

Pipeline ID: lamas/municipality-to-city

maya/maya-bonds-and-options-holdings-changes
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-11 05:19:07.903978
Last Completion:
2021-04-11 05:32:23.890908
Last Success:
2021-04-11 05:32:23.890908

Pipeline ID: maya/maya-bonds-and-options-holdings-changes

maya/maya-company-officer-list
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-11 05:19:07.875463
Last Completion:
2021-04-11 05:34:21.620079
Last Success:
2021-04-11 05:34:21.620079

Pipeline ID: maya/maya-company-officer-list

maya/maya-company-stakeholder-list
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-11 05:32:23.899913
Last Completion:
2021-04-11 06:04:00.009920
Last Success:
2021-04-11 06:04:00.009920

Pipeline ID: maya/maya-company-stakeholder-list

maya/maya-company-vip-appointments
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-11 05:19:07.892705
Last Completion:
2021-04-11 05:32:18.212280
Last Success:
2021-04-11 05:32:18.212280

Pipeline ID: maya/maya-company-vip-appointments

maya/maya-complete-notification-list
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-11 04:12:05.022907
Last Completion:
2021-04-11 05:19:07.692604
Last Success:
2021-04-11 05:19:07.692604

Pipeline ID: maya/maya-complete-notification-list

maya/maya-holdings-changes
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-11 05:32:18.221489
Last Completion:
2021-04-11 05:48:16.612943
Last Success:
2021-04-11 05:48:16.612943

Pipeline ID: maya/maya-holdings-changes

maya/maya-notification-parse-updates
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 02:17:56.221669
Last Completion:
2021-04-11 04:12:01.095686
Last Success:
2021-04-11 04:12:01.095686

Pipeline ID: maya/maya-notification-parse-updates

maya/maya-reported-academic-degrees
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-11 05:34:21.692517
Last Completion:
2021-04-11 05:49:14.119905
Last Success:
2021-04-11 05:49:14.119905

Pipeline ID: maya/maya-reported-academic-degrees

maya/maya-reported-work-record
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-11 05:48:16.621792
Last Completion:
2021-04-11 05:59:37.316550
Last Success:
2021-04-11 05:59:37.316550

Pipeline ID: maya/maya-reported-work-record

maya/maya-tase-companies-current-management
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-11 05:59:37.325229
Last Completion:
2021-04-11 06:47:00.896118
Last Success:
2021-04-11 06:47:00.896118

Pipeline ID: maya/maya-tase-companies-current-management

maya/maya-tase-companies-current-shareholders
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-11 05:49:14.193451
Last Completion:
2021-04-11 06:38:27.640980
Last Success:
2021-04-11 06:38:27.640980

Pipeline ID: maya/maya-tase-companies-current-shareholders

maya/scrape-maya-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 00:18:52.555051
Last Completion:
2021-04-11 00:46:27.890935
Last Success:
2021-04-11 00:46:27.890935

Pipeline ID: maya/scrape-maya-notification-list

maya/scrape-maya-tase-companies
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 00:17:06.927531
Last Completion:
2021-04-11 00:18:37.836168
Last Success:
2021-04-11 00:18:37.836168

Pipeline ID: maya/scrape-maya-tase-companies

people/aggregated
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-11 07:30:03.980013
Last Completion:
2021-04-11 07:50:25.603799
Last Success:
2021-04-11 07:50:25.603799

Pipeline ID: people/aggregated

people/all
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-11 07:10:16.031453
Last Completion:
2021-04-11 07:12:11.903737
Last Success:
2021-04-11 07:12:11.903737

Pipeline ID: people/all

people/association_founders/association-founders
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-11 03:29:49.320482
Last Completion:
2021-04-11 03:30:56.608534
Last Success:
2021-04-11 03:30:56.608534

Pipeline ID: people/association_founders/association-founders

people/company_appointments/all-appointments
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 03:49:33.424675
Last Completion:
2021-04-11 03:52:12.621464
Last Success:
2021-04-11 03:52:12.621464

Pipeline ID: people/company_appointments/all-appointments

people/company_appointments/maya/collect-maya-forms-debug-stats
Failed

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 02:54:11.431082
Last Completion:
2021-04-11 02:54:14.718527
Last Success:
None

dump_to_path
ERROR   :Traceback (most recent call last):
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/base/schema_validator.py", line 73, in schema_validator
ERROR   :row[field.name] = field.cast_value(row.get(field.name))
ERROR   :File "/usr/local/lib/python3.7/site-packages/tableschema/field.py", line 170, in cast_value
ERROR   :).format(field=self, value=value))
ERROR   :datapackage.exceptions
ERROR   :.
ERROR   :CastError
ERROR   ::
ERROR   :Field "HeaderProofValue_equals_HeaderProof" can't cast value "True" for type "number" with format "default"
ERROR   :During handling of the above exception, another exception occurred:
ERROR   :Traceback (most recent call last):
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/dump_to_path.py", line 23, in <module>
ERROR   :spew_flow(flow(ctx.parameters, ctx.stats), ctx)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
ERROR   :spew(self.datapackage, self.resource_iterator, stats=self.stats)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
ERROR   :for rec in res:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/processors/dumpers/dumper_base.py", line 69, in row_counter
ERROR   :for row in iterator:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/processors/dumpers/file_dumper.py", line 78, in rows_processor
ERROR   :for row in resource:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/base/schema_validator.py", line 75, in schema_validator
ERROR   :if not on_error(resource['name'], row, i, e, field):
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/base/schema_validator.py", line 49, in func
ERROR   :return on_error(res_name, row, i, e)
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/base/schema_validator.py", line 24, in raise_exception
ERROR   :raise ValidationError(res_name, row, i, e)
ERROR   :dataflows.base.schema_validator
ERROR   :.
ERROR   :ValidationError
ERROR   ::
ERROR   :ROW: {'HeaderEntityNameEB': Decimal('1'), 'HeaderFixtReport': 0, 'HeaderProof': Decimal('1'), 'HeaderProofFormat': 0, 'HeaderProofValue': Decimal('1'), 'HeaderProofValue_equals_HeaderProof': True, 'alias_stats': [{'FormSubject': '_________'}, {'KodSugYeshut': '1'}, {'ShemYeshutIvrit': 'מת"ב - מערכות תקשורת בכבלים בע"מ'}, {'MisparTofes': 'ת091'}, {'ShemYeshutLoazit': 'MATAV CABLE SYSTEMS MEDIA LTD'}, {'PumbiLoPumbi': 'פומבי'}, {'MezahehHotem': '5086'}, {'': 'מספר ברשם:'}, {'HeaderMisparBaRasham': '520040072'}, {'NeyarotErechReshumim': 'ניירות ערך של התאגיד רשומים למסחר בבורסה בתל-אביב'}, {'MezahehYeshut': '478'}, {'': 'שם מקוצר:'}, {'HeaderSemelBursa': 'מתב'}, {'MezahehTofes': '65'}, {'': 'רחוב:'}, {'HeaderRehov': 'בית ספרד, יורופארק, יקום'}, {'HeaderMisparBait': '1'}, {'HeaderYeshuv': 'יקום'}, {'HeaderMikud': '60972'}, {'HeaderPhone': 'טלפון:'}, {'HeaderTelephone1': '077-7077031'}, {'HeaderTelephone2': '077-7077037'}, {'': 'פקס:'}, {'HeaderFax1': '077-7078230'}, {'': 'דואר אלקטרוני:'}, {'HeaderDoarElectroniMedaveach': '[email protected]'}, {'HeaderSendDate': 'תאריך שידור:'}, {'HeaderSendTime': 'שעת שידור:'}, {'ShaaShidur': '19:06:46'}, {'': 'אתר החברה:'}, {'CompanyUrl': 'www.hot.co.il'}, {'': 'אסמכתא:'}, {'': 'לכבוד'}, {'': 'לכבוד'}, {'': 'רשות ניירות ערך'}, {'': 'הבורסה לניירות ערך בת"א בע"מ'}, {'DoarElectroniRashut': 'www.isa.gov.il'}, {'DoarElectroniBursa': 'www.tase.co.il'}, {'Hanadon': 'דוח מיידי על מינוי נושא משרה בכירה (למעט מינוי דירקטור ולמעט יחיד שמונה מטעם תאגיד שהוא דירקטור)'}, {'': 'תקנה 34 (ב) לתקנות ניירות ערך (דוחות תקופתיים ומיידיים), תש"ל - 1970'}, {'': 'הסבר: אם ממונה גם כדירקטור יש למלא טופס ת093 בלבד'}, {'': 'הסבר: בהתאם לתקנה 34 (ד) לתקנות ניירות ערך (דוחות תקופתיים ומיידים) תש"ל - 1970, יש להגיש במקביל להגשת טופס זה מצבת נושאי משרה בכירה במסגרת טופס ת097'}, {'': '1.'}, {'': 'שם משפחה ושם פרטי:'}, {'Shem': 'ברגמן דלי'}, {'': 'סוג מספר זיהוי:'}, {'SugMisparZihuy': 'מספר ת.ז.'}, {'': 'מספר זיהוי:'}, {'MisparZihuy': '027732304'}, {'': 'אזרחות/ ארץ התאגדות או רישום:'}, {'Ezrachut': 'אדם פרטי עם אזרחות ישראלית'}, {'': 'ארץ אזרחות / התאגדות או רישום:'}, {'EretzEzrachut': '_________'}, {'': '2.'}, {'': 'תאריך לידה:'}, {'TaarichLeida': '27/06/1970'}, {'': '3.'}, {'': 'מען להמצאת כתבי בית דין:'}, {'MaanLeHimatzutKitveyBeitDyn': 'בית ספרד, יורופארק, אזור תעשיה קיבוץ יקום'}, {'': '4.'}, {'': 'תאריך תחילת הכהונה:'}, {'TaarichTchilatHaKehuna': '01/01/2007'}, {'': '5.'}, {'': 'התפקיד לו מונה:'}, {'HaTafkidLoMuna': 'חשב'}, {'TeurHaTafkidLoMuna': '_________'}, {'': '6.'}, {'': 'תפקיד קודם בחברה טרם המינוי:'}, {'TafkidKodem': 'אין'}, {'TafkidKodemAher': '_________'}, {'': '7.'}, {'': 'השכלה אקדמית:'}, {'': 'תואר'}, {'': 'תחום'}, {'': 'שם המוסד האקדמי'}, {'Toar': 'בוגר'}, {'Tchum': 'חשבונאות וכלכלה'}, {'ShemHaMosadHaAcademi': 'אוניברסיטת תל- אביב'}, {'Toar': 'מוסמך'}, {'Tchum': 'מנהל עסקים'}, {'ShemHaMosadHaAcademi': 'אוניברסיטת תל- אביב'}, {'': 'השכלה אחרת ותעודות מקצועיות:'}, {'HaskalaAcheret': 'תעודת חשבות שכר'}, {'': '8.'}, {'': 'עיסוקים עיקריים ב – 5 השנים האחרונות:'}, {'': 'התפקיד שמילא'}, {'': 'מקום העבודה'}, {'': 'משך הזמן שמילא בתפקיד'}, {'HaTafkidSheMila': 'חשב'}, {'MekomHaAvoda': "ערוצי זהב ושות'"}, {'MeshechZmanSheMilaBaTafkid': '5 שנים'}, {'': '9.'}, {'': 'נושא משרה בכירה'}, {'NoseMisraBechira1': 'אינו ממלא'}, {'': 'בתפקידים אחרים בתאגיד,בחברת בת שלו, בחברה קשורה או אצל בעל העניין'}, {'': 'הסבר: אם הוא ממלא תפקידים אחרים בתאגיד, בחברה בת שלו או אצל בעל עניין בו נא לפרט.'}, {'Hesber1': '_________'}, {'': '10.'}, {'': 'נושא משרה בכירה'}, {'NoseMisraBechira2': 'אינו'}, {'': 'בן משפחה של נושא משרה בכירה אחר או של בעל עניין בתאגיד.'}, {'': 'הסבר: אם הוא בן משפחה של נושא משרה בכירה אחר או של בעל עניין בתאגיד, יש לפרט.'}, {'Hesber2': '_________'}, {'': '11.'}, {'': 'אם נושא המשרה הבכירה הוא מנכ"ל: הוא'}, {'NoseMisraBechira3': '_________'}, {'': 'בניירות ערך של התאגיד, של חברת בת או של חברה קשורה.'}, {'': 'הסבר: אם נושא המשרה הבכירה הוא מנכ"ל, יש לפרט אם הוא מחזיק ניירות ערך בתאגיד ,בחברת בת או בחברה קשורה. מילוי הערך מטבלה הוא לא שדה חובה.'}, {'Hesber3': '_________'}, {'TextHofshi': ''}, {'': 'מספרי אסמכתאות של מסמכים קודמים בנושא (אין האזכור מהווה הכללה על דרך הפניה):'}, {'FooterMisparAsmachta1': ''}, {'FooterMisparAsmachta2': ''}, {'FooterMisparAsmachta3': ''}, {'': 'שמות קודמים של ישות מדווחת:'}, {'ShemYeshutKodem': ''}, {'': 'תאריך עדכון מבנה הטופס:'}, {'TaarichIdkunMivne': '01/01/2007'}, {'': 'שם מדווח אלקטרוני:'}, {'FooterShemMedaveach': 'חריט אורית'}, {'FooterShemHevra': ''}, {'': 'תפקידו:'}, {'TafkidBaTaagid': 'עו"ד'}, {'Street': 'אזור התעשיה'}, {'StreetNumber': '-'}, {'City': 'יקום'}, {'ZipCode': '60972'}, {'': 'טלפון:'}, {'Telephone': '077-7077037'}, {'': 'פקס:'}, {'FooterFax1': '077-7078806'}, {'': 'דואר אלקטרוני:'}, {'FooterDoarElectroniMedaveach': '[email protected]'}], 'date': datetime.datetime(2007, 1, 1, 19, 14, 42), 'notification_type': 'ת091', 'positions': [['חשב', '_________']], 's3_object_name': 'maya.tase.co.il/2007_01/235402.htm', 'source': 'maya.tase.co.il', 'url': 'https://ams3.digitaloceanspaces.com/budgetkey-files/maya.tase.co.il/2007_01/235402.htm'}
----

Pipeline ID: people/company_appointments/maya/collect-maya-forms-debug-stats

Join the parsed PDF to get start and end time for each person (correlate)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 03:48:17.107996
Last Completion:
2021-04-11 03:49:33.413080
Last Success:
2021-04-11 03:49:33.413080

Pipeline ID: people/company_appointments/maya/correlate

people/company_appointments/maya/maya-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 03:36:21.721488
Last Completion:
2021-04-11 03:38:20.402483
Last Success:
2021-04-11 03:38:20.402483

Pipeline ID: people/company_appointments/maya/maya-list

Appointment notices from Maya (maya-nominations)
Succeeded

Name, job and company description.


Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 03:43:45.222333
Last Completion:
2021-04-11 03:44:24.802505
Last Success:
2021-04-11 03:44:24.802505

Pipeline ID: people/company_appointments/maya/maya-nominations

people/company_appointments/maya/maya-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 00:00:12.392109
Last Completion:
2021-04-11 01:45:05.093488
Last Success:
2021-04-11 01:45:05.093488

Pipeline ID: people/company_appointments/maya/maya-notification-list

List all notifications from maya system (maya-notification-updates)
Succeeded

id, date, company, notification_type, s3_object_name, url


Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 02:54:14.732996
Last Completion:
2021-04-11 03:27:37.202018
Last Success:
2021-04-11 03:27:37.202018

Pipeline ID: people/company_appointments/maya/maya-notification-updates

Appointment notices from Maya (maya-resignations)
Succeeded

Name, job and company description.


Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 03:44:24.899862
Last Completion:
2021-04-11 03:44:59.997849
Last Success:
2021-04-11 03:44:59.997849

Pipeline ID: people/company_appointments/maya/maya-resignations

מינויים בכלכליסט (calcalist)
Succeeded

רשימת כל המינויים והחברות מאתר כלכליסט


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 06:54:48.290900
Last Completion:
2021-01-27 07:02:36.712183
Last Success:
2021-01-27 07:02:36.712183

Pipeline ID: people/company_appointments/media/calcalist/calcalist

Appointment notices from TheMarker (themarker)
Succeeded

Name, job and company description.


Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 00:04:25.633363
Last Completion:
2021-04-11 00:04:33.192059
Last Success:
2021-04-11 00:04:33.192059

Pipeline ID: people/company_appointments/media/themarker/themarker

Join the parsed PDF to get start and end time for each person (correlate)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 03:01:08.858059
Last Completion:
2021-04-11 03:01:10.812289
Last Success:
2021-04-11 03:01:10.812289

Pipeline ID: people/company_appointments/state_owned/correlate

Parse and concatenate all PDF reports (parse_pdf_resources)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 01:45:05.108190
Last Completion:
2021-04-11 01:45:10.702857
Last Success:
2021-04-11 01:45:10.702857

Pipeline ID: people/company_appointments/state_owned/parse_pdf_resources

collect links to all pdf reports on https://mof.gov.il/GCA/Directors/Pages/DirectorsManningReport.aspx (reports)
Succeeded

columns: date, url


Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 00:16:58.027822
Last Completion:
2021-04-11 00:17:06.917936
Last Success:
2021-04-11 00:17:06.917936

Pipeline ID: people/company_appointments/state_owned/reports

people/company_appointments/state_owned/state-owned-nominations
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 03:36:17.021130
Last Completion:
2021-04-11 03:36:20.992348
Last Success:
2021-04-11 03:36:20.992348

Pipeline ID: people/company_appointments/state_owned/state-owned-nominations

people/municipal_appointments/municipal_representitives
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 06:54:41.821172
Last Completion:
2021-01-27 06:54:48.215585
Last Success:
2021-01-27 06:54:48.215585

Pipeline ID: people/municipal_appointments/municipal_representitives

people/political_candidates/election_candidates21
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 06:54:30.690244
Last Completion:
2021-01-27 06:55:11.193515
Last Success:
2021-01-27 06:55:11.193515

Pipeline ID: people/political_candidates/election_candidates21

people/political_donations/political_donations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 06:54:29.201834
Last Completion:
2021-01-27 06:54:57.068307
Last Success:
2021-01-27 06:54:57.068307

Pipeline ID: people/political_donations/political_donations

people/procurement/procurement-individuals
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-11 06:56:20.313483
Last Completion:
2021-04-11 07:10:15.516397
Last Success:
2021-04-11 07:10:15.516397

Pipeline ID: people/procurement/procurement-individuals

procurement/calls_for_bids/calls-for-bids-all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-10 16:00:03.971095
Last Completion:
2021-04-10 16:02:29.226085
Last Success:
2021-04-10 16:02:29.226085

Pipeline ID: procurement/calls_for_bids/calls-for-bids-all

procurement/calls_for_bids/calls-for-bids-moh
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 00:27:03.033641
Last Completion:
2021-04-11 00:27:10.613946
Last Success:
2021-04-11 00:27:10.613946

Pipeline ID: procurement/calls_for_bids/calls-for-bids-moh

procurement/calls_for_bids/gov-publications
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-09 07:22:13.510287
Last Completion:
2021-02-09 07:35:29.385765
Last Success:
2021-02-09 07:35:29.385765

Pipeline ID: procurement/calls_for_bids/gov-publications

procurement/calls_for_bids/gov-publications-ministry-of-immigration
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 06:41:53.694579
Last Completion:
2021-01-27 06:42:01.591600
Last Success:
2021-01-27 06:42:01.591600

Pipeline ID: procurement/calls_for_bids/gov-publications-ministry-of-immigration

procurement/calls_for_bids/gov-publications2
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-01-27 06:41:53.691330
Last Completion:
2021-01-27 06:42:07.538577
Last Success:
2021-01-27 06:42:07.538577

Pipeline ID: procurement/calls_for_bids/gov-publications2

procurement/calls_for_bids/jobiz-all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-10 15:00:23.580535
Last Completion:
2021-04-10 15:00:25.335320
Last Success:
2021-04-10 15:00:25.335320

Pipeline ID: procurement/calls_for_bids/jobiz-all

procurement/calls_for_bids/jobiz-calls-for-bids
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-10 15:00:25.361137
Last Completion:
2021-04-10 15:00:26.651381
Last Success:
2021-04-10 15:00:26.651381

Pipeline ID: procurement/calls_for_bids/jobiz-calls-for-bids

procurement/calls_for_bids/jobiz-scraper
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-10 15:00:03.037258
Last Completion:
2021-04-10 15:00:23.545832
Last Success:
2021-04-10 15:00:23.545832

Pipeline ID: procurement/calls_for_bids/jobiz-scraper

התקשרויות רכש ממשלתיות (latest-contract-spending)
Succeeded

אנו סוכמים מידע מתוך הדוחות הרבעוניים לתוך טבלה המכילה את המידע העדכני ביותר.


Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-11 03:33:15.007384
Last Completion:
2021-04-11 06:56:19.969902
Last Success:
2021-04-11 06:56:19.969902

Pipeline ID: procurement/spending/latest-contract-spending

procurement/spending/quarterly-contract-spending-report-uris
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-10 23:00:02.979957
Last Completion:
2021-04-10 23:08:10.700389
Last Success:
2021-04-10 23:08:10.700389

Pipeline ID: procurement/spending/quarterly-contract-spending-report-uris

דוחות רבעוניים מתוך מרכבה, לפי נוהל היחידה לחופש המידע. (quarterly-contract-spending-reports)
Succeeded

כל משרדי הממשלה ויחידות הסמך (שמחוברות למערכת מרכבה) צריכים לפרסם אחת לרבעון (תוך 45 יום מסוף הרבעון) דו״ח התקשרויות לפי פורמט מוגדר היטב הממומש כדו״ח מובנה במערכת המרכבה. כל המשרדים מדווחים עצמאית והדו״חות עולים לאתר היחידה לחופש המידע, משם אנו אוספים אותם. התוצר של השרשר הזה הוא פירוט כל הדיווחים של כל המשרדים.


Last Run triggered by:
scheduled
Last Run started at:
2021-04-10 23:19:05.499190
Last Completion:
2021-04-10 23:32:54.116840
Last Success:
2021-04-10 23:32:54.116840

Pipeline ID: procurement/spending/quarterly-contract-spending-reports

procurement/spending/quarterly-contract-spending-reports-data
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-11 01:29:28.295125
Last Completion:
2021-04-11 02:41:05.922025
Last Success:
2021-04-11 02:41:05.922025

Pipeline ID: procurement/spending/quarterly-contract-spending-reports-data

procurement/spending/spending-by-entity
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-11 06:56:20.025190
Last Completion:
2021-04-11 07:10:31.093035
Last Success:
2021-04-11 07:10:31.093035

Pipeline ID: procurement/spending/spending-by-entity

Load all tenders data from data.gov.il to flat file (all)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-03-27 13:08:35.747972
Last Completion:
2021-03-27 13:13:40.739653
Last Success:
2021-03-27 13:13:40.739653

Pipeline ID: procurement/tenders/all

procurement/tenders/processed
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-03-27 13:13:40.856543
Last Completion:
2021-03-27 13:21:49.351926
Last Success:
2021-03-27 13:21:49.351926

Pipeline ID: procurement/tenders/processed

reports/all
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-04-11 03:40:47.608576
Last Completion:
2021-04-11 03:40:56.420063
Last Success:
2021-04-11 03:40:56.420063

Pipeline ID: reports/all

reports/ngos/ngo-activity-report
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 03:30:30.112419
Last Completion:
2021-04-11 03:36:04.117484
Last Success:
2021-04-11 03:36:04.117484

Pipeline ID: reports/ngos/ngo-activity-report

reports/ngos/ngo-district-report
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 03:29:52.316375
Last Completion:
2021-04-11 03:33:14.893239
Last Success:
2021-04-11 03:33:14.893239

Pipeline ID: reports/ngos/ngo-district-report

supports/all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-10 18:10:42.448677
Last Completion:
2021-04-10 18:16:09.200360
Last Success:
2021-04-10 18:16:09.200360

Pipeline ID: supports/all

supports/by-payment-year
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 01:48:56.105837
Last Completion:
2021-04-11 02:13:29.828052
Last Success:
2021-04-11 02:13:29.828052

Pipeline ID: supports/by-payment-year

supports/by-request-year
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 01:49:48.901638
Last Completion:
2021-04-11 02:16:33.195101
Last Success:
2021-04-11 02:16:33.195101

Pipeline ID: supports/by-request-year

supports/criteria/support-criteria
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 01:48:36.726714
Last Completion:
2021-04-11 01:48:46.921005
Last Success:
2021-04-11 01:48:46.921005

Pipeline ID: supports/criteria/support-criteria

supports/criteria/support-criteria-doj
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-11 00:18:39.151451
Last Completion:
2021-04-11 00:18:52.546692
Last Success:
2021-04-11 00:18:52.546692

Pipeline ID: supports/criteria/support-criteria-doj

supports/supports-2004
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-14 06:35:35.709262
Last Completion:
2021-02-14 06:54:40.521850
Last Success:
2021-02-14 06:54:40.521850

Pipeline ID: supports/supports-2004

supports/supports-2005
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-14 06:35:35.893518
Last Completion:
2021-02-14 06:54:44.507357
Last Success:
2021-02-14 06:54:44.507357

Pipeline ID: supports/supports-2005

supports/supports-2006
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-14 09:42:00.489312
Last Completion:
2021-02-14 09:48:46.967568
Last Success:
2021-02-14 09:48:46.967568

Pipeline ID: supports/supports-2006

supports/supports-2007
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-14 09:42:10.695837
Last Completion:
2021-02-14 09:57:52.112324
Last Success:
2021-02-14 09:57:52.112324

Pipeline ID: supports/supports-2007

supports/supports-2008
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-14 09:42:15.931719
Last Completion:
2021-02-14 09:53:53.644962
Last Success:
2021-02-14 09:53:53.644962

Pipeline ID: supports/supports-2008

supports/supports-2009
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-14 09:48:46.980107
Last Completion:
2021-02-14 10:05:07.608859
Last Success:
2021-02-14 10:05:07.608859

Pipeline ID: supports/supports-2009

supports/supports-2010
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-14 09:53:53.655913
Last Completion:
2021-02-14 10:02:54.369901
Last Success:
2021-02-14 10:02:54.369901

Pipeline ID: supports/supports-2010

supports/supports-2011
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-14 09:57:52.124692
Last Completion:
2021-02-14 10:13:43.967747
Last Success:
2021-02-14 10:13:43.967747

Pipeline ID: supports/supports-2011

supports/supports-2012
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-14 10:02:54.380671
Last Completion:
2021-02-14 10:13:41.587789
Last Success:
2021-02-14 10:13:41.587789

Pipeline ID: supports/supports-2012

supports/supports-2013
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-03-01 09:37:12.409042
Last Completion:
2021-03-01 09:49:59.347346
Last Success:
2021-03-01 09:49:59.347346

Pipeline ID: supports/supports-2013

supports/supports-2014
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-21 20:39:27.814289
Last Completion:
2021-02-21 20:51:40.176238
Last Success:
2021-02-21 20:51:40.176238

Pipeline ID: supports/supports-2014

supports/supports-2015
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-14 10:13:41.599566
Last Completion:
2021-02-14 10:29:22.788727
Last Success:
2021-02-14 10:29:22.788727

Pipeline ID: supports/supports-2015

supports/supports-2016
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-02-14 06:50:07.236185
Last Completion:
2021-02-14 07:09:35.013304
Last Success:
2021-02-14 07:09:35.013304

Pipeline ID: supports/supports-2016

supports/supports-2017
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-03-01 09:45:13.896591
Last Completion:
2021-03-01 09:58:35.291853
Last Success:
2021-03-01 09:58:35.291853

Pipeline ID: supports/supports-2017

supports/supports-2018
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-10 15:00:04.113707
Last Completion:
2021-04-10 15:08:16.187261
Last Success:
2021-04-10 15:08:16.187261

Pipeline ID: supports/supports-2018

supports/supports-2019
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-04-10 16:00:03.057398
Last Completion:
2021-04-10 16:09:01.482233
Last Success:
2021-04-10 16:09:01.482233

Pipeline ID: supports/supports-2019

supports/supports-2020
Failed

Last Run triggered by:
scheduled
Last Run started at:
2021-04-10 17:00:02.585179
Last Completion:
2021-04-10 17:06:40.594018
Last Success:
2021-04-08 17:08:02.807716

flow
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 13, in <module>
    flow = flow_module.flow(parameters, datapackage, resources, ctx.stats)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 169, in flow
    DF.load(wrapper(year), format='csv',
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 21, in wrapper
    return scraper(gcd, year)
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 159, in scraper
    get_results_for_column(driver, rects[i])
  File "/datapackage_pipelines_budgetkey/pipelines/supports/scraper.py", line 98, in get_results_for_column