activities/social_services/social_service_reports
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 01:47:43.808516
Last Completion:
2021-09-28 01:48:34.847401
Last Success:
2021-09-28 01:48:34.847401

Pipeline ID: activities/social_services/social_service_reports

activities/social_services/social_service_suppliers
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 01:47:37.111760
Last Completion:
2021-09-28 01:47:40.044134
Last Success:
2021-09-28 01:47:40.044134

Pipeline ID: activities/social_services/social_service_suppliers

activities/social_services/social_service_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 01:47:40.058637
Last Completion:
2021-09-28 01:47:43.549012
Last Success:
2021-09-28 01:47:43.549012

Pipeline ID: activities/social_services/social_service_tenders

Fetch social services from data input (social_services)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 00:13:07.112889
Last Completion:
2021-09-28 00:13:28.908307
Last Success:
2021-09-28 00:13:28.908307

Pipeline ID: activities/social_services/social_services

bank_of_israel/bank_of_israel
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 16:21:26.498569
Last Completion:
2021-05-13 16:25:14.252534
Last Success:
2021-05-13 16:25:14.252534

Pipeline ID: bank_of_israel/bank_of_israel

budget/national/changes/explanations/all
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-18 09:37:51.019675
Last Completion:
2021-05-18 09:39:36.039549
Last Success:
2021-05-18 09:39:36.039549

Pipeline ID: budget/national/changes/explanations/all

budget/national/changes/original/current-year-fixes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-24 01:15:22.553052
Last Completion:
2021-09-24 01:15:53.818425
Last Success:
2021-09-24 01:15:53.818425

Pipeline ID: budget/national/changes/original/current-year-fixes

budget/national/changes/original/national-budget-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-24 00:11:15.378159
Last Completion:
2021-09-24 00:13:14.740658
Last Success:
2021-09-24 00:13:14.740658

Pipeline ID: budget/national/changes/original/national-budget-changes

Changes, grouped by transaction_id, with explanations (national-budget-changes-aggregated)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-24 06:31:13.990496
Last Completion:
2021-09-24 06:33:35.008349
Last Success:
2021-09-24 06:33:35.008349

Pipeline ID: budget/national/changes/processed/national-budget-changes-aggregated

budget/national/changes/processed/transactions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-24 01:15:24.026851
Last Completion:
2021-09-24 06:31:13.765581
Last Success:
2021-09-24 06:31:13.765581

Pipeline ID: budget/national/changes/processed/transactions

National Yearly Budgets (national-budgets)
Succeeded

We get the data the Ministry of Finance publishes in data.gov.il every year. It comes in XLS format, with one row per TAKANA and phase (original, approved, executed). In this pipeline we create from each triplet a single row that has all the data.


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:15:17.615182
Last Completion:
2021-05-13 11:26:39.929891
Last Success:
2021-05-13 11:26:39.929891

Pipeline ID: budget/national/original/national-budgets

National Yearly Budgets - Processed (aggregated-yearly)
Succeeded

This pipeline joins the different phases of the budget (allocated, revised and executed). In the original file there's a separate row for each of the phases. We like it better as a single row with all phase info. Another thing this pipeline does is to rename the column titles - to more friendly English names. Also, it create rows for all hierarchies - where upper hierarchies (2, 4 & 6 digits) are plain aggregations of the 8-digit items they contain.


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 14:31:07.591139
Last Completion:
2021-05-13 16:20:58.443229
Last Success:
2021-05-13 16:20:58.443229

Pipeline ID: budget/national/processed/aggregated-yearly

budget/national/processed/category-explanations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:15:52.098941
Last Completion:
2021-05-13 10:15:52.680936
Last Success:
2021-05-13 10:15:52.680936

Pipeline ID: budget/national/processed/category-explanations

National Yearly Budgets - Joined with category-explanations (connected-items-explained)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-06-25 14:51:17.968724
Last Completion:
2021-06-25 14:59:36.044017
Last Success:
2021-06-25 14:59:36.044017

Pipeline ID: budget/national/processed/connected-items-explained

National Yearly Budgets - Connected Items (connected-national-budgets)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-06-25 14:01:54.773173
Last Completion:
2021-06-25 14:32:45.258029
Last Success:
2021-06-25 14:32:45.258029

Pipeline ID: budget/national/processed/connected-national-budgets

National Yearly Budgets - Just the total (item 00) (just-the-total)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-06-25 13:47:09.870519
Last Completion:
2021-06-25 13:51:56.485356
Last Success:
2021-06-25 13:51:56.485356

Pipeline ID: budget/national/processed/just-the-total

National Yearly Budgets - Main Item Names (roof-names)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-06-25 13:47:09.948998
Last Completion:
2021-06-25 13:51:59.673049
Last Success:
2021-06-25 13:51:59.673049

Pipeline ID: budget/national/processed/roof-names

National Yearly Budgets - With Extras (with-extras)
Succeeded

This pipeline joins the budget data to itself so that each item has a list of its immediate children.


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-06-25 12:51:53.151041
Last Completion:
2021-06-25 13:14:37.251810
Last Success:
2021-06-25 13:14:37.251810

Pipeline ID: budget/national/processed/with-extras

budgetkey/analysis/spending/publisher_entity_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 10:12:40.392414
Last Completion:
2021-09-28 11:01:14.143112
Last Success:
2021-09-28 11:01:14.143112

Pipeline ID: budgetkey/analysis/spending/publisher_entity_analysis

budgetkey/analysis/spending/publisher_foa_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 10:12:40.401422
Last Completion:
2021-09-28 10:17:58.906837
Last Success:
2021-09-28 10:17:58.906837

Pipeline ID: budgetkey/analysis/spending/publisher_foa_analysis

budgetkey/analysis/spending/united
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 10:00:03.055164
Last Completion:
2021-09-28 10:12:40.254237
Last Success:
2021-09-28 10:12:40.254237

Pipeline ID: budgetkey/analysis/spending/united

Main Page - Aggregated budget by functional classification (budget-functional-aggregates)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 18:11:55.037647
Last Completion:
2021-05-13 18:14:37.897472
Last Success:
2021-05-13 18:14:37.897472

Pipeline ID: budgetkey/budget-functional-aggregates

budgetkey/documents
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 19:08:17.160746
Last Completion:
2021-05-13 19:08:18.865794
Last Success:
2021-05-13 19:08:18.865794

Pipeline ID: budgetkey/documents

budgetkey/elasticsearch/index_activities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 01:48:34.909530
Last Completion:
2021-09-28 01:48:49.948213
Last Success:
2021-09-28 01:48:49.948213

Pipeline ID: budgetkey/elasticsearch/index_activities

budgetkey/elasticsearch/index_budget
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-09-24 00:17:23.949038
Last Completion:
2021-09-24 00:50:36.730669
Last Success:
2021-09-24 00:50:36.730669

Pipeline ID: budgetkey/elasticsearch/index_budget

budgetkey/elasticsearch/index_calls_for_bids
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 16:12:09.008096
Last Completion:
2021-09-28 16:12:21.930845
Last Success:
2021-09-28 16:12:21.930845

Pipeline ID: budgetkey/elasticsearch/index_calls_for_bids

budgetkey/elasticsearch/index_contract_spending
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 06:29:13.405511
Last Completion:
2021-09-28 07:58:53.194243
Last Success:
2021-09-28 07:58:53.194243

Pipeline ID: budgetkey/elasticsearch/index_contract_spending

budgetkey/elasticsearch/index_entities
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-09-28 02:59:00.021045
Last Completion:
2021-09-28 04:21:55.207726
Last Success:
2021-09-28 04:21:55.207726

Pipeline ID: budgetkey/elasticsearch/index_entities

budgetkey/elasticsearch/index_gov_decisions
Invalid

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-09-12 12:01:01.414811
Last Completion:
2021-09-12 12:02:13.425729
Last Success:
2021-09-12 12:02:13.425729

Invalid dependency :Cannot run until dependency passes validation: ./government_decisions/government_decisions
From ./government_decisions/government_decisions :['Dependency unsuccessful', 'Cannot run until dependency "./government_decisions/scraper" is successfully executed']

Pipeline ID: budgetkey/elasticsearch/index_gov_decisions

budgetkey/elasticsearch/index_national_budget_changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-24 06:33:35.167051
Last Completion:
2021-09-24 06:35:33.645789
Last Success:
2021-09-24 06:35:33.645789

Pipeline ID: budgetkey/elasticsearch/index_national_budget_changes

budgetkey/elasticsearch/index_people
Running

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-09-28 23:34:07.830722
Last Completion:
Last Success:
2021-09-28 23:10:35.625264

Pipeline ID: budgetkey/elasticsearch/index_people

budgetkey/elasticsearch/index_reports
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-09-24 00:50:36.816124
Last Completion:
2021-09-24 00:51:45.031522
Last Success:
2021-09-24 00:51:45.031522

Pipeline ID: budgetkey/elasticsearch/index_reports

budgetkey/elasticsearch/index_support_criteria
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 03:52:28.108270
Last Completion:
2021-09-28 03:52:39.600221
Last Success:
2021-09-28 03:52:39.600221

Pipeline ID: budgetkey/elasticsearch/index_support_criteria

budgetkey/elasticsearch/index_supports
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 03:47:59.162627
Last Completion:
2021-09-28 05:02:46.711273
Last Success:
2021-09-28 05:02:46.711273

Pipeline ID: budgetkey/elasticsearch/index_supports

budgetkey/elasticsearch/index_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 04:15:57.627885
Last Completion:
2021-09-28 05:17:18.429703
Last Success:
2021-09-28 05:17:18.429703

Pipeline ID: budgetkey/elasticsearch/index_tenders

budgetkey/elasticsearch/index_units
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 00:35:35.731834
Last Completion:
2021-09-28 00:35:44.323406
Last Success:
2021-09-28 00:35:44.323406

Pipeline ID: budgetkey/elasticsearch/index_units

budgetkey/elasticsearch/sitemaps
Running

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-09-28 23:01:07.450854
Last Completion:
Last Success:
2021-09-28 16:14:28.488109

Pipeline ID: budgetkey/elasticsearch/sitemaps

Send periodic emails (emails)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-24 05:18:16.320852
Last Completion:
2021-09-24 12:01:59.676369
Last Success:
2021-09-24 12:01:59.676369

Pipeline ID: budgetkey/emails/emails

donations/candidates
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 12:49:33.668219
Last Completion:
2021-05-13 12:49:44.646388
Last Success:
2021-05-13 12:49:44.646388

Pipeline ID: donations/candidates

donations/parties
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:15:52.734546
Last Completion:
2021-05-13 10:16:09.487287
Last Success:
2021-05-13 10:16:09.487287

Pipeline ID: donations/parties

donations/transactions
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-09-27 14:32:27.629327
Last Completion:
2021-09-27 14:32:39.588823
Last Success:
None

get_transactions
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 150, in <module>
    spew(dp, process_resources(res_iter))
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 109, in get_transactions
    for resp in self.get_for_candidate(cid):
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 95, in get_for_candidate
    resp = self.get_for_range(cid, range_start, range_end)
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 70, in get_for_range
    assert len(resp) == 6
AssertionError
read unix @->/run/docker.sock: read: connection reset by peer

Pipeline ID: donations/transactions

education/tochniyot/tochniyot
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:39:08.772024
Last Completion:
2021-05-15 07:39:19.636786
Last Success:
2021-05-15 07:39:19.636786

Pipeline ID: education/tochniyot/tochniyot

entities/all
Invalid

Last Run triggered by:
scheduled
Last Run started at:
2021-09-27 20:05:36.689399
Last Completion:
2021-09-27 20:18:45.674875
Last Success:
2021-09-27 20:18:45.674875

Dependency unsuccessful :Cannot run until dependency "./entities/special/registry" is successfully executed

Pipeline ID: entities/all

entities/associations/guidestar/guidestar
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-07-29 07:38:34.074956
Last Completion:
2021-07-29 07:43:13.713766
Last Success:
2021-07-29 07:43:13.713766

Pipeline ID: entities/associations/guidestar/guidestar

entities/associations/guidestar/guidestar-scraper
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-07-29 07:22:04.521422
Last Completion:
2021-07-29 07:38:33.858694
Last Success:
2021-07-29 07:38:33.858694

Pipeline ID: entities/associations/guidestar/guidestar-scraper

עמותות פעילות מרשם העמותות (registry)
Succeeded

רשימת כלל העמותות הפעילות, מתעדכן שבועית.


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:29:49.070695
Last Completion:
2021-05-13 10:30:27.053958
Last Success:
2021-05-13 10:30:27.053958

Pipeline ID: entities/associations/registrar/registry

entities/companies/registrar/details
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 20:00:03.029829
Last Completion:
2021-09-28 20:02:57.915098
Last Success:
2021-09-28 20:02:57.915098

Pipeline ID: entities/companies/registrar/details

חברות פעילות מרשם החברות (scraper)
Succeeded

רשימת כלל החברות הפעילות, מתעדכן שבועית.


Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 00:00:37.528949
Last Completion:
2021-09-28 00:13:07.100191
Last Success:
2021-09-28 00:13:07.100191

Pipeline ID: entities/companies/registrar/scraper

רשימת אגודות שיתופיות (cooperatives)
Succeeded

רשימת אגודות שיתופיות, מתוך ממשק נתונים של מאגר של משרד הכלכלה / האגף לאיגוד שיתופי, מתעדכן שבועית


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:37:28.458283
Last Completion:
2021-05-13 11:22:03.555060
Last Success:
2021-05-13 11:22:03.555060

Pipeline ID: entities/cooperatives/cooperatives

רשימת הקדשים (endowments)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-07-29 15:38:27.024173
Last Completion:
2021-07-29 15:38:43.656432
Last Success:
2021-07-29 15:38:43.656432

Pipeline ID: entities/endowments/endowments

entities/entities
Invalid

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-09-28 01:15:42.882125
Last Completion:
2021-09-28 01:25:57.024087
Last Success:
2021-09-28 01:25:57.024087

Invalid dependency :Cannot run until dependency passes validation: ./entities/all
From ./entities/all :['Dependency unsuccessful', 'Cannot run until dependency "./entities/special/registry" is successfully executed']

Pipeline ID: entities/entities

entities/fingerprints
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-09-28 00:51:21.411471
Last Completion:
2021-09-28 02:31:15.034988
Last Success:
2021-09-28 02:31:15.034988

Pipeline ID: entities/fingerprints

entities/foi_orgs/foi_orgs
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:19:35.751155
Last Completion:
2021-05-13 10:20:38.842412
Last Success:
2021-05-13 10:20:38.842412

Pipeline ID: entities/foi_orgs/foi_orgs

entities/moital/moital_service_providers
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:30:27.059041
Last Completion:
2021-05-13 10:37:28.451255
Last Success:
2021-05-13 10:37:28.451255

Pipeline ID: entities/moital/moital_service_providers

רשימת אגודות עותומניות (ottoman-association-registry)
Succeeded

רשימת אגודות עותומניות, מתוך תשובה לבקשת חופש מידע


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 14:38:39.673414
Last Completion:
2021-05-13 14:38:53.363762
Last Success:
2021-05-13 14:38:53.363762

Pipeline ID: entities/ottoman/ottoman-association-registry

רשימת שותפויות (partnerships)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-07-29 14:57:09.152244
Last Completion:
2021-07-29 14:57:33.724787
Last Success:
2021-07-29 14:57:33.724787

Pipeline ID: entities/partnerships/partnerships

entities/safety-orders/safety-orders
Failed

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 00:00:15.618402
Last Completion:
2021-09-28 00:00:19.733419
Last Success:
None

stream_remote_resources
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 245, in <module>
    resource.pop('http_headers', None))
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 199, in stream_reader
    schema, headers, columns, stream, close = get_opener(url, _resource)()
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 175, in opener
    _stream.open()
  File "/usr/local/lib/python3.7/site-packages/tabulator/stream.py", line 423, in open
    self.__parser.open(source, encoding=self.__encoding)
  File "/usr/local/lib/python3.7/site-packages/tabulator/parsers/xlsx.py", line 99, in open
    self.__bytes, read_only=not self.__fill_merged_cells, data_only=True
  File "/usr/local/lib/python3.7/site-packages/openpyxl/reader/excel.py", line 316, in load_workbook
    data_only, keep_links)
  File "/usr/local/lib/python3.7/site-packages/openpyxl/reader/excel.py", line 124, in __init__
    self.archive = _validate_archive(fn)
  File "/usr/local/lib/python3.7/site-packages/openpyxl/reader/excel.py", line 96, in _validate_archive
    archive = ZipFile(filename, 'r')
  File "/usr/local/lib/python3.7/zipfile.py", line 1258, in __init__
    self._RealGetContents()
  File "/usr/local/lib/python3.7/zipfile.py", line 1325, in _RealGetContents
    raise BadZipFile("File is not a zip file")
zipfile.BadZipFile: File is not a zip file

Pipeline ID: entities/safety-orders/safety-orders

entities/safety-orders/safety-orders-by-entity
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./entities/safety-orders/safety-orders" is successfully executed

Pipeline ID: entities/safety-orders/safety-orders-by-entity

entities/special/registry
Failed

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 00:29:04.601186
Last Completion:
2021-09-28 04:33:16.411451
Last Success:
2021-09-27 11:00:40.760903

scraper
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/entities/special/scraper.py", line 163, in <module>
    spew(datapackage, itertools.chain(res_iter, [scrape()]))
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/entities/special/scraper.py", line 104, in scrape
    prepare('#%s (%s)' % (selection, options[selection]))
  File "/datapackage_pipelines_budgetkey/pipelines/entities/special/scraper.py", line 66, in prepare
    EC.presence_of_element_located((By.ID, "RadioBakasha1"))
  File "/usr/local/lib/python3.7/site-packages/selenium/webdriver/support/wait.py", line 71, in until
    value = method(self._driver)
  File "/usr/local/lib/python3.7/site-packages/selenium/webdriver/support/expected_conditions.py", line 64, in __call__
    return _find_element(driver, self.locator)
  File "/usr/local/lib/python3.7/site-packages/selenium/webdriver/support/expected_conditions.py", line 415, in _find_element
    raise e
  File "/usr/local/lib/python3.7/site-packages/selenium/webdriver/support/expected_conditions.py", line 411, in _find_element
    return driver.find_element(*by)
  File "/usr/local/lib/python3.7/site-packages/selenium/webdriver/remote/webdriver.py", line 978, in find_element
    'value': value})['value']
  File "/usr/local/lib/python3.7/site-packages/selenium/webdriver/remote/webdriver.py", line 321, in execute
    self.error_handler.check_response(response)
  File "/usr/local/lib/python3.7/site-packages/selenium/webdriver/remote/errorhandler.py", line 242, in check_response
    raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.WebDriverException: Message: chrome not reachable
  (Session info: chrome=88.0.4324.96)
DEBUG   :[chan 1] Max packet in: 32768 bytes
DEBUG   :[chan 1] Max packet out: 32768 bytes
DEBUG   :Secsh channel 1 opened.
DEBUG   :[chan 1] Sesch channel 1 request ok
DEBUG   :[chan 1] EOF received (1)
DEBUG   :[chan 1] EOF sent (1)

Pipeline ID: entities/special/registry

ezvonot/ezvonot_accounts
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 02:03:38.453848
Last Completion:
2021-09-28 02:03:54.698280
Last Success:
2021-09-28 02:03:54.698280

Pipeline ID: ezvonot/ezvonot_accounts

ezvonot/ezvonot_cases
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 02:03:43.925361
Last Completion:
2021-09-28 02:03:57.973077
Last Success:
2021-09-28 02:03:57.973077

Pipeline ID: ezvonot/ezvonot_cases

ezvonot/ezvonot_crontab
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 00:33:28.320132
Last Completion:
2021-09-28 00:33:30.441442
Last Success:
2021-09-28 00:33:30.441442

Pipeline ID: ezvonot/ezvonot_crontab

ezvonot/ezvonot_decisions
Failed

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 02:03:57.982641
Last Completion:
2021-09-28 02:04:04.137288
Last Success:
None

data_gov_il_resource
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/processors/data_gov_il_resource.py", line 59, in <module>
    spew_flow(flow(ctx.parameters), ctx)
  File "/datapackage_pipelines_budgetkey/processors/data_gov_il_resource.py", line 40, in flow
    url, path = get_resource(gcd, dataset_name, resource_name)
  File "/datapackage_pipelines_budgetkey/common/data_gov_il.py", line 101, in get_resource
    assert False, 'Failed to find resource for name %s: possibilities are %r' % (resource_name, [r['name'] for r in dataset['resources']])
AssertionError: Failed to find resource for name קובץ החלטות וועדה : possibilities are ['קובץ הפקדות', 'קובץ חשבונות המרכיבים את החלטות הועדה', 'קובץ תיקים', 'קובץ ייעודים', 'קובץ החלטות וועדה ', 'הוראות לפתיחת קובץ מאגר באמצעות תוכנת excel']

Pipeline ID: ezvonot/ezvonot_decisions

ezvonot/ezvonot_decisions_join
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./ezvonot/ezvonot_decisions" is successfully executed

Pipeline ID: ezvonot/ezvonot_decisions_join

ezvonot/ezvonot_deposits
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 02:03:16.228881
Last Completion:
2021-09-28 02:03:38.446095
Last Success:
2021-09-28 02:03:38.446095

Pipeline ID: ezvonot/ezvonot_deposits

ezvonot/ezvonot_purposes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 02:03:54.714718
Last Completion:
2021-09-28 02:04:07.208867
Last Success:
2021-09-28 02:04:07.208867

Pipeline ID: ezvonot/ezvonot_purposes

government_decisions/government_decisions
Invalid

Last Run triggered by:
scheduled
Last Run started at:
2021-09-11 12:02:11.584556
Last Completion:
2021-09-11 12:02:20.017255
Last Success:
2021-09-11 12:02:20.017255

Dependency unsuccessful :Cannot run until dependency "./government_decisions/scraper" is successfully executed

Pipeline ID: government_decisions/government_decisions

government_decisions/scraper
Failed

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 12:00:02.613173
Last Completion:
2021-09-28 12:00:08.952954
Last Success:
None

scraper
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/government_decisions/scraper.py", line 128, in <module>
    spew(datapackage, chain(res_iter, [get_decision_list()]))
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/government_decisions/scraper.py", line 56, in get_decision_list
    response = session.get(SEARCH_PAGE_RESULTS_URL.format(skip=0), timeout=TIMEOUT).json()
  File "/usr/local/lib/python3.7/site-packages/requests/models.py", line 892, in json
    self.content.decode(encoding), **kwargs
  File "/usr/local/lib/python3.7/json/__init__.py", line 348, in loads
    return _default_decoder.decode(s)
  File "/usr/local/lib/python3.7/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/local/lib/python3.7/json/decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

Pipeline ID: government_decisions/scraper

lamas/municipal-data
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-09-27 11:00:41.102938
Last Completion:
2021-09-27 11:01:56.215655
Last Success:
2021-09-27 11:01:56.215655

Pipeline ID: lamas/municipal-data

קובץ התאמת רשויות אזוריות לישובים בשטחן (municipality-to-city)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-06-25 12:51:52.448998
Last Completion:
2021-06-25 12:52:07.071841
Last Success:
2021-06-25 12:52:07.071841

Pipeline ID: lamas/municipality-to-city

maya/maya-bonds-and-options-holdings-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 05:08:31.004826
Last Completion:
2021-09-28 05:24:09.117687
Last Success:
2021-09-28 05:24:09.117687

Pipeline ID: maya/maya-bonds-and-options-holdings-changes

maya/maya-company-officer-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 05:08:30.906201
Last Completion:
2021-09-28 05:26:50.524394
Last Success:
2021-09-28 05:26:50.524394

Pipeline ID: maya/maya-company-officer-list

maya/maya-company-stakeholder-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 05:17:18.521756
Last Completion:
2021-09-28 05:45:50.801992
Last Success:
2021-09-28 05:45:50.801992

Pipeline ID: maya/maya-company-stakeholder-list

maya/maya-company-vip-appointments
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 05:08:30.920882
Last Completion:
2021-09-28 05:24:04.731369
Last Success:
2021-09-28 05:24:04.731369

Pipeline ID: maya/maya-company-vip-appointments

maya/maya-complete-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 04:14:44.739292
Last Completion:
2021-09-28 05:08:30.432132
Last Success:
2021-09-28 05:08:30.432132

Pipeline ID: maya/maya-complete-notification-list

maya/maya-holdings-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 05:11:19.529226
Last Completion:
2021-09-28 05:28:06.415763
Last Success:
2021-09-28 05:28:06.415763

Pipeline ID: maya/maya-holdings-changes

maya/maya-notification-parse-updates
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 01:48:50.002702
Last Completion:
2021-09-28 03:47:04.607939
Last Success:
2021-09-28 03:47:04.607939

Pipeline ID: maya/maya-notification-parse-updates

maya/maya-reported-academic-degrees
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 05:24:04.807894
Last Completion:
2021-09-28 05:36:07.732124
Last Success:
2021-09-28 05:36:07.732124

Pipeline ID: maya/maya-reported-academic-degrees

maya/maya-reported-work-record
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 05:24:09.127489
Last Completion:
2021-09-28 05:36:11.022263
Last Success:
2021-09-28 05:36:11.022263

Pipeline ID: maya/maya-reported-work-record

maya/maya-tase-companies-current-management
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 05:28:06.423388
Last Completion:
2021-09-28 06:19:19.388988
Last Success:
2021-09-28 06:19:19.388988

Pipeline ID: maya/maya-tase-companies-current-management

maya/maya-tase-companies-current-shareholders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 05:26:50.532121
Last Completion:
2021-09-28 06:18:52.663663
Last Success:
2021-09-28 06:18:52.663663

Pipeline ID: maya/maya-tase-companies-current-shareholders

maya/scrape-maya-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 00:00:29.120603
Last Completion:
2021-09-28 00:25:06.805026
Last Success:
2021-09-28 00:25:06.805026

Pipeline ID: maya/scrape-maya-notification-list

maya/scrape-maya-tase-companies
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 00:31:50.535813
Last Completion:
2021-09-28 00:33:28.314536
Last Success:
2021-09-28 00:33:28.314536

Pipeline ID: maya/scrape-maya-tase-companies

people/aggregated
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-09-28 23:02:54.911047
Last Completion:
2021-09-28 23:34:06.021632
Last Success:
2021-09-28 23:34:06.021632

Pipeline ID: people/aggregated

people/all
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-09-28 23:01:07.454511
Last Completion:
2021-09-28 23:02:54.339276
Last Success:
2021-09-28 23:02:54.339276

Pipeline ID: people/all

people/association_founders/association-founders
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-07-29 07:43:14.337122
Last Completion:
2021-07-29 07:45:21.432600
Last Success:
2021-07-29 07:45:21.432600

Pipeline ID: people/association_founders/association-founders

people/company_appointments/all-appointments
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-09-28 04:36:22.704570
Last Completion:
2021-09-28 04:39:28.721506
Last Success:
2021-09-28 04:39:28.721506

Pipeline ID: people/company_appointments/all-appointments

people/company_appointments/maya/collect-maya-forms-debug-stats
Failed

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 03:37:32.507343
Last Completion:
2021-09-28 03:37:45.930355
Last Success:
None

dump_to_path
ERROR   :Traceback (most recent call last):
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/base/schema_validator.py", line 73, in schema_validator
ERROR   :row[field.name] = field.cast_value(row.get(field.name))
ERROR   :File "/usr/local/lib/python3.7/site-packages/tableschema/field.py", line 170, in cast_value
ERROR   :).format(field=self, value=value))
ERROR   :datapackage.exceptions
ERROR   :.
ERROR   :CastError
ERROR   ::
ERROR   :Field "HeaderProofValue_equals_HeaderProof" can't cast value "True" for type "number" with format "default"
ERROR   :During handling of the above exception, another exception occurred:
ERROR   :Traceback (most recent call last):
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/dump_to_path.py", line 23, in <module>
ERROR   :spew_flow(flow(ctx.parameters, ctx.stats), ctx)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
ERROR   :spew(self.datapackage, self.resource_iterator, stats=self.stats)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
ERROR   :for rec in res:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/processors/dumpers/dumper_base.py", line 69, in row_counter
ERROR   :for row in iterator:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/processors/dumpers/file_dumper.py", line 96, in rows_processor
ERROR   :for row in resource:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/base/schema_validator.py", line 75, in schema_validator
ERROR   :if not on_error(resource['name'], row, i, e, field):
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/base/schema_validator.py", line 49, in func
ERROR   :return on_error(res_name, row, i, e)
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/base/schema_validator.py", line 24, in raise_exception
ERROR   :raise ValidationError(res_name, row, i, e)
ERROR   :dataflows.base.schema_validator
ERROR   :.
ERROR   :ValidationError
ERROR   ::
ERROR   :ROW: {'HeaderEntityNameEB': Decimal('1'), 'HeaderFixtReport': 0, 'HeaderProof': Decimal('1'), 'HeaderProofFormat': 0, 'HeaderProofValue': Decimal('1'), 'HeaderProofValue_equals_HeaderProof': True, 'alias_stats': [{'FormSubject': '_________'}, {'KodSugYeshut': '1'}, {'ShemYeshutIvrit': 'מת"ב - מערכות תקשורת בכבלים בע"מ'}, {'MisparTofes': 'ת091'}, {'ShemYeshutLoazit': 'MATAV CABLE SYSTEMS MEDIA LTD'}, {'PumbiLoPumbi': 'פומבי'}, {'MezahehHotem': '5086'}, {'': 'מספר ברשם:'}, {'HeaderMisparBaRasham': '520040072'}, {'NeyarotErechReshumim': 'ניירות ערך של התאגיד רשומים למסחר בבורסה בתל-אביב'}, {'MezahehYeshut': '478'}, {'': 'שם מקוצר:'}, {'HeaderSemelBursa': 'מתב'}, {'MezahehTofes': '65'}, {'': 'רחוב:'}, {'HeaderRehov': 'בית ספרד, יורופארק, יקום'}, {'HeaderMisparBait': '1'}, {'HeaderYeshuv': 'יקום'}, {'HeaderMikud': '60972'}, {'HeaderPhone': 'טלפון:'}, {'HeaderTelephone1': '077-7077031'}, {'HeaderTelephone2': '077-7077037'}, {'': 'פקס:'}, {'HeaderFax1': '077-7078230'}, {'': 'דואר אלקטרוני:'}, {'HeaderDoarElectroniMedaveach': '[email protected]'}, {'HeaderSendDate': 'תאריך שידור:'}, {'HeaderSendTime': 'שעת שידור:'}, {'ShaaShidur': '19:06:46'}, {'': 'אתר החברה:'}, {'CompanyUrl': 'www.hot.co.il'}, {'': 'אסמכתא:'}, {'': 'לכבוד'}, {'': 'לכבוד'}, {'': 'רשות ניירות ערך'}, {'': 'הבורסה לניירות ערך בת"א בע"מ'}, {'DoarElectroniRashut': 'www.isa.gov.il'}, {'DoarElectroniBursa': 'www.tase.co.il'}, {'Hanadon': 'דוח מיידי על מינוי נושא משרה בכירה (למעט מינוי דירקטור ולמעט יחיד שמונה מטעם תאגיד שהוא דירקטור)'}, {'': 'תקנה 34 (ב) לתקנות ניירות ערך (דוחות תקופתיים ומיידיים), תש"ל - 1970'}, {'': 'הסבר: אם ממונה גם כדירקטור יש למלא טופס ת093 בלבד'}, {'': 'הסבר: בהתאם לתקנה 34 (ד) לתקנות ניירות ערך (דוחות תקופתיים ומיידים) תש"ל - 1970, יש להגיש במקביל להגשת טופס זה מצבת נושאי משרה בכירה במסגרת טופס ת097'}, {'': '1.'}, {'': 'שם משפחה ושם פרטי:'}, {'Shem': 'ברגמן דלי'}, {'': 'סוג מספר זיהוי:'}, {'SugMisparZihuy': 'מספר ת.ז.'}, {'': 'מספר זיהוי:'}, {'MisparZihuy': '027732304'}, {'': 'אזרחות/ ארץ התאגדות או רישום:'}, {'Ezrachut': 'אדם פרטי עם אזרחות ישראלית'}, {'': 'ארץ אזרחות / התאגדות או רישום:'}, {'EretzEzrachut': '_________'}, {'': '2.'}, {'': 'תאריך לידה:'}, {'TaarichLeida': '27/06/1970'}, {'': '3.'}, {'': 'מען להמצאת כתבי בית דין:'}, {'MaanLeHimatzutKitveyBeitDyn': 'בית ספרד, יורופארק, אזור תעשיה קיבוץ יקום'}, {'': '4.'}, {'': 'תאריך תחילת הכהונה:'}, {'TaarichTchilatHaKehuna': '01/01/2007'}, {'': '5.'}, {'': 'התפקיד לו מונה:'}, {'HaTafkidLoMuna': 'חשב'}, {'TeurHaTafkidLoMuna': '_________'}, {'': '6.'}, {'': 'תפקיד קודם בחברה טרם המינוי:'}, {'TafkidKodem': 'אין'}, {'TafkidKodemAher': '_________'}, {'': '7.'}, {'': 'השכלה אקדמית:'}, {'': 'תואר'}, {'': 'תחום'}, {'': 'שם המוסד האקדמי'}, {'Toar': 'בוגר'}, {'Tchum': 'חשבונאות וכלכלה'}, {'ShemHaMosadHaAcademi': 'אוניברסיטת תל- אביב'}, {'Toar': 'מוסמך'}, {'Tchum': 'מנהל עסקים'}, {'ShemHaMosadHaAcademi': 'אוניברסיטת תל- אביב'}, {'': 'השכלה אחרת ותעודות מקצועיות:'}, {'HaskalaAcheret': 'תעודת חשבות שכר'}, {'': '8.'}, {'': 'עיסוקים עיקריים ב – 5 השנים האחרונות:'}, {'': 'התפקיד שמילא'}, {'': 'מקום העבודה'}, {'': 'משך הזמן שמילא בתפקיד'}, {'HaTafkidSheMila': 'חשב'}, {'MekomHaAvoda': "ערוצי זהב ושות'"}, {'MeshechZmanSheMilaBaTafkid': '5 שנים'}, {'': '9.'}, {'': 'נושא משרה בכירה'}, {'NoseMisraBechira1': 'אינו ממלא'}, {'': 'בתפקידים אחרים בתאגיד,בחברת בת שלו, בחברה קשורה או אצל בעל העניין'}, {'': 'הסבר: אם הוא ממלא תפקידים אחרים בתאגיד, בחברה בת שלו או אצל בעל עניין בו נא לפרט.'}, {'Hesber1': '_________'}, {'': '10.'}, {'': 'נושא משרה בכירה'}, {'NoseMisraBechira2': 'אינו'}, {'': 'בן משפחה של נושא משרה בכירה אחר או של בעל עניין בתאגיד.'}, {'': 'הסבר: אם הוא בן משפחה של נושא משרה בכירה אחר או של בעל עניין בתאגיד, יש לפרט.'}, {'Hesber2': '_________'}, {'': '11.'}, {'': 'אם נושא המשרה הבכירה הוא מנכ"ל: הוא'}, {'NoseMisraBechira3': '_________'}, {'': 'בניירות ערך של התאגיד, של חברת בת או של חברה קשורה.'}, {'': 'הסבר: אם נושא המשרה הבכירה הוא מנכ"ל, יש לפרט אם הוא מחזיק ניירות ערך בתאגיד ,בחברת בת או בחברה קשורה. מילוי הערך מטבלה הוא לא שדה חובה.'}, {'Hesber3': '_________'}, {'TextHofshi': ''}, {'': 'מספרי אסמכתאות של מסמכים קודמים בנושא (אין האזכור מהווה הכללה על דרך הפניה):'}, {'FooterMisparAsmachta1': ''}, {'FooterMisparAsmachta2': ''}, {'FooterMisparAsmachta3': ''}, {'': 'שמות קודמים של ישות מדווחת:'}, {'ShemYeshutKodem': ''}, {'': 'תאריך עדכון מבנה הטופס:'}, {'TaarichIdkunMivne': '01/01/2007'}, {'': 'שם מדווח אלקטרוני:'}, {'FooterShemMedaveach': 'חריט אורית'}, {'FooterShemHevra': ''}, {'': 'תפקידו:'}, {'TafkidBaTaagid': 'עו"ד'}, {'Street': 'אזור התעשיה'}, {'StreetNumber': '-'}, {'City': 'יקום'}, {'ZipCode': '60972'}, {'': 'טלפון:'}, {'Telephone': '077-7077037'}, {'': 'פקס:'}, {'FooterFax1': '077-7078806'}, {'': 'דואר אלקטרוני:'}, {'FooterDoarElectroniMedaveach': '[email protected]'}], 'date': datetime.datetime(2007, 1, 1, 19, 14, 42), 'notification_type': 'ת091', 'positions': [['חשב', '_________']], 's3_object_name': 'maya.tase.co.il/2007_01/235402.htm', 'source': 'maya.tase.co.il', 'url': 'https://ams3.digitaloceanspaces.com/budgetkey-files/maya.tase.co.il/2007_01/235402.htm'}
----

Pipeline ID: people/company_appointments/maya/collect-maya-forms-debug-stats

Join the parsed PDF to get start and end time for each person (correlate)
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-09-28 04:36:17.005905
Last Completion:
2021-09-28 04:37:16.715767
Last Success:
2021-09-28 04:37:16.715767

Pipeline ID: people/company_appointments/maya/correlate

people/company_appointments/maya/maya-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 04:21:55.308496
Last Completion:
2021-09-28 04:23:02.198540
Last Success:
2021-09-28 04:23:02.198540

Pipeline ID: people/company_appointments/maya/maya-list

Appointment notices from Maya (maya-nominations)
Succeeded

Name, job and company description.


Last Run triggered by:
dirty-task-update
Last Run started at:
2021-09-28 04:33:16.432343
Last Completion:
2021-09-28 04:33:48.099658
Last Success:
2021-09-28 04:33:48.099658

Pipeline ID: people/company_appointments/maya/maya-nominations

people/company_appointments/maya/maya-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 00:00:32.717491
Last Completion:
2021-09-28 01:40:43.946100
Last Success:
2021-09-28 01:40:43.946100

Pipeline ID: people/company_appointments/maya/maya-notification-list

List all notifications from maya system (maya-notification-updates)
Succeeded

id, date, company, notification_type, s3_object_name, url


Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 03:37:45.945468
Last Completion:
2021-09-28 04:13:16.545484
Last Success:
2021-09-28 04:13:16.545484

Pipeline ID: people/company_appointments/maya/maya-notification-updates

Appointment notices from Maya (maya-resignations)
Succeeded

Name, job and company description.


Last Run triggered by:
dirty-task-update
Last Run started at:
2021-09-28 04:33:48.126844
Last Completion:
2021-09-28 04:34:20.111358
Last Success:
2021-09-28 04:34:20.111358

Pipeline ID: people/company_appointments/maya/maya-resignations

מינויים בכלכליסט (calcalist)
Succeeded

רשימת כל המינויים והחברות מאתר כלכליסט


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-06-25 12:52:07.078402
Last Completion:
2021-06-25 12:59:20.565291
Last Success:
2021-06-25 12:59:20.565291

Pipeline ID: people/company_appointments/media/calcalist/calcalist

Appointment notices from TheMarker (themarker)
Succeeded

Name, job and company description.


Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 00:00:21.814702
Last Completion:
2021-09-28 00:00:32.033526
Last Success:
2021-09-28 00:00:32.033526

Pipeline ID: people/company_appointments/media/themarker/themarker

Join the parsed PDF to get start and end time for each person (correlate)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 02:04:07.221145
Last Completion:
2021-09-28 02:04:10.798472
Last Success:
2021-09-28 02:04:10.798472

Pipeline ID: people/company_appointments/state_owned/correlate

Parse and concatenate all PDF reports (parse_pdf_resources)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 00:33:38.614314
Last Completion:
2021-09-28 00:33:41.723650
Last Success:
2021-09-28 00:33:41.723650

Pipeline ID: people/company_appointments/state_owned/parse_pdf_resources

collect links to all pdf reports on https://mof.gov.il/GCA/Directors/Pages/DirectorsManningReport.aspx (reports)
Succeeded

columns: date, url


Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 00:00:18.603454
Last Completion:
2021-09-28 00:00:29.617177
Last Success:
2021-09-28 00:00:29.617177

Pipeline ID: people/company_appointments/state_owned/reports

people/company_appointments/state_owned/state-owned-nominations
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 03:52:25.138921
Last Completion:
2021-09-28 03:52:28.023459
Last Success:
2021-09-28 03:52:28.023459

Pipeline ID: people/company_appointments/state_owned/state-owned-nominations

people/municipal_appointments/municipal_representitives
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:16:56.046239
Last Completion:
2021-05-13 10:16:59.457440
Last Success:
2021-05-13 10:16:59.457440

Pipeline ID: people/municipal_appointments/municipal_representitives

people/political_candidates/election_candidates21
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:16:20.348493
Last Completion:
2021-05-13 10:16:56.040846
Last Success:
2021-05-13 10:16:56.040846

Pipeline ID: people/political_candidates/election_candidates21

people/political_donations/political_donations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:16:09.492377
Last Completion:
2021-05-13 10:16:20.342973
Last Success:
2021-05-13 10:16:20.342973

Pipeline ID: people/political_donations/political_donations

people/procurement/procurement-individuals
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 06:29:13.003564
Last Completion:
2021-09-28 06:40:44.608619
Last Success:
2021-09-28 06:40:44.608619

Pipeline ID: people/procurement/procurement-individuals

procurement/calls_for_bids/calls-for-bids-all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 16:00:03.775517
Last Completion:
2021-09-28 16:12:08.823441
Last Success:
2021-09-28 16:12:08.823441

Pipeline ID: procurement/calls_for_bids/calls-for-bids-all

procurement/calls_for_bids/calls-for-bids-moh
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 00:00:24.125278
Last Completion:
2021-09-28 00:00:29.103272
Last Success:
2021-09-28 00:00:29.103272

Pipeline ID: procurement/calls_for_bids/calls-for-bids-moh

procurement/calls_for_bids/gov-publications
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 12:12:43.848667
Last Completion:
2021-05-13 12:13:03.059027
Last Success:
2021-05-13 12:13:03.059027

Pipeline ID: procurement/calls_for_bids/gov-publications

procurement/calls_for_bids/gov-publications-ministry-of-immigration
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 12:12:43.864235
Last Completion:
2021-05-13 12:12:50.198790
Last Success:
2021-05-13 12:12:50.198790

Pipeline ID: procurement/calls_for_bids/gov-publications-ministry-of-immigration

procurement/calls_for_bids/gov-publications2
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 12:12:43.860501
Last Completion:
2021-05-13 12:24:33.116656
Last Success:
2021-05-13 12:24:33.116656

Pipeline ID: procurement/calls_for_bids/gov-publications2

procurement/calls_for_bids/jobiz-all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 15:00:14.824517
Last Completion:
2021-09-28 15:00:16.852149
Last Success:
2021-09-28 15:00:16.852149

Pipeline ID: procurement/calls_for_bids/jobiz-all

procurement/calls_for_bids/jobiz-calls-for-bids
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 15:00:16.877676
Last Completion:
2021-09-28 15:00:18.493389
Last Success:
2021-09-28 15:00:18.493389

Pipeline ID: procurement/calls_for_bids/jobiz-calls-for-bids

procurement/calls_for_bids/jobiz-scraper
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 15:00:02.904246
Last Completion:
2021-09-28 15:00:14.802809
Last Success:
2021-09-28 15:00:14.802809

Pipeline ID: procurement/calls_for_bids/jobiz-scraper

התקשרויות רכש ממשלתיות (latest-contract-spending)
Running

אנו סוכמים מידע מתוך הדוחות הרבעוניים לתוך טבלה המכילה את המידע העדכני ביותר.


Last Run triggered by:
dirty-task-update
Last Run started at:
2021-09-28 23:01:00.326769
Last Completion:
Last Success:
2021-09-28 06:29:12.836670

Pipeline ID: procurement/spending/latest-contract-spending

procurement/spending/quarterly-contract-spending-report-uris
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 23:00:02.880981
Last Completion:
2021-09-28 23:00:32.161349
Last Success:
2021-09-28 23:00:32.161349

Pipeline ID: procurement/spending/quarterly-contract-spending-report-uris

דוחות רבעוניים מתוך מרכבה, לפי נוהל היחידה לחופש המידע. (quarterly-contract-spending-reports)
Succeeded

כל משרדי הממשלה ויחידות הסמך (שמחוברות למערכת מרכבה) צריכים לפרסם אחת לרבעון (תוך 45 יום מסוף הרבעון) דו״ח התקשרויות לפי פורמט מוגדר היטב הממומש כדו״ח מובנה במערכת המרכבה. כל המשרדים מדווחים עצמאית והדו״חות עולים לאתר היחידה לחופש המידע, משם אנו אוספים אותם. התוצר של השרשר הזה הוא פירוט כל הדיווחים של כל המשרדים.


Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 23:00:32.289422
Last Completion:
2021-09-28 23:17:56.240067
Last Success:
2021-09-28 23:17:56.240067

Pipeline ID: procurement/spending/quarterly-contract-spending-reports

procurement/spending/quarterly-contract-spending-reports-data
Running

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 23:17:56.347535
Last Completion:
Last Success:
2021-09-28 00:51:09.710779

Pipeline ID: procurement/spending/quarterly-contract-spending-reports-data

procurement/spending/spending-by-entity
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 06:29:12.881765
Last Completion:
2021-09-28 06:40:42.914242
Last Success:
2021-09-28 06:40:42.914242

Pipeline ID: procurement/spending/spending-by-entity

Load all tenders data from data.gov.il to flat file (all)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 00:25:06.920908
Last Completion:
2021-09-28 00:31:50.525918
Last Success:
2021-09-28 00:31:50.525918

Pipeline ID: procurement/tenders/all

procurement/tenders/processed
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 03:39:33.462184
Last Completion:
2021-09-28 03:47:59.147160
Last Success:
2021-09-28 03:47:59.147160

Pipeline ID: procurement/tenders/processed

reports/all
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-07-29 07:49:06.328921
Last Completion:
2021-07-29 07:49:11.443767
Last Success:
2021-07-29 07:49:11.443767

Pipeline ID: reports/all

reports/ngos/ngo-activity-report
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-07-29 07:43:14.271558
Last Completion:
2021-07-29 07:49:05.656108
Last Success:
2021-07-29 07:49:05.656108

Pipeline ID: reports/ngos/ngo-activity-report

reports/ngos/ngo-district-report
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-07-29 07:43:14.267120
Last Completion:
2021-07-29 07:47:39.942460
Last Success:
2021-07-29 07:47:39.942460

Pipeline ID: reports/ngos/ngo-district-report

supports/all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-27 18:09:10.713690
Last Completion:
2021-09-27 18:14:28.033736
Last Success:
2021-09-27 18:14:28.033736

Pipeline ID: supports/all

supports/by-payment-year
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 01:49:44.215502
Last Completion:
2021-09-28 01:58:52.138645
Last Success:
2021-09-28 01:58:52.138645

Pipeline ID: supports/by-payment-year

supports/by-request-year
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 01:51:57.230340
Last Completion:
2021-09-28 02:03:43.916658
Last Success:
2021-09-28 02:03:43.916658

Pipeline ID: supports/by-request-year

supports/criteria/support-criteria
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 02:04:04.701056
Last Completion:
2021-09-28 02:04:15.404366
Last Success:
2021-09-28 02:04:15.404366

Pipeline ID: supports/criteria/support-criteria

supports/criteria/support-criteria-doj
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-09-28 00:33:30.518217
Last Completion:
2021-09-28 00:33:38.598826
Last Success:
2021-09-28 00:33:38.598826

Pipeline ID: supports/criteria/support-criteria-doj

supports/supports-2004
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:05.077865
Last Completion:
2021-05-15 07:28:09.149585
Last Success:
2021-05-15 07:28:09.149585

Pipeline ID: supports/supports-2004

supports/supports-2005
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:05.081187
Last Completion:
2021-05-15 07:28:08.946001
Last Success:
2021-05-15 07:28:08.946001

Pipeline ID: supports/supports-2005

supports/supports-2006
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:05.149888
Last Completion:
2021-05-15 07:28:09.165177
Last Success:
2021-05-15 07:28:09.165177

Pipeline ID: supports/supports-2006

supports/supports-2007
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:05.153070
Last Completion:
2021-05-15 07:28:09.543286
Last Success:
2021-05-15 07:28:09.543286

Pipeline ID: supports/supports-2007

supports/supports-2008
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:05.167896
Last Completion:
2021-05-15 07:28:08.765835
Last Success:
2021-05-15 07:28:08.765835

Pipeline ID: supports/supports-2008

supports/supports-2009
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:08.847174
Last Completion:
2021-05-15 07:28:11.472865
Last Success:
2021-05-15 07:28:11.472865

Pipeline ID: supports/supports-2009

supports/supports-2010
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:08.953846
Last Completion:
2021-05-15 07:28:11.760031
Last Success:
2021-05-15 07:28:11.760031

Pipeline ID: supports/supports-2010

supports/supports-2011
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:09.162466
Last Completion:
2021-05-15 07:28:11.569127
Last Success:
2021-05-15 07:28:11.569127

Pipeline ID: supports/supports-2011

supports/supports-2012
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:09.172544
Last Completion:
2021-05-15 07:28:12.046532
Last Success:
2021-05-15 07:28:12.046532

Pipeline ID: supports/supports-2012

supports/supports-2013
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:09.553460
Last Completion:
2021-05-15 07:28:12.659860
Last Success:
2021-05-15 07:28:12.659860

Pipeline ID: supports/supports-2013

supports/supports-2014
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:09.660997
Last Completion:
2021-05-15 07:28:12.551766
Last Success:
2021-05-15 07:28:12.551766

Pipeline ID: supports/supports-2014