activities/social_services/social_service_suppliers
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 00:24:17.333891
Last Completion:
2021-08-05 00:24:20.626152
Last Success:
2021-08-05 00:24:20.626152

Pipeline ID: activities/social_services/social_service_suppliers

activities/social_services/social_service_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 00:24:20.635761
Last Completion:
2021-08-05 00:24:24.455316
Last Success:
2021-08-05 00:24:24.455316

Pipeline ID: activities/social_services/social_service_tenders

Fetch social services from data input (social_services)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 00:00:23.014948
Last Completion:
2021-08-05 00:00:46.449223
Last Success:
2021-08-05 00:00:46.449223

Pipeline ID: activities/social_services/social_services

bank_of_israel/bank_of_israel
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 16:21:26.498569
Last Completion:
2021-05-13 16:25:14.252534
Last Success:
2021-05-13 16:25:14.252534

Pipeline ID: bank_of_israel/bank_of_israel

budget/national/changes/explanations/all
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-18 09:37:51.019675
Last Completion:
2021-05-18 09:39:36.039549
Last Success:
2021-05-18 09:39:36.039549

Pipeline ID: budget/national/changes/explanations/all

budget/national/changes/original/current-year-fixes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-07-30 02:07:45.760897
Last Completion:
2021-07-30 02:08:24.936358
Last Success:
2021-07-30 02:08:24.936358

Pipeline ID: budget/national/changes/original/current-year-fixes

budget/national/changes/original/national-budget-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-07-30 00:05:31.615011
Last Completion:
2021-07-30 00:10:14.159808
Last Success:
2021-07-30 00:10:14.159808

Pipeline ID: budget/national/changes/original/national-budget-changes

Changes, grouped by transaction_id, with explanations (national-budget-changes-aggregated)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-07-30 12:07:11.747293
Last Completion:
2021-07-30 12:11:45.026397
Last Success:
2021-07-30 12:11:45.026397

Pipeline ID: budget/national/changes/processed/national-budget-changes-aggregated

budget/national/changes/processed/transactions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-07-30 02:08:25.020256
Last Completion:
2021-07-30 12:07:11.458565
Last Success:
2021-07-30 12:07:11.458565

Pipeline ID: budget/national/changes/processed/transactions

National Yearly Budgets (national-budgets)
Succeeded

We get the data the Ministry of Finance publishes in data.gov.il every year. It comes in XLS format, with one row per TAKANA and phase (original, approved, executed). In this pipeline we create from each triplet a single row that has all the data.


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:15:17.615182
Last Completion:
2021-05-13 11:26:39.929891
Last Success:
2021-05-13 11:26:39.929891

Pipeline ID: budget/national/original/national-budgets

National Yearly Budgets - Processed (aggregated-yearly)
Succeeded

This pipeline joins the different phases of the budget (allocated, revised and executed). In the original file there's a separate row for each of the phases. We like it better as a single row with all phase info. Another thing this pipeline does is to rename the column titles - to more friendly English names. Also, it create rows for all hierarchies - where upper hierarchies (2, 4 & 6 digits) are plain aggregations of the 8-digit items they contain.


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 14:31:07.591139
Last Completion:
2021-05-13 16:20:58.443229
Last Success:
2021-05-13 16:20:58.443229

Pipeline ID: budget/national/processed/aggregated-yearly

budget/national/processed/category-explanations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:15:52.098941
Last Completion:
2021-05-13 10:15:52.680936
Last Success:
2021-05-13 10:15:52.680936

Pipeline ID: budget/national/processed/category-explanations

National Yearly Budgets - Joined with category-explanations (connected-items-explained)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-06-25 14:51:17.968724
Last Completion:
2021-06-25 14:59:36.044017
Last Success:
2021-06-25 14:59:36.044017

Pipeline ID: budget/national/processed/connected-items-explained

National Yearly Budgets - Connected Items (connected-national-budgets)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-06-25 14:01:54.773173
Last Completion:
2021-06-25 14:32:45.258029
Last Success:
2021-06-25 14:32:45.258029

Pipeline ID: budget/national/processed/connected-national-budgets

National Yearly Budgets - Just the total (item 00) (just-the-total)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-06-25 13:47:09.870519
Last Completion:
2021-06-25 13:51:56.485356
Last Success:
2021-06-25 13:51:56.485356

Pipeline ID: budget/national/processed/just-the-total

National Yearly Budgets - Main Item Names (roof-names)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-06-25 13:47:09.948998
Last Completion:
2021-06-25 13:51:59.673049
Last Success:
2021-06-25 13:51:59.673049

Pipeline ID: budget/national/processed/roof-names

National Yearly Budgets - With Extras (with-extras)
Succeeded

This pipeline joins the budget data to itself so that each item has a list of its immediate children.


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-06-25 12:51:53.151041
Last Completion:
2021-06-25 13:14:37.251810
Last Success:
2021-06-25 13:14:37.251810

Pipeline ID: budget/national/processed/with-extras

budgetkey/analysis/spending/publisher_entity_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 10:15:42.702298
Last Completion:
2021-08-05 11:14:49.401495
Last Success:
2021-08-05 11:14:49.401495

Pipeline ID: budgetkey/analysis/spending/publisher_entity_analysis

budgetkey/analysis/spending/publisher_foa_analysis
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 10:15:42.712176
Last Completion:
2021-08-05 10:22:17.566560
Last Success:
2021-08-05 10:22:17.566560

Pipeline ID: budgetkey/analysis/spending/publisher_foa_analysis

budgetkey/analysis/spending/united
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 10:00:03.113949
Last Completion:
2021-08-05 10:15:42.459522
Last Success:
2021-08-05 10:15:42.459522

Pipeline ID: budgetkey/analysis/spending/united

Main Page - Aggregated budget by functional classification (budget-functional-aggregates)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 18:11:55.037647
Last Completion:
2021-05-13 18:14:37.897472
Last Success:
2021-05-13 18:14:37.897472

Pipeline ID: budgetkey/budget-functional-aggregates

budgetkey/documents
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 19:08:17.160746
Last Completion:
2021-05-13 19:08:18.865794
Last Success:
2021-05-13 19:08:18.865794

Pipeline ID: budgetkey/documents

budgetkey/elasticsearch/index_activities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 00:24:24.532102
Last Completion:
2021-08-05 00:24:41.615101
Last Success:
2021-08-05 00:24:41.615101

Pipeline ID: budgetkey/elasticsearch/index_activities

budgetkey/elasticsearch/index_budget
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-07-30 01:37:32.246426
Last Completion:
2021-07-30 02:21:40.715936
Last Success:
2021-07-30 02:21:40.715936

Pipeline ID: budgetkey/elasticsearch/index_budget

budgetkey/elasticsearch/index_calls_for_bids
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-04 16:10:12.471211
Last Completion:
2021-08-04 16:10:25.095912
Last Success:
2021-08-04 16:10:25.095912

Pipeline ID: budgetkey/elasticsearch/index_calls_for_bids

budgetkey/elasticsearch/index_contract_spending
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 06:26:27.337634
Last Completion:
2021-08-05 08:38:19.356277
Last Success:
2021-08-05 08:38:19.356277

Pipeline ID: budgetkey/elasticsearch/index_contract_spending

budgetkey/elasticsearch/index_entities
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-08-02 02:14:50.616858
Last Completion:
2021-08-02 04:24:35.535012
Last Success:
2021-08-02 04:24:35.535012

Pipeline ID: budgetkey/elasticsearch/index_entities

budgetkey/elasticsearch/index_gov_decisions
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-08-01 12:01:01.859683
Last Completion:
2021-08-01 12:05:07.691498
Last Success:
2021-08-01 12:05:07.691498

Pipeline ID: budgetkey/elasticsearch/index_gov_decisions

budgetkey/elasticsearch/index_national_budget_changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-07-30 12:11:45.313701
Last Completion:
2021-07-30 12:15:20.803895
Last Success:
2021-07-30 12:15:20.803895

Pipeline ID: budgetkey/elasticsearch/index_national_budget_changes

budgetkey/elasticsearch/index_people
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-08-05 07:07:28.485538
Last Completion:
2021-08-05 07:11:19.428003
Last Success:
2021-08-05 07:11:19.428003

Pipeline ID: budgetkey/elasticsearch/index_people

budgetkey/elasticsearch/index_reports
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-07-30 01:51:08.834647
Last Completion:
2021-07-30 01:52:17.015149
Last Success:
2021-07-30 01:52:17.015149

Pipeline ID: budgetkey/elasticsearch/index_reports

budgetkey/elasticsearch/index_support_criteria
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 01:36:20.733391
Last Completion:
2021-08-05 01:36:43.251077
Last Success:
2021-08-05 01:36:43.251077

Pipeline ID: budgetkey/elasticsearch/index_support_criteria

budgetkey/elasticsearch/index_supports
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 01:45:40.018584
Last Completion:
2021-08-05 03:21:14.653304
Last Success:
2021-08-05 03:21:14.653304

Pipeline ID: budgetkey/elasticsearch/index_supports

budgetkey/elasticsearch/index_tenders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 03:06:07.244595
Last Completion:
2021-08-05 03:47:17.012932
Last Success:
2021-08-05 03:47:17.012932

Pipeline ID: budgetkey/elasticsearch/index_tenders

budgetkey/elasticsearch/index_units
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 01:06:02.850055
Last Completion:
2021-08-05 01:06:13.548800
Last Success:
2021-08-05 01:06:13.548800

Pipeline ID: budgetkey/elasticsearch/index_units

budgetkey/elasticsearch/sitemaps
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 08:38:19.825922
Last Completion:
2021-08-05 09:33:21.874663
Last Success:
2021-08-05 09:33:21.874663

Pipeline ID: budgetkey/elasticsearch/sitemaps

Send periodic emails (emails)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-07-30 06:22:32.155528
Last Completion:
2021-07-30 13:04:23.287943
Last Success:
2021-07-30 13:04:23.287943

Pipeline ID: budgetkey/emails/emails

donations/candidates
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 12:49:33.668219
Last Completion:
2021-05-13 12:49:44.646388
Last Success:
2021-05-13 12:49:44.646388

Pipeline ID: donations/candidates

donations/parties
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:15:52.734546
Last Completion:
2021-05-13 10:16:09.487287
Last Success:
2021-05-13 10:16:09.487287

Pipeline ID: donations/parties

donations/transactions
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-08-01 09:16:05.348540
Last Completion:
2021-08-01 09:16:12.732022
Last Success:
None

get_transactions
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 150, in <module>
    spew(dp, process_resources(res_iter))
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 109, in get_transactions
    for resp in self.get_for_candidate(cid):
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 95, in get_for_candidate
    resp = self.get_for_range(cid, range_start, range_end)
  File "/datapackage_pipelines_budgetkey/pipelines/donations/get_transactions.py", line 70, in get_for_range
    assert len(resp) == 6
AssertionError
read unix @->/var/run/docker.sock: read: connection reset by peer

Pipeline ID: donations/transactions

education/tochniyot/tochniyot
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:39:08.772024
Last Completion:
2021-05-15 07:39:19.636786
Last Success:
2021-05-15 07:39:19.636786

Pipeline ID: education/tochniyot/tochniyot

entities/all
Invalid

Last Run triggered by:
scheduled
Last Run started at:
2021-08-01 20:05:56.325611
Last Completion:
2021-08-01 20:20:01.226891
Last Success:
2021-08-01 20:20:01.226891

Dependency unsuccessful :Cannot run until dependency "./entities/special/registry" is successfully executed

Pipeline ID: entities/all

entities/associations/guidestar/guidestar
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-07-29 07:38:34.074956
Last Completion:
2021-07-29 07:43:13.713766
Last Success:
2021-07-29 07:43:13.713766

Pipeline ID: entities/associations/guidestar/guidestar

entities/associations/guidestar/guidestar-scraper
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-07-29 07:22:04.521422
Last Completion:
2021-07-29 07:38:33.858694
Last Success:
2021-07-29 07:38:33.858694

Pipeline ID: entities/associations/guidestar/guidestar-scraper

עמותות פעילות מרשם העמותות (registry)
Succeeded

רשימת כלל העמותות הפעילות, מתעדכן שבועית.


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:29:49.070695
Last Completion:
2021-05-13 10:30:27.053958
Last Success:
2021-05-13 10:30:27.053958

Pipeline ID: entities/associations/registrar/registry

entities/companies/registrar/details
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 01:09:08.145386
Last Completion:
2021-08-05 01:17:05.534648
Last Success:
2021-08-05 01:17:05.534648

Pipeline ID: entities/companies/registrar/details

חברות פעילות מרשם החברות (scraper)
Succeeded

רשימת כלל החברות הפעילות, מתעדכן שבועית.


Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 00:01:58.521193
Last Completion:
2021-08-05 00:16:59.126294
Last Success:
2021-08-05 00:16:59.126294

Pipeline ID: entities/companies/registrar/scraper

רשימת אגודות שיתופיות (cooperatives)
Succeeded

רשימת אגודות שיתופיות, מתוך ממשק נתונים של מאגר של משרד הכלכלה / האגף לאיגוד שיתופי, מתעדכן שבועית


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:37:28.458283
Last Completion:
2021-05-13 11:22:03.555060
Last Success:
2021-05-13 11:22:03.555060

Pipeline ID: entities/cooperatives/cooperatives

רשימת הקדשים (endowments)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-07-29 15:38:27.024173
Last Completion:
2021-07-29 15:38:43.656432
Last Success:
2021-07-29 15:38:43.656432

Pipeline ID: entities/endowments/endowments

entities/entities
Invalid

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-08-02 01:19:51.844069
Last Completion:
2021-08-02 01:35:21.522139
Last Success:
2021-08-02 01:35:21.522139

Invalid dependency :Cannot run until dependency passes validation: ./entities/all
From ./entities/all :['Dependency unsuccessful', 'Cannot run until dependency "./entities/special/registry" is successfully executed']

Pipeline ID: entities/entities

entities/fingerprints
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-08-02 01:19:44.546865
Last Completion:
2021-08-02 03:32:15.542558
Last Success:
2021-08-02 03:32:15.542558

Pipeline ID: entities/fingerprints

entities/foi_orgs/foi_orgs
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:19:35.751155
Last Completion:
2021-05-13 10:20:38.842412
Last Success:
2021-05-13 10:20:38.842412

Pipeline ID: entities/foi_orgs/foi_orgs

entities/moital/moital_service_providers
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:30:27.059041
Last Completion:
2021-05-13 10:37:28.451255
Last Success:
2021-05-13 10:37:28.451255

Pipeline ID: entities/moital/moital_service_providers

רשימת אגודות עותומניות (ottoman-association-registry)
Succeeded

רשימת אגודות עותומניות, מתוך תשובה לבקשת חופש מידע


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 14:38:39.673414
Last Completion:
2021-05-13 14:38:53.363762
Last Success:
2021-05-13 14:38:53.363762

Pipeline ID: entities/ottoman/ottoman-association-registry

רשימת שותפויות (partnerships)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-07-29 14:57:09.152244
Last Completion:
2021-07-29 14:57:33.724787
Last Success:
2021-07-29 14:57:33.724787

Pipeline ID: entities/partnerships/partnerships

entities/safety-orders/safety-orders
Failed

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 00:03:04.129945
Last Completion:
2021-08-05 00:03:08.220840
Last Success:
None

stream_remote_resources
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 245, in <module>
    resource.pop('http_headers', None))
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 199, in stream_reader
    schema, headers, columns, stream, close = get_opener(url, _resource)()
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 175, in opener
    _stream.open()
  File "/usr/local/lib/python3.7/site-packages/tabulator/stream.py", line 423, in open
    self.__parser.open(source, encoding=self.__encoding)
  File "/usr/local/lib/python3.7/site-packages/tabulator/parsers/xlsx.py", line 99, in open
    self.__bytes, read_only=not self.__fill_merged_cells, data_only=True
  File "/usr/local/lib/python3.7/site-packages/openpyxl/reader/excel.py", line 316, in load_workbook
    data_only, keep_links)
  File "/usr/local/lib/python3.7/site-packages/openpyxl/reader/excel.py", line 124, in __init__
    self.archive = _validate_archive(fn)
  File "/usr/local/lib/python3.7/site-packages/openpyxl/reader/excel.py", line 96, in _validate_archive
    archive = ZipFile(filename, 'r')
  File "/usr/local/lib/python3.7/zipfile.py", line 1258, in __init__
    self._RealGetContents()
  File "/usr/local/lib/python3.7/zipfile.py", line 1325, in _RealGetContents
    raise BadZipFile("File is not a zip file")
zipfile.BadZipFile: File is not a zip file

Pipeline ID: entities/safety-orders/safety-orders

entities/safety-orders/safety-orders-by-entity
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./entities/safety-orders/safety-orders" is successfully executed

Pipeline ID: entities/safety-orders/safety-orders-by-entity

entities/special/registry
Failed

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 00:00:34.650358
Last Completion:
2021-08-05 00:02:58.514016
Last Success:
2021-08-01 07:17:17.418455

scraper
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/entities/special/scraper.py", line 152, in <module>
    spew(datapackage, itertools.chain(res_iter, [scrape()]))
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/entities/special/scraper.py", line 96, in scrape
    prepare()
  File "/datapackage_pipelines_budgetkey/pipelines/entities/special/scraper.py", line 64, in prepare
    EC.presence_of_element_located((By.ID, "RadioBakasha1"))
  File "/usr/local/lib/python3.7/site-packages/selenium/webdriver/support/wait.py", line 80, in until
    raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
DEBUG   :[chan 1] Max packet in: 32768 bytes
DEBUG   :[chan 1] Max packet out: 32768 bytes
DEBUG   :Secsh channel 1 opened.
DEBUG   :[chan 1] Sesch channel 1 request ok
DEBUG   :[chan 1] EOF received (1)
DEBUG   :[chan 1] EOF sent (1)

Pipeline ID: entities/special/registry

ezvonot/ezvonot_accounts
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 00:23:00.417661
Last Completion:
2021-08-05 00:23:26.351187
Last Success:
2021-08-05 00:23:26.351187

Pipeline ID: ezvonot/ezvonot_accounts

ezvonot/ezvonot_cases
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 00:23:26.425620
Last Completion:
2021-08-05 00:23:43.831369
Last Success:
2021-08-05 00:23:43.831369

Pipeline ID: ezvonot/ezvonot_cases

ezvonot/ezvonot_crontab
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 00:00:17.418373
Last Completion:
2021-08-05 00:00:19.626354
Last Success:
2021-08-05 00:00:19.626354

Pipeline ID: ezvonot/ezvonot_crontab

ezvonot/ezvonot_decisions
Failed

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 00:23:58.823565
Last Completion:
2021-08-05 00:24:07.022234
Last Success:
None

data_gov_il_resource
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/processors/data_gov_il_resource.py", line 59, in <module>
    spew_flow(flow(ctx.parameters), ctx)
  File "/datapackage_pipelines_budgetkey/processors/data_gov_il_resource.py", line 40, in flow
    url, path = get_resource(gcd, dataset_name, resource_name)
  File "/datapackage_pipelines_budgetkey/common/data_gov_il.py", line 101, in get_resource
    assert False, 'Failed to find resource for name %s: possibilities are %r' % (resource_name, [r['name'] for r in dataset['resources']])
AssertionError: Failed to find resource for name קובץ החלטות וועדה : possibilities are ['קובץ הפקדות', 'קובץ חשבונות המרכיבים את החלטות הועדה', 'קובץ תיקים', 'קובץ ייעודים', 'קובץ החלטות וועדה ', 'הוראות לפתיחת קובץ מאגר באמצעות תוכנת excel']

Pipeline ID: ezvonot/ezvonot_decisions

ezvonot/ezvonot_decisions_join
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./ezvonot/ezvonot_decisions" is successfully executed

Pipeline ID: ezvonot/ezvonot_decisions_join

ezvonot/ezvonot_deposits
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 00:22:26.127645
Last Completion:
2021-08-05 00:23:00.340120
Last Success:
2021-08-05 00:23:00.340120

Pipeline ID: ezvonot/ezvonot_deposits

ezvonot/ezvonot_purposes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 00:23:43.918169
Last Completion:
2021-08-05 00:23:58.746865
Last Success:
2021-08-05 00:23:58.746865

Pipeline ID: ezvonot/ezvonot_purposes

government_decisions/government_decisions
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-07-31 12:00:07.196665
Last Completion:
2021-07-31 12:00:17.870514
Last Success:
2021-07-31 12:00:17.870514

Pipeline ID: government_decisions/government_decisions

government_decisions/scraper
Failed

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 12:00:03.054904
Last Completion:
2021-08-05 12:00:09.526509
Last Success:
2021-07-31 12:00:07.025541

scraper
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 706, in urlopen
    chunked=chunked,
  File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 382, in _make_request
    self._validate_conn(conn)
  File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 1010, in _validate_conn
    conn.connect()
  File "/usr/local/lib/python3.7/site-packages/urllib3/connection.py", line 421, in connect
    tls_in_tls=tls_in_tls,
  File "/usr/local/lib/python3.7/site-packages/urllib3/util/ssl_.py", line 450, in ssl_wrap_socket
    sock, context, tls_in_tls, server_hostname=server_hostname
  File "/usr/local/lib/python3.7/site-packages/urllib3/util/ssl_.py", line 493, in _ssl_wrap_socket_impl
    return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
  File "/usr/local/lib/python3.7/ssl.py", line 423, in wrap_socket
    session=session
  File "/usr/local/lib/python3.7/ssl.py", line 870, in _create
    self.do_handshake()
  File "/usr/local/lib/python3.7/ssl.py", line 1139, in do_handshake
    self._sslobj.do_handshake()
ConnectionResetError: [Errno 104] Connection reset by peer
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 756, in urlopen
    method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
  File "/usr/local/lib/python3.7/site-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.7/site-packages/urllib3/packages/six.py", line 769, in reraise
    raise value.with_traceback(tb)
  File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 706, in urlopen
    chunked=chunked,
  File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 382, in _make_request
    self._validate_conn(conn)
  File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 1010, in _validate_conn
    conn.connect()
  File "/usr/local/lib/python3.7/site-packages/urllib3/connection.py", line 421, in connect
    tls_in_tls=tls_in_tls,
  File "/usr/local/lib/python3.7/site-packages/urllib3/util/ssl_.py", line 450, in ssl_wrap_socket
    sock, context, tls_in_tls, server_hostname=server_hostname
  File "/usr/local/lib/python3.7/site-packages/urllib3/util/ssl_.py", line 493, in _ssl_wrap_socket_impl
    return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
  File "/usr/local/lib/python3.7/ssl.py", line 423, in wrap_socket
    session=session
  File "/usr/local/lib/python3.7/ssl.py", line 870, in _create
    self.do_handshake()
  File "/usr/local/lib/python3.7/ssl.py", line 1139, in do_handshake
    self._sslobj.do_handshake()
urllib3.exceptions.ProtocolError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/government_decisions/scraper.py", line 128, in <module>
    spew(datapackage, chain(res_iter, [get_decision_list()]))
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/government_decisions/scraper.py", line 56, in get_decision_list
    response = session.get(SEARCH_PAGE_RESULTS_URL.format(skip=0), timeout=TIMEOUT).json()
  File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/requests/adapters.py", line 498, in send
    raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))

Pipeline ID: government_decisions/scraper

lamas/municipal-data
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-08-01 07:17:18.034168
Last Completion:
2021-08-01 07:18:22.415675
Last Success:
2021-08-01 07:18:22.415675

Pipeline ID: lamas/municipal-data

קובץ התאמת רשויות אזוריות לישובים בשטחן (municipality-to-city)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-06-25 12:51:52.448998
Last Completion:
2021-06-25 12:52:07.071841
Last Success:
2021-06-25 12:52:07.071841

Pipeline ID: lamas/municipality-to-city

maya/maya-bonds-and-options-holdings-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 04:26:54.532658
Last Completion:
2021-08-05 04:44:05.737598
Last Success:
2021-08-05 04:44:05.737598

Pipeline ID: maya/maya-bonds-and-options-holdings-changes

maya/maya-company-officer-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 04:26:54.515111
Last Completion:
2021-08-05 04:47:29.324245
Last Success:
2021-08-05 04:47:29.324245

Pipeline ID: maya/maya-company-officer-list

maya/maya-company-stakeholder-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 04:31:42.326435
Last Completion:
2021-08-05 05:06:09.514987
Last Success:
2021-08-05 05:06:09.514987

Pipeline ID: maya/maya-company-stakeholder-list

maya/maya-company-vip-appointments
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 04:26:54.520833
Last Completion:
2021-08-05 04:44:10.417505
Last Success:
2021-08-05 04:44:10.417505

Pipeline ID: maya/maya-company-vip-appointments

maya/maya-complete-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 03:41:43.826978
Last Completion:
2021-08-05 04:26:54.175608
Last Success:
2021-08-05 04:26:54.175608

Pipeline ID: maya/maya-complete-notification-list

maya/maya-holdings-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 04:28:49.738816
Last Completion:
2021-08-05 04:48:31.515138
Last Success:
2021-08-05 04:48:31.515138

Pipeline ID: maya/maya-holdings-changes

maya/maya-notification-parse-updates
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 01:37:47.324190
Last Completion:
2021-08-05 03:38:47.273096
Last Success:
2021-08-05 03:38:47.273096

Pipeline ID: maya/maya-notification-parse-updates

maya/maya-reported-academic-degrees
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 04:44:05.747197
Last Completion:
2021-08-05 04:58:05.633195
Last Success:
2021-08-05 04:58:05.633195

Pipeline ID: maya/maya-reported-academic-degrees

maya/maya-reported-work-record
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 04:44:10.435397
Last Completion:
2021-08-05 04:58:13.847165
Last Success:
2021-08-05 04:58:13.847165

Pipeline ID: maya/maya-reported-work-record

maya/maya-tase-companies-current-management
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 04:48:31.523969
Last Completion:
2021-08-05 05:39:06.012360
Last Success:
2021-08-05 05:39:06.012360

Pipeline ID: maya/maya-tase-companies-current-management

maya/maya-tase-companies-current-shareholders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 04:47:29.332633
Last Completion:
2021-08-05 05:38:19.319444
Last Success:
2021-08-05 05:38:19.319444

Pipeline ID: maya/maya-tase-companies-current-shareholders

maya/scrape-maya-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 00:00:19.218188
Last Completion:
2021-08-05 00:28:09.433669
Last Success:
2021-08-05 00:28:09.433669

Pipeline ID: maya/scrape-maya-notification-list

maya/scrape-maya-tase-companies
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 00:00:21.421415
Last Completion:
2021-08-05 00:01:58.457359
Last Success:
2021-08-05 00:01:58.457359

Pipeline ID: maya/scrape-maya-tase-companies

people/aggregated
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-08-05 06:51:02.471233
Last Completion:
2021-08-05 07:07:28.238524
Last Success:
2021-08-05 07:07:28.238524

Pipeline ID: people/aggregated

people/all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 06:40:27.716679
Last Completion:
2021-08-05 06:41:49.100805
Last Success:
2021-08-05 06:41:49.100805

Pipeline ID: people/all

people/association_founders/association-founders
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-07-29 07:43:14.337122
Last Completion:
2021-07-29 07:45:21.432600
Last Success:
2021-07-29 07:45:21.432600

Pipeline ID: people/association_founders/association-founders

people/company_appointments/all-appointments
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 03:45:13.428591
Last Completion:
2021-08-05 03:47:29.368395
Last Success:
2021-08-05 03:47:29.368395

Pipeline ID: people/company_appointments/all-appointments

people/company_appointments/maya/collect-maya-forms-debug-stats
Failed

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 01:59:31.742940
Last Completion:
2021-08-05 01:59:36.912767
Last Success:
None

dump_to_path
ERROR   :Traceback (most recent call last):
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/base/schema_validator.py", line 73, in schema_validator
ERROR   :row[field.name] = field.cast_value(row.get(field.name))
ERROR   :File "/usr/local/lib/python3.7/site-packages/tableschema/field.py", line 170, in cast_value
ERROR   :).format(field=self, value=value))
ERROR   :datapackage.exceptions
ERROR   :.
ERROR   :CastError
ERROR   ::
ERROR   :Field "HeaderProofValue_equals_HeaderProof" can't cast value "True" for type "number" with format "default"
ERROR   :During handling of the above exception, another exception occurred:
ERROR   :Traceback (most recent call last):
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/dump_to_path.py", line 23, in <module>
ERROR   :spew_flow(flow(ctx.parameters, ctx.stats), ctx)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
ERROR   :spew(self.datapackage, self.resource_iterator, stats=self.stats)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
ERROR   :for rec in res:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/processors/dumpers/dumper_base.py", line 69, in row_counter
ERROR   :for row in iterator:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/processors/dumpers/file_dumper.py", line 78, in rows_processor
ERROR   :for row in resource:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/base/schema_validator.py", line 75, in schema_validator
ERROR   :if not on_error(resource['name'], row, i, e, field):
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/base/schema_validator.py", line 49, in func
ERROR   :return on_error(res_name, row, i, e)
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/base/schema_validator.py", line 24, in raise_exception
ERROR   :raise ValidationError(res_name, row, i, e)
ERROR   :dataflows.base.schema_validator
ERROR   :.
ERROR   :ValidationError
ERROR   ::
ERROR   :ROW: {'HeaderEntityNameEB': Decimal('1'), 'HeaderFixtReport': 0, 'HeaderProof': Decimal('1'), 'HeaderProofFormat': 0, 'HeaderProofValue': Decimal('1'), 'HeaderProofValue_equals_HeaderProof': True, 'alias_stats': [{'FormSubject': '_________'}, {'KodSugYeshut': '1'}, {'ShemYeshutIvrit': 'מת"ב - מערכות תקשורת בכבלים בע"מ'}, {'MisparTofes': 'ת091'}, {'ShemYeshutLoazit': 'MATAV CABLE SYSTEMS MEDIA LTD'}, {'PumbiLoPumbi': 'פומבי'}, {'MezahehHotem': '5086'}, {'': 'מספר ברשם:'}, {'HeaderMisparBaRasham': '520040072'}, {'NeyarotErechReshumim': 'ניירות ערך של התאגיד רשומים למסחר בבורסה בתל-אביב'}, {'MezahehYeshut': '478'}, {'': 'שם מקוצר:'}, {'HeaderSemelBursa': 'מתב'}, {'MezahehTofes': '65'}, {'': 'רחוב:'}, {'HeaderRehov': 'בית ספרד, יורופארק, יקום'}, {'HeaderMisparBait': '1'}, {'HeaderYeshuv': 'יקום'}, {'HeaderMikud': '60972'}, {'HeaderPhone': 'טלפון:'}, {'HeaderTelephone1': '077-7077031'}, {'HeaderTelephone2': '077-7077037'}, {'': 'פקס:'}, {'HeaderFax1': '077-7078230'}, {'': 'דואר אלקטרוני:'}, {'HeaderDoarElectroniMedaveach': '[email protected]'}, {'HeaderSendDate': 'תאריך שידור:'}, {'HeaderSendTime': 'שעת שידור:'}, {'ShaaShidur': '19:06:46'}, {'': 'אתר החברה:'}, {'CompanyUrl': 'www.hot.co.il'}, {'': 'אסמכתא:'}, {'': 'לכבוד'}, {'': 'לכבוד'}, {'': 'רשות ניירות ערך'}, {'': 'הבורסה לניירות ערך בת"א בע"מ'}, {'DoarElectroniRashut': 'www.isa.gov.il'}, {'DoarElectroniBursa': 'www.tase.co.il'}, {'Hanadon': 'דוח מיידי על מינוי נושא משרה בכירה (למעט מינוי דירקטור ולמעט יחיד שמונה מטעם תאגיד שהוא דירקטור)'}, {'': 'תקנה 34 (ב) לתקנות ניירות ערך (דוחות תקופתיים ומיידיים), תש"ל - 1970'}, {'': 'הסבר: אם ממונה גם כדירקטור יש למלא טופס ת093 בלבד'}, {'': 'הסבר: בהתאם לתקנה 34 (ד) לתקנות ניירות ערך (דוחות תקופתיים ומיידים) תש"ל - 1970, יש להגיש במקביל להגשת טופס זה מצבת נושאי משרה בכירה במסגרת טופס ת097'}, {'': '1.'}, {'': 'שם משפחה ושם פרטי:'}, {'Shem': 'ברגמן דלי'}, {'': 'סוג מספר זיהוי:'}, {'SugMisparZihuy': 'מספר ת.ז.'}, {'': 'מספר זיהוי:'}, {'MisparZihuy': '027732304'}, {'': 'אזרחות/ ארץ התאגדות או רישום:'}, {'Ezrachut': 'אדם פרטי עם אזרחות ישראלית'}, {'': 'ארץ אזרחות / התאגדות או רישום:'}, {'EretzEzrachut': '_________'}, {'': '2.'}, {'': 'תאריך לידה:'}, {'TaarichLeida': '27/06/1970'}, {'': '3.'}, {'': 'מען להמצאת כתבי בית דין:'}, {'MaanLeHimatzutKitveyBeitDyn': 'בית ספרד, יורופארק, אזור תעשיה קיבוץ יקום'}, {'': '4.'}, {'': 'תאריך תחילת הכהונה:'}, {'TaarichTchilatHaKehuna': '01/01/2007'}, {'': '5.'}, {'': 'התפקיד לו מונה:'}, {'HaTafkidLoMuna': 'חשב'}, {'TeurHaTafkidLoMuna': '_________'}, {'': '6.'}, {'': 'תפקיד קודם בחברה טרם המינוי:'}, {'TafkidKodem': 'אין'}, {'TafkidKodemAher': '_________'}, {'': '7.'}, {'': 'השכלה אקדמית:'}, {'': 'תואר'}, {'': 'תחום'}, {'': 'שם המוסד האקדמי'}, {'Toar': 'בוגר'}, {'Tchum': 'חשבונאות וכלכלה'}, {'ShemHaMosadHaAcademi': 'אוניברסיטת תל- אביב'}, {'Toar': 'מוסמך'}, {'Tchum': 'מנהל עסקים'}, {'ShemHaMosadHaAcademi': 'אוניברסיטת תל- אביב'}, {'': 'השכלה אחרת ותעודות מקצועיות:'}, {'HaskalaAcheret': 'תעודת חשבות שכר'}, {'': '8.'}, {'': 'עיסוקים עיקריים ב – 5 השנים האחרונות:'}, {'': 'התפקיד שמילא'}, {'': 'מקום העבודה'}, {'': 'משך הזמן שמילא בתפקיד'}, {'HaTafkidSheMila': 'חשב'}, {'MekomHaAvoda': "ערוצי זהב ושות'"}, {'MeshechZmanSheMilaBaTafkid': '5 שנים'}, {'': '9.'}, {'': 'נושא משרה בכירה'}, {'NoseMisraBechira1': 'אינו ממלא'}, {'': 'בתפקידים אחרים בתאגיד,בחברת בת שלו, בחברה קשורה או אצל בעל העניין'}, {'': 'הסבר: אם הוא ממלא תפקידים אחרים בתאגיד, בחברה בת שלו או אצל בעל עניין בו נא לפרט.'}, {'Hesber1': '_________'}, {'': '10.'}, {'': 'נושא משרה בכירה'}, {'NoseMisraBechira2': 'אינו'}, {'': 'בן משפחה של נושא משרה בכירה אחר או של בעל עניין בתאגיד.'}, {'': 'הסבר: אם הוא בן משפחה של נושא משרה בכירה אחר או של בעל עניין בתאגיד, יש לפרט.'}, {'Hesber2': '_________'}, {'': '11.'}, {'': 'אם נושא המשרה הבכירה הוא מנכ"ל: הוא'}, {'NoseMisraBechira3': '_________'}, {'': 'בניירות ערך של התאגיד, של חברת בת או של חברה קשורה.'}, {'': 'הסבר: אם נושא המשרה הבכירה הוא מנכ"ל, יש לפרט אם הוא מחזיק ניירות ערך בתאגיד ,בחברת בת או בחברה קשורה. מילוי הערך מטבלה הוא לא שדה חובה.'}, {'Hesber3': '_________'}, {'TextHofshi': ''}, {'': 'מספרי אסמכתאות של מסמכים קודמים בנושא (אין האזכור מהווה הכללה על דרך הפניה):'}, {'FooterMisparAsmachta1': ''}, {'FooterMisparAsmachta2': ''}, {'FooterMisparAsmachta3': ''}, {'': 'שמות קודמים של ישות מדווחת:'}, {'ShemYeshutKodem': ''}, {'': 'תאריך עדכון מבנה הטופס:'}, {'TaarichIdkunMivne': '01/01/2007'}, {'': 'שם מדווח אלקטרוני:'}, {'FooterShemMedaveach': 'חריט אורית'}, {'FooterShemHevra': ''}, {'': 'תפקידו:'}, {'TafkidBaTaagid': 'עו"ד'}, {'Street': 'אזור התעשיה'}, {'StreetNumber': '-'}, {'City': 'יקום'}, {'ZipCode': '60972'}, {'': 'טלפון:'}, {'Telephone': '077-7077037'}, {'': 'פקס:'}, {'FooterFax1': '077-7078806'}, {'': 'דואר אלקטרוני:'}, {'FooterDoarElectroniMedaveach': '[email protected]'}], 'date': datetime.datetime(2007, 1, 1, 19, 14, 42), 'notification_type': 'ת091', 'positions': [['חשב', '_________']], 's3_object_name': 'maya.tase.co.il/2007_01/235402.htm', 'source': 'maya.tase.co.il', 'url': 'https://ams3.digitaloceanspaces.com/budgetkey-files/maya.tase.co.il/2007_01/235402.htm'}
----

Pipeline ID: people/company_appointments/maya/collect-maya-forms-debug-stats

Join the parsed PDF to get start and end time for each person (correlate)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 03:44:28.032275
Last Completion:
2021-08-05 03:45:13.415218
Last Success:
2021-08-05 03:45:13.415218

Pipeline ID: people/company_appointments/maya/correlate

people/company_appointments/maya/maya-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 03:27:22.520156
Last Completion:
2021-08-05 03:28:28.135590
Last Success:
2021-08-05 03:28:28.135590

Pipeline ID: people/company_appointments/maya/maya-list

Appointment notices from Maya (maya-nominations)
Succeeded

Name, job and company description.


Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 03:39:21.042134
Last Completion:
2021-08-05 03:39:47.320280
Last Success:
2021-08-05 03:39:47.320280

Pipeline ID: people/company_appointments/maya/maya-nominations

people/company_appointments/maya/maya-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 00:00:46.459719
Last Completion:
2021-08-05 01:41:15.419002
Last Success:
2021-08-05 01:41:15.419002

Pipeline ID: people/company_appointments/maya/maya-notification-list

List all notifications from maya system (maya-notification-updates)
Succeeded

id, date, company, notification_type, s3_object_name, url


Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 01:59:36.930296
Last Completion:
2021-08-05 02:37:05.027900
Last Success:
2021-08-05 02:37:05.027900

Pipeline ID: people/company_appointments/maya/maya-notification-updates

Appointment notices from Maya (maya-resignations)
Succeeded

Name, job and company description.


Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 03:39:47.335975
Last Completion:
2021-08-05 03:40:13.844307
Last Success:
2021-08-05 03:40:13.844307

Pipeline ID: people/company_appointments/maya/maya-resignations

מינויים בכלכליסט (calcalist)
Succeeded

רשימת כל המינויים והחברות מאתר כלכליסט


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-06-25 12:52:07.078402
Last Completion:
2021-06-25 12:59:20.565291
Last Success:
2021-06-25 12:59:20.565291

Pipeline ID: people/company_appointments/media/calcalist/calcalist

Appointment notices from TheMarker (themarker)
Succeeded

Name, job and company description.


Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 00:03:08.228798
Last Completion:
2021-08-05 00:03:18.437860
Last Success:
2021-08-05 00:03:18.437860

Pipeline ID: people/company_appointments/media/themarker/themarker

Join the parsed PDF to get start and end time for each person (correlate)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 01:55:30.619727
Last Completion:
2021-08-05 01:55:35.427074
Last Success:
2021-08-05 01:55:35.427074

Pipeline ID: people/company_appointments/state_owned/correlate

Parse and concatenate all PDF reports (parse_pdf_resources)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 01:36:18.820487
Last Completion:
2021-08-05 01:36:25.534547
Last Success:
2021-08-05 01:36:25.534547

Pipeline ID: people/company_appointments/state_owned/parse_pdf_resources

collect links to all pdf reports on https://mof.gov.il/GCA/Directors/Pages/DirectorsManningReport.aspx (reports)
Succeeded

columns: date, url


Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 00:22:19.829987
Last Completion:
2021-08-05 00:22:26.114366
Last Success:
2021-08-05 00:22:26.114366

Pipeline ID: people/company_appointments/state_owned/reports

people/company_appointments/state_owned/state-owned-nominations
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 03:04:37.265303
Last Completion:
2021-08-05 03:04:39.778493
Last Success:
2021-08-05 03:04:39.778493

Pipeline ID: people/company_appointments/state_owned/state-owned-nominations

people/municipal_appointments/municipal_representitives
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:16:56.046239
Last Completion:
2021-05-13 10:16:59.457440
Last Success:
2021-05-13 10:16:59.457440

Pipeline ID: people/municipal_appointments/municipal_representitives

people/political_candidates/election_candidates21
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:16:20.348493
Last Completion:
2021-05-13 10:16:56.040846
Last Success:
2021-05-13 10:16:56.040846

Pipeline ID: people/political_candidates/election_candidates21

people/political_donations/political_donations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:16:09.492377
Last Completion:
2021-05-13 10:16:20.342973
Last Success:
2021-05-13 10:16:20.342973

Pipeline ID: people/political_donations/political_donations

people/procurement/procurement-individuals
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 06:26:27.053466
Last Completion:
2021-08-05 06:40:27.148581
Last Success:
2021-08-05 06:40:27.148581

Pipeline ID: people/procurement/procurement-individuals

procurement/calls_for_bids/calls-for-bids-all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-04 16:00:02.939179
Last Completion:
2021-08-04 16:10:12.206343
Last Success:
2021-08-04 16:10:12.206343

Pipeline ID: procurement/calls_for_bids/calls-for-bids-all

procurement/calls_for_bids/calls-for-bids-moh
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 00:00:04.242190
Last Completion:
2021-08-05 00:00:08.735251
Last Success:
2021-08-05 00:00:08.735251

Pipeline ID: procurement/calls_for_bids/calls-for-bids-moh

procurement/calls_for_bids/gov-publications
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 12:12:43.848667
Last Completion:
2021-05-13 12:13:03.059027
Last Success:
2021-05-13 12:13:03.059027

Pipeline ID: procurement/calls_for_bids/gov-publications

procurement/calls_for_bids/gov-publications-ministry-of-immigration
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 12:12:43.864235
Last Completion:
2021-05-13 12:12:50.198790
Last Success:
2021-05-13 12:12:50.198790

Pipeline ID: procurement/calls_for_bids/gov-publications-ministry-of-immigration

procurement/calls_for_bids/gov-publications2
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 12:12:43.860501
Last Completion:
2021-05-13 12:24:33.116656
Last Success:
2021-05-13 12:24:33.116656

Pipeline ID: procurement/calls_for_bids/gov-publications2

procurement/calls_for_bids/jobiz-all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-04 15:00:22.806801
Last Completion:
2021-08-04 15:00:24.572532
Last Success:
2021-08-04 15:00:24.572532

Pipeline ID: procurement/calls_for_bids/jobiz-all

procurement/calls_for_bids/jobiz-calls-for-bids
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-04 15:00:24.597585
Last Completion:
2021-08-04 15:00:25.901974
Last Success:
2021-08-04 15:00:25.901974

Pipeline ID: procurement/calls_for_bids/jobiz-calls-for-bids

procurement/calls_for_bids/jobiz-scraper
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-04 15:00:03.478217
Last Completion:
2021-08-04 15:00:22.778733
Last Success:
2021-08-04 15:00:22.778733

Pipeline ID: procurement/calls_for_bids/jobiz-scraper

התקשרויות רכש ממשלתיות (latest-contract-spending)
Succeeded

אנו סוכמים מידע מתוך הדוחות הרבעוניים לתוך טבלה המכילה את המידע העדכני ביותר.


Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 01:37:57.349870
Last Completion:
2021-08-05 06:26:26.825508
Last Success:
2021-08-05 06:26:26.825508

Pipeline ID: procurement/spending/latest-contract-spending

procurement/spending/quarterly-contract-spending-report-uris
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-04 23:00:02.679313
Last Completion:
2021-08-04 23:00:22.541492
Last Success:
2021-08-04 23:00:22.541492

Pipeline ID: procurement/spending/quarterly-contract-spending-report-uris

דוחות רבעוניים מתוך מרכבה, לפי נוהל היחידה לחופש המידע. (quarterly-contract-spending-reports)
Succeeded

כל משרדי הממשלה ויחידות הסמך (שמחוברות למערכת מרכבה) צריכים לפרסם אחת לרבעון (תוך 45 יום מסוף הרבעון) דו״ח התקשרויות לפי פורמט מוגדר היטב הממומש כדו״ח מובנה במערכת המרכבה. כל המשרדים מדווחים עצמאית והדו״חות עולים לאתר היחידה לחופש המידע, משם אנו אוספים אותם. התוצר של השרשר הזה הוא פירוט כל הדיווחים של כל המשרדים.


Last Run triggered by:
scheduled
Last Run started at:
2021-08-04 23:00:22.683094
Last Completion:
2021-08-04 23:20:47.841751
Last Success:
2021-08-04 23:20:47.841751

Pipeline ID: procurement/spending/quarterly-contract-spending-reports

procurement/spending/quarterly-contract-spending-reports-data
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-04 23:20:47.954140
Last Completion:
2021-08-05 01:04:11.414841
Last Success:
2021-08-05 01:04:11.414841

Pipeline ID: procurement/spending/quarterly-contract-spending-reports-data

procurement/spending/spending-by-entity
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 06:26:26.936528
Last Completion:
2021-08-05 06:40:45.852354
Last Success:
2021-08-05 06:40:45.852354

Pipeline ID: procurement/spending/spending-by-entity

Load all tenders data from data.gov.il to flat file (all)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 00:16:59.228168
Last Completion:
2021-08-05 00:25:16.148710
Last Success:
2021-08-05 00:25:16.148710

Pipeline ID: procurement/tenders/all

procurement/tenders/processed
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 01:36:29.629632
Last Completion:
2021-08-05 01:59:49.550362
Last Success:
2021-08-05 01:59:49.550362

Pipeline ID: procurement/tenders/processed

reports/all
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-07-29 07:49:06.328921
Last Completion:
2021-07-29 07:49:11.443767
Last Success:
2021-07-29 07:49:11.443767

Pipeline ID: reports/all

reports/ngos/ngo-activity-report
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-07-29 07:43:14.271558
Last Completion:
2021-07-29 07:49:05.656108
Last Success:
2021-07-29 07:49:05.656108

Pipeline ID: reports/ngos/ngo-activity-report

reports/ngos/ngo-district-report
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-07-29 07:43:14.267120
Last Completion:
2021-07-29 07:47:39.942460
Last Success:
2021-07-29 07:47:39.942460

Pipeline ID: reports/ngos/ngo-district-report

supports/all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-04 18:11:53.463889
Last Completion:
2021-08-04 18:17:02.734038
Last Success:
2021-08-04 18:17:02.734038

Pipeline ID: supports/all

supports/by-payment-year
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 01:17:05.547138
Last Completion:
2021-08-05 01:31:16.522870
Last Success:
2021-08-05 01:31:16.522870

Pipeline ID: supports/by-payment-year

supports/by-request-year
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 01:19:11.328600
Last Completion:
2021-08-05 01:36:20.536172
Last Success:
2021-08-05 01:36:20.536172

Pipeline ID: supports/by-request-year

supports/criteria/support-criteria
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 00:24:07.826438
Last Completion:
2021-08-05 00:24:17.246999
Last Success:
2021-08-05 00:24:17.246999

Pipeline ID: supports/criteria/support-criteria

supports/criteria/support-criteria-doj
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-08-05 00:00:25.729683
Last Completion:
2021-08-05 00:00:34.620860
Last Success:
2021-08-05 00:00:34.620860

Pipeline ID: supports/criteria/support-criteria-doj

supports/supports-2004
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:05.077865
Last Completion:
2021-05-15 07:28:09.149585
Last Success:
2021-05-15 07:28:09.149585

Pipeline ID: supports/supports-2004

supports/supports-2005
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:05.081187
Last Completion:
2021-05-15 07:28:08.946001
Last Success:
2021-05-15 07:28:08.946001

Pipeline ID: supports/supports-2005

supports/supports-2006
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:05.149888
Last Completion:
2021-05-15 07:28:09.165177
Last Success:
2021-05-15 07:28:09.165177

Pipeline ID: supports/supports-2006

supports/supports-2007
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:05.153070
Last Completion:
2021-05-15 07:28:09.543286
Last Success:
2021-05-15 07:28:09.543286

Pipeline ID: supports/supports-2007

supports/supports-2008
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:05.167896
Last Completion:
2021-05-15 07:28:08.765835
Last Success:
2021-05-15 07:28:08.765835

Pipeline ID: supports/supports-2008

supports/supports-2009
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:08.847174
Last Completion:
2021-05-15 07:28:11.472865
Last Success:
2021-05-15 07:28:11.472865

Pipeline ID: supports/supports-2009

supports/supports-2010
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:08.953846
Last Completion:
2021-05-15 07:28:11.760031
Last Success:
2021-05-15 07:28:11.760031

Pipeline ID: supports/supports-2010

supports/supports-2011
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:09.162466
Last Completion:
2021-05-15 07:28:11.569127
Last Success:
2021-05-15 07:28:11.569127

Pipeline ID: supports/supports-2011

supports/supports-2012
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:09.172544
Last Completion:
2021-05-15 07:28:12.046532
Last Success:
2021-05-15 07:28:12.046532

Pipeline ID: supports/supports-2012

supports/supports-2013
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:09.553460
Last Completion:
2021-05-15 07:28:12.659860
Last Success:
2021-05-15 07:28:12.659860

Pipeline ID: supports/supports-2013

supports/supports-2014
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:09.660997
Last Completion:
2021-05-15 07:28:12.551766
Last Success:
2021-05-15 07:28:12.551766

Pipeline ID: supports/supports-2014

supports/supports-2015
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:11.478050
Last Completion:
2021-05-15 07:28:13.948180
Last Success:
2021-05-15 07:28:13.948180

Pipeline ID: supports/supports-2015