activities/all
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-18 09:25:36.094028
Last Completion:
2021-05-18 09:25:37.448776
Last Success:
2021-05-18 09:25:37.448776

Pipeline ID: activities/all

activities/social_services/historic_data
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-18 09:25:10.248777
Last Completion:
2021-05-18 09:25:35.896363
Last Success:
2021-05-18 09:25:35.896363

Pipeline ID: activities/social_services/historic_data

bank_of_israel/bank_of_israel
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 16:21:26.498569
Last Completion:
2021-05-13 16:25:14.252534
Last Success:
2021-05-13 16:25:14.252534

Pipeline ID: bank_of_israel/bank_of_israel

budget/national/changes/explanations/all
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-18 09:37:51.019675
Last Completion:
2021-05-18 09:39:36.039549
Last Success:
2021-05-18 09:39:36.039549

Pipeline ID: budget/national/changes/explanations/all

budget/national/changes/original/current-year-fixes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-14 01:51:53.660639
Last Completion:
2021-05-14 01:52:25.651916
Last Success:
2021-05-14 01:52:25.651916

Pipeline ID: budget/national/changes/original/current-year-fixes

budget/national/changes/original/national-budget-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-14 00:03:10.261390
Last Completion:
2021-05-14 00:06:18.870940
Last Success:
2021-05-14 00:06:18.870940

Pipeline ID: budget/national/changes/original/national-budget-changes

Changes, grouped by transaction_id, with explanations (national-budget-changes-aggregated)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-18 09:39:36.295380
Last Completion:
2021-05-18 09:42:29.732630
Last Success:
2021-05-18 09:42:29.732630

Pipeline ID: budget/national/changes/processed/national-budget-changes-aggregated

budget/national/changes/processed/transactions
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-14 10:03:45.145930
Last Completion:
2021-05-14 15:17:10.226592
Last Success:
2021-05-14 15:17:10.226592

Pipeline ID: budget/national/changes/processed/transactions

National Yearly Budgets (national-budgets)
Succeeded

We get the data the Ministry of Finance publishes in data.gov.il every year. It comes in XLS format, with one row per TAKANA and phase (original, approved, executed). In this pipeline we create from each triplet a single row that has all the data.


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:15:17.615182
Last Completion:
2021-05-13 11:26:39.929891
Last Success:
2021-05-13 11:26:39.929891

Pipeline ID: budget/national/original/national-budgets

National Yearly Budgets - Processed (aggregated-yearly)
Succeeded

This pipeline joins the different phases of the budget (allocated, revised and executed). In the original file there's a separate row for each of the phases. We like it better as a single row with all phase info. Another thing this pipeline does is to rename the column titles - to more friendly English names. Also, it create rows for all hierarchies - where upper hierarchies (2, 4 & 6 digits) are plain aggregations of the 8-digit items they contain.


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 14:31:07.591139
Last Completion:
2021-05-13 16:20:58.443229
Last Success:
2021-05-13 16:20:58.443229

Pipeline ID: budget/national/processed/aggregated-yearly

budget/national/processed/category-explanations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:15:52.098941
Last Completion:
2021-05-13 10:15:52.680936
Last Success:
2021-05-13 10:15:52.680936

Pipeline ID: budget/national/processed/category-explanations

National Yearly Budgets - Joined with category-explanations (connected-items-explained)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 19:39:55.247204
Last Completion:
2021-05-13 19:46:03.041853
Last Success:
2021-05-13 19:46:03.041853

Pipeline ID: budget/national/processed/connected-items-explained

National Yearly Budgets - Connected Items (connected-national-budgets)
Succeeded

This pipeline joins budget items that span across years.


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 19:07:57.047685
Last Completion:
2021-05-13 19:29:07.571728
Last Success:
2021-05-13 19:29:07.571728

Pipeline ID: budget/national/processed/connected-national-budgets

National Yearly Budgets - Just the total (item 00) (just-the-total)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 19:00:50.413606
Last Completion:
2021-05-13 19:04:32.585855
Last Success:
2021-05-13 19:04:32.585855

Pipeline ID: budget/national/processed/just-the-total

National Yearly Budgets - Main Item Names (roof-names)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 19:04:32.590804
Last Completion:
2021-05-13 19:07:57.042198
Last Success:
2021-05-13 19:07:57.042198

Pipeline ID: budget/national/processed/roof-names

National Yearly Budgets - With Extras (with-extras)
Succeeded

This pipeline joins the budget data to itself so that each item has a list of its immediate children.


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 17:59:36.749335
Last Completion:
2021-05-13 18:11:55.030787
Last Success:
2021-05-13 18:11:55.030787

Pipeline ID: budget/national/processed/with-extras

budgetkey/analysis/spending/publisher_entity_analysis
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-18 10:20:06.476394
Last Completion:
2021-05-18 11:12:16.289020
Last Success:
2021-05-18 11:12:16.289020

Pipeline ID: budgetkey/analysis/spending/publisher_entity_analysis

budgetkey/analysis/spending/publisher_foa_analysis
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-18 10:20:06.481492
Last Completion:
2021-05-18 10:28:09.958946
Last Success:
2021-05-18 10:28:09.958946

Pipeline ID: budgetkey/analysis/spending/publisher_foa_analysis

budgetkey/analysis/spending/united
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-18 10:06:26.763536
Last Completion:
2021-05-18 10:20:06.237770
Last Success:
2021-05-18 10:20:06.237770

Pipeline ID: budgetkey/analysis/spending/united

Main Page - Aggregated budget by functional classification (budget-functional-aggregates)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 18:11:55.037647
Last Completion:
2021-05-13 18:14:37.897472
Last Success:
2021-05-13 18:14:37.897472

Pipeline ID: budgetkey/budget-functional-aggregates

budgetkey/documents
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 19:08:17.160746
Last Completion:
2021-05-13 19:08:18.865794
Last Success:
2021-05-13 19:08:18.865794

Pipeline ID: budgetkey/documents

budgetkey/elasticsearch/index_activities
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-18 09:25:37.673639
Last Completion:
2021-05-18 09:25:44.395326
Last Success:
2021-05-18 09:25:44.395326

Pipeline ID: budgetkey/elasticsearch/index_activities

budgetkey/elasticsearch/index_budget
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-05-14 01:16:30.650427
Last Completion:
2021-05-14 01:51:39.846673
Last Success:
2021-05-14 01:51:39.846673

Pipeline ID: budgetkey/elasticsearch/index_budget

budgetkey/elasticsearch/index_calls_for_bids
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 16:04:26.217468
Last Completion:
2021-05-18 16:04:38.481478
Last Success:
2021-05-18 16:04:38.481478

Pipeline ID: budgetkey/elasticsearch/index_calls_for_bids

budgetkey/elasticsearch/index_contract_spending
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-05-18 05:52:07.670184
Last Completion:
2021-05-18 07:35:26.595492
Last Success:
2021-05-18 07:35:26.595492

Pipeline ID: budgetkey/elasticsearch/index_contract_spending

budgetkey/elasticsearch/index_entities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 20:24:21.491114
Last Completion:
2021-05-18 21:19:24.207103
Last Success:
2021-05-18 21:19:24.207103

Pipeline ID: budgetkey/elasticsearch/index_entities

budgetkey/elasticsearch/index_gov_decisions
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Invalid dependency :Cannot run until dependency passes validation: ./government_decisions/government_decisions
From ./government_decisions/government_decisions :['Dependency unsuccessful', 'Cannot run until dependency "./government_decisions/scraper" is successfully executed']

Pipeline ID: budgetkey/elasticsearch/index_gov_decisions

budgetkey/elasticsearch/index_national_budget_changes
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-18 09:42:29.945751
Last Completion:
2021-05-18 09:45:00.350358
Last Success:
2021-05-18 09:45:00.350358

Pipeline ID: budgetkey/elasticsearch/index_national_budget_changes

budgetkey/elasticsearch/index_people
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-05-18 06:36:56.376945
Last Completion:
2021-05-18 06:40:25.292084
Last Success:
2021-05-18 06:40:25.292084

Pipeline ID: budgetkey/elasticsearch/index_people

budgetkey/elasticsearch/index_reports
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 03:53:32.883963
Last Completion:
2021-05-18 03:54:12.571789
Last Success:
2021-05-18 03:54:12.571789

Pipeline ID: budgetkey/elasticsearch/index_reports

budgetkey/elasticsearch/index_support_criteria
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 01:44:33.265430
Last Completion:
2021-05-18 01:44:52.574013
Last Success:
2021-05-18 01:44:52.574013

Pipeline ID: budgetkey/elasticsearch/index_support_criteria

budgetkey/elasticsearch/index_supports
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 03:01:29.610534
Last Completion:
2021-05-18 03:31:46.458799
Last Success:
2021-05-18 03:31:46.458799

Pipeline ID: budgetkey/elasticsearch/index_supports

budgetkey/elasticsearch/index_tenders
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-05-14 00:00:09.246142
Last Completion:
2021-05-14 00:51:00.099775
Last Success:
2021-05-14 00:51:00.099775

Pipeline ID: budgetkey/elasticsearch/index_tenders

budgetkey/elasticsearch/sitemaps
Running

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 21:19:24.613466
Last Completion:
Last Success:
2021-05-18 20:39:17.214908

Pipeline ID: budgetkey/elasticsearch/sitemaps

Send periodic emails (1) (emails)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-14 10:14:56.320045
Last Completion:
2021-05-14 12:35:47.453314
Last Success:
2021-05-14 12:35:47.453314

Pipeline ID: budgetkey/emails/emails

donations/candidates
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 12:49:33.668219
Last Completion:
2021-05-13 12:49:44.646388
Last Success:
2021-05-13 12:49:44.646388

Pipeline ID: donations/candidates

donations/parties
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:15:52.734546
Last Completion:
2021-05-13 10:16:09.487287
Last Success:
2021-05-13 10:16:09.487287

Pipeline ID: donations/parties

donations/transactions
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-18 10:06:24.212044
Last Completion:
2021-05-18 10:06:41.041108
Last Success:
None

dump.to_path
ERROR   :Failed to transform row {'CandidateName': 'בוארון אביחי', 'City': 'עופרה', 'Country': 'ישראל', 'GD_Date': '/Date(1423432800000)/', 'GD_Name': 'אביחי בוארון תרומה עצמית', 'GD_Sum': '130000.00', 'GuaranteeOrDonation': 'תרומה', 'ID': None, 'IsControl': False, 'IsDeficitCoverage': 'לא', 'IsUpdate': False, 'Party': 'הבית היהודי, מיסודה של המפד"ל ', 'PublisherTypeID': 2, 'State': 0, 'SumInCurrency': '0.00', 'URL': None}
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/file_formats.py", line 31, in __transform_row
    for k, v in row.items())
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/file_formats.py", line 31, in <genexpr>
    for k, v in row.items())
KeyError: 'IsDeficitCoverage'
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/dump/to_path.py", line 37, in <module>
    PathDumper()()
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/dumper_base.py", line 53, in __call__
    finalizer=self.finalize
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/dumper_base.py", line 128, in row_counter
    for row in resource:
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/dumper_base.py", line 258, in rows_processor
    file_formatter.write_row(writer, row, fields)
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/file_formats.py", line 44, in write_row
    transformed_row = self.__transform_row(row, fields)
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/file_formats.py", line 31, in __transform_row
    for k, v in row.items())
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/file_formats.py", line 31, in <genexpr>
    for k, v in row.items())
KeyError: 'IsDeficitCoverage'

Pipeline ID: donations/transactions

education/tochniyot/tochniyot
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:39:08.772024
Last Completion:
2021-05-15 07:39:19.636786
Last Success:
2021-05-15 07:39:19.636786

Pipeline ID: education/tochniyot/tochniyot

entities/all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 20:04:48.168514
Last Completion:
2021-05-18 20:16:23.048564
Last Success:
2021-05-18 20:16:23.048564

Pipeline ID: entities/all

entities/associations/guidestar/guidestar
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 01:46:31.566619
Last Completion:
2021-05-18 01:51:33.151121
Last Success:
2021-05-18 01:51:33.151121

Pipeline ID: entities/associations/guidestar/guidestar

entities/associations/guidestar/guidestar-scraper
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 00:30:08.297088
Last Completion:
2021-05-18 00:45:11.569071
Last Success:
2021-05-18 00:45:11.569071

Pipeline ID: entities/associations/guidestar/guidestar-scraper

עמותות פעילות מרשם העמותות (registry)
Succeeded

רשימת כלל העמותות הפעילות, מתעדכן שבועית.


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:29:49.070695
Last Completion:
2021-05-13 10:30:27.053958
Last Success:
2021-05-13 10:30:27.053958

Pipeline ID: entities/associations/registrar/registry

entities/companies/registrar/details
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 20:00:01.802806
Last Completion:
2021-05-18 20:04:47.876540
Last Success:
2021-05-18 20:04:47.876540

Pipeline ID: entities/companies/registrar/details

חברות פעילות מרשם החברות (scraper)
Succeeded

רשימת כלל החברות הפעילות, מתעדכן שבועית.


Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 00:21:52.942668
Last Completion:
2021-05-18 00:29:51.403408
Last Success:
2021-05-18 00:29:51.403408

Pipeline ID: entities/companies/registrar/scraper

רשימת אגודות שיתופיות (cooperatives)
Succeeded

רשימת אגודות שיתופיות, מתוך ממשק נתונים של מאגר של משרד הכלכלה / האגף לאיגוד שיתופי, מתעדכן שבועית


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:37:28.458283
Last Completion:
2021-05-13 11:22:03.555060
Last Success:
2021-05-13 11:22:03.555060

Pipeline ID: entities/cooperatives/cooperatives

entities/entities
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 20:16:23.290543
Last Completion:
2021-05-18 20:24:21.234903
Last Success:
2021-05-18 20:24:21.234903

Pipeline ID: entities/entities

entities/fingerprints
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-05-18 20:55:01.265090
Last Completion:
2021-05-18 21:29:23.589206
Last Success:
2021-05-18 21:29:23.589206

Pipeline ID: entities/fingerprints

entities/foi_orgs/foi_orgs
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:19:35.751155
Last Completion:
2021-05-13 10:20:38.842412
Last Success:
2021-05-13 10:20:38.842412

Pipeline ID: entities/foi_orgs/foi_orgs

entities/moital/moital_service_providers
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:30:27.059041
Last Completion:
2021-05-13 10:37:28.451255
Last Success:
2021-05-13 10:37:28.451255

Pipeline ID: entities/moital/moital_service_providers

רשימת אגודות עותומניות (ottoman-association-registry)
Succeeded

רשימת אגודות עותומניות, מתוך תשובה לבקשת חופש מידע


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 14:38:39.673414
Last Completion:
2021-05-13 14:38:53.363762
Last Success:
2021-05-13 14:38:53.363762

Pipeline ID: entities/ottoman/ottoman-association-registry

entities/safety-orders/safety-orders
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-18 10:06:24.657676
Last Completion:
2021-05-18 10:06:55.250946
Last Success:
None

stream_remote_resources
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/tabulator/loaders/remote.py", line 63, in load
    bytes = _RemoteStream(source, self.__http_session, self.__http_timeout).open()
  File "/usr/local/lib/python3.7/site-packages/tabulator/loaders/remote.py", line 121, in open
    self.seek(0)
  File "/usr/local/lib/python3.7/site-packages/tabulator/loaders/remote.py", line 143, in seek
    self.__response.raise_for_status()
  File "/usr/local/lib/python3.7/site-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.gov.il/he/error
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 243, in <module>
    resource.pop('http_headers', None))
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 197, in stream_reader
    schema, headers, columns, stream, close = get_opener(url, _resource)()
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 173, in opener
    _stream.open()
  File "/usr/local/lib/python3.7/site-packages/tabulator/stream.py", line 423, in open
    self.__parser.open(source, encoding=self.__encoding)
  File "/usr/local/lib/python3.7/site-packages/tabulator/parsers/xlsx.py", line 81, in open
    source_bytes = self.__loader.load(source, mode="b", encoding=encoding)
  File "/usr/local/lib/python3.7/site-packages/tabulator/loaders/remote.py", line 72, in load
    raise exceptions.HTTPError(str(exception))
tabulator.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.gov.il/he/error

Pipeline ID: entities/safety-orders/safety-orders

entities/safety-orders/safety-orders-by-entity
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./entities/safety-orders/safety-orders" is successfully executed

Pipeline ID: entities/safety-orders/safety-orders-by-entity

entities/special/registry
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 00:14:39.267920
Last Completion:
2021-05-18 00:29:57.162086
Last Success:
2021-05-18 00:29:57.162086

Pipeline ID: entities/special/registry

ezvonot/ezvonot_accounts
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 01:30:10.766947
Last Completion:
2021-05-18 01:30:32.482979
Last Success:
2021-05-18 01:30:32.482979

Pipeline ID: ezvonot/ezvonot_accounts

ezvonot/ezvonot_cases
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 01:30:32.490442
Last Completion:
2021-05-18 01:30:45.378635
Last Success:
2021-05-18 01:30:45.378635

Pipeline ID: ezvonot/ezvonot_cases

ezvonot/ezvonot_crontab
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 00:18:05.772270
Last Completion:
2021-05-18 00:18:07.769823
Last Success:
2021-05-18 00:18:07.769823

Pipeline ID: ezvonot/ezvonot_crontab

ezvonot/ezvonot_decisions
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-18 10:06:24.855513
Last Completion:
2021-05-18 10:06:38.765978
Last Success:
None

concatenate
ERROR   :Expected to see 1 resource(s) but spewed 0
ERROR   :Traceback (most recent call last):
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/concatenate.py", line 25, in <module>
ERROR   :spew_flow(flow(ctx.parameters), ctx)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
ERROR   :spew(self.datapackage, self.resource_iterator, stats=self.stats)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 95, in spew
ERROR   :assert num_resources == expected_resources
ERROR   :AssertionError

Pipeline ID: ezvonot/ezvonot_decisions

ezvonot/ezvonot_decisions_join
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./ezvonot/ezvonot_decisions" is successfully executed

Pipeline ID: ezvonot/ezvonot_decisions_join

ezvonot/ezvonot_deposits
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 01:29:45.069526
Last Completion:
2021-05-18 01:30:10.760543
Last Success:
2021-05-18 01:30:10.760543

Pipeline ID: ezvonot/ezvonot_deposits

ezvonot/ezvonot_purposes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 01:30:45.386675
Last Completion:
2021-05-18 01:30:56.860100
Last Success:
2021-05-18 01:30:56.860100

Pipeline ID: ezvonot/ezvonot_purposes

government_decisions/government_decisions
Invalid

Last Run triggered by:
None
Last Run started at:
None
Last Completion:
None
Last Success:
None

Dependency unsuccessful :Cannot run until dependency "./government_decisions/scraper" is successfully executed

Pipeline ID: government_decisions/government_decisions

government_decisions/scraper
Failed

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 12:00:01.943589
Last Completion:
2021-05-18 12:00:09.659139
Last Success:
None

scraper
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 706, in urlopen
    chunked=chunked,
  File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 382, in _make_request
    self._validate_conn(conn)
  File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 1010, in _validate_conn
    conn.connect()
  File "/usr/local/lib/python3.7/site-packages/urllib3/connection.py", line 421, in connect
    tls_in_tls=tls_in_tls,
  File "/usr/local/lib/python3.7/site-packages/urllib3/util/ssl_.py", line 429, in ssl_wrap_socket
    sock, context, tls_in_tls, server_hostname=server_hostname
  File "/usr/local/lib/python3.7/site-packages/urllib3/util/ssl_.py", line 472, in _ssl_wrap_socket_impl
    return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
  File "/usr/local/lib/python3.7/ssl.py", line 423, in wrap_socket
    session=session
  File "/usr/local/lib/python3.7/ssl.py", line 870, in _create
    self.do_handshake()
  File "/usr/local/lib/python3.7/ssl.py", line 1139, in do_handshake
    self._sslobj.do_handshake()
ConnectionResetError: [Errno 104] Connection reset by peer
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 756, in urlopen
    method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
  File "/usr/local/lib/python3.7/site-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.7/site-packages/urllib3/packages/six.py", line 734, in reraise
    raise value.with_traceback(tb)
  File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 706, in urlopen
    chunked=chunked,
  File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 382, in _make_request
    self._validate_conn(conn)
  File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 1010, in _validate_conn
    conn.connect()
  File "/usr/local/lib/python3.7/site-packages/urllib3/connection.py", line 421, in connect
    tls_in_tls=tls_in_tls,
  File "/usr/local/lib/python3.7/site-packages/urllib3/util/ssl_.py", line 429, in ssl_wrap_socket
    sock, context, tls_in_tls, server_hostname=server_hostname
  File "/usr/local/lib/python3.7/site-packages/urllib3/util/ssl_.py", line 472, in _ssl_wrap_socket_impl
    return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
  File "/usr/local/lib/python3.7/ssl.py", line 423, in wrap_socket
    session=session
  File "/usr/local/lib/python3.7/ssl.py", line 870, in _create
    self.do_handshake()
  File "/usr/local/lib/python3.7/ssl.py", line 1139, in do_handshake
    self._sslobj.do_handshake()
urllib3.exceptions.ProtocolError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/datapackage_pipelines_budgetkey/pipelines/government_decisions/scraper.py", line 122, in <module>
    spew(datapackage, chain(res_iter, [get_decision_list()]))
  File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
    for rec in res:
  File "/datapackage_pipelines_budgetkey/pipelines/government_decisions/scraper.py", line 55, in get_decision_list
    response = session.get(SEARCH_PAGE_RESULTS_URL.format(skip=0), timeout=TIMEOUT).json()
  File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/requests/adapters.py", line 498, in send
    raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))

Pipeline ID: government_decisions/scraper

lamas/municipal-data
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 01:43:45.645497
Last Completion:
2021-05-18 01:44:30.350367
Last Success:
2021-05-18 01:44:30.350367

Pipeline ID: lamas/municipal-data

קובץ התאמת רשויות אזוריות לישובים בשטחן (municipality-to-city)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:13:19.203012
Last Completion:
2021-05-13 10:13:21.286304
Last Success:
2021-05-13 10:13:21.286304

Pipeline ID: lamas/municipality-to-city

maya/maya-bonds-and-options-holdings-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 04:54:19.866862
Last Completion:
2021-05-18 05:05:56.447082
Last Success:
2021-05-18 05:05:56.447082

Pipeline ID: maya/maya-bonds-and-options-holdings-changes

maya/maya-company-officer-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 04:42:47.574035
Last Completion:
2021-05-18 04:55:37.659792
Last Success:
2021-05-18 04:55:37.659792

Pipeline ID: maya/maya-company-officer-list

maya/maya-company-stakeholder-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 05:04:52.248928
Last Completion:
2021-05-18 05:30:56.261790
Last Success:
2021-05-18 05:30:56.261790

Pipeline ID: maya/maya-company-stakeholder-list

maya/maya-company-vip-appointments
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 04:42:47.575977
Last Completion:
2021-05-18 04:54:19.857193
Last Success:
2021-05-18 04:54:19.857193

Pipeline ID: maya/maya-company-vip-appointments

maya/maya-complete-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 03:41:57.855213
Last Completion:
2021-05-18 04:42:47.271485
Last Success:
2021-05-18 04:42:47.271485

Pipeline ID: maya/maya-complete-notification-list

maya/maya-holdings-changes
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 04:55:37.668802
Last Completion:
2021-05-18 05:08:02.361785
Last Success:
2021-05-18 05:08:02.361785

Pipeline ID: maya/maya-holdings-changes

maya/maya-notification-parse-updates
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 01:46:01.657068
Last Completion:
2021-05-18 03:38:55.765000
Last Success:
2021-05-18 03:38:55.765000

Pipeline ID: maya/maya-notification-parse-updates

maya/maya-reported-academic-degrees
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 05:05:56.456680
Last Completion:
2021-05-18 05:18:21.766425
Last Success:
2021-05-18 05:18:21.766425

Pipeline ID: maya/maya-reported-academic-degrees

maya/maya-reported-work-record
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 05:08:02.371496
Last Completion:
2021-05-18 05:20:10.061642
Last Success:
2021-05-18 05:20:10.061642

Pipeline ID: maya/maya-reported-work-record

maya/maya-tase-companies-current-management
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 05:20:10.070786
Last Completion:
2021-05-18 06:08:37.842468
Last Success:
2021-05-18 06:08:37.842468

Pipeline ID: maya/maya-tase-companies-current-management

maya/maya-tase-companies-current-shareholders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 05:18:21.843330
Last Completion:
2021-05-18 06:08:38.241840
Last Success:
2021-05-18 06:08:38.241840

Pipeline ID: maya/maya-tase-companies-current-shareholders

maya/scrape-maya-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 00:19:29.145651
Last Completion:
2021-05-18 00:44:33.870277
Last Success:
2021-05-18 00:44:33.870277

Pipeline ID: maya/scrape-maya-notification-list

maya/scrape-maya-tase-companies
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 00:17:59.573764
Last Completion:
2021-05-18 00:19:29.079137
Last Success:
2021-05-18 00:19:29.079137

Pipeline ID: maya/scrape-maya-tase-companies

people/aggregated
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-05-18 06:21:01.536480
Last Completion:
2021-05-18 06:36:56.101343
Last Success:
2021-05-18 06:36:56.101343

Pipeline ID: people/aggregated

people/all
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-05-18 06:03:28.354418
Last Completion:
2021-05-18 06:04:59.045928
Last Success:
2021-05-18 06:04:59.045928

Pipeline ID: people/all

people/association_founders/association-founders
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 03:34:46.668770
Last Completion:
2021-05-18 03:35:47.561883
Last Success:
2021-05-18 03:35:47.561883

Pipeline ID: people/association_founders/association-founders

people/company_appointments/all-appointments
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 04:34:28.072182
Last Completion:
2021-05-18 04:36:59.053336
Last Success:
2021-05-18 04:36:59.053336

Pipeline ID: people/company_appointments/all-appointments

people/company_appointments/maya/collect-maya-forms-debug-stats
Failed

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-18 10:06:24.268702
Last Completion:
2021-05-18 10:06:36.161195
Last Success:
None

dump_to_path
ERROR   :Traceback (most recent call last):
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/base/schema_validator.py", line 73, in schema_validator
ERROR   :row[field.name] = field.cast_value(row.get(field.name))
ERROR   :File "/usr/local/lib/python3.7/site-packages/tableschema/field.py", line 170, in cast_value
ERROR   :).format(field=self, value=value))
ERROR   :datapackage.exceptions
ERROR   :.
ERROR   :CastError
ERROR   ::
ERROR   :Field "HeaderProofValue_equals_HeaderProof" can't cast value "True" for type "number" with format "default"
ERROR   :During handling of the above exception, another exception occurred:
ERROR   :Traceback (most recent call last):
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/dump_to_path.py", line 23, in <module>
ERROR   :spew_flow(flow(ctx.parameters, ctx.stats), ctx)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
ERROR   :spew(self.datapackage, self.resource_iterator, stats=self.stats)
ERROR   :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
ERROR   :for rec in res:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/processors/dumpers/dumper_base.py", line 69, in row_counter
ERROR   :for row in iterator:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/processors/dumpers/file_dumper.py", line 78, in rows_processor
ERROR   :for row in resource:
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/base/schema_validator.py", line 75, in schema_validator
ERROR   :if not on_error(resource['name'], row, i, e, field):
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/base/schema_validator.py", line 49, in func
ERROR   :return on_error(res_name, row, i, e)
ERROR   :File "/usr/local/lib/python3.7/site-packages/dataflows/base/schema_validator.py", line 24, in raise_exception
ERROR   :raise ValidationError(res_name, row, i, e)
ERROR   :dataflows.base.schema_validator
ERROR   :.
ERROR   :ValidationError
ERROR   ::
ERROR   :ROW: {'HeaderEntityNameEB': Decimal('1'), 'HeaderFixtReport': 0, 'HeaderProof': Decimal('1'), 'HeaderProofFormat': 0, 'HeaderProofValue': Decimal('1'), 'HeaderProofValue_equals_HeaderProof': True, 'alias_stats': [{'FormSubject': '_________'}, {'KodSugYeshut': '1'}, {'ShemYeshutIvrit': 'מת"ב - מערכות תקשורת בכבלים בע"מ'}, {'MisparTofes': 'ת091'}, {'ShemYeshutLoazit': 'MATAV CABLE SYSTEMS MEDIA LTD'}, {'PumbiLoPumbi': 'פומבי'}, {'MezahehHotem': '5086'}, {'': 'מספר ברשם:'}, {'HeaderMisparBaRasham': '520040072'}, {'NeyarotErechReshumim': 'ניירות ערך של התאגיד רשומים למסחר בבורסה בתל-אביב'}, {'MezahehYeshut': '478'}, {'': 'שם מקוצר:'}, {'HeaderSemelBursa': 'מתב'}, {'MezahehTofes': '65'}, {'': 'רחוב:'}, {'HeaderRehov': 'בית ספרד, יורופארק, יקום'}, {'HeaderMisparBait': '1'}, {'HeaderYeshuv': 'יקום'}, {'HeaderMikud': '60972'}, {'HeaderPhone': 'טלפון:'}, {'HeaderTelephone1': '077-7077031'}, {'HeaderTelephone2': '077-7077037'}, {'': 'פקס:'}, {'HeaderFax1': '077-7078230'}, {'': 'דואר אלקטרוני:'}, {'HeaderDoarElectroniMedaveach': '[email protected]'}, {'HeaderSendDate': 'תאריך שידור:'}, {'HeaderSendTime': 'שעת שידור:'}, {'ShaaShidur': '19:06:46'}, {'': 'אתר החברה:'}, {'CompanyUrl': 'www.hot.co.il'}, {'': 'אסמכתא:'}, {'': 'לכבוד'}, {'': 'לכבוד'}, {'': 'רשות ניירות ערך'}, {'': 'הבורסה לניירות ערך בת"א בע"מ'}, {'DoarElectroniRashut': 'www.isa.gov.il'}, {'DoarElectroniBursa': 'www.tase.co.il'}, {'Hanadon': 'דוח מיידי על מינוי נושא משרה בכירה (למעט מינוי דירקטור ולמעט יחיד שמונה מטעם תאגיד שהוא דירקטור)'}, {'': 'תקנה 34 (ב) לתקנות ניירות ערך (דוחות תקופתיים ומיידיים), תש"ל - 1970'}, {'': 'הסבר: אם ממונה גם כדירקטור יש למלא טופס ת093 בלבד'}, {'': 'הסבר: בהתאם לתקנה 34 (ד) לתקנות ניירות ערך (דוחות תקופתיים ומיידים) תש"ל - 1970, יש להגיש במקביל להגשת טופס זה מצבת נושאי משרה בכירה במסגרת טופס ת097'}, {'': '1.'}, {'': 'שם משפחה ושם פרטי:'}, {'Shem': 'ברגמן דלי'}, {'': 'סוג מספר זיהוי:'}, {'SugMisparZihuy': 'מספר ת.ז.'}, {'': 'מספר זיהוי:'}, {'MisparZihuy': '027732304'}, {'': 'אזרחות/ ארץ התאגדות או רישום:'}, {'Ezrachut': 'אדם פרטי עם אזרחות ישראלית'}, {'': 'ארץ אזרחות / התאגדות או רישום:'}, {'EretzEzrachut': '_________'}, {'': '2.'}, {'': 'תאריך לידה:'}, {'TaarichLeida': '27/06/1970'}, {'': '3.'}, {'': 'מען להמצאת כתבי בית דין:'}, {'MaanLeHimatzutKitveyBeitDyn': 'בית ספרד, יורופארק, אזור תעשיה קיבוץ יקום'}, {'': '4.'}, {'': 'תאריך תחילת הכהונה:'}, {'TaarichTchilatHaKehuna': '01/01/2007'}, {'': '5.'}, {'': 'התפקיד לו מונה:'}, {'HaTafkidLoMuna': 'חשב'}, {'TeurHaTafkidLoMuna': '_________'}, {'': '6.'}, {'': 'תפקיד קודם בחברה טרם המינוי:'}, {'TafkidKodem': 'אין'}, {'TafkidKodemAher': '_________'}, {'': '7.'}, {'': 'השכלה אקדמית:'}, {'': 'תואר'}, {'': 'תחום'}, {'': 'שם המוסד האקדמי'}, {'Toar': 'בוגר'}, {'Tchum': 'חשבונאות וכלכלה'}, {'ShemHaMosadHaAcademi': 'אוניברסיטת תל- אביב'}, {'Toar': 'מוסמך'}, {'Tchum': 'מנהל עסקים'}, {'ShemHaMosadHaAcademi': 'אוניברסיטת תל- אביב'}, {'': 'השכלה אחרת ותעודות מקצועיות:'}, {'HaskalaAcheret': 'תעודת חשבות שכר'}, {'': '8.'}, {'': 'עיסוקים עיקריים ב – 5 השנים האחרונות:'}, {'': 'התפקיד שמילא'}, {'': 'מקום העבודה'}, {'': 'משך הזמן שמילא בתפקיד'}, {'HaTafkidSheMila': 'חשב'}, {'MekomHaAvoda': "ערוצי זהב ושות'"}, {'MeshechZmanSheMilaBaTafkid': '5 שנים'}, {'': '9.'}, {'': 'נושא משרה בכירה'}, {'NoseMisraBechira1': 'אינו ממלא'}, {'': 'בתפקידים אחרים בתאגיד,בחברת בת שלו, בחברה קשורה או אצל בעל העניין'}, {'': 'הסבר: אם הוא ממלא תפקידים אחרים בתאגיד, בחברה בת שלו או אצל בעל עניין בו נא לפרט.'}, {'Hesber1': '_________'}, {'': '10.'}, {'': 'נושא משרה בכירה'}, {'NoseMisraBechira2': 'אינו'}, {'': 'בן משפחה של נושא משרה בכירה אחר או של בעל עניין בתאגיד.'}, {'': 'הסבר: אם הוא בן משפחה של נושא משרה בכירה אחר או של בעל עניין בתאגיד, יש לפרט.'}, {'Hesber2': '_________'}, {'': '11.'}, {'': 'אם נושא המשרה הבכירה הוא מנכ"ל: הוא'}, {'NoseMisraBechira3': '_________'}, {'': 'בניירות ערך של התאגיד, של חברת בת או של חברה קשורה.'}, {'': 'הסבר: אם נושא המשרה הבכירה הוא מנכ"ל, יש לפרט אם הוא מחזיק ניירות ערך בתאגיד ,בחברת בת או בחברה קשורה. מילוי הערך מטבלה הוא לא שדה חובה.'}, {'Hesber3': '_________'}, {'TextHofshi': ''}, {'': 'מספרי אסמכתאות של מסמכים קודמים בנושא (אין האזכור מהווה הכללה על דרך הפניה):'}, {'FooterMisparAsmachta1': ''}, {'FooterMisparAsmachta2': ''}, {'FooterMisparAsmachta3': ''}, {'': 'שמות קודמים של ישות מדווחת:'}, {'ShemYeshutKodem': ''}, {'': 'תאריך עדכון מבנה הטופס:'}, {'TaarichIdkunMivne': '01/01/2007'}, {'': 'שם מדווח אלקטרוני:'}, {'FooterShemMedaveach': 'חריט אורית'}, {'FooterShemHevra': ''}, {'': 'תפקידו:'}, {'TafkidBaTaagid': 'עו"ד'}, {'Street': 'אזור התעשיה'}, {'StreetNumber': '-'}, {'City': 'יקום'}, {'ZipCode': '60972'}, {'': 'טלפון:'}, {'Telephone': '077-7077037'}, {'': 'פקס:'}, {'FooterFax1': '077-7078806'}, {'': 'דואר אלקטרוני:'}, {'FooterDoarElectroniMedaveach': '[email protected]'}], 'date': datetime.datetime(2007, 1, 1, 19, 14, 42), 'notification_type': 'ת091', 'positions': [['חשב', '_________']], 's3_object_name': 'maya.tase.co.il/2007_01/235402.htm', 'source': 'maya.tase.co.il', 'url': 'https://ams3.digitaloceanspaces.com/budgetkey-files/maya.tase.co.il/2007_01/235402.htm'}
----

Pipeline ID: people/company_appointments/maya/collect-maya-forms-debug-stats

Join the parsed PDF to get start and end time for each person (correlate)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 04:33:41.267027
Last Completion:
2021-05-18 04:34:28.061159
Last Success:
2021-05-18 04:34:28.061159

Pipeline ID: people/company_appointments/maya/correlate

people/company_appointments/maya/maya-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 04:15:34.769608
Last Completion:
2021-05-18 04:17:14.659402
Last Success:
2021-05-18 04:17:14.659402

Pipeline ID: people/company_appointments/maya/maya-list

Appointment notices from Maya (maya-nominations)
Succeeded

Name, job and company description.


Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 04:29:55.443733
Last Completion:
2021-05-18 04:30:27.344927
Last Success:
2021-05-18 04:30:27.344927

Pipeline ID: people/company_appointments/maya/maya-nominations

people/company_appointments/maya/maya-notification-list
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 00:18:07.854033
Last Completion:
2021-05-18 02:02:52.254471
Last Success:
2021-05-18 02:02:52.254471

Pipeline ID: people/company_appointments/maya/maya-notification-list

List all notifications from maya system (maya-notification-updates)
Succeeded

id, date, company, notification_type, s3_object_name, url


Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 03:37:06.453055
Last Completion:
2021-05-18 04:12:57.066720
Last Success:
2021-05-18 04:12:57.066720

Pipeline ID: people/company_appointments/maya/maya-notification-updates

Appointment notices from Maya (maya-resignations)
Succeeded

Name, job and company description.


Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 04:30:27.368076
Last Completion:
2021-05-18 04:30:59.046213
Last Success:
2021-05-18 04:30:59.046213

Pipeline ID: people/company_appointments/maya/maya-resignations

מינויים בכלכליסט (calcalist)
Succeeded

רשימת כל המינויים והחברות מאתר כלכליסט


Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:16:59.541946
Last Completion:
2021-05-13 10:24:19.347402
Last Success:
2021-05-13 10:24:19.347402

Pipeline ID: people/company_appointments/media/calcalist/calcalist

Appointment notices from TheMarker (themarker)
Succeeded

Name, job and company description.


Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 00:17:55.945988
Last Completion:
2021-05-18 00:18:05.756206
Last Success:
2021-05-18 00:18:05.756206

Pipeline ID: people/company_appointments/media/themarker/themarker

Join the parsed PDF to get start and end time for each person (correlate)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 03:31:46.467955
Last Completion:
2021-05-18 03:31:48.899668
Last Success:
2021-05-18 03:31:48.899668

Pipeline ID: people/company_appointments/state_owned/correlate

Parse and concatenate all PDF reports (parse_pdf_resources)
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 01:44:30.357544
Last Completion:
2021-05-18 01:44:33.163907
Last Success:
2021-05-18 01:44:33.163907

Pipeline ID: people/company_appointments/state_owned/parse_pdf_resources

collect links to all pdf reports on https://mof.gov.il/GCA/Directors/Pages/DirectorsManningReport.aspx (reports)
Succeeded

columns: date, url


Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 00:29:59.917102
Last Completion:
2021-05-18 00:30:08.286816
Last Success:
2021-05-18 00:30:08.286816

Pipeline ID: people/company_appointments/state_owned/reports

people/company_appointments/state_owned/state-owned-nominations
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 03:38:55.967504
Last Completion:
2021-05-18 03:38:59.645225
Last Success:
2021-05-18 03:38:59.645225

Pipeline ID: people/company_appointments/state_owned/state-owned-nominations

people/municipal_appointments/municipal_representitives
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:16:56.046239
Last Completion:
2021-05-13 10:16:59.457440
Last Success:
2021-05-13 10:16:59.457440

Pipeline ID: people/municipal_appointments/municipal_representitives

people/political_candidates/election_candidates21
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:16:20.348493
Last Completion:
2021-05-13 10:16:56.040846
Last Success:
2021-05-13 10:16:56.040846

Pipeline ID: people/political_candidates/election_candidates21

people/political_donations/political_donations
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 10:16:09.492377
Last Completion:
2021-05-13 10:16:20.342973
Last Success:
2021-05-13 10:16:20.342973

Pipeline ID: people/political_donations/political_donations

people/procurement/procurement-individuals
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-05-18 05:45:05.744569
Last Completion:
2021-05-18 05:55:21.656648
Last Success:
2021-05-18 05:55:21.656648

Pipeline ID: people/procurement/procurement-individuals

procurement/calls_for_bids/calls-for-bids-all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 16:00:02.708714
Last Completion:
2021-05-18 16:04:25.951994
Last Success:
2021-05-18 16:04:25.951994

Pipeline ID: procurement/calls_for_bids/calls-for-bids-all

procurement/calls_for_bids/calls-for-bids-moh
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 00:29:51.443088
Last Completion:
2021-05-18 00:29:59.912298
Last Success:
2021-05-18 00:29:59.912298

Pipeline ID: procurement/calls_for_bids/calls-for-bids-moh

procurement/calls_for_bids/gov-publications
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 12:12:43.848667
Last Completion:
2021-05-13 12:13:03.059027
Last Success:
2021-05-13 12:13:03.059027

Pipeline ID: procurement/calls_for_bids/gov-publications

procurement/calls_for_bids/gov-publications-ministry-of-immigration
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 12:12:43.864235
Last Completion:
2021-05-13 12:12:50.198790
Last Success:
2021-05-13 12:12:50.198790

Pipeline ID: procurement/calls_for_bids/gov-publications-ministry-of-immigration

procurement/calls_for_bids/gov-publications2
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 12:12:43.860501
Last Completion:
2021-05-13 12:24:33.116656
Last Success:
2021-05-13 12:24:33.116656

Pipeline ID: procurement/calls_for_bids/gov-publications2

procurement/calls_for_bids/jobiz-all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 15:00:20.157639
Last Completion:
2021-05-18 15:00:21.819893
Last Success:
2021-05-18 15:00:21.819893

Pipeline ID: procurement/calls_for_bids/jobiz-all

procurement/calls_for_bids/jobiz-calls-for-bids
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 15:00:21.843892
Last Completion:
2021-05-18 15:00:23.121151
Last Success:
2021-05-18 15:00:23.121151

Pipeline ID: procurement/calls_for_bids/jobiz-calls-for-bids

procurement/calls_for_bids/jobiz-scraper
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 15:00:02.459001
Last Completion:
2021-05-18 15:00:20.097072
Last Success:
2021-05-18 15:00:20.097072

Pipeline ID: procurement/calls_for_bids/jobiz-scraper

התקשרויות רכש ממשלתיות (latest-contract-spending)
Succeeded

אנו סוכמים מידע מתוך הדוחות הרבעוניים לתוך טבלה המכילה את המידע העדכני ביותר.


Last Run triggered by:
dirty-task-update
Last Run started at:
2021-05-18 01:49:51.889273
Last Completion:
2021-05-18 05:42:15.954144
Last Success:
2021-05-18 05:42:15.954144

Pipeline ID: procurement/spending/latest-contract-spending

procurement/spending/quarterly-contract-spending-report-uris
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-17 23:00:01.518778
Last Completion:
2021-05-17 23:08:27.355668
Last Success:
2021-05-17 23:08:27.355668

Pipeline ID: procurement/spending/quarterly-contract-spending-report-uris

דוחות רבעוניים מתוך מרכבה, לפי נוהל היחידה לחופש המידע. (quarterly-contract-spending-reports)
Succeeded

כל משרדי הממשלה ויחידות הסמך (שמחוברות למערכת מרכבה) צריכים לפרסם אחת לרבעון (תוך 45 יום מסוף הרבעון) דו״ח התקשרויות לפי פורמט מוגדר היטב הממומש כדו״ח מובנה במערכת המרכבה. כל המשרדים מדווחים עצמאית והדו״חות עולים לאתר היחידה לחופש המידע, משם אנו אוספים אותם. התוצר של השרשר הזה הוא פירוט כל הדיווחים של כל המשרדים.


Last Run triggered by:
scheduled
Last Run started at:
2021-05-17 23:17:05.255451
Last Completion:
2021-05-17 23:30:51.741637
Last Success:
2021-05-17 23:30:51.741637

Pipeline ID: procurement/spending/quarterly-contract-spending-reports

procurement/spending/quarterly-contract-spending-reports-data
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-05-17 23:58:00.479296
Last Completion:
2021-05-18 00:49:42.768499
Last Success:
2021-05-18 00:49:42.768499

Pipeline ID: procurement/spending/quarterly-contract-spending-reports-data

procurement/spending/spending-by-entity
Succeeded

Last Run triggered by:
dirty-task-update
Last Run started at:
2021-05-18 05:42:16.002558
Last Completion:
2021-05-18 05:52:07.655952
Last Success:
2021-05-18 05:52:07.655952

Pipeline ID: procurement/spending/spending-by-entity

Load all tenders data from data.gov.il to flat file (all)
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 09:36:48.717854
Last Completion:
2021-05-13 09:39:52.004863
Last Success:
2021-05-13 09:39:52.004863

Pipeline ID: procurement/tenders/all

procurement/tenders/processed
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-13 11:51:45.537367
Last Completion:
2021-05-13 11:57:20.626679
Last Success:
2021-05-13 11:57:20.626679

Pipeline ID: procurement/tenders/processed

reports/all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 03:41:03.941466
Last Completion:
2021-05-18 03:41:10.763790
Last Success:
2021-05-18 03:41:10.763790

Pipeline ID: reports/all

reports/ngos/ngo-activity-report
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 03:33:43.279426
Last Completion:
2021-05-18 03:37:50.943427
Last Success:
2021-05-18 03:37:50.943427

Pipeline ID: reports/ngos/ngo-activity-report

reports/ngos/ngo-district-report
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 03:32:19.253577
Last Completion:
2021-05-18 03:34:46.650740
Last Success:
2021-05-18 03:34:46.650740

Pipeline ID: reports/ngos/ngo-district-report

supports/all
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 18:11:32.305953
Last Completion:
2021-05-18 18:16:01.369396
Last Success:
2021-05-18 18:16:01.369396

Pipeline ID: supports/all

supports/by-payment-year
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 01:31:03.255347
Last Completion:
2021-05-18 01:41:23.367792
Last Success:
2021-05-18 01:41:23.367792

Pipeline ID: supports/by-payment-year

supports/by-request-year
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 01:31:18.545998
Last Completion:
2021-05-18 01:43:45.472504
Last Success:
2021-05-18 01:43:45.472504

Pipeline ID: supports/by-request-year

supports/criteria/support-criteria
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 00:30:24.178490
Last Completion:
2021-05-18 00:30:29.853064
Last Success:
2021-05-18 00:30:29.853064

Pipeline ID: supports/criteria/support-criteria

supports/criteria/support-criteria-doj
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 00:00:43.870804
Last Completion:
2021-05-18 00:00:58.462478
Last Success:
2021-05-18 00:00:58.462478

Pipeline ID: supports/criteria/support-criteria-doj

supports/supports-2004
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:05.077865
Last Completion:
2021-05-15 07:28:09.149585
Last Success:
2021-05-15 07:28:09.149585

Pipeline ID: supports/supports-2004

supports/supports-2005
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:05.081187
Last Completion:
2021-05-15 07:28:08.946001
Last Success:
2021-05-15 07:28:08.946001

Pipeline ID: supports/supports-2005

supports/supports-2006
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:05.149888
Last Completion:
2021-05-15 07:28:09.165177
Last Success:
2021-05-15 07:28:09.165177

Pipeline ID: supports/supports-2006

supports/supports-2007
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:05.153070
Last Completion:
2021-05-15 07:28:09.543286
Last Success:
2021-05-15 07:28:09.543286

Pipeline ID: supports/supports-2007

supports/supports-2008
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:05.167896
Last Completion:
2021-05-15 07:28:08.765835
Last Success:
2021-05-15 07:28:08.765835

Pipeline ID: supports/supports-2008

supports/supports-2009
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:08.847174
Last Completion:
2021-05-15 07:28:11.472865
Last Success:
2021-05-15 07:28:11.472865

Pipeline ID: supports/supports-2009

supports/supports-2010
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:08.953846
Last Completion:
2021-05-15 07:28:11.760031
Last Success:
2021-05-15 07:28:11.760031

Pipeline ID: supports/supports-2010

supports/supports-2011
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:09.162466
Last Completion:
2021-05-15 07:28:11.569127
Last Success:
2021-05-15 07:28:11.569127

Pipeline ID: supports/supports-2011

supports/supports-2012
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:09.172544
Last Completion:
2021-05-15 07:28:12.046532
Last Success:
2021-05-15 07:28:12.046532

Pipeline ID: supports/supports-2012

supports/supports-2013
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:09.553460
Last Completion:
2021-05-15 07:28:12.659860
Last Success:
2021-05-15 07:28:12.659860

Pipeline ID: supports/supports-2013

supports/supports-2014
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:09.660997
Last Completion:
2021-05-15 07:28:12.551766
Last Success:
2021-05-15 07:28:12.551766

Pipeline ID: supports/supports-2014

supports/supports-2015
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:11.478050
Last Completion:
2021-05-15 07:28:13.948180
Last Success:
2021-05-15 07:28:13.948180

Pipeline ID: supports/supports-2015

supports/supports-2016
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:11.574410
Last Completion:
2021-05-15 07:28:14.147959
Last Success:
2021-05-15 07:28:14.147959

Pipeline ID: supports/supports-2016

supports/supports-2017
Succeeded

Last Run triggered by:
dirty-task-init
Last Run started at:
2021-05-15 07:28:11.764463
Last Completion:
2021-05-15 07:28:15.566110
Last Success:
2021-05-15 07:28:15.566110

Pipeline ID: supports/supports-2017

supports/supports-2018
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 15:00:01.968716
Last Completion:
2021-05-18 15:15:37.254842
Last Success:
2021-05-18 15:15:37.254842

Pipeline ID: supports/supports-2018

supports/supports-2019
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 16:00:01.892381
Last Completion:
2021-05-18 16:12:13.089536
Last Success:
2021-05-18 16:12:13.089536

Pipeline ID: supports/supports-2019

supports/supports-2020
Succeeded

Last Run triggered by:
scheduled
Last Run started at:
2021-05-18 17:00:01.620796
Last Completion:
2021-05-18 17:10:39.308121
Last Success:
2021-05-18 17:10:39.308121

Pipeline ID: supports/supports-2020