Pipeline ID: activities/all
Pipeline ID: activities/social_services/historic_data
Pipeline ID: bank_of_israel/bank_of_israel
explanation_fetcher
Traceback (most recent call last):
File "/datapackage_pipelines_budgetkey/pipelines/budget/national/changes/explanations/explanation_fetcher.py", line 64, in <module>
spew(dp, itertools.chain(res_iter, [get_explanations(parameters['url'])]))
File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
for rec in res:
File "/datapackage_pipelines_budgetkey/pipelines/budget/national/changes/explanations/explanation_fetcher.py", line 32, in get_explanations
archive = gcl.download(url)
File "/datapackage_pipelines_budgetkey/common/google_chrome.py", line 111, in download
self.driver.get(url)
File "/usr/local/lib/python3.7/site-packages/selenium/webdriver/remote/webdriver.py", line 333, in get
self.execute(Command.GET, {'url': url})
File "/usr/local/lib/python3.7/site-packages/selenium/webdriver/remote/webdriver.py", line 321, in execute
self.error_handler.check_response(response)
File "/usr/local/lib/python3.7/site-packages/selenium/webdriver/remote/errorhandler.py", line 242, in check_response
raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.WebDriverException: Message: chrome not reachable
(Session info: chrome=88.0.4324.96)
DEBUG :[chan 482] Max packet in: 32768 bytes
DEBUG :[chan 482] Max packet out: 32768 bytes
DEBUG :Secsh channel 482 opened.
DEBUG :[chan 482] Sesch channel 482 request ok
DEBUG :[chan 482] EOF received (482)
DEBUG :[chan 482] EOF sent (482)
DEBUG :Dropping user packet because connection is dead.
Pipeline ID: budget/national/changes/explanations/all
Pipeline ID: budget/national/changes/original/current-year-fixes
Pipeline ID: budget/national/changes/original/national-budget-changes
Dependency unsuccessful :Cannot run until dependency "./budget/national/changes/explanations/all" is successfully executed
Pipeline ID: budget/national/changes/processed/national-budget-changes-aggregated
Pipeline ID: budget/national/changes/processed/transactions
We get the data the Ministry of Finance publishes in data.gov.il every year. It comes in XLS format, with one row per TAKANA and phase (original, approved, executed). In this pipeline we create from each triplet a single row that has all the data.
Pipeline ID: budget/national/original/national-budgets
This pipeline joins the different phases of the budget (allocated, revised and executed). In the original file there's a separate row for each of the phases. We like it better as a single row with all phase info. Another thing this pipeline does is to rename the column titles - to more friendly English names. Also, it create rows for all hierarchies - where upper hierarchies (2, 4 & 6 digits) are plain aggregations of the 8-digit items they contain.
Pipeline ID: budget/national/processed/aggregated-yearly
Pipeline ID: budget/national/processed/category-explanations
This pipeline joins budget items that span across years.
Pipeline ID: budget/national/processed/connected-items-explained
This pipeline joins budget items that span across years.
Pipeline ID: budget/national/processed/connected-national-budgets
Pipeline ID: budget/national/processed/just-the-total
Pipeline ID: budget/national/processed/roof-names
This pipeline joins the budget data to itself so that each item has a list of its immediate children.
Pipeline ID: budget/national/processed/with-extras
Pipeline ID: budgetkey/analysis/spending/publisher_entity_analysis
Pipeline ID: budgetkey/analysis/spending/publisher_foa_analysis
Pipeline ID: budgetkey/analysis/spending/united
Pipeline ID: budgetkey/budget-functional-aggregates
Pipeline ID: budgetkey/documents
Pipeline ID: budgetkey/elasticsearch/index_activities
Pipeline ID: budgetkey/elasticsearch/index_budget
Pipeline ID: budgetkey/elasticsearch/index_calls_for_bids
Pipeline ID: budgetkey/elasticsearch/index_contract_spending
Pipeline ID: budgetkey/elasticsearch/index_entities
Invalid dependency :Cannot run until dependency passes validation: ./government_decisions/government_decisions From ./government_decisions/government_decisions :['Dependency unsuccessful', 'Cannot run until dependency "./government_decisions/scraper" is successfully executed']
Pipeline ID: budgetkey/elasticsearch/index_gov_decisions
Invalid dependency :Cannot run until dependency passes validation: ./budget/national/changes/processed/national-budget-changes-aggregated From ./budget/national/changes/processed/national-budget-changes-aggregated :['Dependency unsuccessful', 'Cannot run until dependency "./budget/national/changes/explanations/all" is successfully executed']
Pipeline ID: budgetkey/elasticsearch/index_national_budget_changes
Pipeline ID: budgetkey/elasticsearch/index_people
Pipeline ID: budgetkey/elasticsearch/index_reports
Pipeline ID: budgetkey/elasticsearch/index_support_criteria
Pipeline ID: budgetkey/elasticsearch/index_supports
Missing dependency :Failed to find a dependency: ./procurement/tenders/processed
Pipeline ID: budgetkey/elasticsearch/index_tenders
Missing dependency :Failed to find a dependency: ./budgetkey/elasticsearch/index_tenders
Pipeline ID: budgetkey/elasticsearch/sitemaps
Pipeline ID: budgetkey/emails/emails
Pipeline ID: donations/candidates
Pipeline ID: donations/parties
dump.to_path
ERROR :Failed to transform row {'CandidateName': 'בוארון אביחי', 'City': 'עופרה', 'Country': 'ישראל', 'GD_Date': '/Date(1423432800000)/', 'GD_Name': 'אביחי בוארון תרומה עצמית', 'GD_Sum': '130000.00', 'GuaranteeOrDonation': 'תרומה', 'ID': None, 'IsControl': False, 'IsDeficitCoverage': 'לא', 'IsUpdate': False, 'Party': 'הבית היהודי, מיסודה של המפד"ל – המפלגה הדתית לאומית המזרחי הפועל המזרחי בארץ ישראל', 'PublisherTypeID': 2, 'State': 0, 'SumInCurrency': '0.00', 'URL': None}
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/file_formats.py", line 31, in __transform_row
for k, v in row.items())
File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/file_formats.py", line 31, in <genexpr>
for k, v in row.items())
KeyError: 'IsDeficitCoverage'
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/dump/to_path.py", line 37, in <module>
PathDumper()()
File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/dumper_base.py", line 53, in __call__
finalizer=self.finalize
File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
for rec in res:
File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/dumper_base.py", line 128, in row_counter
for row in resource:
File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/dumper_base.py", line 258, in rows_processor
file_formatter.write_row(writer, row, fields)
File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/file_formats.py", line 44, in write_row
transformed_row = self.__transform_row(row, fields)
File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/file_formats.py", line 31, in __transform_row
for k, v in row.items())
File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/lib/dump/file_formats.py", line 31, in <genexpr>
for k, v in row.items())
KeyError: 'IsDeficitCoverage'
Pipeline ID: donations/transactions
Pipeline ID: education/tochniyot/tochniyot
Pipeline ID: entities/all
Pipeline ID: entities/associations/guidestar/guidestar
Pipeline ID: entities/associations/guidestar/guidestar-scraper
רשימת כלל העמותות הפעילות, מתעדכן שבועית.
Pipeline ID: entities/associations/registrar/registry
Pipeline ID: entities/companies/registrar/details
רשימת כלל החברות הפעילות, מתעדכן שבועית.
Pipeline ID: entities/companies/registrar/scraper
רשימת אגודות שיתופיות, מתוך ממשק נתונים של מאגר של משרד הכלכלה / האגף לאיגוד שיתופי, מתעדכן שבועית
Pipeline ID: entities/cooperatives/cooperatives
Pipeline ID: entities/entities
Pipeline ID: entities/fingerprints
Pipeline ID: entities/foi_orgs/foi_orgs
Pipeline ID: entities/moital/moital_service_providers
רשימת אגודות עותומניות, מתוך תשובה לבקשת חופש מידע
Pipeline ID: entities/ottoman/ottoman-association-registry
stream_remote_resources
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/tabulator/loaders/remote.py", line 63, in load
bytes = _RemoteStream(source, self.__http_session, self.__http_timeout).open()
File "/usr/local/lib/python3.7/site-packages/tabulator/loaders/remote.py", line 121, in open
self.seek(0)
File "/usr/local/lib/python3.7/site-packages/tabulator/loaders/remote.py", line 143, in seek
self.__response.raise_for_status()
File "/usr/local/lib/python3.7/site-packages/requests/models.py", line 943, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.gov.il/he/error
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 243, in <module>
resource.pop('http_headers', None))
File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 197, in stream_reader
schema, headers, columns, stream, close = get_opener(url, _resource)()
File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/stream_remote_resources.py", line 173, in opener
_stream.open()
File "/usr/local/lib/python3.7/site-packages/tabulator/stream.py", line 423, in open
self.__parser.open(source, encoding=self.__encoding)
File "/usr/local/lib/python3.7/site-packages/tabulator/parsers/xlsx.py", line 80, in open
source_bytes = self.__loader.load(source, mode="b", encoding=encoding)
File "/usr/local/lib/python3.7/site-packages/tabulator/loaders/remote.py", line 72, in load
raise exceptions.HTTPError(str(exception))
tabulator.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.gov.il/he/error
Pipeline ID: entities/safety-orders/safety-orders
Dependency unsuccessful :Cannot run until dependency "./entities/safety-orders/safety-orders" is successfully executed
Pipeline ID: entities/safety-orders/safety-orders-by-entity
Pipeline ID: entities/special/registry
Pipeline ID: ezvonot/ezvonot_accounts
Pipeline ID: ezvonot/ezvonot_cases
Pipeline ID: ezvonot/ezvonot_crontab
data_gov_il_resource
Traceback (most recent call last):
File "/datapackage_pipelines_budgetkey/processors/data_gov_il_resource.py", line 59, in <module>
spew_flow(flow(ctx.parameters), ctx)
File "/datapackage_pipelines_budgetkey/processors/data_gov_il_resource.py", line 40, in flow
url, path = get_resource(gcd, dataset_name, resource_name)
File "/datapackage_pipelines_budgetkey/common/data_gov_il.py", line 101, in get_resource
assert False, 'Failed to find resource for name %s: possibilities are %r' % (resource_name, [r['name'] for r in dataset['resources']])
AssertionError: Failed to find resource for name קובץ החלטות וועדה : possibilities are ['קובץ הפקדות', 'קובץ חשבונות המרכיבים את החלטות הועדה', 'קובץ תיקים', 'קובץ ייעודים', 'קובץ החלטות וועדה ']
Pipeline ID: ezvonot/ezvonot_decisions
Dependency unsuccessful :Cannot run until dependency "./ezvonot/ezvonot_decisions" is successfully executed
Pipeline ID: ezvonot/ezvonot_decisions_join
Pipeline ID: ezvonot/ezvonot_deposits
Pipeline ID: ezvonot/ezvonot_purposes
Dependency unsuccessful :Cannot run until dependency "./government_decisions/scraper" is successfully executed
Pipeline ID: government_decisions/government_decisions
scraper
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 677, in urlopen
chunked=chunked,
File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 381, in _make_request
self._validate_conn(conn)
File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 978, in _validate_conn
conn.connect()
File "/usr/local/lib/python3.7/site-packages/urllib3/connection.py", line 371, in connect
ssl_context=context,
File "/usr/local/lib/python3.7/site-packages/urllib3/util/ssl_.py", line 386, in ssl_wrap_socket
return context.wrap_socket(sock, server_hostname=server_hostname)
File "/usr/local/lib/python3.7/ssl.py", line 423, in wrap_socket
session=session
File "/usr/local/lib/python3.7/ssl.py", line 870, in _create
self.do_handshake()
File "/usr/local/lib/python3.7/ssl.py", line 1139, in do_handshake
self._sslobj.do_handshake()
ConnectionResetError: [Errno 104] Connection reset by peer
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/requests/adapters.py", line 449, in send
timeout=timeout
File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 727, in urlopen
method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
File "/usr/local/lib/python3.7/site-packages/urllib3/util/retry.py", line 410, in increment
raise six.reraise(type(error), error, _stacktrace)
File "/usr/local/lib/python3.7/site-packages/urllib3/packages/six.py", line 734, in reraise
raise value.with_traceback(tb)
File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 677, in urlopen
chunked=chunked,
File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 381, in _make_request
self._validate_conn(conn)
File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 978, in _validate_conn
conn.connect()
File "/usr/local/lib/python3.7/site-packages/urllib3/connection.py", line 371, in connect
ssl_context=context,
File "/usr/local/lib/python3.7/site-packages/urllib3/util/ssl_.py", line 386, in ssl_wrap_socket
return context.wrap_socket(sock, server_hostname=server_hostname)
File "/usr/local/lib/python3.7/ssl.py", line 423, in wrap_socket
session=session
File "/usr/local/lib/python3.7/ssl.py", line 870, in _create
self.do_handshake()
File "/usr/local/lib/python3.7/ssl.py", line 1139, in do_handshake
self._sslobj.do_handshake()
urllib3.exceptions.ProtocolError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/datapackage_pipelines_budgetkey/pipelines/government_decisions/scraper.py", line 122, in <module>
spew(datapackage, chain(res_iter, [get_decision_list()]))
File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
for rec in res:
File "/datapackage_pipelines_budgetkey/pipelines/government_decisions/scraper.py", line 55, in get_decision_list
response = session.get(SEARCH_PAGE_RESULTS_URL.format(skip=0), timeout=TIMEOUT).json()
File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 555, in get
return self.request('GET', url, **kwargs)
File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 542, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 655, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.7/site-packages/requests/adapters.py", line 498, in send
raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
Pipeline ID: government_decisions/scraper
Pipeline ID: lamas/municipal-data
Pipeline ID: lamas/municipality-to-city
Pipeline ID: maya/maya-bonds-and-options-holdings-changes
Pipeline ID: maya/maya-company-officer-list
Pipeline ID: maya/maya-company-stakeholder-list
Pipeline ID: maya/maya-company-vip-appointments
Pipeline ID: maya/maya-complete-notification-list
Pipeline ID: maya/maya-holdings-changes
Pipeline ID: maya/maya-notification-parse-updates
Pipeline ID: maya/maya-reported-academic-degrees
Pipeline ID: maya/maya-reported-work-record
flow ERROR :Traceback (most recent call last): ERROR :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module> ERROR :spew_flow(flow, ctx) ERROR :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__ ERROR :spew(self.datapackage, self.resource_iterator, stats=self.stats) ERROR :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew ERROR :for rec in res: ERROR :File "/usr/local/lib/python3.7/site-packages/dataflows/helpers/rows_processor.py", line 11, in process_resource ERROR :yield from self.func(resource) ERROR :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_tase_companies_current_management.py", line 61, in process_companies ERROR :for manager in get_company_management(int(row['CompanyTaseId'])): ERROR :File "/datapackage_pipelines_budgetkey/pipelines/maya/maya_tase_companies_current_management.py", line 53, in get_company_management ERROR :json = res.json()['Data'] ERROR :KeyError ERROR :: ERROR :'Data'
Pipeline ID: maya/maya-tase-companies-current-management
Pipeline ID: maya/scrape-maya-notification-list
Pipeline ID: maya/scrape-maya-tase-companies
Pipeline ID: people/aggregated
Pipeline ID: people/all
Pipeline ID: people/association_founders/association-founders
Pipeline ID: people/company_appointments/all-appointments
dump_to_path
ERROR :Traceback (most recent call last):
ERROR :File "/usr/local/lib/python3.7/site-packages/dataflows/base/schema_validator.py", line 73, in schema_validator
ERROR :row[field.name] = field.cast_value(row.get(field.name))
ERROR :File "/usr/local/lib/python3.7/site-packages/tableschema/field.py", line 170, in cast_value
ERROR :).format(field=self, value=value))
ERROR :datapackage.exceptions
ERROR :.
ERROR :CastError
ERROR ::
ERROR :Field "HeaderProofValue_equals_HeaderProof" can't cast value "True" for type "number" with format "default"
ERROR :During handling of the above exception, another exception occurred:
ERROR :Traceback (most recent call last):
ERROR :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/dump_to_path.py", line 23, in <module>
ERROR :spew_flow(flow(ctx.parameters, ctx.stats), ctx)
ERROR :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 181, in __exit__
ERROR :spew(self.datapackage, self.resource_iterator, stats=self.stats)
ERROR :File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 75, in spew
ERROR :for rec in res:
ERROR :File "/usr/local/lib/python3.7/site-packages/dataflows/processors/dumpers/dumper_base.py", line 69, in row_counter
ERROR :for row in iterator:
ERROR :File "/usr/local/lib/python3.7/site-packages/dataflows/processors/dumpers/file_dumper.py", line 77, in rows_processor
ERROR :for row in resource:
ERROR :File "/usr/local/lib/python3.7/site-packages/dataflows/base/schema_validator.py", line 75, in schema_validator
ERROR :if not on_error(resource['name'], row, i, e, field):
ERROR :File "/usr/local/lib/python3.7/site-packages/dataflows/base/schema_validator.py", line 49, in func
ERROR :return on_error(res_name, row, i, e)
ERROR :File "/usr/local/lib/python3.7/site-packages/dataflows/base/schema_validator.py", line 24, in raise_exception
ERROR :raise ValidationError(res_name, row, i, e)
ERROR :dataflows.base.schema_validator
ERROR :.
ERROR :ValidationError
ERROR ::
ERROR :ROW: {'HeaderEntityNameEB': Decimal('1'), 'HeaderFixtReport': 0, 'HeaderProof': Decimal('1'), 'HeaderProofFormat': 0, 'HeaderProofValue': Decimal('1'), 'HeaderProofValue_equals_HeaderProof': True, 'alias_stats': [{'FormSubject': '_________'}, {'KodSugYeshut': '1'}, {'ShemYeshutIvrit': 'מת"ב - מערכות תקשורת בכבלים בע"מ'}, {'MisparTofes': 'ת091'}, {'ShemYeshutLoazit': 'MATAV CABLE SYSTEMS MEDIA LTD'}, {'PumbiLoPumbi': 'פומבי'}, {'MezahehHotem': '5086'}, {'': 'מספר ברשם:'}, {'HeaderMisparBaRasham': '520040072'}, {'NeyarotErechReshumim': 'ניירות ערך של התאגיד רשומים למסחר בבורסה בתל-אביב'}, {'MezahehYeshut': '478'}, {'': 'שם מקוצר:'}, {'HeaderSemelBursa': 'מתב'}, {'MezahehTofes': '65'}, {'': 'רחוב:'}, {'HeaderRehov': 'בית ספרד, יורופארק, יקום'}, {'HeaderMisparBait': '1'}, {'HeaderYeshuv': 'יקום'}, {'HeaderMikud': '60972'}, {'HeaderPhone': 'טלפון:'}, {'HeaderTelephone1': '077-7077031'}, {'HeaderTelephone2': '077-7077037'}, {'': 'פקס:'}, {'HeaderFax1': '077-7078230'}, {'': 'דואר אלקטרוני:'}, {'HeaderDoarElectroniMedaveach': 'ori.gur[email protected]'}, {'HeaderSendDate': 'תאריך שידור:'}, {'HeaderSendTime': 'שעת שידור:'}, {'ShaaShidur': '19:06:46'}, {'': 'אתר החברה:'}, {'CompanyUrl': 'www.hot.co.il'}, {'': 'אסמכתא:'}, {'': 'לכבוד'}, {'': 'לכבוד'}, {'': 'רשות ניירות ערך'}, {'': 'הבורסה לניירות ערך בת"א בע"מ'}, {'DoarElectroniRashut': 'www.isa.gov.il'}, {'DoarElectroniBursa': 'www.tase.co.il'}, {'Hanadon': 'דוח מיידי על מינוי נושא משרה בכירה (למעט מינוי דירקטור ולמעט יחיד שמונה מטעם תאגיד שהוא דירקטור)'}, {'': 'תקנה 34 (ב) לתקנות ניירות ערך (דוחות תקופתיים ומיידיים), תש"ל - 1970'}, {'': 'הסבר: אם ממונה גם כדירקטור יש למלא טופס ת093 בלבד'}, {'': 'הסבר: בהתאם לתקנה 34 (ד) לתקנות ניירות ערך (דוחות תקופתיים ומיידים) תש"ל - 1970, יש להגיש במקביל להגשת טופס זה מצבת נושאי משרה בכירה במסגרת טופס ת097'}, {'': '1.'}, {'': 'שם משפחה ושם פרטי:'}, {'Shem': 'ברגמן דלי'}, {'': 'סוג מספר זיהוי:'}, {'SugMisparZihuy': 'מספר ת.ז.'}, {'': 'מספר זיהוי:'}, {'MisparZihuy': '027732304'}, {'': 'אזרחות/ ארץ התאגדות או רישום:'}, {'Ezrachut': 'אדם פרטי עם אזרחות ישראלית'}, {'': 'ארץ אזרחות / התאגדות או רישום:'}, {'EretzEzrachut': '_________'}, {'': '2.'}, {'': 'תאריך לידה:'}, {'TaarichLeida': '27/06/1970'}, {'': '3.'}, {'': 'מען להמצאת כתבי בית דין:'}, {'MaanLeHimatzutKitveyBeitDyn': 'בית ספרד, יורופארק, אזור תעשיה קיבוץ יקום'}, {'': '4.'}, {'': 'תאריך תחילת הכהונה:'}, {'TaarichTchilatHaKehuna': '01/01/2007'}, {'': '5.'}, {'': 'התפקיד לו מונה:'}, {'HaTafkidLoMuna': 'חשב'}, {'TeurHaTafkidLoMuna': '_________'}, {'': '6.'}, {'': 'תפקיד קודם בחברה טרם המינוי:'}, {'TafkidKodem': 'אין'}, {'TafkidKodemAher': '_________'}, {'': '7.'}, {'': 'השכלה אקדמית:'}, {'': 'תואר'}, {'': 'תחום'}, {'': 'שם המוסד האקדמי'}, {'Toar': 'בוגר'}, {'Tchum': 'חשבונאות וכלכלה'}, {'ShemHaMosadHaAcademi': 'אוניברסיטת תל- אביב'}, {'Toar': 'מוסמך'}, {'Tchum': 'מנהל עסקים'}, {'ShemHaMosadHaAcademi': 'אוניברסיטת תל- אביב'}, {'': 'השכלה אחרת ותעודות מקצועיות:'}, {'HaskalaAcheret': 'תעודת חשבות שכר'}, {'': '8.'}, {'': 'עיסוקים עיקריים ב – 5 השנים האחרונות:'}, {'': 'התפקיד שמילא'}, {'': 'מקום העבודה'}, {'': 'משך הזמן שמילא בתפקיד'}, {'HaTafkidSheMila': 'חשב'}, {'MekomHaAvoda': "ערוצי זהב ושות'"}, {'MeshechZmanSheMilaBaTafkid': '5 שנים'}, {'': '9.'}, {'': 'נושא משרה בכירה'}, {'NoseMisraBechira1': 'אינו ממלא'}, {'': 'בתפקידים אחרים בתאגיד,בחברת בת שלו, בחברה קשורה או אצל בעל העניין'}, {'': 'הסבר: אם הוא ממלא תפקידים אחרים בתאגיד, בחברה בת שלו או אצל בעל עניין בו נא לפרט.'}, {'Hesber1': '_________'}, {'': '10.'}, {'': 'נושא משרה בכירה'}, {'NoseMisraBechira2': 'אינו'}, {'': 'בן משפחה של נושא משרה בכירה אחר או של בעל עניין בתאגיד.'}, {'': 'הסבר: אם הוא בן משפחה של נושא משרה בכירה אחר או של בעל עניין בתאגיד, יש לפרט.'}, {'Hesber2': '_________'}, {'': '11.'}, {'': 'אם נושא המשרה הבכירה הוא מנכ"ל: הוא'}, {'NoseMisraBechira3': '_________'}, {'': 'בניירות ערך של התאגיד, של חברת בת או של חברה קשורה.'}, {'': 'הסבר: אם נושא המשרה הבכירה הוא מנכ"ל, יש לפרט אם הוא מחזיק ניירות ערך בתאגיד ,בחברת בת או בחברה קשורה. מילוי הערך מטבלה הוא לא שדה חובה.'}, {'Hesber3': '_________'}, {'TextHofshi': ''}, {'': 'מספרי אסמכתאות של מסמכים קודמים בנושא (אין האזכור מהווה הכללה על דרך הפניה):'}, {'FooterMisparAsmachta1': ''}, {'FooterMisparAsmachta2': ''}, {'FooterMisparAsmachta3': ''}, {'': 'שמות קודמים של ישות מדווחת:'}, {'ShemYeshutKodem': ''}, {'': 'תאריך עדכון מבנה הטופס:'}, {'TaarichIdkunMivne': '01/01/2007'}, {'': 'שם מדווח אלקטרוני:'}, {'FooterShemMedaveach': 'חריט אורית'}, {'FooterShemHevra': ''}, {'': 'תפקידו:'}, {'TafkidBaTaagid': 'עו"ד'}, {'Street': 'אזור התעשיה'}, {'StreetNumber': '-'}, {'City': 'יקום'}, {'ZipCode': '60972'}, {'': 'טלפון:'}, {'Telephone': '077-7077037'}, {'': 'פקס:'}, {'FooterFax1': '077-7078806'}, {'': 'דואר אלקטרוני:'}, {'FooterDoarElectroniMedaveach': '[email protected]'}], 'date': datetime.datetime(2007, 1, 1, 19, 14, 42), 'notification_type': 'ת091', 'positions': [['חשב', '_________']], 's3_object_name': 'maya.tase.co.il/2007_01/235402.htm', 'source': 'maya.tase.co.il', 'url': 'https://ams3.digitaloceanspaces.com/budgetkey-files/maya.tase.co.il/2007_01/235402.htm'}
----
Pipeline ID: people/company_appointments/maya/collect-maya-forms-debug-stats
Pipeline ID: people/company_appointments/maya/correlate
Pipeline ID: people/company_appointments/maya/maya-list
Name, job and company description.
Pipeline ID: people/company_appointments/maya/maya-nominations
Pipeline ID: people/company_appointments/maya/maya-notification-list
id, date, company, notification_type, s3_object_name, url
Pipeline ID: people/company_appointments/maya/maya-notification-updates
Name, job and company description.
Pipeline ID: people/company_appointments/maya/maya-resignations
רשימת כל המינויים והחברות מאתר כלכליסט
Pipeline ID: people/company_appointments/media/calcalist/calcalist
Name, job and company description.
Pipeline ID: people/company_appointments/media/themarker/themarker
Pipeline ID: people/company_appointments/state_owned/correlate
Pipeline ID: people/company_appointments/state_owned/parse_pdf_resources
columns: date, url
Pipeline ID: people/company_appointments/state_owned/reports
Pipeline ID: people/company_appointments/state_owned/state-owned-nominations
Pipeline ID: people/municipal_appointments/municipal_representitives
Pipeline ID: people/political_candidates/election_candidates21
Pipeline ID: people/political_donations/political_donations
Pipeline ID: people/procurement/procurement-individuals
flow
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/dataflows/base/datastream_processor.py", line 79, in _process
self.datapackage = self.process_datapackage(self.datapackage)
File "/usr/local/lib/python3.7/site-packages/dataflows/helpers/iterable_loader.py", line 112, in process_datapackage
raise self.exc
File "/usr/local/lib/python3.7/site-packages/dataflows/helpers/iterable_loader.py", line 60, in describe
sample = list(itertools.islice(self.iterable, self.SAMPLE_SIZE))
File "/usr/local/lib/python3.7/site-packages/dataflows/helpers/iterable_loader.py", line 89, in handle_iterable
for x in self.iterable:
File "/datapackage_pipelines_budgetkey/pipelines/procurement/calls_for_bids/class_action.py", line 36, in scrape
if not link.startswith('http'):
AttributeError: 'NoneType' object has no attribute 'startswith'
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/specs/../lib/flow.py", line 15, in <module>
spew_flow(flow, ctx)
File "/usr/local/lib/python3.7/site-packages/datapackage_pipelines/utilities/flow_utils.py", line 46, in spew_flow
datastream = flow.datastream()
File "/usr/local/lib/python3.7/site-packages/dataflows/base/flow.py", line 18, in datastream
return self._chain(ds)._process()
File "/usr/local/lib/python3.7/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
datastream = self.source._process()
File "/usr/local/lib/python3.7/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
datastream = self.source._process()
File "/usr/local/lib/python3.7/site-packages/dataflows/base/datastream_processor.py", line 75, in _process
datastream = self.source._process()
[Previous line repeated 1 more time]
File "/usr/local/lib/python3.7/site-packages/dataflows/base/datastream_processor.py", line 86, in _process
self.raise_exception(exception)
File "/usr/local/lib/python3.7/site-packages/dataflows/base/datastream_processor.py", line 96, in raise_exception
raise error from cause
dataflows.base.exceptions.ProcessorError: Errored in processor iterable_loader in position #1: 'NoneType' object has no attribute 'startswith'
DEBUG :[chan 2] Max packet in: 32768 bytes
DEBUG :[chan 2] Max packet out: 32768 bytes
DEBUG :Secsh channel 2 opened.
DEBUG :[chan 2] Sesch channel 2 request ok
DEBUG :[chan 2] EOF received (2)
DEBUG :[chan 2] EOF sent (2)
DEBUG :Dropping user packet because connection is dead.
Pipeline ID: procurement/calls_for_bids/calls-for-bids-all
Pipeline ID: procurement/calls_for_bids/calls-for-bids-moh
Pipeline ID: procurement/calls_for_bids/gov-publications
Pipeline ID: procurement/calls_for_bids/gov-publications-ministry-of-immigration
Pipeline ID: procurement/calls_for_bids/gov-publications2
Pipeline ID: procurement/calls_for_bids/jobiz-all
Pipeline ID: procurement/calls_for_bids/jobiz-calls-for-bids
Pipeline ID: procurement/calls_for_bids/jobiz-scraper
אנו סוכמים מידע מתוך הדוחות הרבעוניים לתוך טבלה המכילה את המידע העדכני ביותר.
Pipeline ID: procurement/spending/latest-contract-spending
Pipeline ID: procurement/spending/quarterly-contract-spending-report-uris
כל משרדי הממשלה ויחידות הסמך (שמחוברות למערכת מרכבה) צריכים לפרסם אחת לרבעון (תוך 45 יום מסוף הרבעון) דו״ח התקשרויות לפי פורמט מוגדר היטב הממומש כדו״ח מובנה במערכת המרכבה. כל המשרדים מדווחים עצמאית והדו״חות עולים לאתר היחידה לחופש המידע, משם אנו אוספים אותם. התוצר של השרשר הזה הוא פירוט כל הדיווחים של כל המשרדים.
Pipeline ID: procurement/spending/quarterly-contract-spending-reports
Pipeline ID: procurement/spending/quarterly-contract-spending-reports-data
Pipeline ID: procurement/spending/spending-by-entity
Missing dependency :Failed to find a dependency: ./procurement/tenders/scraper
Pipeline ID: procurement/tenders/all
Missing dependency :Failed to find a dependency: ./procurement/tenders/all
Pipeline ID: procurement/tenders/processed
Pipeline ID: reports/all
Pipeline ID: reports/ngos/ngo-activity-report
Pipeline ID: reports/ngos/ngo-district-report
Pipeline ID: supports/all
Pipeline ID: supports/by-payment-year
Pipeline ID: supports/by-request-year
Pipeline ID: supports/criteria/support-criteria
Pipeline ID: supports/criteria/support-criteria-doj
Pipeline ID: supports/supports-2004
Pipeline ID: supports/supports-2005
Pipeline ID: supports/supports-2006
Pipeline ID: supports/supports-2007
Pipeline ID: supports/supports-2008
Pipeline ID: supports/supports-2009
Pipeline ID: supports/supports-2010
Pipeline ID: supports/supports-2011
Pipeline ID: supports/supports-2012
Pipeline ID: supports/supports-2013
Pipeline ID: supports/supports-2014
Pipeline ID: supports/supports-2015
Pipeline ID: supports/supports-2016
Pipeline ID: supports/supports-2017
Pipeline ID: supports/supports-2018