Apache Kafka Producer and Consumer in Python
A tutorial that guides developers through building a Python application that consumes streaming data from Apache Kafka and writes it into SAP HANA Cloud, data lake Files. It demonstrates how to integrate an open-source distributed event streaming platform with SAP HANA Cloud's data lake storage using Python.
Tutorials that teach this
Prerequisites
- Concept Transport Layer Security (TLS) The provided sources do not contain sufficient information to write a grounded definition for an **undefined** concept. Source [S1] touches on frontend communication security between a customer browser and a system, but without a specific concept name or adequate supporting detail across the sources, no accurate and fully grounded definition can be produced. Please provide a valid concept name and relevant source snippets to generate a definition.
- Concept Client Certificate Management The concept name is not defined in the provided sources and cannot be determined from the available snippets. Based on the sources, **Client Certificate Authentication** in SAP BTP is a mechanism that allows developers to authenticate inbound or outbound communication using client certificates instead of, or in addition to, username/password credentials. Developers use it to securely configure integrations — for example, by [uploading client certificates](https://help.sap.com/docs/btp/sap-business-technology-platform/7f6a8fb4d42b4b2db5dbceb897ecb089?locale=en-US&state=PRODUCTION&version=Cloud) for their area or by [configuring client certificate authentication](https://help.sap.com/docs/btp/sap-business-technology-platform/75a4131c783f478ca5b7e6e363ebe4c0?locale=en-US&state=PRODUCTION&version=Cloud) for communication arrangements. The SAP BTP Destination Service also supports this authentication method, enabling secure connectivity to remote systems using certificate-based identity verification.
- Concept SAP HANA Data Lake File Store REST API Operations The concept name provided is "undefined," so no specific SAP developer concept can be identified or defined. Please provide a valid concept name — such as "SAP HANA data lake File Store REST API" or "SQL on Files" — so that an accurate, source-grounded definition can be written.
- Concept SAP HANA Cloud Connection Management The concept provided is **undefined**, and the supplied sources do not contain enough grounded information to produce a reliable, accurate definition for a specific SAP developer concept. To generate a valid definition, please provide a clearly named concept (for example, "SAP HANA Database Explorer" or "Smart Data Integration") along with relevant source snippets that describe it.
- Concept Python for Data Science The concept name was not provided, so a precise definition cannot be generated. Please supply a valid concept name along with the relevant source snippets so that an accurate, source-grounded definition can be written.
- Concept SAP HANA Cloud Data Lake The concept name was not provided, so a precise definition cannot be determined from the available sources. The sources cover topics such as [SAP HANA Cloud integration with Esri ArcGIS as a geodatabase](https://architecture.learning.sap.com/docs/ref-arch/RA0011/readme), the [Medallion Reference Architecture for big data processing](https://architecture.learning.sap.com/docs/ref-arch/RA0012/readme), and various SAP HANA Cloud data lake capabilities including file store access, relational engine connectivity, and data movement scheduling. Please provide a specific concept name so that an accurate, source-grounded definition can be written.
- Concept Python Development in Cloud Foundry The provided sources do not define a specific named concept — the concept submitted is "undefined." Based on the available sources, Python is a [development language supported in the SAP BTP Cloud Foundry environment](https://help.sap.com/docs/btp/sap-business-technology-platform/2d0ff228fbd049638daa3cc2a66066cb?locale=en-US&state=PRODUCTION&version=Cloud) alongside other languages and buildpacks. Developers use Python on SAP BTP to build and deploy applications in the Cloud Foundry environment, as well as to interact with services such as SAP HANA Cockpit APIs, SAP HANA Spatial Service APIs, and [Data Lake Files instances](https://help.sap.com/docs/btp/sap-business-technology-platform/acf8f49356d047fbb1a4d04dcec3fd36?locale=en-US&state=PRODUCTION&version=Cloud).
- Concept TLS/SSL Configuration and mTLS