SAP Community - Python

Importing python module in datasphere dataflow

2023-09-19T08:01:38+02:00

Hi Team,

Is it possible to import custom module in dataflow. I have many custom modules which needs to be used in many flow, and hence i want to import these modules. Could someone help in how to achieve this.

Execute SQL queries against delta format tables in Azure Data Lake using Jupyter Lab notebook

2023-09-27T19:29:06+02:00

Scenario: We have delta format tables residing in an Azure data lake. We want to be able to run SQL queries against the delta tables from within a Jupyter notebook in Jupyter lab in SAP Data Intelligence. We would like to be able to use the Data Intelligence connection object to the Azure data lake, if possible.

Questions:

Is it possible to achieve the above scenario using Python in a Jupyter notebook?
If yes to #1, how is this accomplished? Are there examples or documentation showing the method?

Thanks.

Pandas function to read table data in Datasphere Dataflow script editor

2023-09-28T12:01:32+02:00

Hi Team,

Can someone please help me in getting the Pandas DataFrame function to read table data in Dataflow python transformation editor.

Can't reach to ODBC Driver for ABAP to download

2023-10-10T16:46:08+02:00

Hello everyone,

I want to download ODBC driver for ABAP to connect to my SAP system with python. I try to get it from this site. But I see only the writing "You are not authorized!".

I requested and got the authorization of Software Download. But I still get the same error. I sent the link and my boss tried to download from his account and he got the same error.

How can I reach the driver? Is there any one who faced with this problem and solved? Or know the solution?

Available Python Build Packs

2023-10-12T14:00:20+02:00

Hi experts,

I'm writing to enquire about the availability of the XSA Buildpacks listed on the Available XSA Buildpacks page.

Is it possible to download them?

I ask because the python buildpack listed there has a significantly higher version compared to the current XSA.

buildpacks             version   position   enabled   locked 
------------------------------------------------------------ 
sap_java_buildpack     1.4.1     1          true      false  
sap_nodejs_buildpack   3.2.3     2          true      false
sap_python_buildpack   1.2.3     2          true      false

3364625 - EXTENDED APPLICATION SERVICES 1 Release 1.1.4

Buildpacks:

SAP Java Buildpack: 1.8.41
SAP Node.js Buildpack: 4.5.1
SAP Python Buildpack: 0.5.3

How to set privileges for HANA Machine Learning in Cloud Foundry ?

2023-10-13T08:17:49+02:00

Hi,

We need to use HANA_ML python package in HANA database in a Cloud Foundry App in BTP. While the code works perfect when running it on a jupyter notebook, it gives unsufficient privilege errors when calling it from within a cloud foundry deployment. (e.g. the ataframe.create_dataframe_from_pandas method fails).

We use the same code and user/password combination in both cases.

Any help appreciated on how to set authorization or how to allow deletion of tables from the CF deployment.

Regards

Marcus

How to use HANA-ML python package in a HANA HDI Container and how to assign correct priveledges?

2023-10-26T09:39:52+02:00

Hi ,

we are struggling with the use of an HDI container for machine learning with the python hana-ml package in Python.

In a previous question https://answers.sap.com/questions/13984833/how-to-set-privileges-for-hana-machine-learning-in.html?childToView=13984942 a topic on missing priviledges was raised. The answer in the end was to use the user/pw combination from the sharedaccesskey in the service definition. However, when using this user it needs to be hard coded. How can we assign priviledges "CREATE ANY" to the user which can be read via the python service object in python ? This is a different user. Also in the documentation it is not recommended to give CREATE ANY to a user in HDI container.

How can this issue be solved ?

Or is machine learning with python in general not allowed / recommended in a DHDI container ? That would however significantly reduce the value of the python approach.

Regards

Marcus

How can I connect my App to a Cloud Connector through Python

2023-11-03T13:07:20+01:00

Im trying to connect my App deployed on Foundry that are consuming oData services through Destination Instance Service, XSUAA and Connectivity Service. The destination is configured correctly because when I try to access it with curl it does. Im using requests library of Python with CFEnv for get credentials of services.

Error: Could not connect to the endpoint URL while deploying Tutorial Model

2023-11-03T17:16:58+01:00

Hello Experts,

I am new to AI Core and followed the Tutorial Series to get to know the environment. (Make Predictions for House Prices with SAP AI Core | SAP Tutorials)

Unfortunately I've encountered an error I am unable to resolve. In the last steps of the Tutorial, while trying to deploy the model on a server, the error "Could not connect to the endpoint URL" appears.

I would be very grateful for your assistance.

Connecting to SAP HANA from Azure Databricks Using hdbcli: [89009] Socket connect timeout

2023-11-07T20:34:04+01:00

Hi all,

I'm trying to connect to a SAP HANA generic database using the following Python code:

from hdbcli import dbapi
conn = dbapi.connect(address='xx.x.xx.xx', port='xx', user='xx', password='xx', encrypt=True, sslValidateCertificate=False)

When I run the code locally using VSCode with VPN connected, it is able to connect to HANA. However, after I move to an Azure Databricks environment approved by SAP and used by SAP employees internally, the connection code keeps giving me the following error:

Error: (-10709, 'Connection failed (RTE:[89009] Socket connect timeout (60000 ms) (Some IP -> Some other IP))')

I'm 80% sure that the Azure Databricks environment should be using an IP allowed to access the HANA database. (I've tried to access another HANA Tenant database while inside this Azure Databricks environment and the connection code works flawlessly.) But I could be wrong.

I've been searching online but few posts have the same error as mine. And the ones with the same error aren't using the same SAP product. Would really appreciate it if anyone could help with this! Thank you.

How to install SAP NetWeaver RFC SDK 7.50

2023-12-05T14:52:18+01:00

I need to install a python library called "pyrfc" but I have realized that I need to install SAP NetWeaver RFC SDK 7.50 first .

But I have not been able to do it because the official SAP place to download it is down https://me.sap.com/notes/2573790 and https://me.sap.com/softwarecenter too.

So I don't find any place to download it nowadays.

I need that library to connect to SAP ERP and to SAP BW. If you know another way to achieve that I'll appreciate it a lot.

Thanks in advance!

Seeking Assistance with Python Script for Multi-Action Execution in SAC API

2024-01-03T21:58:59+01:00

Hello Community,

I'm reaching out for support regarding an issue I'm encountering while trying to trigger a multi-action using Python with the SAC API. Despite extensive research and testing, I've hit a roadblock that I hope someone here can help me resolve.

Background and Research:

SAC API Documentation: I've consulted the official SAC API documentation for details on APIs but found no explicit mention of Python support for multi-actions.
Successful ABAP Implementation: A blog post in SAP Community Blogs shows successful multiAction execution using ABAP, indicating API support in different programming environments.
Execution via Postman: Following SAP KB Article 3407120, I've successfully replicated the multi-action execution using Postman, confirming the viability of necessary API calls.

Python Implementation Challenge: My script successfully runs multi-actions when initiated from Postman to Visual Studio. However, integrating code for obtaining the API token, CSRF token, and building headers for the multi-action endpoint is problematic.

Code Snippets and Output: I'm providing code and execution output (with sensitive data omitted). The issue seems to lie in the headers section of the run_multi_action function, where the session/Bearer/csrf token combination is not accepted. Replacing the run_multi_action header with one from Postman triggers successful script execution.

-----------------------------------------------------------------Actual Code------------------------------------------------------------------------------

import json

import requests

import base64

import os

# Constants

API_OAUTH_CLIENT_ID = '<<Client ID>>'

API_SECRET = '<<secret key>>'

API_URL_BASE = 'https://<<sac tenent URL>>/api/v1/csrf'

API_TOKEN_URL = 'https://<<sac tenent URL>>/oauth/token'

API_MULTIACTION_URL = "https://<<sac tenent URL>>/executions"

AUTH_URL = 'https://<<sac tenent URL>>/oauth/authorize'

def get_api_token():

"""Retrieve the API token."""

print("get_api_token: started")

auth = f'{API_OAUTH_CLIENT_ID}:{API_SECRET}'

token_headers = {

'Authorization': f'Basic {base64.b64encode(auth.encode()).decode()}',

'Content-Type': 'application/json'

}

params = {'grant_type': 'client_credentials'}

try:

response = requests.post(API_TOKEN_URL, headers=token_headers, params=params)

data = json.loads(response.content.decode('utf-8'))

api_token = data['access_token']

print(len(api_token))

return response.json()

except requests.RequestException as e:

print(f"Error getting API token: {e}")

return None

def get_crsf_token(api_token):

"""Get the CSRF token."""

headers = {

'Authorization': f'Bearer {api_token}',

'x-sap-sac-custom-auth': 'true',

'x-csrf-token': 'fetch'

}

try:

response = requests.get(API_URL_BASE, headers=headers)

response.raise_for_status()

return response

except requests.RequestException as e:

print(f"Error getting CSRF token: {e}")

return None

def run_multi_action(api_token, csrf_token, csrf_cookies):

"""Run a multi-action with the provided tokens and cookies."""

headers = {

'x-csrf-token': csrf_token,

'Content-Type': 'application/json',

'Authorization': f'Bearer {api_token}',

'Cookie': f'signature; JSESSIONID={csrf_cookies["JSESSIONID"]}; __VCAP_ID__={csrf_cookies["__VCAP_ID__"]}'

}

payload = json.dumps({"parameterValues": []})

print("Sending request to:", API_MULTIACTION_URL)

print("Headers:", headers)

print("Payload:", payload)

try:

response = requests.post(API_MULTIACTION_URL, headers=headers, data=payload)

response.raise_for_status()

return response.text

except requests.RequestException as e:

error_message = f"Request Exception: {e}"

if hasattr(e, 'response'):

error_message += f"\nResponse: {e.response.text}\nStatus Code: {e.response.status_code}"

print(error_message)

return None

def main():

"""Main function to execute the script logic."""

print("Script started")

api_token_info = get_api_token()

if not api_token_info:

print("Failed to get API token")

return

api_token = api_token_info['access_token']

print(f"Token Length: {len(api_token)}")

csrf_response = get_crsf_token(api_token)

if not csrf_response:

return

csrf_token = csrf_response.headers['x-csrf-token']

csrf_cookies = csrf_response.cookies

multi_action_response = run_multi_action(api_token, csrf_token, csrf_cookies)

if multi_action_response:

print(multi_action_response)

if __name__ == "__main__":

main()

-----------------------------------------------------------------Code End------------------------------------------------------------------------------

Output

Script started
get_api_token: started
2038
Token Length: 2038
Sending request to: <<sac tenent URL>>/api/v1/multiActions/t.cfgsd50/executions
Headers: {'x-csrf-token': '<<csrf_token>>', 'Content-Type': 'application/json', 'Authorization': 'Bearer <<bearer_token>>', 'Cookie': 'signature; JSESSIONID=<<session_id>>; __VCAP_ID__=<<vcap_id>>'}
Payload: {"parameterValues": []}
Request Exception: 401 Client Error: Unauthorized for url: <<sac tenent URL>>/api/v1/multiActions/<<multiaction_id>>/executions
Response: Unauthorized
Status Code: 401

New Challenge with Bearer Token:

Token Length Discrepancy: The Bearer token response in Python is truncated at 2038 characters, whereas tokens from Postman are approximately 2082 characters long. I'm puzzled about why this discrepancy is occurring with Python.

Steps Taken to Investigate:

Verification Script: I created a small script to check the Bearer token length, which confirmed the 2038 character.
Cross-Usage Test: Using the Python-generated Bearer token in a Postman script worked, indicating the token is valid despite its shorter length.
Cookie Analysis: Initially suspecting the cookie, I observed it's a constant in our Postman code. Hardcoding this cookie in my Python code worked only while the Postman session was active. Once inactive (after 60 mins), it resulted in an Unauthorized error.
Removing Cookie from Headers: Excluding the cookie from headers in Python led to an Unauthorized error.
Comparing Cookie Behavior: In Postman, the cookie appears when calling the CSRF token, but not in Python. Hardcoding the Postman cookie in the Python script for the CSRF token had the same limited success as before - it worked only while the Postman session was active.

Specific Problem: The headers section in the run_multi_action function seems to be the issue. When using headers from Postman, the script works, but not with the generated headers in Python.

Request for Assistance: Could anyone provide insights or suggestions on how to correctly format or authenticate the headers in Python for successful multi-action execution? Any help or guidance would be greatly appreciated.

How to access destination from BAS which created using python app deployed in Cloud Foundry Space

2024-02-06T12:13:38.095000+01:00

Hello Experts,

Basic details of my requirement with all followed steps:

I have deployed a basic Python API into Cloud Foundry space and able to access the same using direct call.

No, created a destination using same API under connectivity:

I want to use the same service into SAPUI5 application using Data Source and Service Selection, however I am getting "Service in unavailable" for selected destination as below:

Then I created the project without using data source, but selected "add deployment configuration" option from "project attribute" section and then selected the maintained destination under Cloud Foundry as below screen:

Then modified the mta.yaml and xs-app.json by including below details respectively:

Added below code to use destination inside SAPUI5 app:

but getting below error:

Please help me on this, how can a python API can be used inside SAPUI5 application or any additional steps need to be followed.

Note: the maintained destination is working fine on BAS. Please find curl details from terminal:

Followed link:

https://blog.sap-press.com/how-to-integrate-a-python-app-with-sap-business-application-studio-for-an-sap-s4hana-cloud-system

https://community.sap.com/t5/technology-blogs-by-members/developing-flask-application-in-bas-and-consuming-it-into-sap-ui5/bc-p/13589597#M165768

Regards,

Praveer.

I want to connect SAP system to access all the tables using Python

2024-02-06T18:53:01.661000+01:00

I want to access SAP internal tables using Python.

Exceedance error in manifest.yml file config - Cloud Foundry BTP

2024-02-25T02:38:43.526000+01:00

I'm trying to deploy a Python Application using the Cloud Foundry CLI in a trial BTP account. When I try to push the project, the terminal shows me the following message as output:

memory quota_exceeded, memory instance_memory_limit_exceeded, app_instance_limit app_instance_limit_exceeded

I have tried every way to change the "manifest.yml" file, but in every attempt I'm warned that a certain service has exceeded the trial account limit.

How should I proceed?

SAP hana_ml ARIMAX with SAP AI Core

2024-02-29T01:03:10.117000+01:00

Hi,

I am wanting to use SAP's PAL ARIMAX model (with Python) for a particular use-case in which we would like to use BTP SAP Hana Cloud DB for dataset/model storage and then also use SAP AI Core, flask, Docker etc.. Ultimately trying to avoid using SAP Hana Data Lake or non-sap data storage such as AWS3.

First question, is it possible/acceptable to use SAP PAL ("hana_ml") ARIMAX on Hana Cloud DB and then utilize the power of AI Core for model inference via API? Or has anyone done something like this? If so, could you please share any tutorials/github repositories you've come across showing this process.

Second question, how can I import and access ARIMAX model. I'm able to access ARIMA as follows

< from hana_ml.algorithms.pal.tsa.arima import Arima > ....but getting errors when trying the other ARIMA models such as SARIMA/ARIMAX. Please advise.

Thank you so much for any thoughts and/or guidance.

Quote 2.0: Post requests of a Rest Client

2024-04-09T18:53:43.498000+02:00

Dear SAP Community,

I am currently sending a post request with the following command in an if loop :

RestClient.Post(url, data, headers) . The paramaters url, data and headers are already specified . The problem is that i have further commands after sending the request from the CPQ system in the if loop, that I want to execute. Once The RestClient is run, the further requests are no longer executed.

Does anyone have any suggestions or idea, where or how I can solve such an issue ?

Best regards

Lola

SAP scripting findbyID

2024-04-18T21:22:50.480000+02:00

Hello friends,

I generated an SAP script and it runs perfectly fine when executed from the vbs file however after I convert it to Python, it keeps giving an error (619, 'SAP Frontend Server', 'The control could not be found by id.')... any suggestions? this is the part giving the error, its supposed to select a checkbox in a table in VA13 tcode... thanks!!

VBS

session.findById("wnd[0]").maximize
session.findById("wnd[0]/usr/tabsTAXI_TABSTRIP_OVERVIEW/tabpT\02/ssubSUBSCREEN_BODY:SAPMV45A:4411/subSUBSCREEN_TC:SAPMV45A:4912/tblSAPMV45ATCTRL_U_ERF_ANGEBOT").getAbsoluteRow(0).selected = true
session.findById("wnd[0]/usr/tabsTAXI_TABSTRIP_OVERVIEW/tabpT\02/ssubSUBSCREEN_BODY:SAPMV45A:4411/subSUBSCREEN_TC:SAPMV45A:4912/tblSAPMV45ATCTRL_U_ERF_ANGEBOT/txtVBAP-POSNR[0,0]").setFocus
session.findById("wnd[0]/usr/tabsTAXI_TABSTRIP_OVERVIEW/tabpT\02/ssubSUBSCREEN_BODY:SAPMV45A:4411/subSUBSCREEN_TC:SAPMV45A:4912/tblSAPMV45ATCTRL_U_ERF_ANGEBOT/txtVBAP-POSNR[0,0]").caretPosition = 1

PYTHON

session.findById("wnd[0]").maximize()

session.findById("wnd[0]/usr/tabsTAXI_TABSTRIP_OVERVIEW/tabpT\02/ssubSUBSCREEN_BODY:SAPMV45A:4411/subSUBSCREEN_TC:SAPMV45A:4912/tblSAPMV45ATCTRL_U_ERF_ANGEBOT").getAbsoluteRow(2).selected = True

session.findById("wnd[0]/usr/tabsTAXI_TABSTRIP_OVERVIEW/tabpT\02/ssubSUBSCREEN_BODY:SAPMV45A:4411/subSUBSCREEN_TC:SAPMV45A:4912/tblSAPMV45ATCTRL_U_ERF_ANGEBOT/txtVBAP-POSNR[0,2]").setFocus()

session.findById("wnd[0]/usr/tabsTAXI_TABSTRIP_OVERVIEW/tabpT\02/ssubSUBSCREEN_BODY:SAPMV45A:4411/subSUBSCREEN_TC:SAPMV45A:4912/tblSAPMV45ATCTRL_U_ERF_ANGEBOT/txtVBAP-POSNR[0,2]").caretPosition = 1

>> this is how i'm creating the session

SapGuiAuto = win32com.client.GetObject('SAPGUI')

application = SapGuiAuto.GetScriptingEngine

connection = application.Children(0)

session = connection.Children(0)

LLM, RAG and Cloud Foundry: No space left on device

2024-04-24T11:48:33.733000+02:00

Hi,

we were following a set of blogs and tutorials like:

https://community.sap.com/t5/technology-blogs-by-sap/enhancing-s-4hana-with-sap-hana-cloud-vector-store-and-genai/ba-p/13655191

https://developers.sap.com/tutorials/ai-core-genai-hana-vector.html

We need to use the features in a cloud foundry python app. Unfortunately the installation of

package

sentence-transformers (as part of the requirements.txt file) always leads to a "no space left on device" error during build.

The memory limit is set to 8G, the disk space to 10G in the manifest.yml.

How can we solve this issue in the SAP BTP cloud foundry environment ?

Any help is highly appreciated.

Regards

Marcus

Configuration of job-scheduler in BTP with python flask

2024-05-08T08:11:32.561000+02:00

Hi,

we are struggling with the setup of a job-scheduler for a pyython flask app on cloud foundry in the BTP.

The job must call the app via the approuter.

Following tutorials, we created a check_authorization method with:

access_token = request.headers.get('authorization')[7:]

security_context = xssec.create_security_context(access_token, uaa_service.credentials)

isAuthorized = security_context.check_scope('openid')

We granted

"grant-as-authority-to-apps": ["$XSSERVICENAME(job-scheduler)"] to a scope in xs-security.json and the scope is evaluated to True by security_context.check_local_scope("admin") in both cases (from job and from user)

When called via the job-scheduler, the security_context.check_scope('openid') however gives false, when called with a user it is True.

What might still be missing here ? Or do we need to check against another scope than 'openid' in the check_scope ?

Any help appreciated.

Regards

Marcus