SAP Community - Data and Analytics

How Can Organizations Architect a Scalable Data Engineering Pipeline to Support Real-Time AI-Driven

2025-10-14T11:47:51.530000+02:00

How Can Organizations Architect a Scalable Data Engineering Pipeline to Support Real-Time AI-Driven Decision Making Across Multiple Domains?

Hello everyone,

I’m working on designing a data engineering pipeline that can support real-time AI analytics across multiple business domains, including marketing, operations, and supply chain. I want to ensure that our architecture is scalable, resilient, and compliant with data privacy regulations.

Specifically, I’m looking for insights on:

Data Ingestion & Streaming: What are the best practices for ingesting large-scale structured and unstructured data in near real-time? Which tools or frameworks are most effective for multi-source streaming pipelines?

Data Storage & Modeling: How can we efficiently store both batch and streaming data while maintaining a single source of truth for AI models? Are there recommended data lake or warehouse strategies?

Feature Engineering for AI: How can feature pipelines be automated and monitored to ensure high-quality inputs for machine learning models without introducing bias?

Real-Time Model Deployment: What architecture patterns (e.g., event-driven, micro-batching, or hybrid) best support real-time AI inference while minimizing latency?

Governance & Compliance: How do organizations ensure data privacy, lineage, and regulatory compliance while enabling agile AI experimentation?

Has anyone implemented a production-ready solution that addresses these challenges? I’d love to hear about architectural choices, tool recommendations, pitfalls, and lessons learned from real-world implementations.

CDS analytical Query to be published as a

2025-10-14T20:07:41.002000+02:00

Hello Experts,

Can you help me with the correct steps to setup a CDS view analytical query as a tile in Catalog/Group so that other users can access it?

I am using the format as below:

#AnalyticQuery-analyze?XQUERY=2C<SQL Name of CDS>

However, I am getting the error - "App could not be opened either due to an incorrect SAP Fiori launchpad configuration or a missing role assignment."

What are the most effective approaches for planning and executing a large-scale application moderniz

2025-10-16T12:47:14.414000+02:00

"I'm part of an IT leadership team at a mid-sized organization, and we’re starting to explore application modernization to improve scalability, agility, and overall business efficiency. Many of our critical systems are legacy applications that have been in place for over a decade, and we’re facing challenges with performance, integration, and maintaining outdated code. We’ve heard a lot about strategies like containerization, microservices, DevOps practices, and cloud-native architecture, but it’s overwhelming to decide where to start.

My question to the forum is: What are the most effective approaches for planning and executing a large-scale application modernization initiative? How should we prioritize which applications to modernize first, and what are the key pitfalls to avoid during the process? Additionally, how can we ensure a smooth transition to cloud environments and modern architectures while keeping ongoing operations stable and secure?"

Sales Order Report

2025-10-22T05:27:45.335000+02:00

Hello

Im looing at how other users of SAP 4/HANA Public Cloud do a sales report (that shows sales for month by sales order with their respective costs) that reconciles to the GL (revenue and costs).

We have normal trading goods but also MTO/MTS products. At present our report is coming from billing (custom CDS) and reconciles to the revenue in the GL but its the COGS that dont match (especially for the MTO/MTS products).

How do others report on their sales/COGS in on report that reconciles to their GL? If a custom CDS what views do you use?

This is for public cloud.

Thanks

Adam

Integration of SAP CPI and SAP DataSphere using JDBC

2025-10-29T13:26:11.173000+01:00

Integration Between SAP CPI and SAP DataSphere (JDBC Connection)

JDBC – JAVA DATABASE CONNECTIVITY

Why Recommendation for JDBC Over OData API :
JDBC is recommended over OData when consuming large-scale records (e.g., 100,000+) because JDBC streams data directly from the database with better performance and less overhead, while OData is optimized for lightweight, paginated, service-based access.

Problem statement: 3337495 - OData API returns less records than expected due paging
Pagination limits in OData and Ariba APIs can be handled in SAP CPI using a looping process call.

Goal: Connect CPI to a database used by DataSphere (JDBC) and run a simple read data from the (Analytical Model / Table /View).

For the Write / Delete / Update method, the attached SAP Help Portal Link has syntax in the reference section.

Prerequisites:

SAP DataSphere – Subscribed account (⚠ Trial has limited features, JDBC not supported)

SAP Integration Suite – Subscribed or Trial (JDBC actions supported)

SAP DataSphere Step by Step Guide :

Step	Action / Notes
1. Create a Space	DataSphere → Space Management → New Space → Name it → Create.
2. Create Table / Analytical Model	Data Builder → In your Space → New → Table or Analytical Model → define fields & data types → Save & Publish. Verify Table/Model Deployed Successfully.
3. Prepare / Load Data	Load data manually for testing cases. Otherwise load CSV/import to table via Data Builder/Data Integration.
4. Note Schema & Object Names	Record schema name, table name, and view names for JDBC SQL use. * Created space name is the SCHEMA name and Collect Table / Model name *
5. Decide Where to Create DB User	If HANA Cloud → use HANA Cockpit/DB Explorer. If on-prem DB → use DB admin tools or contact DB Admin. * We are using the HANA cloud system for practical session*
6. Create JDBC DB User	DB admin tool → Security/Users → New User → set username & strong password → Save. Check Active status of User
7. Grant Privileges for the DB user	Assign only required privileges (e.g., SELECT for read; add INSERT/UPDATE/DELETE for CRUD). Best practice: create role JDBC_ROLE and assign.
8. Prepare JDBC Connection Details	Gather JDBC URL (e.g. sample URL from datasphere: z*********-abc.hana.prod-eu10.hanacloud.ondemand.com Format for CPI JDBC Material: jdbc:sap://<host>:<port>/?encrypt=true&validateCertificate=true

SAP Integration Suite Step by Step Guide :

Create a Package & Artifact

In CPI → Design → Create a new package → Add an integration flow artifact.

✅ Make sure your CPI user has the required roles to create and access design-time artifacts.

Go to Monitoring → JDBC Material

In CPI → Monitor → Integrations and APIs → Manage Security → JDBC Material

→ Add JDBC Data Source. → Select HANA cloud

Provide JDBC URL in the correct format (e.g., jdbc:sap://<hana-host>:443/?encrypt=true&validateCertificate=true).

Enter DB username and password (use the dedicated JDBC user created earlier in DataSphere).

Save and deploy the JDBC material.
Apply JDBC Material in iFlow
- In your integration flow, configure the JDBC receiver adapter → select the JDBC data source created.
- Use SQL queries (SELECT) in the Processing tab or provide XML query body. Here, I’m using SQL SELECT * to fetch all records from the table.
Step 1: Timer Start
In this iFlow, the Start Timer is configured with a Simple Schedule → None → On Deployment, which means the integration flow automatically triggers immediately after deployment.

Step 2: Content Modifier
Use this SQL query to fetch all records with the body operation.
SELECT * FROM "<Schema>"."<Model/TableName>"

Step 3: Request Reply & JDBC Receiver Adapter
→ Use the deployed JDBC Data Source alias in the JDBC Material in the previous step and set Max records count based on your requirement.
→ JDBC Maximum Records per call: 2,147,483,647

Sample data Response from JDBC Connection:

References :

CPI JDBC – XML Query in Body for CRUD Operations (Syntax Guide)
link:
https://help.sap.com/docs/cloud-integration/sap-cloud-integration/payload-and-operation

What architectural frameworks, MLOps practices, or data orchestration tools would you recommend?

2025-11-05T11:11:15.921000+01:00

Q: What architectural frameworks, MLOps practices, or data orchestration tools would you recommend to ensure continuous learning, low-latency predictions, and trustworthy analytics outputs in production environments?

Our organization is currently implementing enterprise-level Data and AI solutions to enhance predictive analytics and automate business intelligence processes. However, we’re facing several technical obstacles during the integration phase. Specifically, we’re struggling to design a robust data pipeline that can efficiently handle large-scale, heterogeneous data sources — including IoT streams, ERP systems, and cloud databases — while maintaining data quality, lineage, and governance. Additionally, our AI models trained on historical data aren’t performing well in real-time scenarios due to inconsistent feature updates and model drift. We’ve been experimenting with tools like Azure Machine Learning, Power BI, and Databricks, but syncing these components into a seamless Data and AI solutions architecture has proven difficult. Has anyone here tackled similar challenges in building a scalable, automated AI-driven ecosystem?

Automatic creation of reports in S4Hana Public Cloud

2025-11-19T07:57:04.656000+01:00

Hello,

We were interested in the possibility to configure the automatic creation of reports (such as the Purchase order list) directly from S4Hana Public Cloud. Is there any possibility that we can configure a rule by which the system creates reports extracted from apps in the cloud environment on a specific date, for example monthly, weekly etc?

There is a similar request for the automatic mailing, but this time we are looking specifically for the creation (before mailing):

Solved: Automatic mailing of reports in S4Hana Cloud - SAP Community

Improvement Request Details - Customer Influence

Thanks in advance for your help.

Best regards,

Kerisha

SAP Datasphere - Replication Flow Load Type Initial and Delta Schedule

2025-12-08T20:42:38.284000+01:00

Is there any feature for Datasphere Replication Flows with load type "Initial and Delta" to be scheduled?

Scenario 1

We want a replication flow with load type "Initial and Delta" to start at 9PM. In this scenario, the initial has not yet been loaded. Is there any way to trigger the replication flow to begin at 9PM without having a user log in and manually click a button at 9PM?

Attempting to a schedule on the replication flow with load type "Initial and Delta" results in the error below.

"For replication flows that contain objects with load type "Initial and Delta/Delta Only", no schedule can be created."

Attempting to add the replication flow with load type "Initial and Delta" to a task chain results in the error below.

"Object '<ReplicationFlowName>' cannot be part of a task chain because it does not have an end (as it includes objects with load type Initial and Delta/Delta Only)."

Scenario 2

We want the replication flow with load type "Initial and Delta" to check for new delta records at 9PM every day. The delta load may take anywhere from 15 minutes up to 1 hour depending on the number of the changes observed. Is there any way to ensure that the replication flow will start to load deltas every day at 9PM?

If the frequency is set to 24 hours, we observe that the next delta will begin to be loaded 24 hours after the previous delta load had finished. After some time, the timing will no longer be close to 9PM. We are aware we can change the update frequency to twice daily, or hourly. Updating on that frequency is not necessary for the use case and there is concern for efficiency.

Story Report in Onobarding Query Design

2025-12-15T16:29:39.684000+01:00

Hi All,

I am facing the issue with the story report which I am building for my client.

They want to include a lot of data, i.e. personal information, biographical information, job information and data gathered during the additional data collection.

I managed to build the query which includes all of the data tables which are needed to meet the business requirement. But I am facing the following issue: not all data which is there in the onboarding dashboard, is in the report. I was modyfying the query multiple times but there is always something missing. I managed to determine that there are following issues:

- the query which contains the biographical information and linked tables (country-specific Information, dependents, email information, phone information).

- the report has the filter for legal entity used for the country which data should be visible in the report.

Removing the above from makes all the data which is missing appeared in the report. However it appears with empty rows, only the process ID is visivble, but all the rest (i.e. user ID) is empty. User ID should be there as the data collection steps are in most of the cases completed. Moreover, keeping them is needed to meet the business requirement.

I raised the support ticket with SAP, but they replied that this is due to the query design and does not fall under the scope of the product support team. There seems to be no clear documentation on how to design the query to make it working correctly.

Any feedback will be much appreciated.

I attached the screen shot of the query for your reference.

Thank you in advance.

Piotr Retecki

There is now a banner above the legacy report scheduler saying to use the Report Scheduler

2025-12-24T16:42:56.615000+01:00

There is now a banner on the legacy report distributor which says it is replaced by Report Center Scheduling; however, there is still no way to export a canvas report to a csv file and then to a sftp site. Is there a definite deprecation date for the Legacy Report Distributor tool?

Why Trading Firms Running SAP On‑Prem Need SAP Business Data Cloud Now

2026-01-01T21:38:40.372000+01:00

SAP Business Data Cloud (BDC) offers trading organizations a governed, cloud‑based data fabric that unifies on‑premise SAP trading systems (S/4HANA, BW/BW‑PCE) with non‑SAP and OT data to build reusable data products for business consumption, analytics, and AI.[1][2][3][4][5]

***

From siloed trading data to governed data products

Most trading firms run core processes on SAP S/4HANA and BW while capturing key operational technology (OT) and market data in non‑SAP platforms, files, or data lakes.[2][3][6]

Bringing these sources together usually means heavy ETL, point‑to‑point interfaces, and copies of price curves, positions, and risk metrics across BW cubes, SQL marts, and spreadsheets, raising both cost and risk.[2][7][8]

BDC replaces this pattern with a business data fabric where SAP and non‑SAP data remain in place or in low‑cost cloud storage, but are exposed as governed “data products” with shared semantics and lineage.[1][4][8][9]

For trading, this means structured products, positions, P&L, reference data, market curves, and even sensor/OT data can be modeled once and reused by risk, finance, compliance, and commercial teams.[3][4][5]

***

Business benefits for trading organizations

1. End‑to‑end trading insight
- BDC connects S/4HANA trading, BW positions, and non‑SAP feeds (exchanges, brokers, weather, IoT) into unified data products, providing a single, governed view of exposures, margins, and liquidity.[2][3][5]
- Federation and zero‑copy access avoid constant extraction of SAP data into external warehouses, so risk and P&L dashboards and predictive models stay closer to real time.[1][4][8]

2. Faster innovation with analytics and AI
- Predefined SAP‑managed data products shorten the path from SAP trading data to analytics, while native integration with Databricks and other platforms lets quants and data scientists build models on governed data, not ad‑hoc exports.[3][4][10]
- Output from AI/ML models (e.g., price forecasts, risk factors, credit scores) can be shared back as BDC data products and consumed by SAP Analytics Cloud, Insight Apps, or custom apps without rebuilding pipelines.[3][4][1]

3. Better governance and compliance
- A central catalog, ownership model, and lineage in BDC give auditors and regulators transparency into how key trading metrics (VaR, P&L, limits) are built and where they are used.[1][11][12]
- Consistent access control across SAP and non‑SAP domains reduces the proliferation of unmanaged extracts, helping with data protection and trade surveillance requirements.[1][5][8]

***

Cost benefits and TCO impact

For organizations already running S/4 and BW on‑premise, BDC primarily improves TCO through reduced integration, storage, and operations cost while opening room to decommission legacy tooling over time.[2][4][8][13]

- Less ETL and data duplication
- The fabric approach lets you virtualize SAP data and only persist what adds value (e.g., harmonized trading positions with third‑party data), cutting replication volumes and integration tool spend.[1][4][8][14]
- SAP cites substantial TCO savings versus DIY data fabrics because Datasphere/BDC bundles integration, modeling, and governance rather than forcing you to assemble and run multiple components yourself.[8][4][7]

- Optimized use of existing SAP BW and S/4 investments
- Reference architectures show how BW content can be translated into transformation flows and then exposed as BDC data products, allowing reuse instead of rebuild, and enabling gradual reduction of BW infrastructure.[2][3][15]
- Integration with SAP S/4HANA (including private cloud editions) is productized, so trading data can be transferred into BDC with less custom work than typical third‑party stacks.[16][1][5]

- Hybrid rather than “big bang”
- A hybrid data strategy lets you keep mission‑critical trading execution close to S/4HANA on‑premise while using BDC for analytics, reporting, and AI, limiting initial migration risk and smoothing spend over time.[17][6][18][13]
- Over the medium term, running analytics in BDC instead of parallel on‑premise warehouses and external BI stacks can shrink infrastructure and license footprints, reducing duplicated costs common in hybrid estates.[2][4][13]

***

Pros and cons of moving trading data to BDC

Pros
- Unified SAP + non‑SAP trading view with shared business semantics.[2][1][5][4]
- Stronger data products for risk, treasury, and front‑office teams, increasing trust and reuse.[3][11][12]
- Cloud‑scale analytics and AI on governed data instead of extracts.[4][10][19]
- Strategic roadmap for BW customers beyond classic on‑premise warehousing.[1][2][15]
Cons / risks
- Potential license and platform overlap if BW, external warehouses, and BDC all run without a decommissioning plan.[7][15][13]
- Need for new skills around data products, cloud security, and governance operating models.[4][20][18]
- Stronger dependence on cloud and vendor roadmaps, which must be balanced with latency, sovereignty, and regulatory constraints in some trading jurisdictions.[6][17][21]

***

#SAPBDC #BusinessDataCloud #SAP #S4HANA #SAPBW #TradingAnalytics #DataProducts #DataFabric #HybridCloud #SAPDatasphere #SAPAnalyticsCloud #FinancialMarkets #RiskManagement #DataStrategy #CloudMigration

Which SQL tools can use associations of CDS views?

2026-01-14T09:48:51.402000+01:00

Hello Experts,
we investigate which CDS views of the virtual data model can help us to answer business questions. We also want to use the associations within the CDS views. We know the the App "Custom CDS views" can be used to generate new CDS views and can use the association via path expressions. Now we miss the authority for S_DEVELOP and so can't use this App. Are there other tools which can be used for ad-hoc SQL execution and allow to use the association of the CDS views?
The SQL Console in the ADT in Eclipse can be used. Can the SQL Editor in DBACOCKPIT use associations of CDS views? Are there other tools which can use associations of CDS views?

Thanks
Andreas

Embedded Analytics - SAP S/4 Hana Public Edition

2026-01-16T07:46:38.262000+01:00

Hi SAP Experts,

I am trying to create a custom Story dashboard in Manage KPIs and Reports Fiori application using Embedded Analytics cloud features in SAP S/4 Hana Public Edition.

However, I am facing an issue during the configuration. While embedding the SAC story, I encounter an error please refer to the attached screenshot for details.

I would appreciate it if you could guide me on how to resolve the above error and design dashboard.

Thanks in advance.

SAP Analytics Cloud: How can I compare variable values?

2026-01-21T11:27:32.551000+01:00

Hello all,

in SAC I use BW live connection within a story. To read the value of a variable 0S_CUS I use:

var cust = Chart_59.getDataSource().getVariableValues("0S_CUS")[0];

Then I try to compare the value of variable "cust". Why: I would like to hide some pages in my SAC story if the customer number is greater than 10000000. The infoobject for variable 0S_CUS is 0CUSTOMER (data type: CHAR, length 10).

But this is not working:

var border = "0010000000";
if (cust > border) {
Application.setPageVisible("Page_7", false);
} else {
Application.setPageVisible("Page_7", true);
}

The variable 0S_CUS is a select-option but we pre-fill it with only one value.

The error is: auto-type conversion isn't supported.

Thanks for your help!

No Data Returned in CDS I_MfgOrderActlPlanTgtLdgrCost After Filling Parameters (Production Order Cos

2026-01-26T20:59:44.865000+01:00

Hello SAP Community,

I hope you are doing well.

I am currently working with SAP S/4HANA Cloud, Public Edition, and I am trying to build a production cost analysis in Power BI using CDS views as the data source.

My objective is to analyze production order costs by activity, such as:

Labor hours (man-hours)
Machine hours
Utility-related costs (energy, water, etc.)
Actual vs planned/target costs associated with manufacturing or process orders

The goal is to extract this information via a CDS view and consume it in Power BI.

At the moment, I am using the CDS view:

I_MfgOrderActlPlanTgtLdgrCost

When I try to preview this CDS, the system requires the following parameters:

Ledger
Fiscal Year Period From
Fiscal Year Period To
Currency Role

Even after entering valid values for all these parameters, no data is returned in the preview.

Because of this behavior, I am not sure whether:

This CDS requires additional CO configuration (e.g. settlement, period-end closing, or cost posting prerequisites),
The parameters (ledger, fiscal year/period, or currency role) must be provided in a specific way,
Or if this CDS is not intended to be consumed directly for detailed production order cost analysis.

My questions are:

Has anyone successfully used I_MfgOrderActlPlanTgtLdgrCost and faced a similar issue with no data returned?
Are there any known prerequisites (e.g. cost postings, activity confirmations, period-end processes) required for this CDS to return data?
Are there alternative CDS views recommended to analyze costs associated with production or process orders, especially with a breakdown by activities (labor, machine) and cost components?

Any guidance, experience, or best practices would be greatly appreciated.

Thank you very much in advance for your support.

Best regards,
Sergio

Is there a recorded training link available for Cognos Analysis or schedules for a live webinar?

2026-02-03T17:43:59.377000+01:00

SAP Analytics Cloud – Support for “Hierarchy with Directory” from SAP Datasphere via OData

2026-02-05T15:46:33.994000+01:00

Hello SAP Community,

I am working with an SAP Datasphere Analytic Model that contains a Sold-To Party hierarchy defined as “Hierarchy with Directory.”
The hierarchy works correctly within SAP Datasphere.

To support report broadcasting, I exposed this Analytic Model via OData and imported it into SAP Analytics Cloud (SAC). All measures and dimensions are imported correctly; however, the Hierarchy with Directory is not recognized properly in SAC (it appears flattened / directory attributes are ignored).

Based on SAP Help documentation, I see that:

Hierarchy with Directory has usage limitations outside Datasphere
OData consumption documentation does not mention support for hierarchy directory metadata
There is no explicit confirmation that SAC supports Hierarchy with Directory when consumed via OData from Datasphere
My questions:
1. Does SAP Analytics Cloud officially support Hierarchy with Directory from SAP Datasphere when consumed via OData?
2. If not supported, is this a known limitation and is there any roadmap or planned enhancement?
3. Are there any recommended best practices or workarounds (e.g., flattening hierarchies or rebuilding them in SAC)?
  Any official SAP confirmation, documentation reference, or roadmap insight would be greatly appreciated.
  Thank you in advance for your guidance.
  Best regards,
  Ganga Reddy Somu

Embedded Analytics - Custom Cube for Margin Analysis - Calculated Key Figure shows no data

2026-02-13T15:42:58.059000+01:00

Hello Experts,

let me give you some additional information before explaining the issue.

Back in R/3 we used KE35 (Form) and KER1 (Key Figure Scheme) to prepare for KE30 (Profitability Report) in SAP CO-PA modul.

So far i have done significant tests only with transient view entity … analytical query and was able to replace our custom reports from R/3 costing based COPA to S/4 Margin Analysis queries and the results are very good.

However, i noticed that using a custom consumption view offers very little reuseability. A new requirement triggers a new consumption view and copy/paste of the CDS view. So i want to achieve REUSEABILITY for restricted measures and calculated measures. Looking at the SAP VDM i think it is time to build custom cubes, which i successfully circumvented so far.

So how can i replace R/3 „Forms“, „Key Figures Schemes“ and „Reports“ with Embedded Analytics? I am trying to do a crossover to the VDM which uses cubes, querys, restricted measures, and calculated measures. (Screenshot shows R/3 setup of CO-PA reporting)

I am not trying to replicate the old world 1 by 1, but take over what is still useful e.g. „Prepare a Form“ and „Prepare Key Figures“ and reuse this in multiple querys.

I created the above „custom VDM“ and while the values of the restricted measures are shown correct (see below, RSRT) in the consumption view, the calcuated measures are always inital. What am i doing wrong?

Formulas are very simple:

Revenue - COGS = ContributionMargin1 and FIDirect - OverhAlloc = FIMinusOverhead

My guess is that the calculated measures may have lost their dimensions? Could that be the reason?

Or do i not understand how aggregation works?

Greatful for any tipps. I can share the CDS Views if needed.

Thank you

Regards

David

delete this question please, double posting

2026-02-13T16:14:23.169000+01:00

delete this message please, double posting

SAP S4Hana Public Cloud - Custom CDS View - Need Credit Limit Field for AR Reporting

2026-02-17T17:54:06.334000+01:00

Hello. I am looking to find a field for Custom AR Reporting purposes. The field I am looking for is. “Credit limit” as it exists in the “Manage Credit Accounts” App. Is there a good place for me to locate this field?