# E2E System Refresh Automation

End-to-End (E2E) System Refresh Automation with IT-Conductor simplifies the process of performing SAP system refresh including the database refresh and Post-Copy Automation (PCA). Most SAP customers need to refresh their Quality or Test system on a regular basis to enhance the quality assurance process for the project team. However, this is a complex and long process that typically has to be adapted to each customer’s environment and project needs. Thus, many customers struggle to achieve successful and regular system refreshes.&#x20;

IT-Conductor’s E2E System Refresh Automation reduces time and effort by up to 80% while minimizing manual processes, errors, and dependency on technical personnel.

### Product Description <a href="#product-description" id="product-description"></a>

E2E System Refresh Automation is an Automation-as-a-Service solution created to automate the entire system refresh process from preparation and checks to the actual database refresh, followed by PCA to restore the quality system’s technical configuration.

### Benefits <a href="#benefits" id="benefits"></a>

* Time-reduced in performing SAP system refreshes
* Minimize dependency on scarce SAP technical resources as the process is digitized into intelligent workflows
* Get notified when a scheduled system refresh starts, ends, or when an error occurs
* Flexibility to run system refresh, regardless of your system environment components
* Auditable traces of when and how the system refresh was automated
* Affordable Automation-as-a-Service solution which is supported remotely 24x

### Approach <a href="#approach" id="approach"></a>

The different stages for System Refresh are the following:

* **Provisioning** - Infrastructure and system provisioning via ITC automation (if non-existent)
* **Assessment** - Discovery and distillation of resources
* **Architecture** - Design and development stage
* **Deployment** - Implementation of design

### System Refresh Workflow <a href="#workflow" id="workflow"></a>

<figure><img src="https://377464071-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FXhp08OmU8050PePmMgDt%2Fuploads%2FLbN7Efot0Wugmqpx0hEg%2FWorkflow%20for%20SID-Refresh.png?alt=media&#x26;token=24452cc3-49ad-48fd-9bdd-5a1554358cf1" alt=""><figcaption><p>Figure 1: System Refresh Workflow</p></figcaption></figure>

### Architecture for System Refresh Automation

<figure><img src="https://377464071-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FXhp08OmU8050PePmMgDt%2Fuploads%2FjvQNT1ZGuZmieRYV467Y%2FSAP%20Landscape%20for%20SID-Refresh.png?alt=media&#x26;token=bad656d1-c2e0-4d65-ad8d-d017267810c6" alt=""><figcaption><p>Figure 2: SAP Landscape for SID-Refresh</p></figcaption></figure>

### IT-Conductor System Refresh Automation Workflow <a href="#it-conductor-sid-refresh-automation-workflow" id="it-conductor-sid-refresh-automation-workflow"></a>

Below is an overview of the implementation, which will be configured and tested by the IT-Conductor team in collaboration with the customer’s technical SME (Subject Matter Experts).

The first step is to initialize the process definition with the pre-defined setup for the source and target system in IT-Conductor.

<figure><img src="https://377464071-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FXhp08OmU8050PePmMgDt%2Fuploads%2FIA8wqKb1Nkbja9ISykix%2FSID-Refresh%20Process%20Definition.png?alt=media&#x26;token=1be47c6a-5ce6-4c8a-b8b7-7ede8065f230" alt=""><figcaption><p>Figure 3: System Refresh Process Definition</p></figcaption></figure>

There are one or more subprocesses that need to be executed as shown in the images below.

<figure><img src="https://377464071-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FXhp08OmU8050PePmMgDt%2Fuploads%2FVpQwns6EMNeskWXIDjcr%2FSource%20Prep.png?alt=media&#x26;token=59ac4c62-b4be-49ef-a76a-ad50a04136c4" alt=""><figcaption><p>Figure 4: Source Preparation Subprocess</p></figcaption></figure>

<figure><img src="https://377464071-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FXhp08OmU8050PePmMgDt%2Fuploads%2FBwm7lm8QsEDjWR8aDw8n%2FTarget%20Prep.png?alt=media&#x26;token=2be2d63e-2937-4b36-81e8-dbabe3a8814b" alt=""><figcaption><p>Figure 5: Target Preparation Subprocess</p></figcaption></figure>

For the "Source Prep" or source preparation step, the process will first take a Backup from the Source Tenant Database. Once completed the process triggers the "Target Prep" or the target preparation step, stopping the SAP Application from the target system and exporting the configuration of our target system. For this example, we are using the QAS System.

Once the export is completed, the next step "DB Restore" starts by copying the backup root key (from the filesystem) from the source to the target system, then the process STOP Database Tenant from the target and restores the database.

<figure><img src="https://377464071-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FXhp08OmU8050PePmMgDt%2Fuploads%2FRtpuYwujZeLoeWzwmmCi%2FDB%20Restore.png?alt=media&#x26;token=98ea6c02-cccc-4349-bd60-6e00b61c7ffd" alt=""><figcaption><p>Figure 6: DB Restore Subprocess</p></figcaption></figure>

The process will automatically start the next step once the previous steps are completed and turned GREEN. For the "Post Copy" step, the process will first Import back the QA Configuration and Start the SAP APP from the target system.

<figure><img src="https://377464071-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FXhp08OmU8050PePmMgDt%2Fuploads%2FuyAw5YG7eeCcxfK40sE8%2FPost%20Copy.png?alt=media&#x26;token=7250163b-d1d0-46cc-9567-f5dddd222a13" alt=""><figcaption><p>Figure 7: Post Copy Subprocess</p></figcaption></figure>

### Post-Processing Tasks

After the end-to-end system refresh process is completed. There are some remaining tasks that need to be executed as well.

#### BDLS

The next step is to convert logical system (LOGSYS) names (BDLS). This conversion usually takes a long time for large-size database tables. As part of IT-Conductor automation, we have included this step to be executed post-system refresh.

1. Navigate to **Tenant Name → Process Definitions**.

<figure><img src="https://377464071-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FXhp08OmU8050PePmMgDt%2Fuploads%2FgikkGKbKtpJcpAaZA7Py%2FTenant%20View.png?alt=media&#x26;token=25c53aa8-bf2e-4c8e-b1d8-7dc550865472" alt=""><figcaption><p>Figure 8: Tenant View</p></figcaption></figure>

2\. Select the process definition for BDLS to open.

<figure><img src="https://377464071-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FXhp08OmU8050PePmMgDt%2Fuploads%2F0i834hBQtOIsemfEaqg1%2FBDLS%20Process%20Definition.png?alt=media&#x26;token=b349f7a9-3fb9-4434-ad19-be9f8d032cb3" alt=""><figcaption><p>Figure 9: BDLS Process Definition</p></figcaption></figure>

3\. Once the process is started, the program RBDLSMAP is executed as a background job. After it is completed, the activity will turn to GREEN.

<figure><img src="https://377464071-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FXhp08OmU8050PePmMgDt%2Fuploads%2F0imVyBA7Jf9GYBsTdS55%2FRBDLSMAP%20Program%20Execution.png?alt=media&#x26;token=d36b1c8e-ebca-45f2-911e-1d3e0adacf87" alt=""><figcaption><p>Figure 10: RBDLSMAP Program Execution Completed</p></figcaption></figure>

4\. You can review the execution log when the job is finished.

<figure><img src="https://377464071-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FXhp08OmU8050PePmMgDt%2Fuploads%2FDP93K8jJRXSQuXaQofaL%2FRBDLSMAP%20Execution%20Log.png?alt=media&#x26;token=5450b203-5b40-478f-81ee-f55719380c26" alt=""><figcaption><p>Figure 11: RBDLSMAP Execution Log</p></figcaption></figure>

You can also verify directly in SAP for the job log entries.

<figure><img src="https://377464071-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FXhp08OmU8050PePmMgDt%2Fuploads%2Fv1oobLffImN7E5UiAl5P%2FJob%20Log%20Entries%20in%20SAP.png?alt=media&#x26;token=065aecd4-b94c-4e0c-bf5d-567e6eb852eb" alt=""><figcaption><p>Figure 12: Job Log Entries in SAP</p></figcaption></figure>

The status of the RBDLSMAP job should be "Finished".

<figure><img src="https://377464071-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FXhp08OmU8050PePmMgDt%2Fuploads%2FGy5moVhUy0SEfJElQCK8%2FJob%20Preview%20View.png?alt=media&#x26;token=0b3b1818-c7bd-4c28-9a98-67cd8c0f02da" alt=""><figcaption><p>Figure 13: Job Preview View</p></figcaption></figure>

#### Suspend Jobs (BTCTRNS1)

The next step before performing the client copy is to suspend jobs. The BTCTRNS1 activity is created in IT-Conductor as shown below.

<figure><img src="https://377464071-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FXhp08OmU8050PePmMgDt%2Fuploads%2FBidjyeqwMi7kdLRVtxEu%2FBTCTRNS1%20Program%20Execution.png?alt=media&#x26;token=76d5cfe7-1007-48c2-9ed8-831c5804d203" alt=""><figcaption><p>Figure 14a: BTCTRNS1 Activity Details (General)</p></figcaption></figure>

1. Select the SAP tab and enter the Program Name as BTCTRNS1 without any variant.

<figure><img src="https://377464071-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FXhp08OmU8050PePmMgDt%2Fuploads%2FzRfmESzmoN4NmCZmkQHn%2FSuspend%20Job%20Activity.png?alt=media&#x26;token=9a818ba0-1e6a-4068-ba68-36b25b929ab8" alt=""><figcaption><p>Figure 14b: BTCTRNS1 Activity Details (SAP)</p></figcaption></figure>

#### Client Copy <a href="#client-copy" id="client-copy"></a>

Once all jobs are suspended, the next step is to perform the client copy.

<figure><img src="https://377464071-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FXhp08OmU8050PePmMgDt%2Fuploads%2FmilfMGANt3WGXb6JCWMU%2FClient%20Copy%20Process%20Definition.png?alt=media&#x26;token=f86339bb-5ead-4a6a-92d6-f92c7f1234ad" alt=""><figcaption><p>Figure 15a: Client Copy Activity Details (General)</p></figcaption></figure>

1\. Select the SAP tab and enter the Program Name as "STC\_TM\_PROCESSOR" and the Variant Name as "&0000000000001".

<figure><img src="https://377464071-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FXhp08OmU8050PePmMgDt%2Fuploads%2FSSEXxPULfI2ozroPfIZi%2FClient%20Copy%20Process%20Definition_b.png?alt=media&#x26;token=2ec51bcf-3f06-4df1-9671-7d3d5735f9aa" alt=""><figcaption><p>Figure 15b: Client Copy Prrogram Activity Details (SAP)</p></figcaption></figure>

{% hint style="info" %}
**Note:** To perform client copies from 000 to 250, we need to add credentials for client 200 in IT-Conductor. We already added DDIC-200 credentials in the account section.
{% endhint %}

<figure><img src="https://377464071-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FXhp08OmU8050PePmMgDt%2Fuploads%2Fn6h35b4vBIgDHWDQ5zbD%2FUser%20accounts%20in%20IT-Conductor.png?alt=media&#x26;token=1338c7f4-ecf7-4677-89b0-d0aca4e87346" alt=""><figcaption><p>Figure 16: User Accounts in IT-Conductor</p></figcaption></figure>

#### Release Jobs (BTCTRNS2) <a href="#release-jobs-btctrns2" id="release-jobs-btctrns2"></a>

After the system copy is performed, you need to release the jobs that were suspended earlier.

1. Modify the activity to run the program BTCTRNS2 in our process definition.

<figure><img src="https://377464071-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FXhp08OmU8050PePmMgDt%2Fuploads%2F3yQv3mM0YgjjatbKNYMz%2FBTCTRNS2%20Activity%20Details_a.png?alt=media&#x26;token=90c54e2a-3db2-43b6-8250-256a49825889" alt=""><figcaption><p>Figure 17a: BTCTRNS2 Activity Details (General)</p></figcaption></figure>

<figure><img src="https://377464071-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FXhp08OmU8050PePmMgDt%2Fuploads%2FEdyb44krZgRSC5ubYlAn%2FBTCTRNS2%20Activity%20Details_b.png?alt=media&#x26;token=e8dc18b8-2a84-477f-a7c7-af7bd38cb563" alt=""><figcaption><p>Figure 17b: BTCTRNS2 Activity Details (SAP)</p></figcaption></figure>

Once all steps are completed, they will change color to green.

### System Refresh/Copy Dashboard

A customized dashboard can be deployed to provide an overview of the existing configurations, process definitions, and systems or instances that have undergone system copy. It also includes the following administrative tools:

* Process Instances
* Graphical Process Composer
* Manage Schedules
* Run/Instantiate Process Definition
* Restart Activity
* Activity Log
* Process Flowchart
* Delete Object

<figure><img src="https://377464071-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FXhp08OmU8050PePmMgDt%2Fuploads%2FAwhv4JfE3pD7TO4Vf0EK%2Fsystem-refresh-dashboard.png?alt=media&#x26;token=1ae136b7-e037-45e4-9688-56c340024b23" alt=""><figcaption><p>Figure 18: System Refresh/Copy Dashboard</p></figcaption></figure>
