Data Preparation functionality



What is data preparation functionality and why is it needed?

 

The data preparation functionality will help you get your data much faster than direct export from Jira to Qlik.

If data is exported directly from Jira to Qlik, the following errors may occur:

  1. Rate Limit on the Jira side. If there is a lot of data in your Jira, then when exporting it, it may happen that Jira returns a 429 Too Many Requests error, yes, we will process this error and you will not see it, but this will lead to the export time from Jira to Qlik will increase.

  2. A banal break in the Internet connection and you will again have to repeat the export and wait for a certain time

If you use the data preparation functionality, then you will get rid of these errors and you will be able to receive all your data without any problems. We ran tests and were able to export 250,000 issues in less than 5 minutes.

How does the data preparation functionality work?

In a nutshell, it looks like this:

  1. Create a connector

  2. Start data preparation

  3. Wait for the data to be prepared

  4. Export data to Power BI

If in more detail, then you can study the instructions below and check all this in practice.

And so, first you need to activate the data preparation functionality, if it is not already activated for you. Go to the connectors page and in the right corner there will be a switch to activate/deactivate the functionality.

 

After activating the functionality, tools for managing data preparation will appear opposite each connector

Data preparation has three statuses

not PREPARED

data is not prepared yet and you cannot use this connector for export. Connector link copy button will be disabled

not PREPARED

data is not prepared yet and you cannot use this connector for export. Connector link copy button will be disabled

PREPARED

the data is prepared and you can use the connector for export. Connector link copy button will be active

ERROR

this means that an error occurred during data preparation


To start data preparation, you need to click on the play button, to update previously prepared data, you need to click on the refresh button. To view the preparation status, click on the button with an eye

At the top, you can see the progress of data preparation as a percentage.
Below, on the left side, there will be a list of tables and their provisioning status, as well as the number of rows in the table. On the right side there will be a list of times for automatic updates.

Configuring Automatic Data Update for a Connector

 

Go to the page for creating/editing a connector. Under the filter settings, you will see the Scheduled refresh button. Click on it to expand the block with time settings for auto-update

Here you can add update frequency, days and time

There are two types of Refresh Frequency
Daily - the data will be updated every day at the set time
Weekly - the data will be updated on the days and set that you select

In the Time Zone, you need to specify the desired time zone. By default, the time zone of your computer will be set.

Note: if you edit a connector, you will need to re-prepare the data for it

Our recommendations for installing a refresh.
For example, you set Qlik to auto-update data according to the following schedule: 2:00 AM, 9:00 AM, and 5:00 PM
In order for the data in the reports to be up-to-date, for this you need to set the data refresh in the plugin for your connector an hour before 1:00 AM, 8:00 AM and 4:00 PM so that your data has time to re-prepare before the update occurs in Qlik