ArticlesBite Size Analytics: How to Refresh Data

• To refresh data

• Customer Resource Management (CRM) Analytics
  • All Versions

Customer Resource Management (CRM) Analytics is great at many things and two of them are reporting on volumes (up to 10B records!) and aggregating at speed. However, both of those capabilities affect reporting directly on real-time Salesforce data and so the data used in CRM Analytics needs to be refreshed, and scheduled updates is the way to go.

Before diving into scheduling the Data Refresh, there are a few limits to take note of:

1. The total number of dataflows or recipes that can be run within a 24 hour period is 60.
2. If a dataflow takes less than 2 minutes to run then it doesn't count towards the limit.
3. Dataflows can be scheduled every 15 minutes but we recommend hourly where possible

There are two processes that an Administrator must follow in order to refresh the data for dashboards. This involves two steps.

1. Synchronizing the data
2. Scheduling the dataflow/recipe refresh

In some cases there is no Data synchronization setup so just step 2 can be followed. When both the Data and Data flows are being refreshed everything can be used as intended, however, the browser will need to be refreshed for the new data to be displayed.

Synchronizing the Data

First open the Data Manager App. If you have data sync enabled you should see Connections on the left. Under SFDC_LOCAL press the dropdown arrow followed by Schedule (this is where to schedule the data to be updated). If the Connections option then skip this step.

Data sync above allows the source object data to be refreshed outside of a dataflow. This can be useful if there are multiple dataflows or recipes with the same source object. For example, if there are two dataflows with the Project object and the Project object takes 30 seconds to synchronize in the dataflow that is 30s*2 which is 60 seconds total of data sync time within dataflows. With data sync turned on then the project synchronizes in 30 seconds and then takes maybe 1 second to synchronize in each dataflow so the new total time for loading data is 32 seconds. If there are multiple dataflows with similar objects then enabling data sync is a good idea.

Scheduling the Dataflow

In the bottom left of the Data Manager tab, there is a link for Manage Dataflows. Press this link to be directed to the older data manager.

From here there is an option to select Dataflows & Recipes followed by Dataflows. Use the drop-down arrow next to chose a Dataflow to schedule its update. Hourly, is recommend if possible.

If data sync is turned on, it can be scheduled to run after the local connection syncs is complete. Also, this screen can be used to chain dataflows or recipes to run in a particular order.

• If one or more object/s fail to sync data then please verify that Integration user has 
  • respective package/s license/s assigned
  • read access to the object/s itself and all the fields