Your organisation may have data files containing ad-hoc data, such as data collected during an offline prize draw. This data can be uploaded using the Source File Upload function within SRM Data.
Source File Upload should only be used to import brand new customer records. If your data file contains records that already exist in the database, or a mixture of both new and existing records, please raise a case on the Service Desk.
Preparing the data
- Check that there are no hidden values in any of the columns at the end of your data. To do this, select the first five columns immediately after your data. Right click and select Clear Contents. Alternatively, select the same columns again, right click and select Delete.
- Remove any commas from the file using Ctrl + F. Click on Replace, enter a comma in the Find what box and click Replace All.
- If the file contains a unique ID for supporters (other than email), please name this column SystemRef (with the 'S' and 'R' capitalised and no space in-between the two words).
- Remove any filler values from the data. If there are no values then the field should be left blank. For example, please remove values such as BLANK, NULL, NONE, NO VALUE, NO NUMBER, NO EMAIL, na@na.com, noemail@noemail.com, N/A.
- Ensure any date fields only contain DD/MM/YYYY format and remove any value that is not a valid date.
- Ensure any Mobile, Day Phone or Evening Phone number columns contains only numbers.
- Ensure that no rows have a line break in.
- If you have marketing preferences within your data, please label the column as 'OptInEmailMailingListName' and use the values TRUE or 1 for opt in, FALSE or 0 for opt out and leave the cell empty for records that you do not have an opt in or opt out for.
Below are some examples of what is and isn't accepted:
DOB | CORRECT OR INCORRECT? | REASON |
00001-01-01 | Incorrect | Incorrect format |
NONE | Incorrect | Text not a date format |
02/06/2054 | Incorrect | Future date |
01/02/1990 |
Correct |
DD/MM/YYYY format |
MOBILE | CORRECT OR INCORRECT? | REASON |
2.34906E+12 | Incorrect | Incorrect format |
None | Incorrect | Text not correct phone number format |
07123456789 | Correct | CORRECT |
00447123456789 | Correct | CORRECT |
SystemRef | Date Created | First Name | Last Name | Full Name |
1234567 | 01/01/2023 | Forename 1 |
Surname 1 Surname 2 |
Forename 1 Surname 1 Surname 2 |
You do not need to rename your other column headers, though if you rename them to match the fields listed during the upload process then they will automatically map to the fields in your database. Otherwise, this will need to be done manually during the upload process.
Preparing the file
- The file should be saved as a .CSV file format
- The file name must be less than 120 characters
- The file must be less than 1GB in size
Uploading the file
- After logging in to APPS, navigate to the SRM Data module from your menu bar on the left-hand side and select Upload File.
- Read through the guidance on the File Upload page, then click Select Source File and locate the file that you will be uploading. Click Next.
- If your file contains headers, ensure that you tick Header Row. Under Delimiter Type, select Comma. Click Next.
- If your file contains a unique identifier (other than email address), such as a System Ref, select that column under Unique Identifier. Otherwise, leave this blank. Under Mappings, if the column names in your file (on the left under File Columns) match those that already exist in your data warehouse (on the right under Database Columns) then they will map automatically. Otherwise, these can be mapped manually using the drop down options. You do not need to map your Unique Identifier column if this has been selected from the dropdown above.
- Use the Preview to check the data from your file. This will help you to map the columns correctly.
- Click Next.
- A quick data validation check will take place to ensure good data quality and correct format. DO NOT refresh or quit the page.
- If the file upload fails, click Download Report to see the failure reason. Review the data errors listed in the report. Once you have fixed the errors, please return to step 1 of Uploading the file.
- If the file upload is successful, the file name will be listed under Uploaded File. Name the upload under Job Name. There is the option to add the records to an existing node or create a new node under Upload Source where all current nodes will be listed in the dropdown menu. Click New to create a new node if required. Job Email will contain your email address.
- Click Next.
- Review your upload, ensuring that the naming and columns are correct. Once reviewed, click Finish to import the data. There will be a double confirmation message. If you are sure the upload is correct, click Finish on the second confirmation screen.
- After the file has been uploaded and processed (normally one working day later), the results can be seen under File Upload History. The Status will show as Imported (To be Processed) until it has been processed, at which point this will change to Completed (Waited for BatchProcess).
If the status shows (Error) Process Failed, please raise a case on the Service Desk.
Locating your new node
If you have selected to create a new node for your uploaded file, the node will be available the following working day with counts.
- Navigate to the SRM Campaign module from the dashboard on the left-hand side and select Builder.
- The Filter Builder page will now appear. The node can be found in the node menu on the left-hand side under the section Role -> Source System. Drag and drop the node in to the box with the dashed edges in the centre of the screen.
- Click Run to check the counts. Counts will be displayed at the top of the page.
- The node is now ready to use.
Find out more about using the Filter Builder here.
If the node doesn't appear after refreshing the Filter Builder, if the count returns 0, or you receive any other error message after running your filter, please raise a case on the Service Desk.
File Upload History
It is useful to see what additional data has been uploaded previously and whether your latest upload has been successful. In SRM Data, this can be viewed easily in the History tab.
- After logging in to APPS, navigate to the SRM Data module from your menu bar on the left-hand side and select History.
- Once a file has been uploaded and processed (normally one working day later), the results will be listed under File Upload History. Click on the column headers to reorder the list if required.
- Navigate to the file upload that you want to view using the filter icon or search bar in the top righthand corner. As criteria is added, the list of files fitting the criteria will update in the background. You can also refresh the list using the circular arrow. To navigate out of the filter, click on the X in the top righthand corner.
- When checking a recent upload, the status should have moved from Imported to Completed (Waited for BatchProcess).
- Once the import has been processed overnight you'll see counts appear for Record Count, Distinct GroupID, Existing GroupID and New GroupID.
Below is an explanation of the column names:
Job ID | KORE internal identifier | Distinct Group ID | Total individual records within the file |
Job Name | Name created during the upload process (also the name of the node that is created) | Existing Group ID | Total number of individual records in the file that already exist within the database |
Source | Name of the imported file | New Group ID | Total number of individual records in the file that do not already exist within the database |
Start Date | Date of file upload | Status | Whether the file has been successfully uploaded |
Record Count | Total number of records in the file | Uploader | Name of APPS user that completed the upload |
There is a report available in Tableau Premium that measures the ROI of an uploaded list which could be useful to help understand the value of collecting ad-hoc data.
Contact your Customer Success Manager to discuss any specific upload requirements you may have, or if you require any assistance outside of what is outlined in the Help Center.