I’ve been getting a lot of questions lately about connecting Scribe Online to flat files as a source when building data migrations.
For those of you who have not had a chance to check it out, you definitely want to spend some time getting to know what Scribe Online is all about. It is Scribe’s excellent cloud based version of their industry leading data management platform for transforming, migrating, integrating and working with data of all types and various platforms. In many ways Scribe Online makes huge improvements over their on-premise platform, but each has its own benefits.
OK enough of my Scribe pitch, go check it out! Oh, did I mention free trial?
So, back to the issue at hand. Connecting flat files as a source for Scribe Online…
While Scribe provides some excellent documentation, it is not always very intuitive on how to make the connection to a flat file containing your source data. So I’ll walk you through step by step. I am assuming that you already have a TXT or CSV file that contains the records you need to connect to as your source.
So let’s get to it!
1 – Make sure that the file you are connecting to is in the DataExchange folder within your Scribe Software folder. You can create sub folders within the DataExchange folder.
2 – Log into Scribe Online IS, and navigate to the connections section and click NEW for a new connection
3 – Select Your Connection TYPE, which should be Text File as Source
4 – Give your new connection a name, something that relates to the file, in our case we have a file with sample leads so I called it “Sample Text”
5 – Next make sure the directory path matches any folder you have created where you placed your file(s)
6 – Next click on NEW to create a new “Entity”
7 – Change the entity name to something relating to the file, here I chose to use Sample Text again. You can also add a description to help later remember what this file holds
8 – Next click on the ENTITY tab and enter the exact filename of the file you are connecting to, including the extension. (Note I am using a txt file but you can also use csv files and other text formats. XLS is currently not supported.
9 – Next click on the File Format tab.
Make sure that your file encoding and delimiters match what is in your file
Be sure to check off the check box if your file contains column names in the first row
Next click on preview to see your data
Here you should see a preview of your data.
10 – Click on the Fields tab
This is probably the most important step of setting up your connections.
For each column of data, you need to click on the column in the preview window, and then make sure that the data type matches what is in your target schema for the same field.
***If you do not specify lengths that are sufficient, your data will get truncated.
It is important to check field types and lengths. Also when setting date types, the mask also needs to match what is in the source data. Scribe guesses at the length based on the first 25 rows in your source, but this can be wrong for large data sets.
11 – Click on the Source Data tab
Here you can scroll through your entire dataset as a final scan.
When happy you can click on the Test Connection tab
12 – Success should be yours!
I sure hope this has helped out!
Let me know if there are any other topics you’d like to see covered!