Connecting Scribe Online to Flat Files as a source

Hi folks!

I’ve been getting a lot of questions lately about connecting Scribe Online to flat files as a source when building data migrations.

For those of you who have not had a chance to check it out, you definitely want to spend some time getting to know what Scribe Online is all about. It is Scribe’s excellent cloud based version of their industry leading data management platform for transforming, migrating, integrating and working with data of all types and various platforms. In many ways Scribe Online makes huge improvements over their on-premise platform, but each has its own benefits.

OK enough of my Scribe pitch, go check it out! Oh, did I mention free trial?

So, back to the issue at hand. Connecting flat files as a source for Scribe Online…

While Scribe provides some excellent documentation, it is not always very intuitive on how to make the connection to a flat file containing your source data. So I’ll walk you through step by step. I am assuming that you already have a TXT or CSV file that contains the records you need to connect to as your source.

So let’s get to it!

1 – Make sure that the file you are connecting to is in the DataExchange folder within your Scribe Software folder. You can create sub folders within the DataExchange folder.

Your Source File Location

Your Source File Location

 

2 – Log into Scribe Online IS, and navigate to the connections section and click NEW for a new connection

 

Connecting to Scribe Online

Connecting to Scribe Online

3 – Select Your Connection TYPE, which should be Text File as Source

4 – Give your new connection a name, something that relates to the file, in our case we have a file with sample leads so I called it “Sample Text”

5 – Next make sure the directory path matches any folder you have created where you placed your file(s)

 

Setting Your File Type

Setting Your File Type

6 – Next click on NEW to create a new “Entity”

Name Your Connection

Name Your Connection

 

7 – Change the entity name to something relating to the file, here I chose to use Sample Text again. You can also add a description to help later remember what this file holds

photo5

 

8 – Next click on the ENTITY tab and enter the exact filename of the file you are connecting to, including the extension. (Note I am using a txt file but you can also use csv files and other text formats. XLS is currently not supported.

photo6

9 – Next click on the File Format tab.

Make sure that your file encoding and delimiters match what is in your file

Be sure to check off the check box if your file contains column names in the first row

Next click on preview to see your data

photo7

Here you should see a preview of your data.

photo8

10 – Click on the Fields tab

This is probably the most important step of setting up your connections.

For each column of data, you need to click on the column in the preview window, and then make sure that the data type matches what is in your target schema for the same field.

***If you do not specify lengths that are sufficient, your data will get truncated.

It is important to check field types and lengths. Also when setting date types, the mask also needs to match what is in the source data. Scribe guesses at the length based on the first 25 rows in your source, but this can be wrong for large data sets.

photo9

 

11 – Click on the Source Data tab

Here you can scroll through your entire dataset as a final scan.

When happy you can click on the Test Connection tab

photoA

12 – Success should be yours!

photoB

I sure hope this has helped out!

Let me know if there are any other topics you’d like to see covered!

Don