talend open studio for big data components reference guide

Add another tMSSqlInput task, and select the JournalCategory table.

Repeat steps (2:6) to add tasks to load data from Category table.

Click on Mapping, Check the ‘Key’ Column and add an Index for that column, will need it later to load relationships, I used ‘Key’ instead of ‘ID’ because Neo4j automatically creates ‘ID’ for each node.

Add tNeo4jOutput task, check ‘Remote server’, change the Server URL if Neo4j Rest API URL is not the default, right-click the SQL Input task and add Row-Main connection to the Neo4j output task.

Now check the ‘Use an existing connection’, right-click the connection task and add a trigger ‘On Subjob Ok’ and connect it with the SQL Input task.

Press Guess schema, you will see the list of columns you selected in your query, you may also use Edit schema instead and write the columns yourself.

Notice that in my select statement I added a column ‘NodeType’ which have a static value ‘Journal’, will use this column later for labeling our nodes.

Add tMSSqlInput task, type in your connection properties, don’t worry we’ll use the existing connection task later, but for Talend to be able to generate schema at design time for our query I only managed to do it this way.Create a new job, grab a new tMSSqlConnection Task (Subjob), and type in your database connection properties.

I found Talend Open Studio for Big Data and I was impressed, It is powerful and rich in functionalities yet remains very simple, straight forward and easy to use. the only obstacle was that Talend at that time only supported Neo4j Version 1 and not 2, but managed to handle that and was able to enjoy all of Neo4j version 2. That was a long talk, now to the actual work, hope it will be fun. I gathered Information from different sources and decided to craft my own way trying to make things simpler.

the next step was to migrate existing data from MS SQL Server to Neo4j, but this one was not as simple as I thought, I went through the methods provided by Neo4j here, but I didn’t feel comfortable with any, because most (if not all) of them requires a middle stage where data is exported from original data source to a file (CSV or Excel) then load data from the file into Neo4j, I wanted to do it in one shot. I designed my data in graph shapes on my tablet using this really simple and powerful android app: DrawExpress Diagram, that step went very well and was simpler than I thought after watching the Online training course provided by Neo4j. The first obstacle I faced when I started experiencing Graph databases with Neo4j, is loading data from MS SQL Server into Neo4j.

Talend open studio for big data components reference guide